PROJECT (sourcing_v2)
SPIDER (auto1.de)

2026-03-30 10:35:03 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 10:35:03 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 10:35:03 [auto1.de] INFO: Batch mode enabled: batch 2/2
2026-03-30 10:35:03 [auto1.de] INFO: Starting spider auto1.de
2026-03-30 10:35:03 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 10:35:03 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 10:35:03 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 10:35:03 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 10:35:03 [scrapy.extensions.telnet] INFO: Telnet Password: 6afb7ba01d68a62a
2026-03-30 10:35:03 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 10:35:03 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_18_2026-03-30T10_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 10:35:03 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 10:35:03 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 10:35:03 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 10:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 10:35:03 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 10:35:03 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-30 10:35:03 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:03 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 10:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 10:35:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 10:35:03 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 10:35:03 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 10:35:03 [scrapy.core.engine] INFO: Spider opened
2026-03-30 10:35:03 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 10:35:03 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2026-03-30 10:35:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-30 10:35:03 [scrapy-playwright] INFO: Starting download handler
2026-03-30 10:35:03 [scrapy-playwright] INFO: Starting download handler
2026-03-30 10:35:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 10:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 10:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 10:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 10:35:28 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 9412 | hits on page: 40
2026-03-30 10:35:28 [auto1.de] INFO: Found listing with ID: SJ39785
2026-03-30 10:35:28 [auto1.de] INFO: Found listing with ID: RG09784
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG09784%27 HTTP/1.1" 200 None
2026-03-30 10:35:28 [auto1.de] INFO: Scrape type for RG09784: 2
2026-03-30 10:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07a03ee5-1f0e-509c-8488-32212f740479 with identifier: RG09784
2026-03-30 10:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07a03ee5-1f0e-509c-8488-32212f740479 with scrape type 2
2026-03-30 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07a03ee5-1f0e-509c-8488-32212f740479 with scrape type 2
2026-03-30 10:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07a03ee5-1f0e-509c-8488-32212f740479, identifier: RG09784
2026-03-30 10:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07a03ee5-1f0e-509c-8488-32212f740479 with identifier: RG09784
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 10:35:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 10:35:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07a03ee5-1f0e-509c-8488-32212f740479 with identifier: RG09784
2026-03-30 10:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07a03ee5-1f0e-509c-8488-32212f740479 with identifier: RG09784 to the API
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:02:00Z',
 'fuel_type': 'diesel',
 'id': '07a03ee5-1f0e-509c-8488-32212f740479',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG09784',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 153068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-03',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business Edition BlueMotion',
 'transmission': 'manual',
 'trim': 'Business Edition BlueMotion',
 'year': 2014}
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG09784%27 HTTP/1.1" 200 None
2026-03-30 10:35:29 [auto1.de] INFO: Saving data for RG09784: {'auction_closing_time': 1774969320.0, 'created_time': 1773304633.268485, 'last_price_update_time': 1774866929.246068}
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG09784') HTTP/1.1" 204 0
2026-03-30 10:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:29 [auto1.de] INFO: Found listing with ID: LA41058
2026-03-30 10:35:29 [auto1.de] INFO: Found listing with ID: SN81946
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN81946%27 HTTP/1.1" 200 None
2026-03-30 10:35:29 [auto1.de] INFO: Scrape type for SN81946: 1
2026-03-30 10:35:29 [auto1.de] INFO: Found listing with ID: ZU09871
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU09871%27 HTTP/1.1" 200 None
2026-03-30 10:35:29 [auto1.de] INFO: Scrape type for ZU09871: 2
2026-03-30 10:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d769f941-901f-5996-b26b-430d3c1a7910 with identifier: ZU09871
2026-03-30 10:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d769f941-901f-5996-b26b-430d3c1a7910 with scrape type 2
2026-03-30 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d769f941-901f-5996-b26b-430d3c1a7910 with scrape type 2
2026-03-30 10:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d769f941-901f-5996-b26b-430d3c1a7910, identifier: ZU09871
2026-03-30 10:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d769f941-901f-5996-b26b-430d3c1a7910 with identifier: ZU09871
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 10:35:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 10:35:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d769f941-901f-5996-b26b-430d3c1a7910 with identifier: ZU09871
2026-03-30 10:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d769f941-901f-5996-b26b-430d3c1a7910 with identifier: ZU09871 to the API
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:45:58Z',
 'fuel_type': 'petrol',
 'id': 'd769f941-901f-5996-b26b-430d3c1a7910',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU09871',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 161101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU09871%27 HTTP/1.1" 200 None
2026-03-30 10:35:29 [auto1.de] INFO: Saving data for ZU09871: {'auction_closing_time': 1774971958.0, 'created_time': 1773772962.690288, 'last_price_update_time': 1774866929.935914}
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU09871') HTTP/1.1" 204 0
2026-03-30 10:35:29 [auto1.de] INFO: Found listing with ID: AG61978
2026-03-30 10:35:29 [auto1.de] INFO: Found listing with ID: TB53548
2026-03-30 10:35:29 [auto1.de] INFO: Found listing with ID: UK15244
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK15244%27 HTTP/1.1" 200 None
2026-03-30 10:35:29 [auto1.de] INFO: Scrape type for UK15244: 1
2026-03-30 10:35:29 [auto1.de] INFO: Found listing with ID: FD88969
2026-03-30 10:35:29 [auto1.de] INFO: Found listing with ID: NR21989
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR21989%27 HTTP/1.1" 200 None
2026-03-30 10:35:29 [auto1.de] INFO: Scrape type for NR21989: 1
2026-03-30 10:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:29 [auto1.de] INFO: Found listing with ID: DU63733
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU63733%27 HTTP/1.1" 200 None
2026-03-30 10:35:30 [auto1.de] INFO: Scrape type for DU63733: 2
2026-03-30 10:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7d07554-d61f-5b5d-9be2-9d6681193dac with identifier: DU63733
2026-03-30 10:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7d07554-d61f-5b5d-9be2-9d6681193dac with scrape type 2
2026-03-30 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7d07554-d61f-5b5d-9be2-9d6681193dac with scrape type 2
2026-03-30 10:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7d07554-d61f-5b5d-9be2-9d6681193dac, identifier: DU63733
2026-03-30 10:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7d07554-d61f-5b5d-9be2-9d6681193dac with identifier: DU63733
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 10:35:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7d07554-d61f-5b5d-9be2-9d6681193dac with identifier: DU63733
2026-03-30 10:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7d07554-d61f-5b5d-9be2-9d6681193dac with identifier: DU63733 to the API
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-31T15:39:39Z',
 'fuel_type': 'petrol',
 'id': 'a7d07554-d61f-5b5d-9be2-9d6681193dac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU63733',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 70885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-12',
 'seller_name': None,
 'title': 'BMW 4er 430i xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2017}
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU63733%27 HTTP/1.1" 200 None
2026-03-30 10:35:30 [auto1.de] INFO: Saving data for DU63733: {'auction_closing_time': 1774971579.0, 'created_time': 1774349647.646282, 'last_price_update_time': 1774866930.559652}
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU63733') HTTP/1.1" 204 0
2026-03-30 10:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:30 [auto1.de] INFO: Found listing with ID: RB45502
2026-03-30 10:35:30 [auto1.de] INFO: Found listing with ID: DB24755
2026-03-30 10:35:30 [auto1.de] INFO: Found listing with ID: UV60812
2026-03-30 10:35:30 [auto1.de] INFO: Found listing with ID: VR51220
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR51220%27 HTTP/1.1" 200 None
2026-03-30 10:35:30 [auto1.de] INFO: Scrape type for VR51220: 1
2026-03-30 10:35:30 [auto1.de] INFO: Found listing with ID: XC01628
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC01628%27 HTTP/1.1" 200 None
2026-03-30 10:35:30 [auto1.de] INFO: Scrape type for XC01628: 1
2026-03-30 10:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:30 [auto1.de] INFO: Found listing with ID: EP26654
2026-03-30 10:35:30 [auto1.de] INFO: Found listing with ID: KG59936
2026-03-30 10:35:30 [auto1.de] INFO: Found listing with ID: SP27686
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP27686%27 HTTP/1.1" 200 None
2026-03-30 10:35:30 [auto1.de] INFO: Scrape type for SP27686: 1
2026-03-30 10:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:30 [auto1.de] INFO: Found listing with ID: KT37297
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT37297%27 HTTP/1.1" 200 None
2026-03-30 10:35:30 [auto1.de] INFO: Scrape type for KT37297: 2
2026-03-30 10:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c0bbf5e-2a3e-5d7c-84e6-a37103d5c95a with identifier: KT37297
2026-03-30 10:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c0bbf5e-2a3e-5d7c-84e6-a37103d5c95a with scrape type 2
2026-03-30 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c0bbf5e-2a3e-5d7c-84e6-a37103d5c95a with scrape type 2
2026-03-30 10:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c0bbf5e-2a3e-5d7c-84e6-a37103d5c95a, identifier: KT37297
2026-03-30 10:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c0bbf5e-2a3e-5d7c-84e6-a37103d5c95a with identifier: KT37297
2026-03-30 10:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c0bbf5e-2a3e-5d7c-84e6-a37103d5c95a with identifier: KT37297
2026-03-30 10:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c0bbf5e-2a3e-5d7c-84e6-a37103d5c95a with identifier: KT37297 to the API
2026-03-30 10:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:15:32Z',
 'fuel_type': 'diesel',
 'id': '3c0bbf5e-2a3e-5d7c-84e6-a37103d5c95a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT37297',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 48118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-30',
 'seller_name': None,
 'title': 'Audi A5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT37297%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [auto1.de] INFO: Saving data for KT37297: {'auction_closing_time': 1774970132.0, 'created_time': 1774380516.458077, 'last_price_update_time': 1774866931.552835}
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT37297') HTTP/1.1" 204 0
2026-03-30 10:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:31 [auto1.de] INFO: Found listing with ID: HT22785
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT22785%27 HTTP/1.1" 200 None
2026-03-30 10:35:31 [auto1.de] INFO: Scrape type for HT22785: 2
2026-03-30 10:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9772e868-dd7f-56b8-bc9d-f0532487176d with identifier: HT22785
2026-03-30 10:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9772e868-dd7f-56b8-bc9d-f0532487176d with scrape type 2
2026-03-30 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9772e868-dd7f-56b8-bc9d-f0532487176d with scrape type 2
2026-03-30 10:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9772e868-dd7f-56b8-bc9d-f0532487176d, identifier: HT22785
2026-03-30 10:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9772e868-dd7f-56b8-bc9d-f0532487176d with identifier: HT22785
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 10:35:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9772e868-dd7f-56b8-bc9d-f0532487176d with identifier: HT22785
2026-03-30 10:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9772e868-dd7f-56b8-bc9d-f0532487176d with identifier: HT22785 to the API
2026-03-30 10:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:50:54Z',
 'fuel_type': 'diesel',
 'id': '9772e868-dd7f-56b8-bc9d-f0532487176d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT22785',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 111329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-24',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2014}
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT22785%27 HTTP/1.1" 200 None
2026-03-30 10:35:32 [auto1.de] INFO: Saving data for HT22785: {'auction_closing_time': 1774972254.0, 'created_time': 1773381064.109434, 'last_price_update_time': 1774866932.159746}
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT22785') HTTP/1.1" 204 0
2026-03-30 10:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SN81946/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:32 [auto1.de] INFO: Found listing with ID: NP98224
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP98224%27 HTTP/1.1" 200 None
2026-03-30 10:35:32 [auto1.de] INFO: Scrape type for NP98224: 1
2026-03-30 10:35:32 [auto1.de] INFO: Found listing with ID: LC34893
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC34893%27 HTTP/1.1" 200 None
2026-03-30 10:35:32 [auto1.de] INFO: Scrape type for LC34893: 1
2026-03-30 10:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:32 [auto1.de] INFO: Found listing with ID: RS82573
2026-03-30 10:35:32 [auto1.de] INFO: Found listing with ID: GF48605
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF48605%27 HTTP/1.1" 200 None
2026-03-30 10:35:32 [auto1.de] INFO: Scrape type for GF48605: 1
2026-03-30 10:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:32 [auto1.de] INFO: Found listing with ID: TB59441
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB59441%27 HTTP/1.1" 200 None
2026-03-30 10:35:32 [auto1.de] INFO: Scrape type for TB59441: 1
2026-03-30 10:35:32 [auto1.de] INFO: Found listing with ID: BR87527
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR87527%27 HTTP/1.1" 200 None
2026-03-30 10:35:32 [auto1.de] INFO: Scrape type for BR87527: 2
2026-03-30 10:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31eb6dcc-4072-5b07-9cba-d217d98c7fee with identifier: BR87527
2026-03-30 10:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31eb6dcc-4072-5b07-9cba-d217d98c7fee with scrape type 2
2026-03-30 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31eb6dcc-4072-5b07-9cba-d217d98c7fee with scrape type 2
2026-03-30 10:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31eb6dcc-4072-5b07-9cba-d217d98c7fee, identifier: BR87527
2026-03-30 10:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31eb6dcc-4072-5b07-9cba-d217d98c7fee with identifier: BR87527
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 10:35:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31eb6dcc-4072-5b07-9cba-d217d98c7fee with identifier: BR87527
2026-03-30 10:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31eb6dcc-4072-5b07-9cba-d217d98c7fee with identifier: BR87527 to the API
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:32:10Z',
 'fuel_type': 'petrol',
 'id': '31eb6dcc-4072-5b07-9cba-d217d98c7fee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR87527',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 61993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2016}
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR87527%27 HTTP/1.1" 200 None
2026-03-30 10:35:32 [auto1.de] INFO: Saving data for BR87527: {'auction_closing_time': 1774971130.0, 'created_time': 1774292108.105178, 'last_price_update_time': 1774866932.956731}
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR87527') HTTP/1.1" 204 0
2026-03-30 10:35:33 [auto1.de] INFO: Found listing with ID: SL00980
2026-03-30 10:35:33 [auto1.de] INFO: Found listing with ID: SU59079
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU59079%27 HTTP/1.1" 200 None
2026-03-30 10:35:33 [auto1.de] INFO: Scrape type for SU59079: 1
2026-03-30 10:35:33 [auto1.de] INFO: Found listing with ID: HT07403
2026-03-30 10:35:33 [auto1.de] INFO: Found listing with ID: KB62051
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62051%27 HTTP/1.1" 200 None
2026-03-30 10:35:33 [auto1.de] INFO: Scrape type for KB62051: 1
2026-03-30 10:35:33 [auto1.de] INFO: Found listing with ID: KK63455
2026-03-30 10:35:33 [auto1.de] INFO: Found listing with ID: SJ61730
2026-03-30 10:35:33 [auto1.de] INFO: Found listing with ID: EZ41546
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ41546%27 HTTP/1.1" 200 None
2026-03-30 10:35:33 [auto1.de] INFO: Scrape type for EZ41546: 1
2026-03-30 10:35:33 [auto1.de] INFO: Found listing with ID: HX90600
2026-03-30 10:35:33 [auto1.de] INFO: Found listing with ID: CN17481
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN17481%27 HTTP/1.1" 200 None
2026-03-30 10:35:33 [auto1.de] INFO: Scrape type for CN17481: 1
2026-03-30 10:35:33 [auto1.de] INFO: Found listing with ID: LB63142
2026-03-30 10:35:33 [auto1.de] INFO: Found listing with ID: MV22055
2026-03-30 10:35:33 [auto1.de] INFO: Found listing with ID: RB95028
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB95028%27 HTTP/1.1" 200 None
2026-03-30 10:35:33 [auto1.de] INFO: Scrape type for RB95028: 2
2026-03-30 10:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 475b25ae-3fed-5004-b687-1abab8c4db31 with identifier: RB95028
2026-03-30 10:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 475b25ae-3fed-5004-b687-1abab8c4db31 with scrape type 2
2026-03-30 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 475b25ae-3fed-5004-b687-1abab8c4db31 with scrape type 2
2026-03-30 10:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 475b25ae-3fed-5004-b687-1abab8c4db31, identifier: RB95028
2026-03-30 10:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 475b25ae-3fed-5004-b687-1abab8c4db31 with identifier: RB95028
2026-03-30 10:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 475b25ae-3fed-5004-b687-1abab8c4db31 with identifier: RB95028
2026-03-30 10:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 475b25ae-3fed-5004-b687-1abab8c4db31 with identifier: RB95028 to the API
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:13:45Z',
 'fuel_type': 'petrol',
 'id': '475b25ae-3fed-5004-b687-1abab8c4db31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB95028',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 94100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-14',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT IQ.DRIVE 4Motion',
 'transmission': 'automatic',
 'trim': 'IQ.DRIVE 4Motion',
 'year': 2019}
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB95028%27 HTTP/1.1" 200 None
2026-03-30 10:35:33 [auto1.de] INFO: Saving data for RB95028: {'auction_closing_time': 1774970025.0, 'created_time': 1773343585.199379, 'last_price_update_time': 1774866933.548978}
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB95028') HTTP/1.1" 204 0
2026-03-30 10:35:33 [auto1.de] INFO: Found listing with ID: HJ44005
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ44005%27 HTTP/1.1" 200 None
2026-03-30 10:35:33 [auto1.de] INFO: Scrape type for HJ44005: 2
2026-03-30 10:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f5f72aa-c4ac-58d4-80ed-3bde25f3108d with identifier: HJ44005
2026-03-30 10:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f5f72aa-c4ac-58d4-80ed-3bde25f3108d with scrape type 2
2026-03-30 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f5f72aa-c4ac-58d4-80ed-3bde25f3108d with scrape type 2
2026-03-30 10:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f5f72aa-c4ac-58d4-80ed-3bde25f3108d, identifier: HJ44005
2026-03-30 10:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f5f72aa-c4ac-58d4-80ed-3bde25f3108d with identifier: HJ44005
2026-03-30 10:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f5f72aa-c4ac-58d4-80ed-3bde25f3108d with identifier: HJ44005
2026-03-30 10:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f5f72aa-c4ac-58d4-80ed-3bde25f3108d with identifier: HJ44005 to the API
2026-03-30 10:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-31T15:23:13Z',
 'fuel_type': 'petrol',
 'id': '7f5f72aa-c4ac-58d4-80ed-3bde25f3108d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ44005',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 35495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2022}
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ44005%27 HTTP/1.1" 200 None
2026-03-30 10:35:34 [auto1.de] INFO: Saving data for HJ44005: {'auction_closing_time': 1774970593.0, 'created_time': 1774294177.726331, 'last_price_update_time': 1774866934.12079}
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ44005') HTTP/1.1" 204 0
2026-03-30 10:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:35 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 9412 | hits on page: 40
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: SJ39785
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: RG09784
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG09784%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [auto1.de] INFO: Scrape type for RG09784: 0
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: LA41058
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: SN81946
2026-03-30 10:35:35 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/SN81946/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: ZU09871
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU09871%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [auto1.de] INFO: Scrape type for ZU09871: 0
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: AG61978
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: TB53548
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: UK15244
2026-03-30 10:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR21989/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: FD88969
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: NR21989
2026-03-30 10:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: DU63733
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU63733%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [auto1.de] INFO: Scrape type for DU63733: 0
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: RB45502
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: DB24755
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: UV60812
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: VR51220
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: XC01628
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: EP26654
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: KG59936
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: SP27686
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: KT37297
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT37297%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [auto1.de] INFO: Scrape type for KT37297: 0
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: HT22785
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT22785%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [auto1.de] INFO: Scrape type for HT22785: 0
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: NP98224
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: LC34893
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: RS82573
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: GF48605
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: TB59441
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: BR87527
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR87527%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [auto1.de] INFO: Scrape type for BR87527: 0
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: SL00980
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: SU59079
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: HT07403
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: KB62051
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: KK63455
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: SJ61730
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: EZ41546
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: HX90600
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: CN17481
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: LB63142
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: MV22055
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: RB95028
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB95028%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [auto1.de] INFO: Scrape type for RB95028: 0
2026-03-30 10:35:35 [auto1.de] INFO: Found listing with ID: HJ44005
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ44005%27 HTTP/1.1" 200 None
2026-03-30 10:35:35 [auto1.de] INFO: Scrape type for HJ44005: 0
2026-03-30 10:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF48605/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB59441/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SN81946> (referer: https://www.auto1.com/v1/car-details-view/SN81946/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2766f329-4044-5885-89db-aa9cab5ca5c3 with identifier: SN81946
2026-03-30 10:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2766f329-4044-5885-89db-aa9cab5ca5c3 with scrape type 1
2026-03-30 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2766f329-4044-5885-89db-aa9cab5ca5c3
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fd1%252F5cd1444d18e2a2c50efcd58551c8f529%252Fpa%252FSN81946_5bdf380b066e4af3a8fea54948eec96c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_5bdf380b066e4af3a8fea54948eec96c.jpg not downloaded yet
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fd1%252F5cd1444d18e2a2c50efcd58551c8f529%252Fpa%252FSN81946_3e5c180ad9dce4d6574e10df25457d0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_3e5c180ad9dce4d6574e10df25457d0a.jpg not downloaded yet
2026-03-30 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU59079/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fd1%252F5cd1444d18e2a2c50efcd58551c8f529%252Fpa%252FSN81946_9d8ad084498f8a02bf76ac2f96e4d697.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_9d8ad084498f8a02bf76ac2f96e4d697.jpg not downloaded yet
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fd1%252F5cd1444d18e2a2c50efcd58551c8f529%252Fpa%252FSN81946_0a751b9707fff94f51a590afa22d2de1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_0a751b9707fff94f51a590afa22d2de1.jpg not downloaded yet
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fd1%252F5cd1444d18e2a2c50efcd58551c8f529%252Fpa%252FSN81946_a0e74cec7dad00f55a44f3bee22c4b44.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_a0e74cec7dad00f55a44f3bee22c4b44.jpg not downloaded yet
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fd1%252F5cd1444d18e2a2c50efcd58551c8f529%252Fpa%252FSN81946_85b8bf164d7a97382857faf6ae9c5df8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_85b8bf164d7a97382857faf6ae9c5df8.jpg not downloaded yet
2026-03-30 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK15244/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_85b8bf164d7a97382857faf6ae9c5df8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_9d8ad084498f8a02bf76ac2f96e4d697.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_5bdf380b066e4af3a8fea54948eec96c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5965710>
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2766f329-4044-5885-89db-aa9cab5ca5c3/2766f329-4044-5885-89db-aa9cab5ca5c3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fd1%252F5cd1444d18e2a2c50efcd58551c8f529%252Fpa%252FSN81946_85b8bf164d7a97382857faf6ae9c5df8.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_85b8bf164d7a97382857faf6ae9c5df8.jpg saved to cache
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2766f329-4044-5885-89db-aa9cab5ca5c3
2026-03-30 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_3e5c180ad9dce4d6574e10df25457d0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_a0e74cec7dad00f55a44f3bee22c4b44.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b37210>
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2766f329-4044-5885-89db-aa9cab5ca5c3/2766f329-4044-5885-89db-aa9cab5ca5c3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fd1%252F5cd1444d18e2a2c50efcd58551c8f529%252Fpa%252FSN81946_9d8ad084498f8a02bf76ac2f96e4d697.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_9d8ad084498f8a02bf76ac2f96e4d697.jpg saved to cache
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2766f329-4044-5885-89db-aa9cab5ca5c3
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef505c4d0>
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2766f329-4044-5885-89db-aa9cab5ca5c3/2766f329-4044-5885-89db-aa9cab5ca5c3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fd1%252F5cd1444d18e2a2c50efcd58551c8f529%252Fpa%252FSN81946_5bdf380b066e4af3a8fea54948eec96c.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_5bdf380b066e4af3a8fea54948eec96c.jpg saved to cache
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2766f329-4044-5885-89db-aa9cab5ca5c3
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5065b90>
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2766f329-4044-5885-89db-aa9cab5ca5c3/2766f329-4044-5885-89db-aa9cab5ca5c3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fd1%252F5cd1444d18e2a2c50efcd58551c8f529%252Fpa%252FSN81946_3e5c180ad9dce4d6574e10df25457d0a.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_3e5c180ad9dce4d6574e10df25457d0a.jpg saved to cache
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2766f329-4044-5885-89db-aa9cab5ca5c3
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef596df90>
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2766f329-4044-5885-89db-aa9cab5ca5c3/2766f329-4044-5885-89db-aa9cab5ca5c3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fd1%252F5cd1444d18e2a2c50efcd58551c8f529%252Fpa%252FSN81946_a0e74cec7dad00f55a44f3bee22c4b44.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_a0e74cec7dad00f55a44f3bee22c4b44.jpg saved to cache
2026-03-30 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2766f329-4044-5885-89db-aa9cab5ca5c3
2026-03-30 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_0a751b9707fff94f51a590afa22d2de1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5044c90>
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2766f329-4044-5885-89db-aa9cab5ca5c3/2766f329-4044-5885-89db-aa9cab5ca5c3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fd1%252F5cd1444d18e2a2c50efcd58551c8f529%252Fpa%252FSN81946_0a751b9707fff94f51a590afa22d2de1.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_0a751b9707fff94f51a590afa22d2de1.jpg saved to cache
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2766f329-4044-5885-89db-aa9cab5ca5c3
2026-03-30 10:35:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2766f329-4044-5885-89db-aa9cab5ca5c3, skipping ID generation
2026-03-30 10:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2766f329-4044-5885-89db-aa9cab5ca5c3 with scrape type 1
2026-03-30 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2766f329-4044-5885-89db-aa9cab5ca5c3 sending to next pipeline
2026-03-30 10:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2766f329-4044-5885-89db-aa9cab5ca5c3, identifier: SN81946
2026-03-30 10:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2766f329-4044-5885-89db-aa9cab5ca5c3 with identifier: SN81946
2026-03-30 10:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2766f329-4044-5885-89db-aa9cab5ca5c3 with identifier: SN81946
2026-03-30 10:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2766f329-4044-5885-89db-aa9cab5ca5c3 with identifier: SN81946 to the API
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_0a751b9707fff94f51a590afa22d2de1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:52:11Z',
 'fuel_type': 'diesel',
 'id': '2766f329-4044-5885-89db-aa9cab5ca5c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN81946',
 'listing': 'auction',
 'location': 'DE, Bocholt',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 237151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2766f329-4044-5885-89db-aa9cab5ca5c3/2766f329-4044-5885-89db-aa9cab5ca5c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_5bdf380b066e4af3a8fea54948eec96c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2766f329-4044-5885-89db-aa9cab5ca5c3/2766f329-4044-5885-89db-aa9cab5ca5c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_3e5c180ad9dce4d6574e10df25457d0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2766f329-4044-5885-89db-aa9cab5ca5c3/2766f329-4044-5885-89db-aa9cab5ca5c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_9d8ad084498f8a02bf76ac2f96e4d697.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2766f329-4044-5885-89db-aa9cab5ca5c3/2766f329-4044-5885-89db-aa9cab5ca5c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_0a751b9707fff94f51a590afa22d2de1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2766f329-4044-5885-89db-aa9cab5ca5c3/2766f329-4044-5885-89db-aa9cab5ca5c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_a0e74cec7dad00f55a44f3bee22c4b44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2766f329-4044-5885-89db-aa9cab5ca5c3/2766f329-4044-5885-89db-aa9cab5ca5c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/d1/5cd1444d18e2a2c50efcd58551c8f529/pa/SN81946_85b8bf164d7a97382857faf6ae9c5df8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN81946%27 HTTP/1.1" 200 None
2026-03-30 10:35:39 [auto1.de] INFO: Saving data for SN81946: {'created_time': 1774866939.593441, 'last_price_update_time': 1774866939.593453, 'auction_closing_time': 1774972331.0}
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN81946') HTTP/1.1" 204 0
2026-03-30 10:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP98224/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR51220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LC34893/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB62051/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB59441> (referer: https://www.auto1.com/v1/car-details-view/TB59441/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b83c657-ac3d-5caf-b518-6d8442e1e035 with identifier: TB59441
2026-03-30 10:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b83c657-ac3d-5caf-b518-6d8442e1e035 with scrape type 1
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4b83c657-ac3d-5caf-b518-6d8442e1e035
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F14%252Faa14efc0ca38c7f8671fc0781d5af887%252Fpa%252FTB59441_de150b06679903e18f9165bd1fbb1217.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_de150b06679903e18f9165bd1fbb1217.jpg not downloaded yet
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F14%252Faa14efc0ca38c7f8671fc0781d5af887%252Fpa%252FTB59441_4bb6c88246b285ee9aef87c2cbc940f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_4bb6c88246b285ee9aef87c2cbc940f1.jpg not downloaded yet
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F14%252Faa14efc0ca38c7f8671fc0781d5af887%252Fpa%252FTB59441_0e1bf64d51c7990aee68c5dba7248616.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_0e1bf64d51c7990aee68c5dba7248616.jpg not downloaded yet
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F14%252Faa14efc0ca38c7f8671fc0781d5af887%252Fpa%252FTB59441_ee5ad4cdc3abbedf0c567fbfd7034e3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_ee5ad4cdc3abbedf0c567fbfd7034e3d.jpg not downloaded yet
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F14%252Faa14efc0ca38c7f8671fc0781d5af887%252Fpa%252FTB59441_ab4765f78b494dd0d1aa724d845ecfe1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_ab4765f78b494dd0d1aa724d845ecfe1.jpg not downloaded yet
2026-03-30 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_de150b06679903e18f9165bd1fbb1217.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_0e1bf64d51c7990aee68c5dba7248616.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a8ee50>
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b83c657-ac3d-5caf-b518-6d8442e1e035/4b83c657-ac3d-5caf-b518-6d8442e1e035_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F14%252Faa14efc0ca38c7f8671fc0781d5af887%252Fpa%252FTB59441_de150b06679903e18f9165bd1fbb1217.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_de150b06679903e18f9165bd1fbb1217.jpg saved to cache
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b83c657-ac3d-5caf-b518-6d8442e1e035
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a33610>
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b83c657-ac3d-5caf-b518-6d8442e1e035/4b83c657-ac3d-5caf-b518-6d8442e1e035_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F14%252Faa14efc0ca38c7f8671fc0781d5af887%252Fpa%252FTB59441_0e1bf64d51c7990aee68c5dba7248616.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_0e1bf64d51c7990aee68c5dba7248616.jpg saved to cache
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b83c657-ac3d-5caf-b518-6d8442e1e035
2026-03-30 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_4bb6c88246b285ee9aef87c2cbc940f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_ab4765f78b494dd0d1aa724d845ecfe1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_ee5ad4cdc3abbedf0c567fbfd7034e3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b37cd0>
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b83c657-ac3d-5caf-b518-6d8442e1e035/4b83c657-ac3d-5caf-b518-6d8442e1e035_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F14%252Faa14efc0ca38c7f8671fc0781d5af887%252Fpa%252FTB59441_4bb6c88246b285ee9aef87c2cbc940f1.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_4bb6c88246b285ee9aef87c2cbc940f1.jpg saved to cache
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b83c657-ac3d-5caf-b518-6d8442e1e035
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a37510>
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b83c657-ac3d-5caf-b518-6d8442e1e035/4b83c657-ac3d-5caf-b518-6d8442e1e035_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F14%252Faa14efc0ca38c7f8671fc0781d5af887%252Fpa%252FTB59441_ab4765f78b494dd0d1aa724d845ecfe1.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_ab4765f78b494dd0d1aa724d845ecfe1.jpg saved to cache
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b83c657-ac3d-5caf-b518-6d8442e1e035
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5977b50>
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b83c657-ac3d-5caf-b518-6d8442e1e035/4b83c657-ac3d-5caf-b518-6d8442e1e035_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F14%252Faa14efc0ca38c7f8671fc0781d5af887%252Fpa%252FTB59441_ee5ad4cdc3abbedf0c567fbfd7034e3d.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_ee5ad4cdc3abbedf0c567fbfd7034e3d.jpg saved to cache
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b83c657-ac3d-5caf-b518-6d8442e1e035
2026-03-30 10:35:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b83c657-ac3d-5caf-b518-6d8442e1e035, skipping ID generation
2026-03-30 10:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b83c657-ac3d-5caf-b518-6d8442e1e035 with scrape type 1
2026-03-30 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b83c657-ac3d-5caf-b518-6d8442e1e035 sending to next pipeline
2026-03-30 10:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b83c657-ac3d-5caf-b518-6d8442e1e035, identifier: TB59441
2026-03-30 10:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b83c657-ac3d-5caf-b518-6d8442e1e035 with identifier: TB59441
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 10:35:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b83c657-ac3d-5caf-b518-6d8442e1e035 with identifier: TB59441
2026-03-30 10:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b83c657-ac3d-5caf-b518-6d8442e1e035 with identifier: TB59441 to the API
2026-03-30 10:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_ee5ad4cdc3abbedf0c567fbfd7034e3d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.3L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:23:03Z',
 'fuel_type': 'petrol',
 'id': '4b83c657-ac3d-5caf-b518-6d8442e1e035',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB59441',
 'listing': 'auction',
 'location': 'DE, Ulm-Senden',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 186625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b83c657-ac3d-5caf-b518-6d8442e1e035/4b83c657-ac3d-5caf-b518-6d8442e1e035_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_de150b06679903e18f9165bd1fbb1217.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b83c657-ac3d-5caf-b518-6d8442e1e035/4b83c657-ac3d-5caf-b518-6d8442e1e035_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_4bb6c88246b285ee9aef87c2cbc940f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b83c657-ac3d-5caf-b518-6d8442e1e035/4b83c657-ac3d-5caf-b518-6d8442e1e035_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_0e1bf64d51c7990aee68c5dba7248616.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b83c657-ac3d-5caf-b518-6d8442e1e035/4b83c657-ac3d-5caf-b518-6d8442e1e035_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_ee5ad4cdc3abbedf0c567fbfd7034e3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b83c657-ac3d-5caf-b518-6d8442e1e035/4b83c657-ac3d-5caf-b518-6d8442e1e035_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/14/aa14efc0ca38c7f8671fc0781d5af887/pa/TB59441_ab4765f78b494dd0d1aa724d845ecfe1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 ClearTec 35 Jahre',
 'transmission': 'manual',
 'trim': 'ClearTec 35 Jahre',
 'year': 2013}
2026-03-30 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB59441%27 HTTP/1.1" 200 None
2026-03-30 10:35:44 [auto1.de] INFO: Saving data for TB59441: {'created_time': 1774866944.30012, 'last_price_update_time': 1774866944.300128, 'auction_closing_time': 1774970583.0}
2026-03-30 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB59441') HTTP/1.1" 204 0
2026-03-30 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF48605> (referer: https://www.auto1.com/v1/car-details-view/GF48605/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aabe96a9-986f-5d51-95c1-f205866e3e07 with identifier: GF48605
2026-03-30 10:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aabe96a9-986f-5d51-95c1-f205866e3e07 with scrape type 1
2026-03-30 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aabe96a9-986f-5d51-95c1-f205866e3e07
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F83%252Fba83cbb4b8a3f256f82f7630f6bad19b%252Fpa%252FGF48605_128999a0a4e691db90aee87ec17a6f7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_128999a0a4e691db90aee87ec17a6f7d.jpg already downloaded
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F83%252Fba83cbb4b8a3f256f82f7630f6bad19b%252Fpa%252FGF48605_962a4a496f9dfa50f2c0312f00313d63.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_962a4a496f9dfa50f2c0312f00313d63.jpg already downloaded
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F83%252Fba83cbb4b8a3f256f82f7630f6bad19b%252Fpa%252FGF48605_4a12bde67bfef63a76f0a5bcc5b264c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_4a12bde67bfef63a76f0a5bcc5b264c1.jpg already downloaded
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F83%252Fba83cbb4b8a3f256f82f7630f6bad19b%252Fpa%252FGF48605_3f339003778cafeef0d3d0b92c2d49fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_3f339003778cafeef0d3d0b92c2d49fe.jpg already downloaded
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F83%252Fba83cbb4b8a3f256f82f7630f6bad19b%252Fpa%252FGF48605_f811f18ad916afbe1277efd90e582a7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_f811f18ad916afbe1277efd90e582a7e.jpg already downloaded
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F83%252Fba83cbb4b8a3f256f82f7630f6bad19b%252Fpa%252FGF48605_69496af84bc92af36aac5009ebbf876e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_69496af84bc92af36aac5009ebbf876e.jpg already downloaded
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F83%252Fba83cbb4b8a3f256f82f7630f6bad19b%252Fpa%252FGF48605_6cdc98a727480cd6e9c3fe3e73c01038.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_6cdc98a727480cd6e9c3fe3e73c01038.jpg already downloaded
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F83%252Fba83cbb4b8a3f256f82f7630f6bad19b%252Fpa%252FGF48605_d45ac34e1aa10ae644cbc936fd75d5d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_d45ac34e1aa10ae644cbc936fd75d5d6.jpg already downloaded
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F83%252Fba83cbb4b8a3f256f82f7630f6bad19b%252Fpa%252FGF48605_7c01a6f44dec211414e9b5c08846b71f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_7c01a6f44dec211414e9b5c08846b71f.jpg already downloaded
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F83%252Fba83cbb4b8a3f256f82f7630f6bad19b%252Fpa%252FGF48605_ad39738a104765f1065b30a60db211b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_ad39738a104765f1065b30a60db211b8.jpg already downloaded
2026-03-30 10:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aabe96a9-986f-5d51-95c1-f205866e3e07, identifier: GF48605
2026-03-30 10:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aabe96a9-986f-5d51-95c1-f205866e3e07 with identifier: GF48605
2026-03-30 10:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aabe96a9-986f-5d51-95c1-f205866e3e07 with identifier: GF48605
2026-03-30 10:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aabe96a9-986f-5d51-95c1-f205866e3e07 with identifier: GF48605 to the API
2026-03-30 10:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GF48605>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:42:08Z',
 'fuel_type': 'petrol',
 'id': 'aabe96a9-986f-5d51-95c1-f205866e3e07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF48605',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 84751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_128999a0a4e691db90aee87ec17a6f7d.jpg',
                'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_962a4a496f9dfa50f2c0312f00313d63.jpg',
                'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_4a12bde67bfef63a76f0a5bcc5b264c1.jpg',
                'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_3f339003778cafeef0d3d0b92c2d49fe.jpg',
                'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_f811f18ad916afbe1277efd90e582a7e.jpg',
                'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_69496af84bc92af36aac5009ebbf876e.jpg',
                'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_6cdc98a727480cd6e9c3fe3e73c01038.jpg',
                'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_d45ac34e1aa10ae644cbc936fd75d5d6.jpg',
                'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_7c01a6f44dec211414e9b5c08846b71f.jpg',
                'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_ad39738a104765f1065b30a60db211b8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabe96a9-986f-5d51-95c1-f205866e3e07/aabe96a9-986f-5d51-95c1-f205866e3e07_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2943892,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_128999a0a4e691db90aee87ec17a6f7d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabe96a9-986f-5d51-95c1-f205866e3e07/aabe96a9-986f-5d51-95c1-f205866e3e07_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3298480,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_962a4a496f9dfa50f2c0312f00313d63.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabe96a9-986f-5d51-95c1-f205866e3e07/aabe96a9-986f-5d51-95c1-f205866e3e07_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2924933,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_4a12bde67bfef63a76f0a5bcc5b264c1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabe96a9-986f-5d51-95c1-f205866e3e07/aabe96a9-986f-5d51-95c1-f205866e3e07_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3219733,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_3f339003778cafeef0d3d0b92c2d49fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabe96a9-986f-5d51-95c1-f205866e3e07/aabe96a9-986f-5d51-95c1-f205866e3e07_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_f811f18ad916afbe1277efd90e582a7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabe96a9-986f-5d51-95c1-f205866e3e07/aabe96a9-986f-5d51-95c1-f205866e3e07_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_69496af84bc92af36aac5009ebbf876e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabe96a9-986f-5d51-95c1-f205866e3e07/aabe96a9-986f-5d51-95c1-f205866e3e07_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2641207,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_6cdc98a727480cd6e9c3fe3e73c01038.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabe96a9-986f-5d51-95c1-f205866e3e07/aabe96a9-986f-5d51-95c1-f205866e3e07_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2769160,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_d45ac34e1aa10ae644cbc936fd75d5d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabe96a9-986f-5d51-95c1-f205866e3e07/aabe96a9-986f-5d51-95c1-f205866e3e07_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3069743,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_7c01a6f44dec211414e9b5c08846b71f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabe96a9-986f-5d51-95c1-f205866e3e07/aabe96a9-986f-5d51-95c1-f205866e3e07_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3246797,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/83/ba83cbb4b8a3f256f82f7630f6bad19b/pa/GF48605_ad39738a104765f1065b30a60db211b8.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2015}
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF48605%27 HTTP/1.1" 200 None
2026-03-30 10:35:46 [auto1.de] INFO: Saving data for GF48605: {'created_time': 1774866946.14694, 'last_price_update_time': 1774866946.14695, 'auction_closing_time': 1774971728.0}
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF48605') HTTP/1.1" 204 0
2026-03-30 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN17481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU59079> (referer: https://www.auto1.com/v1/car-details-view/SU59079/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e383138-1a36-59ab-8ce6-c6d5bfa5306e with identifier: SU59079
2026-03-30 10:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e383138-1a36-59ab-8ce6-c6d5bfa5306e with scrape type 1
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e383138-1a36-59ab-8ce6-c6d5bfa5306e
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_e9229a1efe2ff0b2d8f4a8d59ad65a2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_e9229a1efe2ff0b2d8f4a8d59ad65a2b.jpg not downloaded yet
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_fa0da31b741af04f057dcee4b14d9e75.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_fa0da31b741af04f057dcee4b14d9e75.jpg not downloaded yet
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_c8200d22bbf786baf9fba962c337a307.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_c8200d22bbf786baf9fba962c337a307.jpg not downloaded yet
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_026d2d3dca9b848b958e5acb3e28dc07.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_026d2d3dca9b848b958e5acb3e28dc07.jpg not downloaded yet
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_04ab695dab951e7b0d73feaefa372e25.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_04ab695dab951e7b0d73feaefa372e25.jpg not downloaded yet
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_d609fb9b4792dce27345e897b48872b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_d609fb9b4792dce27345e897b48872b2.jpg not downloaded yet
2026-03-30 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_e9229a1efe2ff0b2d8f4a8d59ad65a2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_ef7de58e97d9771b7e4b65dcb1b16595.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_ef7de58e97d9771b7e4b65dcb1b16595.jpg not downloaded yet
2026-03-30 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_fa0da31b741af04f057dcee4b14d9e75.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_349c4129edac8518ff6c1c36b643f98e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_349c4129edac8518ff6c1c36b643f98e.jpg not downloaded yet
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_d67ec249e536366ee45540e3ddf05338.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_d67ec249e536366ee45540e3ddf05338.jpg not downloaded yet
2026-03-30 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_c8200d22bbf786baf9fba962c337a307.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_0f50a552d906bf35d7cd29eb1cd5ba1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_0f50a552d906bf35d7cd29eb1cd5ba1c.jpg not downloaded yet
2026-03-30 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59bf1d0>
2026-03-30 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_e9229a1efe2ff0b2d8f4a8d59ad65a2b.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_e9229a1efe2ff0b2d8f4a8d59ad65a2b.jpg saved to cache
2026-03-30 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e383138-1a36-59ab-8ce6-c6d5bfa5306e
2026-03-30 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6c7d0>
2026-03-30 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_fa0da31b741af04f057dcee4b14d9e75.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_fa0da31b741af04f057dcee4b14d9e75.jpg saved to cache
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e383138-1a36-59ab-8ce6-c6d5bfa5306e
2026-03-30 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_026d2d3dca9b848b958e5acb3e28dc07.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_d67ec249e536366ee45540e3ddf05338.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ad6ad0>
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_c8200d22bbf786baf9fba962c337a307.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_c8200d22bbf786baf9fba962c337a307.jpg saved to cache
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e383138-1a36-59ab-8ce6-c6d5bfa5306e
2026-03-30 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_ef7de58e97d9771b7e4b65dcb1b16595.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EZ41546/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef596fb50>
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_026d2d3dca9b848b958e5acb3e28dc07.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_026d2d3dca9b848b958e5acb3e28dc07.jpg saved to cache
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e383138-1a36-59ab-8ce6-c6d5bfa5306e
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595db50>
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_d67ec249e536366ee45540e3ddf05338.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_d67ec249e536366ee45540e3ddf05338.jpg saved to cache
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e383138-1a36-59ab-8ce6-c6d5bfa5306e
2026-03-30 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_d609fb9b4792dce27345e897b48872b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5073850>
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_ef7de58e97d9771b7e4b65dcb1b16595.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_ef7de58e97d9771b7e4b65dcb1b16595.jpg saved to cache
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e383138-1a36-59ab-8ce6-c6d5bfa5306e
2026-03-30 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_0f50a552d906bf35d7cd29eb1cd5ba1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_04ab695dab951e7b0d73feaefa372e25.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_349c4129edac8518ff6c1c36b643f98e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5067050>
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_d609fb9b4792dce27345e897b48872b2.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_d609fb9b4792dce27345e897b48872b2.jpg saved to cache
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e383138-1a36-59ab-8ce6-c6d5bfa5306e
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a23610>
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_0f50a552d906bf35d7cd29eb1cd5ba1c.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_0f50a552d906bf35d7cd29eb1cd5ba1c.jpg saved to cache
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e383138-1a36-59ab-8ce6-c6d5bfa5306e
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50a6950>
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_04ab695dab951e7b0d73feaefa372e25.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_04ab695dab951e7b0d73feaefa372e25.jpg saved to cache
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e383138-1a36-59ab-8ce6-c6d5bfa5306e
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50ad3d0>
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F58%252F305834b22c3cd36acc79083f60d0b182%252Fpa%252FSU59079_349c4129edac8518ff6c1c36b643f98e.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_349c4129edac8518ff6c1c36b643f98e.jpg saved to cache
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e383138-1a36-59ab-8ce6-c6d5bfa5306e
2026-03-30 10:35:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e383138-1a36-59ab-8ce6-c6d5bfa5306e, skipping ID generation
2026-03-30 10:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e383138-1a36-59ab-8ce6-c6d5bfa5306e with scrape type 1
2026-03-30 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e383138-1a36-59ab-8ce6-c6d5bfa5306e sending to next pipeline
2026-03-30 10:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e383138-1a36-59ab-8ce6-c6d5bfa5306e, identifier: SU59079
2026-03-30 10:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e383138-1a36-59ab-8ce6-c6d5bfa5306e with identifier: SU59079
2026-03-30 10:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e383138-1a36-59ab-8ce6-c6d5bfa5306e with identifier: SU59079
2026-03-30 10:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e383138-1a36-59ab-8ce6-c6d5bfa5306e with identifier: SU59079 to the API
2026-03-30 10:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_349c4129edac8518ff6c1c36b643f98e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:54:00Z',
 'fuel_type': 'petrol',
 'id': '2e383138-1a36-59ab-8ce6-c6d5bfa5306e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU59079',
 'listing': 'auction',
 'location': 'DE, Lahr',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 73681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_e9229a1efe2ff0b2d8f4a8d59ad65a2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_fa0da31b741af04f057dcee4b14d9e75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_c8200d22bbf786baf9fba962c337a307.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_026d2d3dca9b848b958e5acb3e28dc07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_04ab695dab951e7b0d73feaefa372e25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_d609fb9b4792dce27345e897b48872b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_ef7de58e97d9771b7e4b65dcb1b16595.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_349c4129edac8518ff6c1c36b643f98e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_d67ec249e536366ee45540e3ddf05338.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e383138-1a36-59ab-8ce6-c6d5bfa5306e/2e383138-1a36-59ab-8ce6-c6d5bfa5306e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/58/305834b22c3cd36acc79083f60d0b182/pa/SU59079_0f50a552d906bf35d7cd29eb1cd5ba1c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 TSI GTI',
 'transmission': 'manual',
 'trim': 'GTI',
 'year': 2021}
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU59079%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [auto1.de] INFO: Saving data for SU59079: {'created_time': 1774866949.254048, 'last_price_update_time': 1774866949.254058, 'auction_closing_time': 1774972440.0}
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU59079') HTTP/1.1" 204 0
2026-03-30 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LC34893> (referer: https://www.auto1.com/v1/car-details-view/LC34893/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5c3a878-602e-5eb2-8ff0-7fd4d040c55e with identifier: LC34893
2026-03-30 10:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5c3a878-602e-5eb2-8ff0-7fd4d040c55e with scrape type 1
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5c3a878-602e-5eb2-8ff0-7fd4d040c55e
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_dfe7a8756de8c6b7d6baeb21e5b6992d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_dfe7a8756de8c6b7d6baeb21e5b6992d.jpg not downloaded yet
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_551528575521fb666cea5f890fbba052.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_551528575521fb666cea5f890fbba052.jpg not downloaded yet
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_6d8971b52494ec7b532b72e5ea623838.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_6d8971b52494ec7b532b72e5ea623838.jpg not downloaded yet
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_dbca37a57400498e319124f313469601.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_dbca37a57400498e319124f313469601.jpg not downloaded yet
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_593a100d0447c63adc04442105c6731d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_593a100d0447c63adc04442105c6731d.jpg not downloaded yet
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_d9b4e6a759a7296741a9744ca598204d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_d9b4e6a759a7296741a9744ca598204d.jpg not downloaded yet
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_d54ea7e20832c284333dffdb124373b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_d54ea7e20832c284333dffdb124373b1.jpg not downloaded yet
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_ee8a4ab58547ce9d24a3b5af2565b66a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_ee8a4ab58547ce9d24a3b5af2565b66a.jpg not downloaded yet
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_bab3b713694d30572745c847d84abe76.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_bab3b713694d30572745c847d84abe76.jpg not downloaded yet
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_3da693e287185a665694c75731002278.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_3da693e287185a665694c75731002278.jpg not downloaded yet
2026-03-30 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_593a100d0447c63adc04442105c6731d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_6d8971b52494ec7b532b72e5ea623838.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_dbca37a57400498e319124f313469601.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_3da693e287185a665694c75731002278.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_dfe7a8756de8c6b7d6baeb21e5b6992d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b203d0>
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_593a100d0447c63adc04442105c6731d.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_593a100d0447c63adc04442105c6731d.jpg saved to cache
2026-03-30 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5c3a878-602e-5eb2-8ff0-7fd4d040c55e
2026-03-30 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_551528575521fb666cea5f890fbba052.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_bab3b713694d30572745c847d84abe76.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ae1a90>
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_6d8971b52494ec7b532b72e5ea623838.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_6d8971b52494ec7b532b72e5ea623838.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5c3a878-602e-5eb2-8ff0-7fd4d040c55e
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a8e550>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_dbca37a57400498e319124f313469601.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_dbca37a57400498e319124f313469601.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5c3a878-602e-5eb2-8ff0-7fd4d040c55e
2026-03-30 10:35:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef673c6d0>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_3da693e287185a665694c75731002278.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_3da693e287185a665694c75731002278.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5c3a878-602e-5eb2-8ff0-7fd4d040c55e
2026-03-30 10:35:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef505c290>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_dfe7a8756de8c6b7d6baeb21e5b6992d.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_dfe7a8756de8c6b7d6baeb21e5b6992d.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5c3a878-602e-5eb2-8ff0-7fd4d040c55e
2026-03-30 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_ee8a4ab58547ce9d24a3b5af2565b66a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC01628/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50ccc50>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_551528575521fb666cea5f890fbba052.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_551528575521fb666cea5f890fbba052.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5c3a878-602e-5eb2-8ff0-7fd4d040c55e
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5983d90>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_bab3b713694d30572745c847d84abe76.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_bab3b713694d30572745c847d84abe76.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5c3a878-602e-5eb2-8ff0-7fd4d040c55e
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50708d0>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_ee8a4ab58547ce9d24a3b5af2565b66a.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_ee8a4ab58547ce9d24a3b5af2565b66a.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5c3a878-602e-5eb2-8ff0-7fd4d040c55e
2026-03-30 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_d9b4e6a759a7296741a9744ca598204d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_d54ea7e20832c284333dffdb124373b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5072390>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_d9b4e6a759a7296741a9744ca598204d.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_d9b4e6a759a7296741a9744ca598204d.jpg saved to cache
2026-03-30 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5c3a878-602e-5eb2-8ff0-7fd4d040c55e
2026-03-30 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR21989> (referer: https://www.auto1.com/v1/car-details-view/NR21989/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50a7850>
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F72%252Fac72d5590f2f6eb04b0a32d0e6c187ba%252Fpa%252FLC34893_d54ea7e20832c284333dffdb124373b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_d54ea7e20832c284333dffdb124373b1.jpg saved to cache
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5c3a878-602e-5eb2-8ff0-7fd4d040c55e
2026-03-30 10:35:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5c3a878-602e-5eb2-8ff0-7fd4d040c55e, skipping ID generation
2026-03-30 10:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5c3a878-602e-5eb2-8ff0-7fd4d040c55e with scrape type 1
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5c3a878-602e-5eb2-8ff0-7fd4d040c55e sending to next pipeline
2026-03-30 10:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5c3a878-602e-5eb2-8ff0-7fd4d040c55e, identifier: LC34893
2026-03-30 10:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5c3a878-602e-5eb2-8ff0-7fd4d040c55e with identifier: LC34893
2026-03-30 10:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5c3a878-602e-5eb2-8ff0-7fd4d040c55e with identifier: LC34893
2026-03-30 10:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5c3a878-602e-5eb2-8ff0-7fd4d040c55e with identifier: LC34893 to the API
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_d54ea7e20832c284333dffdb124373b1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:12:46Z',
 'fuel_type': 'petrol',
 'id': 'c5c3a878-602e-5eb2-8ff0-7fd4d040c55e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC34893',
 'listing': 'auction',
 'location': 'DE, Lüdenscheid',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 72102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2876161,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_dfe7a8756de8c6b7d6baeb21e5b6992d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2836062,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_551528575521fb666cea5f890fbba052.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_6d8971b52494ec7b532b72e5ea623838.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_dbca37a57400498e319124f313469601.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2632979,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_593a100d0447c63adc04442105c6731d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2775645,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_d9b4e6a759a7296741a9744ca598204d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2357909,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_d54ea7e20832c284333dffdb124373b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_ee8a4ab58547ce9d24a3b5af2565b66a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_bab3b713694d30572745c847d84abe76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c3a878-602e-5eb2-8ff0-7fd4d040c55e/c5c3a878-602e-5eb2-8ff0-7fd4d040c55e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2708758,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/72/ac72d5590f2f6eb04b0a32d0e6c187ba/pa/LC34893_3da693e287185a665694c75731002278.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2017}
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC34893%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [auto1.de] INFO: Saving data for LC34893: {'created_time': 1774866951.587063, 'last_price_update_time': 1774866951.587075, 'auction_closing_time': 1774969966.0}
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC34893') HTTP/1.1" 204 0
2026-03-30 10:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP98224> (referer: https://www.auto1.com/v1/car-details-view/NP98224/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a635786f-bf3c-5c1b-97f0-0c9c6235dbbb with identifier: NR21989
2026-03-30 10:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a635786f-bf3c-5c1b-97f0-0c9c6235dbbb with scrape type 1
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a635786f-bf3c-5c1b-97f0-0c9c6235dbbb
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_9d73fc53da3380f2a7e11579c793b982.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_9d73fc53da3380f2a7e11579c793b982.jpg not downloaded yet
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_fdc5fd4a39cbb9d9597dd02d2cb0b5d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_fdc5fd4a39cbb9d9597dd02d2cb0b5d7.jpg not downloaded yet
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_c2269620349a6bc222201995d6190bcb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_c2269620349a6bc222201995d6190bcb.jpg not downloaded yet
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_430836b610fcbee0cfb029167b60ef64.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_430836b610fcbee0cfb029167b60ef64.jpg not downloaded yet
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_af750a76e348d8dd3e5d8e51828f08f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_af750a76e348d8dd3e5d8e51828f08f2.jpg not downloaded yet
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_b6a3149b71205de43928fdb63d1bf3e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_b6a3149b71205de43928fdb63d1bf3e3.jpg not downloaded yet
2026-03-30 10:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb2553f5-d7f6-5711-8b92-12b42f9e0d93 with identifier: NP98224
2026-03-30 10:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb2553f5-d7f6-5711-8b92-12b42f9e0d93 with scrape type 1
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb2553f5-d7f6-5711-8b92-12b42f9e0d93
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fec%252F7beca8f733394909ec850eaad79da385%252Fpa%252FNP98224_6396ffe28c0ec819a6a2b31bb1bd8cb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_6396ffe28c0ec819a6a2b31bb1bd8cb3.jpg already downloaded
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fec%252F7beca8f733394909ec850eaad79da385%252Fpa%252FNP98224_93248f1fb69cdf537b95b5360ec81eec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_93248f1fb69cdf537b95b5360ec81eec.jpg already downloaded
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fec%252F7beca8f733394909ec850eaad79da385%252Fpa%252FNP98224_75cac021a3f4b71d915b183c61d34363.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_75cac021a3f4b71d915b183c61d34363.jpg already downloaded
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fec%252F7beca8f733394909ec850eaad79da385%252Fpa%252FNP98224_87f217ad8fa0e414d9c5c6e4c0d619be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_87f217ad8fa0e414d9c5c6e4c0d619be.jpg already downloaded
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fec%252F7beca8f733394909ec850eaad79da385%252Fpa%252FNP98224_427313abd26c44fc0cae94e64472b30b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_427313abd26c44fc0cae94e64472b30b.jpg already downloaded
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fec%252F7beca8f733394909ec850eaad79da385%252Fpa%252FNP98224_40bc316b4b785d536711a0735041c937.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_40bc316b4b785d536711a0735041c937.jpg already downloaded
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fec%252F7beca8f733394909ec850eaad79da385%252Fpa%252FNP98224_4aa6b22faa977d244d53370b18cec732.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_4aa6b22faa977d244d53370b18cec732.jpg already downloaded
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fec%252F7beca8f733394909ec850eaad79da385%252Fpa%252FNP98224_b2b47afa653d145e9dfb242721738d87.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_b2b47afa653d145e9dfb242721738d87.jpg already downloaded
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fec%252F7beca8f733394909ec850eaad79da385%252Fpa%252FNP98224_a5338cbc8d166c77f326dab9406e0d65.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_a5338cbc8d166c77f326dab9406e0d65.jpg already downloaded
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fec%252F7beca8f733394909ec850eaad79da385%252Fpa%252FNP98224_4931f5a8c866ed922377ddb3ffb40dd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_4931f5a8c866ed922377ddb3ffb40dd0.jpg already downloaded
2026-03-30 10:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb2553f5-d7f6-5711-8b92-12b42f9e0d93, identifier: NP98224
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_2a37863197f80072c8204157baf2ea71.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_2a37863197f80072c8204157baf2ea71.jpg not downloaded yet
2026-03-30 10:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb2553f5-d7f6-5711-8b92-12b42f9e0d93 with identifier: NP98224
2026-03-30 10:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb2553f5-d7f6-5711-8b92-12b42f9e0d93 with identifier: NP98224
2026-03-30 10:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb2553f5-d7f6-5711-8b92-12b42f9e0d93 with identifier: NP98224 to the API
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NP98224>
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:34:21Z',
 'fuel_type': 'petrol',
 'id': 'bb2553f5-d7f6-5711-8b92-12b42f9e0d93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP98224',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 115264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_6396ffe28c0ec819a6a2b31bb1bd8cb3.jpg',
                'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_93248f1fb69cdf537b95b5360ec81eec.jpg',
                'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_75cac021a3f4b71d915b183c61d34363.jpg',
                'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_87f217ad8fa0e414d9c5c6e4c0d619be.jpg',
                'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_427313abd26c44fc0cae94e64472b30b.jpg',
                'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_40bc316b4b785d536711a0735041c937.jpg',
                'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_4aa6b22faa977d244d53370b18cec732.jpg',
                'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_b2b47afa653d145e9dfb242721738d87.jpg',
                'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_a5338cbc8d166c77f326dab9406e0d65.jpg',
                'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_4931f5a8c866ed922377ddb3ffb40dd0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2553f5-d7f6-5711-8b92-12b42f9e0d93/bb2553f5-d7f6-5711-8b92-12b42f9e0d93_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3015943,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_6396ffe28c0ec819a6a2b31bb1bd8cb3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2553f5-d7f6-5711-8b92-12b42f9e0d93/bb2553f5-d7f6-5711-8b92-12b42f9e0d93_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2999317,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_93248f1fb69cdf537b95b5360ec81eec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2553f5-d7f6-5711-8b92-12b42f9e0d93/bb2553f5-d7f6-5711-8b92-12b42f9e0d93_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2756396,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_75cac021a3f4b71d915b183c61d34363.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2553f5-d7f6-5711-8b92-12b42f9e0d93/bb2553f5-d7f6-5711-8b92-12b42f9e0d93_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2674693,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_87f217ad8fa0e414d9c5c6e4c0d619be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2553f5-d7f6-5711-8b92-12b42f9e0d93/bb2553f5-d7f6-5711-8b92-12b42f9e0d93_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2647698,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_427313abd26c44fc0cae94e64472b30b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2553f5-d7f6-5711-8b92-12b42f9e0d93/bb2553f5-d7f6-5711-8b92-12b42f9e0d93_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_40bc316b4b785d536711a0735041c937.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2553f5-d7f6-5711-8b92-12b42f9e0d93/bb2553f5-d7f6-5711-8b92-12b42f9e0d93_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2774292,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_4aa6b22faa977d244d53370b18cec732.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2553f5-d7f6-5711-8b92-12b42f9e0d93/bb2553f5-d7f6-5711-8b92-12b42f9e0d93_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_b2b47afa653d145e9dfb242721738d87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2553f5-d7f6-5711-8b92-12b42f9e0d93/bb2553f5-d7f6-5711-8b92-12b42f9e0d93_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_a5338cbc8d166c77f326dab9406e0d65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2553f5-d7f6-5711-8b92-12b42f9e0d93/bb2553f5-d7f6-5711-8b92-12b42f9e0d93_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ec/7beca8f733394909ec850eaad79da385/pa/NP98224_4931f5a8c866ed922377ddb3ffb40dd0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 Sol',
 'transmission': 'automatic',
 'trim': 'Sol',
 'year': 2004}
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP98224%27 HTTP/1.1" 200 None
2026-03-30 10:35:52 [auto1.de] INFO: Saving data for NP98224: {'created_time': 1774866952.364877, 'last_price_update_time': 1774866952.364887, 'auction_closing_time': 1774971261.0}
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP98224') HTTP/1.1" 204 0
2026-03-30 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_fdc5fd4a39cbb9d9597dd02d2cb0b5d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_c2269620349a6bc222201995d6190bcb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_430836b610fcbee0cfb029167b60ef64.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_82c0d67df277696a9dcf564a5e646ff9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_82c0d67df277696a9dcf564a5e646ff9.jpg not downloaded yet
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_5daf3ebf46a78e692c952ce26b9e6a26.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_5daf3ebf46a78e692c952ce26b9e6a26.jpg not downloaded yet
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_484b1dca34b4a45843ead88852f96e1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_484b1dca34b4a45843ead88852f96e1c.jpg not downloaded yet
2026-03-30 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_af750a76e348d8dd3e5d8e51828f08f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_b6a3149b71205de43928fdb63d1bf3e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50a9ed0>
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_fdc5fd4a39cbb9d9597dd02d2cb0b5d7.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_fdc5fd4a39cbb9d9597dd02d2cb0b5d7.jpg saved to cache
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a635786f-bf3c-5c1b-97f0-0c9c6235dbbb
2026-03-30 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_2a37863197f80072c8204157baf2ea71.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59ab3d0>
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_c2269620349a6bc222201995d6190bcb.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_c2269620349a6bc222201995d6190bcb.jpg saved to cache
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a635786f-bf3c-5c1b-97f0-0c9c6235dbbb
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef599c710>
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_430836b610fcbee0cfb029167b60ef64.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_430836b610fcbee0cfb029167b60ef64.jpg saved to cache
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a635786f-bf3c-5c1b-97f0-0c9c6235dbbb
2026-03-30 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_9d73fc53da3380f2a7e11579c793b982.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_5daf3ebf46a78e692c952ce26b9e6a26.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ab84d0>
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_af750a76e348d8dd3e5d8e51828f08f2.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_af750a76e348d8dd3e5d8e51828f08f2.jpg saved to cache
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a635786f-bf3c-5c1b-97f0-0c9c6235dbbb
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ae3d50>
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_b6a3149b71205de43928fdb63d1bf3e3.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_b6a3149b71205de43928fdb63d1bf3e3.jpg saved to cache
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a635786f-bf3c-5c1b-97f0-0c9c6235dbbb
2026-03-30 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_82c0d67df277696a9dcf564a5e646ff9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK15244> (referer: https://www.auto1.com/v1/car-details-view/UK15244/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508e990>
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_2a37863197f80072c8204157baf2ea71.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_2a37863197f80072c8204157baf2ea71.jpg saved to cache
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a635786f-bf3c-5c1b-97f0-0c9c6235dbbb
2026-03-30 10:35:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 10:35:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 10:35:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 10:35:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 10:35:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a68d10>
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_9d73fc53da3380f2a7e11579c793b982.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_9d73fc53da3380f2a7e11579c793b982.jpg saved to cache
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a635786f-bf3c-5c1b-97f0-0c9c6235dbbb
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a97810>
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_5daf3ebf46a78e692c952ce26b9e6a26.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_5daf3ebf46a78e692c952ce26b9e6a26.jpg saved to cache
2026-03-30 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a635786f-bf3c-5c1b-97f0-0c9c6235dbbb
2026-03-30 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_484b1dca34b4a45843ead88852f96e1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b2310>
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_82c0d67df277696a9dcf564a5e646ff9.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_82c0d67df277696a9dcf564a5e646ff9.jpg saved to cache
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a635786f-bf3c-5c1b-97f0-0c9c6235dbbb
2026-03-30 10:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 386fa05f-9193-5085-b8d2-c57f89d0ba45 with identifier: UK15244
2026-03-30 10:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 386fa05f-9193-5085-b8d2-c57f89d0ba45 with scrape type 1
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 386fa05f-9193-5085-b8d2-c57f89d0ba45
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_b668007b1e0bb420fe448158b61152e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_b668007b1e0bb420fe448158b61152e8.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_71387263c26a73f66bd8ca70d5a947e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_71387263c26a73f66bd8ca70d5a947e3.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_5664f8591247d19f14f70937135725cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_5664f8591247d19f14f70937135725cd.jpg not downloaded yet
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef593d5d0>
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F38%252F02381fdeec45e31807bdebd38e4a7624%252Fpa%252FNR21989_484b1dca34b4a45843ead88852f96e1c.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_484b1dca34b4a45843ead88852f96e1c.jpg saved to cache
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a635786f-bf3c-5c1b-97f0-0c9c6235dbbb
2026-03-30 10:35:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a635786f-bf3c-5c1b-97f0-0c9c6235dbbb, skipping ID generation
2026-03-30 10:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a635786f-bf3c-5c1b-97f0-0c9c6235dbbb with scrape type 1
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a635786f-bf3c-5c1b-97f0-0c9c6235dbbb sending to next pipeline
2026-03-30 10:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a635786f-bf3c-5c1b-97f0-0c9c6235dbbb, identifier: NR21989
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_f58159fda67dfaafe76c6bdb7ffdf8e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_f58159fda67dfaafe76c6bdb7ffdf8e7.jpg not downloaded yet
2026-03-30 10:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a635786f-bf3c-5c1b-97f0-0c9c6235dbbb with identifier: NR21989
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a635786f-bf3c-5c1b-97f0-0c9c6235dbbb with identifier: NR21989
2026-03-30 10:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a635786f-bf3c-5c1b-97f0-0c9c6235dbbb with identifier: NR21989 to the API
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_484b1dca34b4a45843ead88852f96e1c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:17:01Z',
 'fuel_type': 'diesel',
 'id': 'a635786f-bf3c-5c1b-97f0-0c9c6235dbbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR21989',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 179950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 33,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 5112229,
             'Height': 5712,
             'OriginUrl': 'https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_9d73fc53da3380f2a7e11579c793b982.jpg',
             'Width': 4284},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_fdc5fd4a39cbb9d9597dd02d2cb0b5d7.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_c2269620349a6bc222201995d6190bcb.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_430836b610fcbee0cfb029167b60ef64.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_af750a76e348d8dd3e5d8e51828f08f2.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_b6a3149b71205de43928fdb63d1bf3e3.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_2a37863197f80072c8204157baf2ea71.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_82c0d67df277696a9dcf564a5e646ff9.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_5daf3ebf46a78e692c952ce26b9e6a26.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a635786f-bf3c-5c1b-97f0-0c9c6235dbbb/a635786f-bf3c-5c1b-97f0-0c9c6235dbbb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/38/02381fdeec45e31807bdebd38e4a7624/pa/NR21989_484b1dca34b4a45843ead88852f96e1c.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2016}
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR21989%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [auto1.de] INFO: Saving data for NR21989: {'created_time': 1774866953.806571, 'last_price_update_time': 1774866953.806579, 'auction_closing_time': 1774970221.0}
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR21989') HTTP/1.1" 204 0
2026-03-30 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP27686/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_779dd2ef5358fee9d40963fd5963c941.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_779dd2ef5358fee9d40963fd5963c941.jpg not downloaded yet
2026-03-30 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC01628> (referer: https://www.auto1.com/v1/car-details-view/XC01628/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_c647af34af96fda0f3b74e0a44b6fd75.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_c647af34af96fda0f3b74e0a44b6fd75.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_5191cae64d5eef29e2f3dcc747590175.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_5191cae64d5eef29e2f3dcc747590175.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_4a27d30a3514adc82f63807e42de1f01.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_4a27d30a3514adc82f63807e42de1f01.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_41d30079cea070fbdc52561c76924b96.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_41d30079cea070fbdc52561c76924b96.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_f1d9c95503b1a28ad8cb2b4b16dcd347.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_f1d9c95503b1a28ad8cb2b4b16dcd347.jpg not downloaded yet
2026-03-30 10:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c with identifier: XC01628
2026-03-30 10:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c with scrape type 1
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_0f69abe6aeffe3e146f0a0fc0c7f5a6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_0f69abe6aeffe3e146f0a0fc0c7f5a6d.jpg not downloaded yet
2026-03-30 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_6452175e8116766037d389b670d3b0d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_6452175e8116766037d389b670d3b0d7.jpg not downloaded yet
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_e9b9c4700bcaee0b474f86790350e81e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_e9b9c4700bcaee0b474f86790350e81e.jpg not downloaded yet
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_68632f81df27b1c2a16fa3adbc0b08e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_68632f81df27b1c2a16fa3adbc0b08e0.jpg not downloaded yet
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_c647af34af96fda0f3b74e0a44b6fd75.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_70077c03a795d10012632a493ed6847f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_70077c03a795d10012632a493ed6847f.jpg not downloaded yet
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_9b920bb75e791d48be5c01da6e4865a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_9b920bb75e791d48be5c01da6e4865a2.jpg not downloaded yet
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_109bb8efe19bffcd6106a34f0fd87094.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_109bb8efe19bffcd6106a34f0fd87094.jpg not downloaded yet
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_5191cae64d5eef29e2f3dcc747590175.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_779dd2ef5358fee9d40963fd5963c941.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_6b32df681569f6de36b2107115d1886a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_6b32df681569f6de36b2107115d1886a.jpg not downloaded yet
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_b8a6d2c90c6147e541c72d21bff80dba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_b8a6d2c90c6147e541c72d21bff80dba.jpg not downloaded yet
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_6ba5b9a1e87023db6ba54b7789308e8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_6ba5b9a1e87023db6ba54b7789308e8c.jpg not downloaded yet
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5047690>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_c647af34af96fda0f3b74e0a44b6fd75.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_c647af34af96fda0f3b74e0a44b6fd75.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 386fa05f-9193-5085-b8d2-c57f89d0ba45
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50ff2d0>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_5191cae64d5eef29e2f3dcc747590175.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_5191cae64d5eef29e2f3dcc747590175.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 386fa05f-9193-5085-b8d2-c57f89d0ba45
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595e4d0>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_779dd2ef5358fee9d40963fd5963c941.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_779dd2ef5358fee9d40963fd5963c941.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 386fa05f-9193-5085-b8d2-c57f89d0ba45
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_4a27d30a3514adc82f63807e42de1f01.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_71387263c26a73f66bd8ca70d5a947e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_41d30079cea070fbdc52561c76924b96.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_b668007b1e0bb420fe448158b61152e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_5664f8591247d19f14f70937135725cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_f58159fda67dfaafe76c6bdb7ffdf8e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_e9b9c4700bcaee0b474f86790350e81e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_f1d9c95503b1a28ad8cb2b4b16dcd347.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c17d0>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_4a27d30a3514adc82f63807e42de1f01.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_4a27d30a3514adc82f63807e42de1f01.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 386fa05f-9193-5085-b8d2-c57f89d0ba45
2026-03-30 10:35:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b1090>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_71387263c26a73f66bd8ca70d5a947e3.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_71387263c26a73f66bd8ca70d5a947e3.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 386fa05f-9193-5085-b8d2-c57f89d0ba45
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50d66d0>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_41d30079cea070fbdc52561c76924b96.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_41d30079cea070fbdc52561c76924b96.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 386fa05f-9193-5085-b8d2-c57f89d0ba45
2026-03-30 10:35:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595e850>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_b668007b1e0bb420fe448158b61152e8.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_b668007b1e0bb420fe448158b61152e8.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 386fa05f-9193-5085-b8d2-c57f89d0ba45
2026-03-30 10:35:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ffcbd0>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_5664f8591247d19f14f70937135725cd.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_5664f8591247d19f14f70937135725cd.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 386fa05f-9193-5085-b8d2-c57f89d0ba45
2026-03-30 10:35:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fef210>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_f58159fda67dfaafe76c6bdb7ffdf8e7.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_f58159fda67dfaafe76c6bdb7ffdf8e7.jpg saved to cache
2026-03-30 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 386fa05f-9193-5085-b8d2-c57f89d0ba45
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ae2ad0>
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_e9b9c4700bcaee0b474f86790350e81e.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_e9b9c4700bcaee0b474f86790350e81e.jpg saved to cache
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ff53d0>
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F86%252Fca864ab8134911b227db4de709c67bbf%252Fpa%252FUK15244_f1d9c95503b1a28ad8cb2b4b16dcd347.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_f1d9c95503b1a28ad8cb2b4b16dcd347.jpg saved to cache
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 386fa05f-9193-5085-b8d2-c57f89d0ba45
2026-03-30 10:35:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 386fa05f-9193-5085-b8d2-c57f89d0ba45, skipping ID generation
2026-03-30 10:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 386fa05f-9193-5085-b8d2-c57f89d0ba45 with scrape type 1
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 386fa05f-9193-5085-b8d2-c57f89d0ba45 sending to next pipeline
2026-03-30 10:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 386fa05f-9193-5085-b8d2-c57f89d0ba45, identifier: UK15244
2026-03-30 10:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 386fa05f-9193-5085-b8d2-c57f89d0ba45 with identifier: UK15244
2026-03-30 10:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 386fa05f-9193-5085-b8d2-c57f89d0ba45 with identifier: UK15244
2026-03-30 10:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 386fa05f-9193-5085-b8d2-c57f89d0ba45 with identifier: UK15244 to the API
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_f1d9c95503b1a28ad8cb2b4b16dcd347.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:15:21Z',
 'fuel_type': 'petrol',
 'id': '386fa05f-9193-5085-b8d2-c57f89d0ba45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK15244',
 'listing': 'auction',
 'location': 'DE, Leipzig',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 167430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2786247,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_b668007b1e0bb420fe448158b61152e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2597257,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_71387263c26a73f66bd8ca70d5a947e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2735928,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_5664f8591247d19f14f70937135725cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2744471,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_f58159fda67dfaafe76c6bdb7ffdf8e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_779dd2ef5358fee9d40963fd5963c941.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_c647af34af96fda0f3b74e0a44b6fd75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_5191cae64d5eef29e2f3dcc747590175.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_4a27d30a3514adc82f63807e42de1f01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_41d30079cea070fbdc52561c76924b96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_386fa05f-9193-5085-b8d2-c57f89d0ba45/386fa05f-9193-5085-b8d2-c57f89d0ba45_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/86/ca864ab8134911b227db4de709c67bbf/pa/UK15244_f1d9c95503b1a28ad8cb2b4b16dcd347.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK15244%27 HTTP/1.1" 200 None
2026-03-30 10:35:55 [auto1.de] INFO: Saving data for UK15244: {'created_time': 1774866955.55205, 'last_price_update_time': 1774866955.552059, 'auction_closing_time': 1774970121.0}
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK15244') HTTP/1.1" 204 0
2026-03-30 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_109bb8efe19bffcd6106a34f0fd87094.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_6ba5b9a1e87023db6ba54b7789308e8c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR51220> (referer: https://www.auto1.com/v1/car-details-view/VR51220/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EZ41546> (referer: https://www.auto1.com/v1/car-details-view/EZ41546/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_9b920bb75e791d48be5c01da6e4865a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_b8a6d2c90c6147e541c72d21bff80dba.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_6b32df681569f6de36b2107115d1886a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_0f69abe6aeffe3e146f0a0fc0c7f5a6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5113050>
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_109bb8efe19bffcd6106a34f0fd87094.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_109bb8efe19bffcd6106a34f0fd87094.jpg saved to cache
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5111e50>
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_6ba5b9a1e87023db6ba54b7789308e8c.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_6ba5b9a1e87023db6ba54b7789308e8c.jpg saved to cache
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c
2026-03-30 10:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9888aec1-be8b-5c30-8542-b48961599656 with identifier: VR51220
2026-03-30 10:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9888aec1-be8b-5c30-8542-b48961599656 with scrape type 1
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9888aec1-be8b-5c30-8542-b48961599656
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fe0%252Fa8e073620765f45aa8fe9f9c93342972%252Fpa%252FVR51220_b2345adcd33d7826a572a8b7d4592a08.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_b2345adcd33d7826a572a8b7d4592a08.jpg not downloaded yet
2026-03-30 10:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c744d56-ba62-5b0b-bd66-f71c3a7a90dc with identifier: EZ41546
2026-03-30 10:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c744d56-ba62-5b0b-bd66-f71c3a7a90dc with scrape type 1
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4c744d56-ba62-5b0b-bd66-f71c3a7a90dc
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F69%252F446998100fea91b2d7641f9b5bfc429c%252Fpa%252FEZ41546_c814dd7f3c46e6e417f7c83c195de2d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_c814dd7f3c46e6e417f7c83c195de2d7.jpg not downloaded yet
2026-03-30 10:35:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50d4410>
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_9b920bb75e791d48be5c01da6e4865a2.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_9b920bb75e791d48be5c01da6e4865a2.jpg saved to cache
2026-03-30 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c
2026-03-30 10:35:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fed890>
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_b8a6d2c90c6147e541c72d21bff80dba.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_b8a6d2c90c6147e541c72d21bff80dba.jpg saved to cache
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c
2026-03-30 10:35:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5093b90>
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_6b32df681569f6de36b2107115d1886a.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_6b32df681569f6de36b2107115d1886a.jpg saved to cache
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fe0%252Fa8e073620765f45aa8fe9f9c93342972%252Fpa%252FVR51220_76aa8da15edf3c3f9b7298b68096358f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_76aa8da15edf3c3f9b7298b68096358f.jpg not downloaded yet
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F69%252F446998100fea91b2d7641f9b5bfc429c%252Fpa%252FEZ41546_75e000395e99a8fca5c84621ec653502.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_75e000395e99a8fca5c84621ec653502.jpg not downloaded yet
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_68632f81df27b1c2a16fa3adbc0b08e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_6452175e8116766037d389b670d3b0d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fe0%252Fa8e073620765f45aa8fe9f9c93342972%252Fpa%252FVR51220_5ad76005fb1a9cb75a5fcdc5f4c82baf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_5ad76005fb1a9cb75a5fcdc5f4c82baf.jpg not downloaded yet
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F69%252F446998100fea91b2d7641f9b5bfc429c%252Fpa%252FEZ41546_20d3da3be792dd615b3aaa7a7b8e2d48.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_20d3da3be792dd615b3aaa7a7b8e2d48.jpg not downloaded yet
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef511a850>
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_0f69abe6aeffe3e146f0a0fc0c7f5a6d.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_0f69abe6aeffe3e146f0a0fc0c7f5a6d.jpg saved to cache
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fe0%252Fa8e073620765f45aa8fe9f9c93342972%252Fpa%252FVR51220_53f6eb3f5c31205d622717da90fd0e40.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_53f6eb3f5c31205d622717da90fd0e40.jpg not downloaded yet
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F69%252F446998100fea91b2d7641f9b5bfc429c%252Fpa%252FEZ41546_30b9d593abf4a8f0fd8188858e1462ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_30b9d593abf4a8f0fd8188858e1462ac.jpg not downloaded yet
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7cc6b10>
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_68632f81df27b1c2a16fa3adbc0b08e0.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_68632f81df27b1c2a16fa3adbc0b08e0.jpg saved to cache
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5981d10>
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_6452175e8116766037d389b670d3b0d7.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_6452175e8116766037d389b670d3b0d7.jpg saved to cache
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fe0%252Fa8e073620765f45aa8fe9f9c93342972%252Fpa%252FVR51220_b63ff8cd39c111c4fb6566fc158e6278.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_b63ff8cd39c111c4fb6566fc158e6278.jpg not downloaded yet
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F69%252F446998100fea91b2d7641f9b5bfc429c%252Fpa%252FEZ41546_d2bba7669b55504cd79eb40e079d1ce3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_d2bba7669b55504cd79eb40e079d1ce3.jpg not downloaded yet
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_c814dd7f3c46e6e417f7c83c195de2d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_b2345adcd33d7826a572a8b7d4592a08.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_75e000395e99a8fca5c84621ec653502.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_76aa8da15edf3c3f9b7298b68096358f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP27686> (referer: https://www.auto1.com/v1/car-details-view/SP27686/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_70077c03a795d10012632a493ed6847f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_d2bba7669b55504cd79eb40e079d1ce3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_b63ff8cd39c111c4fb6566fc158e6278.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_30b9d593abf4a8f0fd8188858e1462ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_20d3da3be792dd615b3aaa7a7b8e2d48.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6a010>
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c744d56-ba62-5b0b-bd66-f71c3a7a90dc/4c744d56-ba62-5b0b-bd66-f71c3a7a90dc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F69%252F446998100fea91b2d7641f9b5bfc429c%252Fpa%252FEZ41546_c814dd7f3c46e6e417f7c83c195de2d7.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_c814dd7f3c46e6e417f7c83c195de2d7.jpg saved to cache
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c744d56-ba62-5b0b-bd66-f71c3a7a90dc
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f6d490>
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9888aec1-be8b-5c30-8542-b48961599656/9888aec1-be8b-5c30-8542-b48961599656_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fe0%252Fa8e073620765f45aa8fe9f9c93342972%252Fpa%252FVR51220_b2345adcd33d7826a572a8b7d4592a08.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_b2345adcd33d7826a572a8b7d4592a08.jpg saved to cache
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9888aec1-be8b-5c30-8542-b48961599656
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f87310>
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c744d56-ba62-5b0b-bd66-f71c3a7a90dc/4c744d56-ba62-5b0b-bd66-f71c3a7a90dc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F69%252F446998100fea91b2d7641f9b5bfc429c%252Fpa%252FEZ41546_75e000395e99a8fca5c84621ec653502.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_75e000395e99a8fca5c84621ec653502.jpg saved to cache
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c744d56-ba62-5b0b-bd66-f71c3a7a90dc
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f70450>
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9888aec1-be8b-5c30-8542-b48961599656/9888aec1-be8b-5c30-8542-b48961599656_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fe0%252Fa8e073620765f45aa8fe9f9c93342972%252Fpa%252FVR51220_76aa8da15edf3c3f9b7298b68096358f.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_76aa8da15edf3c3f9b7298b68096358f.jpg saved to cache
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9888aec1-be8b-5c30-8542-b48961599656
2026-03-30 10:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9d82534-e26b-5550-bb38-a6519415e144 with identifier: SP27686
2026-03-30 10:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9d82534-e26b-5550-bb38-a6519415e144 with scrape type 1
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9d82534-e26b-5550-bb38-a6519415e144
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_44ca527d5d7e11307893b5928b81892d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_44ca527d5d7e11307893b5928b81892d.jpg not downloaded yet
2026-03-30 10:35:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5116150>
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F19%252F1e19779b16c14e0252081d091db8eed7%252Fpa%252FXC01628_70077c03a795d10012632a493ed6847f.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_70077c03a795d10012632a493ed6847f.jpg saved to cache
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c
2026-03-30 10:35:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c, skipping ID generation
2026-03-30 10:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c with scrape type 1
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c sending to next pipeline
2026-03-30 10:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c, identifier: XC01628
2026-03-30 10:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c with identifier: XC01628
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 10:35:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c with identifier: XC01628
2026-03-30 10:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81bac62b-89fe-53f6-b6c2-9dd2d1158e4c with identifier: XC01628 to the API
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_70077c03a795d10012632a493ed6847f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:39:30Z',
 'fuel_type': 'hybrid',
 'id': '81bac62b-89fe-53f6-b6c2-9dd2d1158e4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC01628',
 'listing': 'auction',
 'location': 'DE, Darmstadt',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 15295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_0f69abe6aeffe3e146f0a0fc0c7f5a6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_6452175e8116766037d389b670d3b0d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_e9b9c4700bcaee0b474f86790350e81e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_68632f81df27b1c2a16fa3adbc0b08e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2838361,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_70077c03a795d10012632a493ed6847f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2737445,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_9b920bb75e791d48be5c01da6e4865a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_109bb8efe19bffcd6106a34f0fd87094.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2705250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_6b32df681569f6de36b2107115d1886a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2504704,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_b8a6d2c90c6147e541c72d21bff80dba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bac62b-89fe-53f6-b6c2-9dd2d1158e4c/81bac62b-89fe-53f6-b6c2-9dd2d1158e4c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/19/1e19779b16c14e0252081d091db8eed7/pa/XC01628_6ba5b9a1e87023db6ba54b7789308e8c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid Prime 4WD',
 'transmission': 'automatic',
 'trim': 'Prime 4WD',
 'year': 2023}
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC01628%27 HTTP/1.1" 200 None
2026-03-30 10:35:57 [auto1.de] INFO: Saving data for XC01628: {'created_time': 1774866957.842592, 'last_price_update_time': 1774866957.842601, 'auction_closing_time': 1774971570.0}
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC01628') HTTP/1.1" 204 0
2026-03-30 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_53f6eb3f5c31205d622717da90fd0e40.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_a984e146df6016e019471ab5aa925512.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_a984e146df6016e019471ab5aa925512.jpg not downloaded yet
2026-03-30 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_5ad76005fb1a9cb75a5fcdc5f4c82baf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5117c50>
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c744d56-ba62-5b0b-bd66-f71c3a7a90dc/4c744d56-ba62-5b0b-bd66-f71c3a7a90dc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F69%252F446998100fea91b2d7641f9b5bfc429c%252Fpa%252FEZ41546_d2bba7669b55504cd79eb40e079d1ce3.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_d2bba7669b55504cd79eb40e079d1ce3.jpg saved to cache
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c744d56-ba62-5b0b-bd66-f71c3a7a90dc
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a26010>
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9888aec1-be8b-5c30-8542-b48961599656/9888aec1-be8b-5c30-8542-b48961599656_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fe0%252Fa8e073620765f45aa8fe9f9c93342972%252Fpa%252FVR51220_b63ff8cd39c111c4fb6566fc158e6278.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_b63ff8cd39c111c4fb6566fc158e6278.jpg saved to cache
2026-03-30 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9888aec1-be8b-5c30-8542-b48961599656
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb03d0>
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c744d56-ba62-5b0b-bd66-f71c3a7a90dc/4c744d56-ba62-5b0b-bd66-f71c3a7a90dc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F69%252F446998100fea91b2d7641f9b5bfc429c%252Fpa%252FEZ41546_30b9d593abf4a8f0fd8188858e1462ac.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_30b9d593abf4a8f0fd8188858e1462ac.jpg saved to cache
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c744d56-ba62-5b0b-bd66-f71c3a7a90dc
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a27410>
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c744d56-ba62-5b0b-bd66-f71c3a7a90dc/4c744d56-ba62-5b0b-bd66-f71c3a7a90dc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F69%252F446998100fea91b2d7641f9b5bfc429c%252Fpa%252FEZ41546_20d3da3be792dd615b3aaa7a7b8e2d48.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_20d3da3be792dd615b3aaa7a7b8e2d48.jpg saved to cache
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c744d56-ba62-5b0b-bd66-f71c3a7a90dc
2026-03-30 10:35:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c744d56-ba62-5b0b-bd66-f71c3a7a90dc, skipping ID generation
2026-03-30 10:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c744d56-ba62-5b0b-bd66-f71c3a7a90dc with scrape type 1
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c744d56-ba62-5b0b-bd66-f71c3a7a90dc sending to next pipeline
2026-03-30 10:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c744d56-ba62-5b0b-bd66-f71c3a7a90dc, identifier: EZ41546
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_2bc84695772c34a7c54efaa99540ea63.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_2bc84695772c34a7c54efaa99540ea63.jpg not downloaded yet
2026-03-30 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c744d56-ba62-5b0b-bd66-f71c3a7a90dc with identifier: EZ41546
2026-03-30 10:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c744d56-ba62-5b0b-bd66-f71c3a7a90dc with identifier: EZ41546
2026-03-30 10:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c744d56-ba62-5b0b-bd66-f71c3a7a90dc with identifier: EZ41546 to the API
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_20d3da3be792dd615b3aaa7a7b8e2d48.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:13:36Z',
 'fuel_type': 'petrol',
 'id': '4c744d56-ba62-5b0b-bd66-f71c3a7a90dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ41546',
 'listing': 'auction',
 'location': 'DE, Mainz',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 136868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c744d56-ba62-5b0b-bd66-f71c3a7a90dc/4c744d56-ba62-5b0b-bd66-f71c3a7a90dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_c814dd7f3c46e6e417f7c83c195de2d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c744d56-ba62-5b0b-bd66-f71c3a7a90dc/4c744d56-ba62-5b0b-bd66-f71c3a7a90dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_75e000395e99a8fca5c84621ec653502.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c744d56-ba62-5b0b-bd66-f71c3a7a90dc/4c744d56-ba62-5b0b-bd66-f71c3a7a90dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_20d3da3be792dd615b3aaa7a7b8e2d48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c744d56-ba62-5b0b-bd66-f71c3a7a90dc/4c744d56-ba62-5b0b-bd66-f71c3a7a90dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_30b9d593abf4a8f0fd8188858e1462ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c744d56-ba62-5b0b-bd66-f71c3a7a90dc/4c744d56-ba62-5b0b-bd66-f71c3a7a90dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/69/446998100fea91b2d7641f9b5bfc429c/pa/EZ41546_d2bba7669b55504cd79eb40e079d1ce3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1999-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition 100',
 'transmission': 'manual',
 'trim': 'Edition 100',
 'year': 1999}
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ41546%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [auto1.de] INFO: Saving data for EZ41546: {'created_time': 1774866958.577803, 'last_price_update_time': 1774866958.577813, 'auction_closing_time': 1774970016.0}
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ41546') HTTP/1.1" 204 0
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_1e9b43775e2e132316ed4767e73340d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_1e9b43775e2e132316ed4767e73340d6.jpg not downloaded yet
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5aac250>
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9888aec1-be8b-5c30-8542-b48961599656/9888aec1-be8b-5c30-8542-b48961599656_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fe0%252Fa8e073620765f45aa8fe9f9c93342972%252Fpa%252FVR51220_53f6eb3f5c31205d622717da90fd0e40.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_53f6eb3f5c31205d622717da90fd0e40.jpg saved to cache
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9888aec1-be8b-5c30-8542-b48961599656
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fbb410>
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9888aec1-be8b-5c30-8542-b48961599656/9888aec1-be8b-5c30-8542-b48961599656_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fe0%252Fa8e073620765f45aa8fe9f9c93342972%252Fpa%252FVR51220_5ad76005fb1a9cb75a5fcdc5f4c82baf.jpg') HTTP/1.1" 204 0
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_5ad76005fb1a9cb75a5fcdc5f4c82baf.jpg saved to cache
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9888aec1-be8b-5c30-8542-b48961599656
2026-03-30 10:35:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9888aec1-be8b-5c30-8542-b48961599656, skipping ID generation
2026-03-30 10:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9888aec1-be8b-5c30-8542-b48961599656 with scrape type 1
2026-03-30 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9888aec1-be8b-5c30-8542-b48961599656 sending to next pipeline
2026-03-30 10:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9888aec1-be8b-5c30-8542-b48961599656, identifier: VR51220
2026-03-30 10:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9888aec1-be8b-5c30-8542-b48961599656 with identifier: VR51220
2026-03-30 10:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9888aec1-be8b-5c30-8542-b48961599656 with identifier: VR51220
2026-03-30 10:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9888aec1-be8b-5c30-8542-b48961599656 with identifier: VR51220 to the API
2026-03-30 10:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_5ad76005fb1a9cb75a5fcdc5f4c82baf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:25:54Z',
 'fuel_type': 'petrol',
 'id': '9888aec1-be8b-5c30-8542-b48961599656',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR51220',
 'listing': 'auction',
 'location': 'DE, Friedrichsdorf',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 103091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9888aec1-be8b-5c30-8542-b48961599656/9888aec1-be8b-5c30-8542-b48961599656_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_b2345adcd33d7826a572a8b7d4592a08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9888aec1-be8b-5c30-8542-b48961599656/9888aec1-be8b-5c30-8542-b48961599656_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_76aa8da15edf3c3f9b7298b68096358f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9888aec1-be8b-5c30-8542-b48961599656/9888aec1-be8b-5c30-8542-b48961599656_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_5ad76005fb1a9cb75a5fcdc5f4c82baf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9888aec1-be8b-5c30-8542-b48961599656/9888aec1-be8b-5c30-8542-b48961599656_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_53f6eb3f5c31205d622717da90fd0e40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9888aec1-be8b-5c30-8542-b48961599656/9888aec1-be8b-5c30-8542-b48961599656_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/e0/a8e073620765f45aa8fe9f9c93342972/pa/VR51220_b63ff8cd39c111c4fb6566fc158e6278.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Night & Day',
 'transmission': 'manual',
 'trim': 'Night & Day',
 'year': 2011}
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR51220%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [auto1.de] INFO: Saving data for VR51220: {'created_time': 1774866959.197903, 'last_price_update_time': 1774866959.197916, 'auction_closing_time': 1774970754.0}
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR51220') HTTP/1.1" 204 0
2026-03-30 10:35:59 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 9414 | hits on page: 40
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_da8d43b1621ec625b3f5f18b8d9f13d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_da8d43b1621ec625b3f5f18b8d9f13d1.jpg not downloaded yet
2026-03-30 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_44ca527d5d7e11307893b5928b81892d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:35:59 [auto1.de] INFO: Found listing with ID: RB95028
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB95028%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [auto1.de] INFO: Scrape type for RB95028: 0
2026-03-30 10:35:59 [auto1.de] INFO: Found listing with ID: HJ44005
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ44005%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [auto1.de] INFO: Scrape type for HJ44005: 0
2026-03-30 10:35:59 [auto1.de] INFO: Found listing with ID: ZT78115
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT78115%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [auto1.de] INFO: Scrape type for ZT78115: 1
2026-03-30 10:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_d1d9861fe22f8b238eec2dfb7a146eb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_d1d9861fe22f8b238eec2dfb7a146eb5.jpg not downloaded yet
2026-03-30 10:35:59 [auto1.de] INFO: Found listing with ID: NC73719
2026-03-30 10:35:59 [auto1.de] INFO: Found listing with ID: NV34927
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV34927%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [auto1.de] INFO: Scrape type for NV34927: 1
2026-03-30 10:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_77ea32557f9c41726d70bace3b10a555.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_77ea32557f9c41726d70bace3b10a555.jpg not downloaded yet
2026-03-30 10:35:59 [auto1.de] INFO: Found listing with ID: MV50915
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV50915%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [auto1.de] INFO: Scrape type for MV50915: 2
2026-03-30 10:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71756da2-60f0-56b7-9754-9f1a59c63dd8 with identifier: MV50915
2026-03-30 10:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71756da2-60f0-56b7-9754-9f1a59c63dd8 with scrape type 2
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71756da2-60f0-56b7-9754-9f1a59c63dd8 with scrape type 2
2026-03-30 10:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71756da2-60f0-56b7-9754-9f1a59c63dd8, identifier: MV50915
2026-03-30 10:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_2aa9966a2a5d91f8fcd2fde2861535eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_2aa9966a2a5d91f8fcd2fde2861535eb.jpg not downloaded yet
2026-03-30 10:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71756da2-60f0-56b7-9754-9f1a59c63dd8 with identifier: MV50915
2026-03-30 10:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71756da2-60f0-56b7-9754-9f1a59c63dd8 with identifier: MV50915
2026-03-30 10:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71756da2-60f0-56b7-9754-9f1a59c63dd8 with identifier: MV50915 to the API
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:13:22Z',
 'fuel_type': 'diesel',
 'id': '71756da2-60f0-56b7-9754-9f1a59c63dd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV50915',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 160833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-15',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Business Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Start/Stop',
 'year': 2019}
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV50915%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [auto1.de] INFO: Saving data for MV50915: {'auction_closing_time': 1774970002.0, 'created_time': 1774263868.248907, 'last_price_update_time': 1774866959.879839}
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV50915') HTTP/1.1" 204 0
2026-03-30 10:35:59 [auto1.de] INFO: Found listing with ID: BA33674
2026-03-30 10:35:59 [auto1.de] INFO: Found listing with ID: RE71978
2026-03-30 10:35:59 [auto1.de] INFO: Found listing with ID: GE19068
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE19068%27 HTTP/1.1" 200 None
2026-03-30 10:35:59 [auto1.de] INFO: Scrape type for GE19068: 1
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5974710>
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_44ca527d5d7e11307893b5928b81892d.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_44ca527d5d7e11307893b5928b81892d.jpg saved to cache
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9d82534-e26b-5550-bb38-a6519415e144
2026-03-30 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_da8d43b1621ec625b3f5f18b8d9f13d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_d1d9861fe22f8b238eec2dfb7a146eb5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_7cb34828353e4320624b82e37e9e95cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_7cb34828353e4320624b82e37e9e95cc.jpg not downloaded yet
2026-03-30 10:36:00 [auto1.de] INFO: Found listing with ID: FA89686
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA89686%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [auto1.de] INFO: Scrape type for FA89686: 2
2026-03-30 10:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 247476db-d9a4-5ee1-ab82-02c4be2bda40 with identifier: FA89686
2026-03-30 10:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 247476db-d9a4-5ee1-ab82-02c4be2bda40 with scrape type 2
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 247476db-d9a4-5ee1-ab82-02c4be2bda40 with scrape type 2
2026-03-30 10:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 247476db-d9a4-5ee1-ab82-02c4be2bda40, identifier: FA89686
2026-03-30 10:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_0ad3b312a74b354933d2dfcbb4c47292.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_0ad3b312a74b354933d2dfcbb4c47292.jpg not downloaded yet
2026-03-30 10:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 247476db-d9a4-5ee1-ab82-02c4be2bda40 with identifier: FA89686
2026-03-30 10:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 247476db-d9a4-5ee1-ab82-02c4be2bda40 with identifier: FA89686
2026-03-30 10:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 247476db-d9a4-5ee1-ab82-02c4be2bda40 with identifier: FA89686 to the API
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:58:31Z',
 'fuel_type': 'diesel',
 'id': '247476db-d9a4-5ee1-ab82-02c4be2bda40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA89686',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 203708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-25',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2015}
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA89686%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [auto1.de] INFO: Saving data for FA89686: {'auction_closing_time': 1774972711.0, 'created_time': 1773225888.089096, 'last_price_update_time': 1774866960.551318}
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA89686') HTTP/1.1" 204 0
2026-03-30 10:36:00 [auto1.de] INFO: Found listing with ID: SR78906
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR78906%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [auto1.de] INFO: Scrape type for SR78906: 1
2026-03-30 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_77ea32557f9c41726d70bace3b10a555.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_2aa9966a2a5d91f8fcd2fde2861535eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN17481> (referer: https://www.auto1.com/v1/car-details-view/CN17481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:00 [auto1.de] INFO: Found listing with ID: AA01285
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA01285%27 HTTP/1.1" 200 None
2026-03-30 10:36:00 [auto1.de] INFO: Scrape type for AA01285: 2
2026-03-30 10:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4735cce-4b52-581d-9bc8-5f499bfead0f with identifier: AA01285
2026-03-30 10:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4735cce-4b52-581d-9bc8-5f499bfead0f with scrape type 2
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4735cce-4b52-581d-9bc8-5f499bfead0f with scrape type 2
2026-03-30 10:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4735cce-4b52-581d-9bc8-5f499bfead0f, identifier: AA01285
2026-03-30 10:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b28390>
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_da8d43b1621ec625b3f5f18b8d9f13d1.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_da8d43b1621ec625b3f5f18b8d9f13d1.jpg saved to cache
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9d82534-e26b-5550-bb38-a6519415e144
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5995b90>
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_d1d9861fe22f8b238eec2dfb7a146eb5.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_d1d9861fe22f8b238eec2dfb7a146eb5.jpg saved to cache
2026-03-30 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9d82534-e26b-5550-bb38-a6519415e144
2026-03-30 10:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4735cce-4b52-581d-9bc8-5f499bfead0f with identifier: AA01285
2026-03-30 10:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4735cce-4b52-581d-9bc8-5f499bfead0f with identifier: AA01285
2026-03-30 10:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4735cce-4b52-581d-9bc8-5f499bfead0f with identifier: AA01285 to the API
2026-03-30 10:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:17:09Z',
 'fuel_type': 'diesel',
 'id': 'e4735cce-4b52-581d-9bc8-5f499bfead0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA01285',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 191968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-28',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2014}
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA01285%27 HTTP/1.1" 200 None
2026-03-30 10:36:01 [auto1.de] INFO: Saving data for AA01285: {'auction_closing_time': 1774970229.0, 'created_time': 1774291174.869122, 'last_price_update_time': 1774866961.188413}
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA01285') HTTP/1.1" 204 0
2026-03-30 10:36:01 [auto1.de] INFO: Found listing with ID: CJ96583
2026-03-30 10:36:01 [auto1.de] INFO: Found listing with ID: MJ14379
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ14379%27 HTTP/1.1" 200 None
2026-03-30 10:36:01 [auto1.de] INFO: Scrape type for MJ14379: 1
2026-03-30 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT78115/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV34927/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a75fd0>
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_77ea32557f9c41726d70bace3b10a555.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_77ea32557f9c41726d70bace3b10a555.jpg saved to cache
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9d82534-e26b-5550-bb38-a6519415e144
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595da50>
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_2aa9966a2a5d91f8fcd2fde2861535eb.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_2aa9966a2a5d91f8fcd2fde2861535eb.jpg saved to cache
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9d82534-e26b-5550-bb38-a6519415e144
2026-03-30 10:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a5d3e6-2189-5fa0-a74f-3026bbae39b0 with identifier: CN17481
2026-03-30 10:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a5d3e6-2189-5fa0-a74f-3026bbae39b0 with scrape type 1
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40a5d3e6-2189-5fa0-a74f-3026bbae39b0
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F43%252F7443404d2915a30d6b134a8c1cc7ee28%252Fpa%252FCN17481_9654f78dd24f31b528431c7439e2bd61.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_9654f78dd24f31b528431c7439e2bd61.jpg already downloaded
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F43%252F7443404d2915a30d6b134a8c1cc7ee28%252Fpa%252FCN17481_b17ba5df812ab5a2c19b9c921dab1e4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_b17ba5df812ab5a2c19b9c921dab1e4b.jpg already downloaded
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F43%252F7443404d2915a30d6b134a8c1cc7ee28%252Fpa%252FCN17481_13e4561a2ba368f5793ba28ce219bab2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_13e4561a2ba368f5793ba28ce219bab2.jpg already downloaded
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F43%252F7443404d2915a30d6b134a8c1cc7ee28%252Fpa%252FCN17481_1e4e30df5afc9861f3e4e2517e1c08c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_1e4e30df5afc9861f3e4e2517e1c08c8.jpg already downloaded
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F43%252F7443404d2915a30d6b134a8c1cc7ee28%252Fpa%252FCN17481_14ececc04d0ff483260fc83f34cd33b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_14ececc04d0ff483260fc83f34cd33b0.jpg already downloaded
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F43%252F7443404d2915a30d6b134a8c1cc7ee28%252Fpa%252FCN17481_d22ff5928da67a06ba0776ab0c60e9ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_d22ff5928da67a06ba0776ab0c60e9ca.jpg already downloaded
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F43%252F7443404d2915a30d6b134a8c1cc7ee28%252Fpa%252FCN17481_4ae938e9ddb17705e6ce7d82e41bc427.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_4ae938e9ddb17705e6ce7d82e41bc427.jpg already downloaded
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F43%252F7443404d2915a30d6b134a8c1cc7ee28%252Fpa%252FCN17481_1f45bdd5640fa288d3cc391e92357bea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_1f45bdd5640fa288d3cc391e92357bea.jpg already downloaded
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F43%252F7443404d2915a30d6b134a8c1cc7ee28%252Fpa%252FCN17481_1eb38d23a4dea451574e13e2665bc398.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_1eb38d23a4dea451574e13e2665bc398.jpg already downloaded
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F43%252F7443404d2915a30d6b134a8c1cc7ee28%252Fpa%252FCN17481_d95d4e07eb4b97c8e3c5276172aefce6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_d95d4e07eb4b97c8e3c5276172aefce6.jpg already downloaded
2026-03-30 10:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40a5d3e6-2189-5fa0-a74f-3026bbae39b0, identifier: CN17481
2026-03-30 10:36:01 [auto1.de] INFO: Found listing with ID: AC44957
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC44957%27 HTTP/1.1" 200 None
2026-03-30 10:36:01 [auto1.de] INFO: Scrape type for AC44957: 1
2026-03-30 10:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40a5d3e6-2189-5fa0-a74f-3026bbae39b0 with identifier: CN17481
2026-03-30 10:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40a5d3e6-2189-5fa0-a74f-3026bbae39b0 with identifier: CN17481
2026-03-30 10:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40a5d3e6-2189-5fa0-a74f-3026bbae39b0 with identifier: CN17481 to the API
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CN17481>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:34:33Z',
 'fuel_type': 'petrol',
 'id': '40a5d3e6-2189-5fa0-a74f-3026bbae39b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN17481',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 17064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_9654f78dd24f31b528431c7439e2bd61.jpg',
                'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_b17ba5df812ab5a2c19b9c921dab1e4b.jpg',
                'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_13e4561a2ba368f5793ba28ce219bab2.jpg',
                'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_1e4e30df5afc9861f3e4e2517e1c08c8.jpg',
                'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_14ececc04d0ff483260fc83f34cd33b0.jpg',
                'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_d22ff5928da67a06ba0776ab0c60e9ca.jpg',
                'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_4ae938e9ddb17705e6ce7d82e41bc427.jpg',
                'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_1f45bdd5640fa288d3cc391e92357bea.jpg',
                'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_1eb38d23a4dea451574e13e2665bc398.jpg',
                'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_d95d4e07eb4b97c8e3c5276172aefce6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a5d3e6-2189-5fa0-a74f-3026bbae39b0/40a5d3e6-2189-5fa0-a74f-3026bbae39b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2750116,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_9654f78dd24f31b528431c7439e2bd61.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a5d3e6-2189-5fa0-a74f-3026bbae39b0/40a5d3e6-2189-5fa0-a74f-3026bbae39b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_b17ba5df812ab5a2c19b9c921dab1e4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a5d3e6-2189-5fa0-a74f-3026bbae39b0/40a5d3e6-2189-5fa0-a74f-3026bbae39b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_13e4561a2ba368f5793ba28ce219bab2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a5d3e6-2189-5fa0-a74f-3026bbae39b0/40a5d3e6-2189-5fa0-a74f-3026bbae39b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2614438,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_1e4e30df5afc9861f3e4e2517e1c08c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a5d3e6-2189-5fa0-a74f-3026bbae39b0/40a5d3e6-2189-5fa0-a74f-3026bbae39b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_14ececc04d0ff483260fc83f34cd33b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a5d3e6-2189-5fa0-a74f-3026bbae39b0/40a5d3e6-2189-5fa0-a74f-3026bbae39b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_d22ff5928da67a06ba0776ab0c60e9ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a5d3e6-2189-5fa0-a74f-3026bbae39b0/40a5d3e6-2189-5fa0-a74f-3026bbae39b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_4ae938e9ddb17705e6ce7d82e41bc427.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a5d3e6-2189-5fa0-a74f-3026bbae39b0/40a5d3e6-2189-5fa0-a74f-3026bbae39b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_1f45bdd5640fa288d3cc391e92357bea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a5d3e6-2189-5fa0-a74f-3026bbae39b0/40a5d3e6-2189-5fa0-a74f-3026bbae39b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_1eb38d23a4dea451574e13e2665bc398.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a5d3e6-2189-5fa0-a74f-3026bbae39b0/40a5d3e6-2189-5fa0-a74f-3026bbae39b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/43/7443404d2915a30d6b134a8c1cc7ee28/pa/CN17481_d95d4e07eb4b97c8e3c5276172aefce6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-08-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2024}
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN17481%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [auto1.de] INFO: Saving data for CN17481: {'created_time': 1774866962.094519, 'last_price_update_time': 1774866962.094531, 'auction_closing_time': 1774971273.0}
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN17481') HTTP/1.1" 204 0
2026-03-30 10:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_0ad3b312a74b354933d2dfcbb4c47292.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:02 [auto1.de] INFO: Found listing with ID: AT48689
2026-03-30 10:36:02 [auto1.de] INFO: Found listing with ID: LA60747
2026-03-30 10:36:02 [auto1.de] INFO: Found listing with ID: RL05361
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL05361%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [auto1.de] INFO: Scrape type for RL05361: 1
2026-03-30 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE19068/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB62051> (referer: https://www.auto1.com/v1/car-details-view/KB62051/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:02 [auto1.de] INFO: Found listing with ID: FY79679
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY79679%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [auto1.de] INFO: Scrape type for FY79679: 1
2026-03-30 10:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:02 [auto1.de] INFO: Found listing with ID: GL90573
2026-03-30 10:36:02 [auto1.de] INFO: Found listing with ID: UA27050
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA27050%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [auto1.de] INFO: Scrape type for UA27050: 1
2026-03-30 10:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:02 [auto1.de] INFO: Found listing with ID: ZB67475
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB67475%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [auto1.de] INFO: Scrape type for ZB67475: 2
2026-03-30 10:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 706b4efb-7606-5b0f-9f18-15891624c961 with identifier: ZB67475
2026-03-30 10:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 706b4efb-7606-5b0f-9f18-15891624c961 with scrape type 2
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 706b4efb-7606-5b0f-9f18-15891624c961 with scrape type 2
2026-03-30 10:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 706b4efb-7606-5b0f-9f18-15891624c961, identifier: ZB67475
2026-03-30 10:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 706b4efb-7606-5b0f-9f18-15891624c961 with identifier: ZB67475
2026-03-30 10:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 706b4efb-7606-5b0f-9f18-15891624c961 with identifier: ZB67475
2026-03-30 10:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 706b4efb-7606-5b0f-9f18-15891624c961 with identifier: ZB67475 to the API
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:07:23Z',
 'fuel_type': 'petrol',
 'id': '706b4efb-7606-5b0f-9f18-15891624c961',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB67475',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 73786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-09',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB67475%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [auto1.de] INFO: Saving data for ZB67475: {'auction_closing_time': 1774969643.0, 'created_time': 1773726130.463136, 'last_price_update_time': 1774866962.698891}
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB67475') HTTP/1.1" 204 0
2026-03-30 10:36:02 [auto1.de] INFO: Found listing with ID: AF24454
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF24454%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [auto1.de] INFO: Scrape type for AF24454: 1
2026-03-30 10:36:02 [auto1.de] INFO: Found listing with ID: VU63296
2026-03-30 10:36:02 [auto1.de] INFO: Found listing with ID: PG43779
2026-03-30 10:36:02 [auto1.de] INFO: Found listing with ID: RM26402
2026-03-30 10:36:02 [auto1.de] INFO: Found listing with ID: RY19910
2026-03-30 10:36:02 [auto1.de] INFO: Found listing with ID: LR52017
2026-03-30 10:36:02 [auto1.de] INFO: Found listing with ID: AC30992
2026-03-30 10:36:02 [auto1.de] INFO: Found listing with ID: ZE05106
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE05106%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [auto1.de] INFO: Scrape type for ZE05106: 1
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6e710>
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_0ad3b312a74b354933d2dfcbb4c47292.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_0ad3b312a74b354933d2dfcbb4c47292.jpg saved to cache
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9d82534-e26b-5550-bb38-a6519415e144
2026-03-30 10:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5c09cc3-3d22-5690-abed-9093d96442b3 with identifier: KB62051
2026-03-30 10:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5c09cc3-3d22-5690-abed-9093d96442b3 with scrape type 1
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5c09cc3-3d22-5690-abed-9093d96442b3
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd2%252Fa4d249d67a8de0f12b9d2973353cec6f%252Fpa%252FKB62051_7aecba9118e797d90cd7dac4dc2639ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_7aecba9118e797d90cd7dac4dc2639ba.jpg already downloaded
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd2%252Fa4d249d67a8de0f12b9d2973353cec6f%252Fpa%252FKB62051_0abe3398aa10b23947f8edc3e45046f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_0abe3398aa10b23947f8edc3e45046f0.jpg already downloaded
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd2%252Fa4d249d67a8de0f12b9d2973353cec6f%252Fpa%252FKB62051_ac674636ca5492da95c29ee17704f9c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_ac674636ca5492da95c29ee17704f9c9.jpg already downloaded
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd2%252Fa4d249d67a8de0f12b9d2973353cec6f%252Fpa%252FKB62051_64609c08cdad7d78c58ea85e7fda946b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_64609c08cdad7d78c58ea85e7fda946b.jpg already downloaded
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd2%252Fa4d249d67a8de0f12b9d2973353cec6f%252Fpa%252FKB62051_62a31f55894ddb7aadd00e9361f4f7e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_62a31f55894ddb7aadd00e9361f4f7e5.jpg already downloaded
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd2%252Fa4d249d67a8de0f12b9d2973353cec6f%252Fpa%252FKB62051_ae0d7c9850510374b5e47aeee1e6cbfd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_ae0d7c9850510374b5e47aeee1e6cbfd.jpg already downloaded
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd2%252Fa4d249d67a8de0f12b9d2973353cec6f%252Fpa%252FKB62051_29ed74088b55d48460c99442657ae113.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_29ed74088b55d48460c99442657ae113.jpg already downloaded
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd2%252Fa4d249d67a8de0f12b9d2973353cec6f%252Fpa%252FKB62051_ba102d6578cd5f0279dcaf1d7fa68660.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_ba102d6578cd5f0279dcaf1d7fa68660.jpg already downloaded
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd2%252Fa4d249d67a8de0f12b9d2973353cec6f%252Fpa%252FKB62051_b702f7dc16ed0ae2c1a2531c7a89e1e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_b702f7dc16ed0ae2c1a2531c7a89e1e8.jpg already downloaded
2026-03-30 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd2%252Fa4d249d67a8de0f12b9d2973353cec6f%252Fpa%252FKB62051_c102e0ffce237e3cb8fd1a3a0e1f3cce.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_c102e0ffce237e3cb8fd1a3a0e1f3cce.jpg already downloaded
2026-03-30 10:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5c09cc3-3d22-5690-abed-9093d96442b3, identifier: KB62051
2026-03-30 10:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5c09cc3-3d22-5690-abed-9093d96442b3 with identifier: KB62051
2026-03-30 10:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5c09cc3-3d22-5690-abed-9093d96442b3 with identifier: KB62051
2026-03-30 10:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5c09cc3-3d22-5690-abed-9093d96442b3 with identifier: KB62051 to the API
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KB62051>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:55:06Z',
 'fuel_type': 'petrol',
 'id': 'c5c09cc3-3d22-5690-abed-9093d96442b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB62051',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 29645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_7aecba9118e797d90cd7dac4dc2639ba.jpg',
                'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_0abe3398aa10b23947f8edc3e45046f0.jpg',
                'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_ac674636ca5492da95c29ee17704f9c9.jpg',
                'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_64609c08cdad7d78c58ea85e7fda946b.jpg',
                'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_62a31f55894ddb7aadd00e9361f4f7e5.jpg',
                'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_ae0d7c9850510374b5e47aeee1e6cbfd.jpg',
                'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_29ed74088b55d48460c99442657ae113.jpg',
                'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_ba102d6578cd5f0279dcaf1d7fa68660.jpg',
                'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_b702f7dc16ed0ae2c1a2531c7a89e1e8.jpg',
                'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_c102e0ffce237e3cb8fd1a3a0e1f3cce.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c09cc3-3d22-5690-abed-9093d96442b3/c5c09cc3-3d22-5690-abed-9093d96442b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2701676,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_7aecba9118e797d90cd7dac4dc2639ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c09cc3-3d22-5690-abed-9093d96442b3/c5c09cc3-3d22-5690-abed-9093d96442b3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2637996,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_0abe3398aa10b23947f8edc3e45046f0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c09cc3-3d22-5690-abed-9093d96442b3/c5c09cc3-3d22-5690-abed-9093d96442b3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_ac674636ca5492da95c29ee17704f9c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c09cc3-3d22-5690-abed-9093d96442b3/c5c09cc3-3d22-5690-abed-9093d96442b3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_64609c08cdad7d78c58ea85e7fda946b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c09cc3-3d22-5690-abed-9093d96442b3/c5c09cc3-3d22-5690-abed-9093d96442b3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2977652,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_62a31f55894ddb7aadd00e9361f4f7e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c09cc3-3d22-5690-abed-9093d96442b3/c5c09cc3-3d22-5690-abed-9093d96442b3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_ae0d7c9850510374b5e47aeee1e6cbfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c09cc3-3d22-5690-abed-9093d96442b3/c5c09cc3-3d22-5690-abed-9093d96442b3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_29ed74088b55d48460c99442657ae113.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c09cc3-3d22-5690-abed-9093d96442b3/c5c09cc3-3d22-5690-abed-9093d96442b3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_ba102d6578cd5f0279dcaf1d7fa68660.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c09cc3-3d22-5690-abed-9093d96442b3/c5c09cc3-3d22-5690-abed-9093d96442b3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2762451,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_b702f7dc16ed0ae2c1a2531c7a89e1e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c09cc3-3d22-5690-abed-9093d96442b3/c5c09cc3-3d22-5690-abed-9093d96442b3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d2/a4d249d67a8de0f12b9d2973353cec6f/pa/KB62051_c102e0ffce237e3cb8fd1a3a0e1f3cce.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2011}
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62051%27 HTTP/1.1" 200 None
2026-03-30 10:36:03 [auto1.de] INFO: Saving data for KB62051: {'created_time': 1774866963.445742, 'last_price_update_time': 1774866963.445756, 'auction_closing_time': 1774972506.0}
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB62051') HTTP/1.1" 204 0
2026-03-30 10:36:03 [auto1.de] INFO: Found listing with ID: WL02580
2026-03-30 10:36:03 [auto1.de] INFO: Found listing with ID: TN19858
2026-03-30 10:36:03 [auto1.de] INFO: Found listing with ID: ND23678
2026-03-30 10:36:03 [auto1.de] INFO: Found listing with ID: YP09894
2026-03-30 10:36:03 [auto1.de] INFO: Found listing with ID: KH00073
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH00073%27 HTTP/1.1" 200 None
2026-03-30 10:36:03 [auto1.de] INFO: Scrape type for KH00073: 1
2026-03-30 10:36:03 [auto1.de] INFO: Found listing with ID: MW69190
2026-03-30 10:36:03 [auto1.de] INFO: Found listing with ID: UT23109
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT23109%27 HTTP/1.1" 200 None
2026-03-30 10:36:03 [auto1.de] INFO: Scrape type for UT23109: 1
2026-03-30 10:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_a984e146df6016e019471ab5aa925512.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:03 [auto1.de] INFO: Found listing with ID: HC62061
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC62061%27 HTTP/1.1" 200 None
2026-03-30 10:36:03 [auto1.de] INFO: Scrape type for HC62061: 1
2026-03-30 10:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_2bc84695772c34a7c54efaa99540ea63.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:03 [auto1.de] INFO: Found listing with ID: DV69723
2026-03-30 10:36:03 [auto1.de] INFO: Found listing with ID: LJ61664
2026-03-30 10:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_1e9b43775e2e132316ed4767e73340d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_7cb34828353e4320624b82e37e9e95cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef785f790>
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_a984e146df6016e019471ab5aa925512.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_a984e146df6016e019471ab5aa925512.jpg saved to cache
2026-03-30 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9d82534-e26b-5550-bb38-a6519415e144
2026-03-30 10:36:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe00d0>
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_2bc84695772c34a7c54efaa99540ea63.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_2bc84695772c34a7c54efaa99540ea63.jpg saved to cache
2026-03-30 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9d82534-e26b-5550-bb38-a6519415e144
2026-03-30 10:36:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5116450>
2026-03-30 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_1e9b43775e2e132316ed4767e73340d6.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_1e9b43775e2e132316ed4767e73340d6.jpg saved to cache
2026-03-30 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9d82534-e26b-5550-bb38-a6519415e144
2026-03-30 10:36:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb5e50>
2026-03-30 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F7a%252F1a7aed3d00706776c58e9e2492343475%252Fpa%252FSP27686_7cb34828353e4320624b82e37e9e95cc.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_7cb34828353e4320624b82e37e9e95cc.jpg saved to cache
2026-03-30 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9d82534-e26b-5550-bb38-a6519415e144
2026-03-30 10:36:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9d82534-e26b-5550-bb38-a6519415e144, skipping ID generation
2026-03-30 10:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9d82534-e26b-5550-bb38-a6519415e144 with scrape type 1
2026-03-30 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9d82534-e26b-5550-bb38-a6519415e144 sending to next pipeline
2026-03-30 10:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9d82534-e26b-5550-bb38-a6519415e144, identifier: SP27686
2026-03-30 10:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9d82534-e26b-5550-bb38-a6519415e144 with identifier: SP27686
2026-03-30 10:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9d82534-e26b-5550-bb38-a6519415e144 with identifier: SP27686
2026-03-30 10:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9d82534-e26b-5550-bb38-a6519415e144 with identifier: SP27686 to the API
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_7cb34828353e4320624b82e37e9e95cc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 197,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:56:24Z',
 'fuel_type': 'diesel',
 'id': 'c9d82534-e26b-5550-bb38-a6519415e144',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP27686',
 'listing': 'auction',
 'location': 'DE, Bad Oeynhausen',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 240027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_44ca527d5d7e11307893b5928b81892d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2307499,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_a984e146df6016e019471ab5aa925512.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2263581,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_2bc84695772c34a7c54efaa99540ea63.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2191570,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_1e9b43775e2e132316ed4767e73340d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_da8d43b1621ec625b3f5f18b8d9f13d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_d1d9861fe22f8b238eec2dfb7a146eb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_77ea32557f9c41726d70bace3b10a555.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_2aa9966a2a5d91f8fcd2fde2861535eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2420924,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_7cb34828353e4320624b82e37e9e95cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d82534-e26b-5550-bb38-a6519415e144/c9d82534-e26b-5550-bb38-a6519415e144_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/7a/1a7aed3d00706776c58e9e2492343475/pa/SP27686_0ad3b312a74b354933d2dfcbb4c47292.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 290 L1 Sport',
 'transmission': 'manual',
 'trim': '290 L1 Sport',
 'year': 2016}
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP27686%27 HTTP/1.1" 200 None
2026-03-30 10:36:04 [auto1.de] INFO: Saving data for SP27686: {'created_time': 1774866964.729917, 'last_price_update_time': 1774866964.729928, 'auction_closing_time': 1774972584.0}
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP27686') HTTP/1.1" 204 0
2026-03-30 10:36:04 [scrapy.extensions.logstats] INFO: Crawled 37 pages (at 37 pages/min), scraped 26 items (at 26 items/min)
2026-03-30 10:36:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC44957/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR78906/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL05361/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ14379/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF24454/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FY79679/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT23109/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC62061/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA27050/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH00073/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT78115> (referer: https://www.auto1.com/v1/car-details-view/ZT78115/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66f5847a-dced-5e15-8ff7-55550f4de100 with identifier: ZT78115
2026-03-30 10:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f5847a-dced-5e15-8ff7-55550f4de100 with scrape type 1
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66f5847a-dced-5e15-8ff7-55550f4de100
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_b01f605f094c6e92e967e61bcb817002.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_b01f605f094c6e92e967e61bcb817002.jpg not downloaded yet
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_eb640202436e06e9f92013529185ab8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_eb640202436e06e9f92013529185ab8b.jpg not downloaded yet
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_fa04e2b35c0f3ae99a8dd57f0c05d4e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_fa04e2b35c0f3ae99a8dd57f0c05d4e2.jpg not downloaded yet
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_46052b68e5e72d502261f73aff62e459.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_46052b68e5e72d502261f73aff62e459.jpg not downloaded yet
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_7ff3b68988f93a8329387a76117bf81a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_7ff3b68988f93a8329387a76117bf81a.jpg not downloaded yet
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_2d69def795c47abd6ef8db32a00bbbe0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_2d69def795c47abd6ef8db32a00bbbe0.jpg not downloaded yet
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_534cc43b1e361c83a311220168a80bf9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_534cc43b1e361c83a311220168a80bf9.jpg not downloaded yet
2026-03-30 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_b01f605f094c6e92e967e61bcb817002.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_2b4721f290c9393d860c13155c5eb8e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_2b4721f290c9393d860c13155c5eb8e1.jpg not downloaded yet
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_6b3540438816f64fb5f68a7a47d0b3e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_6b3540438816f64fb5f68a7a47d0b3e5.jpg not downloaded yet
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_ecc5a8dc74e9e79b32d1ac8f40527710.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_ecc5a8dc74e9e79b32d1ac8f40527710.jpg not downloaded yet
2026-03-30 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_eb640202436e06e9f92013529185ab8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a65110>
2026-03-30 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_b01f605f094c6e92e967e61bcb817002.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_b01f605f094c6e92e967e61bcb817002.jpg saved to cache
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66f5847a-dced-5e15-8ff7-55550f4de100
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5975e50>
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_eb640202436e06e9f92013529185ab8b.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_eb640202436e06e9f92013529185ab8b.jpg saved to cache
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66f5847a-dced-5e15-8ff7-55550f4de100
2026-03-30 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_534cc43b1e361c83a311220168a80bf9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_ecc5a8dc74e9e79b32d1ac8f40527710.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b30450>
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_534cc43b1e361c83a311220168a80bf9.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_534cc43b1e361c83a311220168a80bf9.jpg saved to cache
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66f5847a-dced-5e15-8ff7-55550f4de100
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5086210>
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_ecc5a8dc74e9e79b32d1ac8f40527710.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_ecc5a8dc74e9e79b32d1ac8f40527710.jpg saved to cache
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66f5847a-dced-5e15-8ff7-55550f4de100
2026-03-30 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_2b4721f290c9393d860c13155c5eb8e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7850910>
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_2b4721f290c9393d860c13155c5eb8e1.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_2b4721f290c9393d860c13155c5eb8e1.jpg saved to cache
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66f5847a-dced-5e15-8ff7-55550f4de100
2026-03-30 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_6b3540438816f64fb5f68a7a47d0b3e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_2d69def795c47abd6ef8db32a00bbbe0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b320d0>
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_6b3540438816f64fb5f68a7a47d0b3e5.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_6b3540438816f64fb5f68a7a47d0b3e5.jpg saved to cache
2026-03-30 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 66f5847a-dced-5e15-8ff7-55550f4de100
2026-03-30 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE19068> (referer: https://www.auto1.com/v1/car-details-view/GE19068/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5118590>
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_2d69def795c47abd6ef8db32a00bbbe0.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_2d69def795c47abd6ef8db32a00bbbe0.jpg saved to cache
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66f5847a-dced-5e15-8ff7-55550f4de100
2026-03-30 10:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6eae664-bbc0-5b43-952a-5010268d09de with identifier: GE19068
2026-03-30 10:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6eae664-bbc0-5b43-952a-5010268d09de with scrape type 1
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6eae664-bbc0-5b43-952a-5010268d09de
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_2b0fbad5887be85e836b85df9768954c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_2b0fbad5887be85e836b85df9768954c.jpg not downloaded yet
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_7db9df0e2a08c77add79a0af78969478.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_7db9df0e2a08c77add79a0af78969478.jpg not downloaded yet
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_b9d1ab2cc8dcc8060fe30010c292b6be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_b9d1ab2cc8dcc8060fe30010c292b6be.jpg not downloaded yet
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_cac6ff135c4bb4b01afb70dd6d602b86.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_cac6ff135c4bb4b01afb70dd6d602b86.jpg not downloaded yet
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_b83d7714591f49e1b05849bd53718ffb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_b83d7714591f49e1b05849bd53718ffb.jpg not downloaded yet
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_d73794882f082ca339510ad826ec9508.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_d73794882f082ca339510ad826ec9508.jpg not downloaded yet
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_1f9d0ab6c2fb864ab7fb85fb92592b4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_1f9d0ab6c2fb864ab7fb85fb92592b4a.jpg not downloaded yet
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_5392b909dee6b497211dbcd39650ccfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_5392b909dee6b497211dbcd39650ccfb.jpg not downloaded yet
2026-03-30 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_fa04e2b35c0f3ae99a8dd57f0c05d4e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_b7475f081d2b1e3cbe68c5f54a740f61.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_b7475f081d2b1e3cbe68c5f54a740f61.jpg not downloaded yet
2026-03-30 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_46052b68e5e72d502261f73aff62e459.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_df26cd84e266a643a32d514385006978.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_df26cd84e266a643a32d514385006978.jpg not downloaded yet
2026-03-30 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_7ff3b68988f93a8329387a76117bf81a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb5cd0>
2026-03-30 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_fa04e2b35c0f3ae99a8dd57f0c05d4e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_fa04e2b35c0f3ae99a8dd57f0c05d4e2.jpg saved to cache
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66f5847a-dced-5e15-8ff7-55550f4de100
2026-03-30 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_df26cd84e266a643a32d514385006978.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5976a10>
2026-03-30 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_46052b68e5e72d502261f73aff62e459.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_46052b68e5e72d502261f73aff62e459.jpg saved to cache
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66f5847a-dced-5e15-8ff7-55550f4de100
2026-03-30 10:36:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50fc510>
2026-03-30 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F4c%252F784c594e01a95555dc80b5584ce15c30%252Fpa%252FZT78115_7ff3b68988f93a8329387a76117bf81a.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_7ff3b68988f93a8329387a76117bf81a.jpg saved to cache
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66f5847a-dced-5e15-8ff7-55550f4de100
2026-03-30 10:36:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66f5847a-dced-5e15-8ff7-55550f4de100, skipping ID generation
2026-03-30 10:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f5847a-dced-5e15-8ff7-55550f4de100 with scrape type 1
2026-03-30 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66f5847a-dced-5e15-8ff7-55550f4de100 sending to next pipeline
2026-03-30 10:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66f5847a-dced-5e15-8ff7-55550f4de100, identifier: ZT78115
2026-03-30 10:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66f5847a-dced-5e15-8ff7-55550f4de100 with identifier: ZT78115
2026-03-30 10:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66f5847a-dced-5e15-8ff7-55550f4de100 with identifier: ZT78115
2026-03-30 10:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66f5847a-dced-5e15-8ff7-55550f4de100 with identifier: ZT78115 to the API
2026-03-30 10:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_7ff3b68988f93a8329387a76117bf81a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:44:10Z',
 'fuel_type': 'petrol',
 'id': '66f5847a-dced-5e15-8ff7-55550f4de100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT78115',
 'listing': 'auction',
 'location': 'DE, Bernburg (Saale)',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 155695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_b01f605f094c6e92e967e61bcb817002.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_eb640202436e06e9f92013529185ab8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_fa04e2b35c0f3ae99a8dd57f0c05d4e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_46052b68e5e72d502261f73aff62e459.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2881680,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_7ff3b68988f93a8329387a76117bf81a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2849087,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_2d69def795c47abd6ef8db32a00bbbe0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_534cc43b1e361c83a311220168a80bf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3054028,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_2b4721f290c9393d860c13155c5eb8e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2852673,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_6b3540438816f64fb5f68a7a47d0b3e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66f5847a-dced-5e15-8ff7-55550f4de100/66f5847a-dced-5e15-8ff7-55550f4de100_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/4c/784c594e01a95555dc80b5584ce15c30/pa/ZT78115_ecc5a8dc74e9e79b32d1ac8f40527710.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT78115%27 HTTP/1.1" 200 None
2026-03-30 10:36:16 [auto1.de] INFO: Saving data for ZT78115: {'created_time': 1774866976.567904, 'last_price_update_time': 1774866976.567914, 'auction_closing_time': 1774971850.0}
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT78115') HTTP/1.1" 204 0
2026-03-30 10:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_5392b909dee6b497211dbcd39650ccfb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_b7475f081d2b1e3cbe68c5f54a740f61.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50e4210>
2026-03-30 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_df26cd84e266a643a32d514385006978.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_df26cd84e266a643a32d514385006978.jpg saved to cache
2026-03-30 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6eae664-bbc0-5b43-952a-5010268d09de
2026-03-30 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b351d0>
2026-03-30 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_5392b909dee6b497211dbcd39650ccfb.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_5392b909dee6b497211dbcd39650ccfb.jpg saved to cache
2026-03-30 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6eae664-bbc0-5b43-952a-5010268d09de
2026-03-30 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b38d10>
2026-03-30 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_b7475f081d2b1e3cbe68c5f54a740f61.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_b7475f081d2b1e3cbe68c5f54a740f61.jpg saved to cache
2026-03-30 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6eae664-bbc0-5b43-952a-5010268d09de
2026-03-30 10:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_1f9d0ab6c2fb864ab7fb85fb92592b4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_d73794882f082ca339510ad826ec9508.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b01390>
2026-03-30 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_1f9d0ab6c2fb864ab7fb85fb92592b4a.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_1f9d0ab6c2fb864ab7fb85fb92592b4a.jpg saved to cache
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6eae664-bbc0-5b43-952a-5010268d09de
2026-03-30 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_b83d7714591f49e1b05849bd53718ffb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_b9d1ab2cc8dcc8060fe30010c292b6be.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_cac6ff135c4bb4b01afb70dd6d602b86.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50e5b10>
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_d73794882f082ca339510ad826ec9508.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_d73794882f082ca339510ad826ec9508.jpg saved to cache
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6eae664-bbc0-5b43-952a-5010268d09de
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50dcb10>
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_b83d7714591f49e1b05849bd53718ffb.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_b83d7714591f49e1b05849bd53718ffb.jpg saved to cache
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6eae664-bbc0-5b43-952a-5010268d09de
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5084c50>
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_b9d1ab2cc8dcc8060fe30010c292b6be.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_b9d1ab2cc8dcc8060fe30010c292b6be.jpg saved to cache
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6eae664-bbc0-5b43-952a-5010268d09de
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f46b50>
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_cac6ff135c4bb4b01afb70dd6d602b86.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_cac6ff135c4bb4b01afb70dd6d602b86.jpg saved to cache
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6eae664-bbc0-5b43-952a-5010268d09de
2026-03-30 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_2b0fbad5887be85e836b85df9768954c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_7db9df0e2a08c77add79a0af78969478.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef8153650>
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_2b0fbad5887be85e836b85df9768954c.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_2b0fbad5887be85e836b85df9768954c.jpg saved to cache
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6eae664-bbc0-5b43-952a-5010268d09de
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb3d90>
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F85%252F4c85759ce58b39a555b7bcbfd84c7186%252Fpa%252FGE19068_7db9df0e2a08c77add79a0af78969478.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_7db9df0e2a08c77add79a0af78969478.jpg saved to cache
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6eae664-bbc0-5b43-952a-5010268d09de
2026-03-30 10:36:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6eae664-bbc0-5b43-952a-5010268d09de, skipping ID generation
2026-03-30 10:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6eae664-bbc0-5b43-952a-5010268d09de with scrape type 1
2026-03-30 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6eae664-bbc0-5b43-952a-5010268d09de sending to next pipeline
2026-03-30 10:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6eae664-bbc0-5b43-952a-5010268d09de, identifier: GE19068
2026-03-30 10:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6eae664-bbc0-5b43-952a-5010268d09de with identifier: GE19068
2026-03-30 10:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6eae664-bbc0-5b43-952a-5010268d09de with identifier: GE19068
2026-03-30 10:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6eae664-bbc0-5b43-952a-5010268d09de with identifier: GE19068 to the API
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_7db9df0e2a08c77add79a0af78969478.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:50:02Z',
 'fuel_type': 'petrol',
 'id': 'a6eae664-bbc0-5b43-952a-5010268d09de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE19068',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 95401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_2b0fbad5887be85e836b85df9768954c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_7db9df0e2a08c77add79a0af78969478.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_b9d1ab2cc8dcc8060fe30010c292b6be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_cac6ff135c4bb4b01afb70dd6d602b86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_b83d7714591f49e1b05849bd53718ffb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433020,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_d73794882f082ca339510ad826ec9508.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438806,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_1f9d0ab6c2fb864ab7fb85fb92592b4a.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_5392b909dee6b497211dbcd39650ccfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_b7475f081d2b1e3cbe68c5f54a740f61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eae664-bbc0-5b43-952a-5010268d09de/a6eae664-bbc0-5b43-952a-5010268d09de_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/85/4c85759ce58b39a555b7bcbfd84c7186/pa/GE19068_df26cd84e266a643a32d514385006978.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 160',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE19068%27 HTTP/1.1" 200 None
2026-03-30 10:36:17 [auto1.de] INFO: Saving data for GE19068: {'created_time': 1774866977.96326, 'last_price_update_time': 1774866977.963271, 'auction_closing_time': 1774972202.0}
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE19068') HTTP/1.1" 204 0
2026-03-30 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC44957> (referer: https://www.auto1.com/v1/car-details-view/AC44957/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fbc8b0d-6731-5b54-be83-9eeda701dae3 with identifier: AC44957
2026-03-30 10:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fbc8b0d-6731-5b54-be83-9eeda701dae3 with scrape type 1
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7fbc8b0d-6731-5b54-be83-9eeda701dae3
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fd5%252F83d533e903622ef242369422e715cb0b%252Fpa%252FAC44957_aef0b5e079e7f2c3daf25353f876dc02.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_aef0b5e079e7f2c3daf25353f876dc02.jpg already downloaded
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fd5%252F83d533e903622ef242369422e715cb0b%252Fpa%252FAC44957_f7de76363c4e5c3468a1e22fd166f71c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_f7de76363c4e5c3468a1e22fd166f71c.jpg already downloaded
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fd5%252F83d533e903622ef242369422e715cb0b%252Fpa%252FAC44957_43b506a5d71f37ecc64b577cfb7c1b6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_43b506a5d71f37ecc64b577cfb7c1b6d.jpg already downloaded
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fd5%252F83d533e903622ef242369422e715cb0b%252Fpa%252FAC44957_79c9b6f12b961f140f5197ee94f0f7e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_79c9b6f12b961f140f5197ee94f0f7e6.jpg already downloaded
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fd5%252F83d533e903622ef242369422e715cb0b%252Fpa%252FAC44957_35719160d3aa08616302f2bc2f09e62c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_35719160d3aa08616302f2bc2f09e62c.jpg already downloaded
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fd5%252F83d533e903622ef242369422e715cb0b%252Fpa%252FAC44957_1711062b9fe53a741fd56a48c884a896.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_1711062b9fe53a741fd56a48c884a896.jpg already downloaded
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fd5%252F83d533e903622ef242369422e715cb0b%252Fpa%252FAC44957_fe69c1715cf4ac3683c736ce8849c750.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_fe69c1715cf4ac3683c736ce8849c750.jpg already downloaded
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fd5%252F83d533e903622ef242369422e715cb0b%252Fpa%252FAC44957_1e43cc7e740d8323f3b53fb5d7c0996a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_1e43cc7e740d8323f3b53fb5d7c0996a.jpg already downloaded
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fd5%252F83d533e903622ef242369422e715cb0b%252Fpa%252FAC44957_82d24e80080c49b395ddf410f2ffa087.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_82d24e80080c49b395ddf410f2ffa087.jpg already downloaded
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fd5%252F83d533e903622ef242369422e715cb0b%252Fpa%252FAC44957_8b3a4e024f354035b29895dba6129da9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_8b3a4e024f354035b29895dba6129da9.jpg already downloaded
2026-03-30 10:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fbc8b0d-6731-5b54-be83-9eeda701dae3, identifier: AC44957
2026-03-30 10:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fbc8b0d-6731-5b54-be83-9eeda701dae3 with identifier: AC44957
2026-03-30 10:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fbc8b0d-6731-5b54-be83-9eeda701dae3 with identifier: AC44957
2026-03-30 10:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fbc8b0d-6731-5b54-be83-9eeda701dae3 with identifier: AC44957 to the API
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AC44957>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:06:48Z',
 'fuel_type': 'petrol',
 'id': '7fbc8b0d-6731-5b54-be83-9eeda701dae3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC44957',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 52883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_aef0b5e079e7f2c3daf25353f876dc02.jpg',
                'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_f7de76363c4e5c3468a1e22fd166f71c.jpg',
                'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_43b506a5d71f37ecc64b577cfb7c1b6d.jpg',
                'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_79c9b6f12b961f140f5197ee94f0f7e6.jpg',
                'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_35719160d3aa08616302f2bc2f09e62c.jpg',
                'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_1711062b9fe53a741fd56a48c884a896.jpg',
                'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_fe69c1715cf4ac3683c736ce8849c750.jpg',
                'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_1e43cc7e740d8323f3b53fb5d7c0996a.jpg',
                'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_82d24e80080c49b395ddf410f2ffa087.jpg',
                'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_8b3a4e024f354035b29895dba6129da9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fbc8b0d-6731-5b54-be83-9eeda701dae3/7fbc8b0d-6731-5b54-be83-9eeda701dae3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2084435,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_aef0b5e079e7f2c3daf25353f876dc02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fbc8b0d-6731-5b54-be83-9eeda701dae3/7fbc8b0d-6731-5b54-be83-9eeda701dae3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_f7de76363c4e5c3468a1e22fd166f71c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fbc8b0d-6731-5b54-be83-9eeda701dae3/7fbc8b0d-6731-5b54-be83-9eeda701dae3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2061263,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_43b506a5d71f37ecc64b577cfb7c1b6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fbc8b0d-6731-5b54-be83-9eeda701dae3/7fbc8b0d-6731-5b54-be83-9eeda701dae3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_79c9b6f12b961f140f5197ee94f0f7e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fbc8b0d-6731-5b54-be83-9eeda701dae3/7fbc8b0d-6731-5b54-be83-9eeda701dae3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2079011,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_35719160d3aa08616302f2bc2f09e62c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fbc8b0d-6731-5b54-be83-9eeda701dae3/7fbc8b0d-6731-5b54-be83-9eeda701dae3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2057206,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_1711062b9fe53a741fd56a48c884a896.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fbc8b0d-6731-5b54-be83-9eeda701dae3/7fbc8b0d-6731-5b54-be83-9eeda701dae3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1970733,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_fe69c1715cf4ac3683c736ce8849c750.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fbc8b0d-6731-5b54-be83-9eeda701dae3/7fbc8b0d-6731-5b54-be83-9eeda701dae3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2083918,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_1e43cc7e740d8323f3b53fb5d7c0996a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fbc8b0d-6731-5b54-be83-9eeda701dae3/7fbc8b0d-6731-5b54-be83-9eeda701dae3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_82d24e80080c49b395ddf410f2ffa087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fbc8b0d-6731-5b54-be83-9eeda701dae3/7fbc8b0d-6731-5b54-be83-9eeda701dae3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2400387,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/d5/83d533e903622ef242369422e715cb0b/pa/AC44957_8b3a4e024f354035b29895dba6129da9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2019}
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC44957%27 HTTP/1.1" 200 None
2026-03-30 10:36:18 [auto1.de] INFO: Saving data for AC44957: {'created_time': 1774866978.741468, 'last_price_update_time': 1774866978.741478, 'auction_closing_time': 1774969608.0}
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC44957') HTTP/1.1" 204 0
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL05361> (referer: https://www.auto1.com/v1/car-details-view/RL05361/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8939386e-4fcd-5f18-b29d-ae6a59d7bd55 with identifier: RL05361
2026-03-30 10:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8939386e-4fcd-5f18-b29d-ae6a59d7bd55 with scrape type 1
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8939386e-4fcd-5f18-b29d-ae6a59d7bd55
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_45782fb8ec66494a36287ce088bdc606.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_45782fb8ec66494a36287ce088bdc606.jpg not downloaded yet
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_2158c910b6aa31be4715a333c76aff43.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_2158c910b6aa31be4715a333c76aff43.jpg not downloaded yet
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_7a9eccddc555dd7950fddf4905bd35bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_7a9eccddc555dd7950fddf4905bd35bd.jpg not downloaded yet
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_1fbb7e8b8a00153042ee29ff4988e32b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_1fbb7e8b8a00153042ee29ff4988e32b.jpg not downloaded yet
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_bb7ef484297c3a471a2b4ae8998c47e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_bb7ef484297c3a471a2b4ae8998c47e1.jpg not downloaded yet
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_b390a400fb187755570835c83d800d12.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_b390a400fb187755570835c83d800d12.jpg not downloaded yet
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_45782fb8ec66494a36287ce088bdc606.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_b801164ae84c6a8f90e8f3b2262832ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_b801164ae84c6a8f90e8f3b2262832ed.jpg not downloaded yet
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_ff79cb39035914516719905451c9dd5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_ff79cb39035914516719905451c9dd5d.jpg not downloaded yet
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_11ebc6de1357d92d4bfacd80ace7ead8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_11ebc6de1357d92d4bfacd80ace7ead8.jpg not downloaded yet
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_7a9eccddc555dd7950fddf4905bd35bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_52e875be588738eb287b1c30f5510d39.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_52e875be588738eb287b1c30f5510d39.jpg not downloaded yet
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a95110>
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_45782fb8ec66494a36287ce088bdc606.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_45782fb8ec66494a36287ce088bdc606.jpg saved to cache
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8939386e-4fcd-5f18-b29d-ae6a59d7bd55
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_2158c910b6aa31be4715a333c76aff43.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_1fbb7e8b8a00153042ee29ff4988e32b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5966bd0>
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_7a9eccddc555dd7950fddf4905bd35bd.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_7a9eccddc555dd7950fddf4905bd35bd.jpg saved to cache
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8939386e-4fcd-5f18-b29d-ae6a59d7bd55
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_bb7ef484297c3a471a2b4ae8998c47e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b36d10>
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_2158c910b6aa31be4715a333c76aff43.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_2158c910b6aa31be4715a333c76aff43.jpg saved to cache
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8939386e-4fcd-5f18-b29d-ae6a59d7bd55
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fefe50>
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_1fbb7e8b8a00153042ee29ff4988e32b.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_1fbb7e8b8a00153042ee29ff4988e32b.jpg saved to cache
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8939386e-4fcd-5f18-b29d-ae6a59d7bd55
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_b390a400fb187755570835c83d800d12.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_11ebc6de1357d92d4bfacd80ace7ead8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_ff79cb39035914516719905451c9dd5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5087d90>
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_bb7ef484297c3a471a2b4ae8998c47e1.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_bb7ef484297c3a471a2b4ae8998c47e1.jpg saved to cache
2026-03-30 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8939386e-4fcd-5f18-b29d-ae6a59d7bd55
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_b801164ae84c6a8f90e8f3b2262832ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_52e875be588738eb287b1c30f5510d39.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ14379> (referer: https://www.auto1.com/v1/car-details-view/MJ14379/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b353d0>
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_b390a400fb187755570835c83d800d12.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_b390a400fb187755570835c83d800d12.jpg saved to cache
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8939386e-4fcd-5f18-b29d-ae6a59d7bd55
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50e7fd0>
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_11ebc6de1357d92d4bfacd80ace7ead8.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_11ebc6de1357d92d4bfacd80ace7ead8.jpg saved to cache
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8939386e-4fcd-5f18-b29d-ae6a59d7bd55
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f47290>
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_ff79cb39035914516719905451c9dd5d.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_ff79cb39035914516719905451c9dd5d.jpg saved to cache
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8939386e-4fcd-5f18-b29d-ae6a59d7bd55
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef673c050>
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_b801164ae84c6a8f90e8f3b2262832ed.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_b801164ae84c6a8f90e8f3b2262832ed.jpg saved to cache
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8939386e-4fcd-5f18-b29d-ae6a59d7bd55
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b35b10>
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F6d%252Fc46d314c554343a94943e39a103b6647%252Fpa%252FRL05361_52e875be588738eb287b1c30f5510d39.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_52e875be588738eb287b1c30f5510d39.jpg saved to cache
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8939386e-4fcd-5f18-b29d-ae6a59d7bd55
2026-03-30 10:36:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8939386e-4fcd-5f18-b29d-ae6a59d7bd55, skipping ID generation
2026-03-30 10:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8939386e-4fcd-5f18-b29d-ae6a59d7bd55 with scrape type 1
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8939386e-4fcd-5f18-b29d-ae6a59d7bd55 sending to next pipeline
2026-03-30 10:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8939386e-4fcd-5f18-b29d-ae6a59d7bd55, identifier: RL05361
2026-03-30 10:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6065d69d-a048-5c0a-b648-82aba84f1ae7 with identifier: MJ14379
2026-03-30 10:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6065d69d-a048-5c0a-b648-82aba84f1ae7 with scrape type 1
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6065d69d-a048-5c0a-b648-82aba84f1ae7
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_a8096a6cb264d80b9d8278ec2785edb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_a8096a6cb264d80b9d8278ec2785edb8.jpg not downloaded yet
2026-03-30 10:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8939386e-4fcd-5f18-b29d-ae6a59d7bd55 with identifier: RL05361
2026-03-30 10:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8939386e-4fcd-5f18-b29d-ae6a59d7bd55 with identifier: RL05361
2026-03-30 10:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8939386e-4fcd-5f18-b29d-ae6a59d7bd55 with identifier: RL05361 to the API
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_52e875be588738eb287b1c30f5510d39.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:40:39Z',
 'fuel_type': 'petrol',
 'id': '8939386e-4fcd-5f18-b29d-ae6a59d7bd55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL05361',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 101466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_45782fb8ec66494a36287ce088bdc606.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_2158c910b6aa31be4715a333c76aff43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_7a9eccddc555dd7950fddf4905bd35bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_1fbb7e8b8a00153042ee29ff4988e32b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2843518,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_bb7ef484297c3a471a2b4ae8998c47e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_b390a400fb187755570835c83d800d12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_b801164ae84c6a8f90e8f3b2262832ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_ff79cb39035914516719905451c9dd5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_11ebc6de1357d92d4bfacd80ace7ead8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8939386e-4fcd-5f18-b29d-ae6a59d7bd55/8939386e-4fcd-5f18-b29d-ae6a59d7bd55_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/6d/c46d314c554343a94943e39a103b6647/pa/RL05361_52e875be588738eb287b1c30f5510d39.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2015}
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL05361%27 HTTP/1.1" 200 None
2026-03-30 10:36:22 [auto1.de] INFO: Saving data for RL05361: {'created_time': 1774866982.71057, 'last_price_update_time': 1774866982.710581, 'auction_closing_time': 1774971639.0}
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL05361') HTTP/1.1" 204 0
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_34ce16f5e4038f0bcfc984e855545f6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_34ce16f5e4038f0bcfc984e855545f6b.jpg not downloaded yet
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_eeb70d9538b6938b0418cfb928d09db1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_eeb70d9538b6938b0418cfb928d09db1.jpg not downloaded yet
2026-03-30 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE05106/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_b427a41f0bb20d0e0a8ea89f2acad27e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_b427a41f0bb20d0e0a8ea89f2acad27e.jpg not downloaded yet
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_9ef2ab3ac6697c5dc64c63a4c81e4eb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_9ef2ab3ac6697c5dc64c63a4c81e4eb5.jpg not downloaded yet
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_15fe50e3ec8aa6750fb154ffe93ffa26.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_15fe50e3ec8aa6750fb154ffe93ffa26.jpg not downloaded yet
2026-03-30 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_a8096a6cb264d80b9d8278ec2785edb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_a26196b563673727aed03de54ce5d0e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_a26196b563673727aed03de54ce5d0e3.jpg not downloaded yet
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_54f9499cdaad57e4f05bc9c6c33e882b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_54f9499cdaad57e4f05bc9c6c33e882b.jpg not downloaded yet
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_666dcaa3ad44a88b3f604ac62bedae27.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_666dcaa3ad44a88b3f604ac62bedae27.jpg not downloaded yet
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_02916e133027a3547142588ef9bb2a41.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_02916e133027a3547142588ef9bb2a41.jpg not downloaded yet
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5996250>
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_a8096a6cb264d80b9d8278ec2785edb8.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_a8096a6cb264d80b9d8278ec2785edb8.jpg saved to cache
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6065d69d-a048-5c0a-b648-82aba84f1ae7
2026-03-30 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_34ce16f5e4038f0bcfc984e855545f6b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_b427a41f0bb20d0e0a8ea89f2acad27e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV34927> (referer: https://www.auto1.com/v1/car-details-view/NV34927/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_eeb70d9538b6938b0418cfb928d09db1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5113990>
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_34ce16f5e4038f0bcfc984e855545f6b.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_34ce16f5e4038f0bcfc984e855545f6b.jpg saved to cache
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6065d69d-a048-5c0a-b648-82aba84f1ae7
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fec090>
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_b427a41f0bb20d0e0a8ea89f2acad27e.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_b427a41f0bb20d0e0a8ea89f2acad27e.jpg saved to cache
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6065d69d-a048-5c0a-b648-82aba84f1ae7
2026-03-30 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_9ef2ab3ac6697c5dc64c63a4c81e4eb5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_a26196b563673727aed03de54ce5d0e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_15fe50e3ec8aa6750fb154ffe93ffa26.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_54f9499cdaad57e4f05bc9c6c33e882b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdf2d4ad-4a11-5393-9402-15a0cbddb661 with identifier: NV34927
2026-03-30 10:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdf2d4ad-4a11-5393-9402-15a0cbddb661 with scrape type 1
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bdf2d4ad-4a11-5393-9402-15a0cbddb661
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387d8e622953c23acf1d4ab648ce886f%252Fpa%252FNV34927_54b934b4138e3faa0ec723da68b55ab6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_54b934b4138e3faa0ec723da68b55ab6.jpg already downloaded
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387d8e622953c23acf1d4ab648ce886f%252Fpa%252FNV34927_3e6938d6ac494cf767e137eecac453af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_3e6938d6ac494cf767e137eecac453af.jpg already downloaded
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387d8e622953c23acf1d4ab648ce886f%252Fpa%252FNV34927_afb5818887b6f33e10be2d3d4d65dd9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_afb5818887b6f33e10be2d3d4d65dd9f.jpg already downloaded
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387d8e622953c23acf1d4ab648ce886f%252Fpa%252FNV34927_0bea275bd7c0c3ac9c8358b336144439.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_0bea275bd7c0c3ac9c8358b336144439.jpg already downloaded
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387d8e622953c23acf1d4ab648ce886f%252Fpa%252FNV34927_4e825392dbd397912ca437c55e59b3ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_4e825392dbd397912ca437c55e59b3ee.jpg already downloaded
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387d8e622953c23acf1d4ab648ce886f%252Fpa%252FNV34927_7fd6193918480b1a82b9275f277d8282.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_7fd6193918480b1a82b9275f277d8282.jpg already downloaded
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387d8e622953c23acf1d4ab648ce886f%252Fpa%252FNV34927_45308e00792f9179dfb7028e19c27bf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_45308e00792f9179dfb7028e19c27bf0.jpg already downloaded
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387d8e622953c23acf1d4ab648ce886f%252Fpa%252FNV34927_fd0ded992e4704c7d22465fff264cf05.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_fd0ded992e4704c7d22465fff264cf05.jpg already downloaded
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387d8e622953c23acf1d4ab648ce886f%252Fpa%252FNV34927_f0dccecb9834be0cc2eeb30d015d173a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_f0dccecb9834be0cc2eeb30d015d173a.jpg already downloaded
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F7d%252F387d8e622953c23acf1d4ab648ce886f%252Fpa%252FNV34927_7776f4650da2a4fcb9a88672075d8a61.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_7776f4650da2a4fcb9a88672075d8a61.jpg already downloaded
2026-03-30 10:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdf2d4ad-4a11-5393-9402-15a0cbddb661, identifier: NV34927
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5005190>
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_eeb70d9538b6938b0418cfb928d09db1.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_eeb70d9538b6938b0418cfb928d09db1.jpg saved to cache
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6065d69d-a048-5c0a-b648-82aba84f1ae7
2026-03-30 10:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdf2d4ad-4a11-5393-9402-15a0cbddb661 with identifier: NV34927
2026-03-30 10:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdf2d4ad-4a11-5393-9402-15a0cbddb661 with identifier: NV34927
2026-03-30 10:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdf2d4ad-4a11-5393-9402-15a0cbddb661 with identifier: NV34927 to the API
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NV34927>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:55:45Z',
 'fuel_type': 'diesel',
 'id': 'bdf2d4ad-4a11-5393-9402-15a0cbddb661',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV34927',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 180988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_54b934b4138e3faa0ec723da68b55ab6.jpg',
                'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_3e6938d6ac494cf767e137eecac453af.jpg',
                'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_afb5818887b6f33e10be2d3d4d65dd9f.jpg',
                'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_0bea275bd7c0c3ac9c8358b336144439.jpg',
                'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_4e825392dbd397912ca437c55e59b3ee.jpg',
                'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_7fd6193918480b1a82b9275f277d8282.jpg',
                'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_45308e00792f9179dfb7028e19c27bf0.jpg',
                'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_fd0ded992e4704c7d22465fff264cf05.jpg',
                'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_f0dccecb9834be0cc2eeb30d015d173a.jpg',
                'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_7776f4650da2a4fcb9a88672075d8a61.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2d4ad-4a11-5393-9402-15a0cbddb661/bdf2d4ad-4a11-5393-9402-15a0cbddb661_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2539178,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_54b934b4138e3faa0ec723da68b55ab6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2d4ad-4a11-5393-9402-15a0cbddb661/bdf2d4ad-4a11-5393-9402-15a0cbddb661_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_3e6938d6ac494cf767e137eecac453af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2d4ad-4a11-5393-9402-15a0cbddb661/bdf2d4ad-4a11-5393-9402-15a0cbddb661_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2452815,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_afb5818887b6f33e10be2d3d4d65dd9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2d4ad-4a11-5393-9402-15a0cbddb661/bdf2d4ad-4a11-5393-9402-15a0cbddb661_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_0bea275bd7c0c3ac9c8358b336144439.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2d4ad-4a11-5393-9402-15a0cbddb661/bdf2d4ad-4a11-5393-9402-15a0cbddb661_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2421200,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_4e825392dbd397912ca437c55e59b3ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2d4ad-4a11-5393-9402-15a0cbddb661/bdf2d4ad-4a11-5393-9402-15a0cbddb661_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463997,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_7fd6193918480b1a82b9275f277d8282.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2d4ad-4a11-5393-9402-15a0cbddb661/bdf2d4ad-4a11-5393-9402-15a0cbddb661_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_45308e00792f9179dfb7028e19c27bf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2d4ad-4a11-5393-9402-15a0cbddb661/bdf2d4ad-4a11-5393-9402-15a0cbddb661_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2522872,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_fd0ded992e4704c7d22465fff264cf05.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2d4ad-4a11-5393-9402-15a0cbddb661/bdf2d4ad-4a11-5393-9402-15a0cbddb661_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_f0dccecb9834be0cc2eeb30d015d173a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdf2d4ad-4a11-5393-9402-15a0cbddb661/bdf2d4ad-4a11-5393-9402-15a0cbddb661_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2613163,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/7d/387d8e622953c23acf1d4ab648ce886f/pa/NV34927_7776f4650da2a4fcb9a88672075d8a61.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Cup BlueMotion',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion',
 'year': 2015}
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV34927%27 HTTP/1.1" 200 None
2026-03-30 10:36:23 [auto1.de] INFO: Saving data for NV34927: {'created_time': 1774866983.898042, 'last_price_update_time': 1774866983.898051, 'auction_closing_time': 1774972545.0}
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV34927') HTTP/1.1" 204 0
2026-03-30 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_02916e133027a3547142588ef9bb2a41.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_666dcaa3ad44a88b3f604ac62bedae27.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT23109> (referer: https://www.auto1.com/v1/car-details-view/UT23109/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59948d0>
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_9ef2ab3ac6697c5dc64c63a4c81e4eb5.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_9ef2ab3ac6697c5dc64c63a4c81e4eb5.jpg saved to cache
2026-03-30 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6065d69d-a048-5c0a-b648-82aba84f1ae7
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c2d50>
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_a26196b563673727aed03de54ce5d0e3.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_a26196b563673727aed03de54ce5d0e3.jpg saved to cache
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6065d69d-a048-5c0a-b648-82aba84f1ae7
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4febd90>
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_15fe50e3ec8aa6750fb154ffe93ffa26.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_15fe50e3ec8aa6750fb154ffe93ffa26.jpg saved to cache
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6065d69d-a048-5c0a-b648-82aba84f1ae7
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7cc6d50>
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_54f9499cdaad57e4f05bc9c6c33e882b.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_54f9499cdaad57e4f05bc9c6c33e882b.jpg saved to cache
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6065d69d-a048-5c0a-b648-82aba84f1ae7
2026-03-30 10:36:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb85d0>
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_02916e133027a3547142588ef9bb2a41.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_02916e133027a3547142588ef9bb2a41.jpg saved to cache
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6065d69d-a048-5c0a-b648-82aba84f1ae7
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5109dd0>
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F28%252F1428b2a5fda3279d11bd65054bce624c%252Fpa%252FMJ14379_666dcaa3ad44a88b3f604ac62bedae27.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_666dcaa3ad44a88b3f604ac62bedae27.jpg saved to cache
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6065d69d-a048-5c0a-b648-82aba84f1ae7
2026-03-30 10:36:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6065d69d-a048-5c0a-b648-82aba84f1ae7, skipping ID generation
2026-03-30 10:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6065d69d-a048-5c0a-b648-82aba84f1ae7 with scrape type 1
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6065d69d-a048-5c0a-b648-82aba84f1ae7 sending to next pipeline
2026-03-30 10:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6065d69d-a048-5c0a-b648-82aba84f1ae7, identifier: MJ14379
2026-03-30 10:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 393a450d-c958-5281-8b7e-883358155386 with identifier: UT23109
2026-03-30 10:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 393a450d-c958-5281-8b7e-883358155386 with scrape type 1
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 393a450d-c958-5281-8b7e-883358155386
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f56f91459525d3a811184b5cdf6818%252Fpa%252FUT23109_7db479c2ff793da9e54efca6f3ec39e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_7db479c2ff793da9e54efca6f3ec39e8.jpg already downloaded
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f56f91459525d3a811184b5cdf6818%252Fpa%252FUT23109_f8e9c7424c19df1691d91f06ade0556f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_f8e9c7424c19df1691d91f06ade0556f.jpg already downloaded
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f56f91459525d3a811184b5cdf6818%252Fpa%252FUT23109_dd8c7dcfa1c37ee367d5d0b23bfddf94.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_dd8c7dcfa1c37ee367d5d0b23bfddf94.jpg already downloaded
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f56f91459525d3a811184b5cdf6818%252Fpa%252FUT23109_a8399348f9bc923f59a1e547e4e4ffec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_a8399348f9bc923f59a1e547e4e4ffec.jpg already downloaded
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f56f91459525d3a811184b5cdf6818%252Fpa%252FUT23109_45b4d51e1fe6243484d408ed31c1a1f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_45b4d51e1fe6243484d408ed31c1a1f8.jpg already downloaded
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f56f91459525d3a811184b5cdf6818%252Fpa%252FUT23109_3fac69d28058ad71e2d05d2c072a15db.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_3fac69d28058ad71e2d05d2c072a15db.jpg already downloaded
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f56f91459525d3a811184b5cdf6818%252Fpa%252FUT23109_aa9f44ce303071161aaef18ec3f1dace.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_aa9f44ce303071161aaef18ec3f1dace.jpg already downloaded
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f56f91459525d3a811184b5cdf6818%252Fpa%252FUT23109_c44331a1c06ceb6a8d2a4a866546ddd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_c44331a1c06ceb6a8d2a4a866546ddd0.jpg already downloaded
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f56f91459525d3a811184b5cdf6818%252Fpa%252FUT23109_9042407ae226afd4b63d88e574ae035a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_9042407ae226afd4b63d88e574ae035a.jpg already downloaded
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Ff5%252F86f56f91459525d3a811184b5cdf6818%252Fpa%252FUT23109_7b96932f012ea2f0634dd16bcf8c9dea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_7b96932f012ea2f0634dd16bcf8c9dea.jpg already downloaded
2026-03-30 10:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 393a450d-c958-5281-8b7e-883358155386, identifier: UT23109
2026-03-30 10:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6065d69d-a048-5c0a-b648-82aba84f1ae7 with identifier: MJ14379
2026-03-30 10:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6065d69d-a048-5c0a-b648-82aba84f1ae7 with identifier: MJ14379
2026-03-30 10:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6065d69d-a048-5c0a-b648-82aba84f1ae7 with identifier: MJ14379 to the API
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_666dcaa3ad44a88b3f604ac62bedae27.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:12:42Z',
 'fuel_type': 'petrol',
 'id': '6065d69d-a048-5c0a-b648-82aba84f1ae7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ14379',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 71596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_a8096a6cb264d80b9d8278ec2785edb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_34ce16f5e4038f0bcfc984e855545f6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_eeb70d9538b6938b0418cfb928d09db1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_b427a41f0bb20d0e0a8ea89f2acad27e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_9ef2ab3ac6697c5dc64c63a4c81e4eb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_15fe50e3ec8aa6750fb154ffe93ffa26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_a26196b563673727aed03de54ce5d0e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_54f9499cdaad57e4f05bc9c6c33e882b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_666dcaa3ad44a88b3f604ac62bedae27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6065d69d-a048-5c0a-b648-82aba84f1ae7/6065d69d-a048-5c0a-b648-82aba84f1ae7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/28/1428b2a5fda3279d11bd65054bce624c/pa/MJ14379_02916e133027a3547142588ef9bb2a41.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ14379%27 HTTP/1.1" 200 None
2026-03-30 10:36:24 [auto1.de] INFO: Saving data for MJ14379: {'created_time': 1774866984.984528, 'last_price_update_time': 1774866984.984539, 'auction_closing_time': 1774969962.0}
2026-03-30 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ14379') HTTP/1.1" 204 0
2026-03-30 10:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 393a450d-c958-5281-8b7e-883358155386 with identifier: UT23109
2026-03-30 10:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 393a450d-c958-5281-8b7e-883358155386 with identifier: UT23109
2026-03-30 10:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 393a450d-c958-5281-8b7e-883358155386 with identifier: UT23109 to the API
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UT23109>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 182,
 'expiration_date': '2026-03-31T15:39:55Z',
 'fuel_type': 'petrol',
 'id': '393a450d-c958-5281-8b7e-883358155386',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT23109',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 41125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_7db479c2ff793da9e54efca6f3ec39e8.jpg',
                'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_f8e9c7424c19df1691d91f06ade0556f.jpg',
                'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_dd8c7dcfa1c37ee367d5d0b23bfddf94.jpg',
                'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_a8399348f9bc923f59a1e547e4e4ffec.jpg',
                'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_45b4d51e1fe6243484d408ed31c1a1f8.jpg',
                'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_3fac69d28058ad71e2d05d2c072a15db.jpg',
                'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_aa9f44ce303071161aaef18ec3f1dace.jpg',
                'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_c44331a1c06ceb6a8d2a4a866546ddd0.jpg',
                'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_9042407ae226afd4b63d88e574ae035a.jpg',
                'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_7b96932f012ea2f0634dd16bcf8c9dea.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_393a450d-c958-5281-8b7e-883358155386/393a450d-c958-5281-8b7e-883358155386_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_7db479c2ff793da9e54efca6f3ec39e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_393a450d-c958-5281-8b7e-883358155386/393a450d-c958-5281-8b7e-883358155386_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_f8e9c7424c19df1691d91f06ade0556f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_393a450d-c958-5281-8b7e-883358155386/393a450d-c958-5281-8b7e-883358155386_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_dd8c7dcfa1c37ee367d5d0b23bfddf94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_393a450d-c958-5281-8b7e-883358155386/393a450d-c958-5281-8b7e-883358155386_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_a8399348f9bc923f59a1e547e4e4ffec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_393a450d-c958-5281-8b7e-883358155386/393a450d-c958-5281-8b7e-883358155386_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_45b4d51e1fe6243484d408ed31c1a1f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_393a450d-c958-5281-8b7e-883358155386/393a450d-c958-5281-8b7e-883358155386_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_3fac69d28058ad71e2d05d2c072a15db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_393a450d-c958-5281-8b7e-883358155386/393a450d-c958-5281-8b7e-883358155386_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_aa9f44ce303071161aaef18ec3f1dace.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_393a450d-c958-5281-8b7e-883358155386/393a450d-c958-5281-8b7e-883358155386_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_c44331a1c06ceb6a8d2a4a866546ddd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_393a450d-c958-5281-8b7e-883358155386/393a450d-c958-5281-8b7e-883358155386_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_9042407ae226afd4b63d88e574ae035a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_393a450d-c958-5281-8b7e-883358155386/393a450d-c958-5281-8b7e-883358155386_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/f5/86f56f91459525d3a811184b5cdf6818/pa/UT23109_7b96932f012ea2f0634dd16bcf8c9dea.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Individual',
 'transmission': 'automatic',
 'trim': 'Individual',
 'year': 2016}
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT23109%27 HTTP/1.1" 200 None
2026-03-30 10:36:25 [auto1.de] INFO: Saving data for UT23109: {'created_time': 1774866985.34958, 'last_price_update_time': 1774866985.34959, 'auction_closing_time': 1774971595.0}
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT23109') HTTP/1.1" 204 0
2026-03-30 10:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA27050> (referer: https://www.auto1.com/v1/car-details-view/UA27050/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC62061> (referer: https://www.auto1.com/v1/car-details-view/HC62061/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27275f83-23f6-5fa5-9c91-fa2d5f3374d0 with identifier: UA27050
2026-03-30 10:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27275f83-23f6-5fa5-9c91-fa2d5f3374d0 with scrape type 1
2026-03-30 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 27275f83-23f6-5fa5-9c91-fa2d5f3374d0
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ffd%252Fa1fd09d47fd3f148e5f3249f28919fda%252Fpa%252FUA27050_18d1ff413ce12e425912ded0d62fa8b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/fd/a1fd09d47fd3f148e5f3249f28919fda/pa/UA27050_18d1ff413ce12e425912ded0d62fa8b0.jpg already downloaded
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ffd%252Fa1fd09d47fd3f148e5f3249f28919fda%252Fpa%252FUA27050_7651a7d37e2cc2ed6cdf56ec88028a32.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/fd/a1fd09d47fd3f148e5f3249f28919fda/pa/UA27050_7651a7d37e2cc2ed6cdf56ec88028a32.jpg already downloaded
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ffd%252Fa1fd09d47fd3f148e5f3249f28919fda%252Fpa%252FUA27050_f34a6b8ce71ea70d4b65a021717a7f79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/fd/a1fd09d47fd3f148e5f3249f28919fda/pa/UA27050_f34a6b8ce71ea70d4b65a021717a7f79.jpg already downloaded
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ffd%252Fa1fd09d47fd3f148e5f3249f28919fda%252Fpa%252FUA27050_a7a0885de6086dfc2692381ece8732ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/fd/a1fd09d47fd3f148e5f3249f28919fda/pa/UA27050_a7a0885de6086dfc2692381ece8732ee.jpg already downloaded
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ffd%252Fa1fd09d47fd3f148e5f3249f28919fda%252Fpa%252FUA27050_bce24925810887e6551b0fe44bff7f83.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/fd/a1fd09d47fd3f148e5f3249f28919fda/pa/UA27050_bce24925810887e6551b0fe44bff7f83.jpg already downloaded
2026-03-30 10:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27275f83-23f6-5fa5-9c91-fa2d5f3374d0, identifier: UA27050
2026-03-30 10:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27275f83-23f6-5fa5-9c91-fa2d5f3374d0 with identifier: UA27050
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 10:36:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27275f83-23f6-5fa5-9c91-fa2d5f3374d0 with identifier: UA27050
2026-03-30 10:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27275f83-23f6-5fa5-9c91-fa2d5f3374d0 with identifier: UA27050 to the API
2026-03-30 10:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UA27050>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.3L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:29:18Z',
 'fuel_type': 'petrol',
 'id': '27275f83-23f6-5fa5-9c91-fa2d5f3374d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA27050',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 144337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imga1/fd/a1fd09d47fd3f148e5f3249f28919fda/pa/UA27050_18d1ff413ce12e425912ded0d62fa8b0.jpg',
                'https://img-pa.auto1.com/imga1/fd/a1fd09d47fd3f148e5f3249f28919fda/pa/UA27050_7651a7d37e2cc2ed6cdf56ec88028a32.jpg',
                'https://img-pa.auto1.com/imga1/fd/a1fd09d47fd3f148e5f3249f28919fda/pa/UA27050_f34a6b8ce71ea70d4b65a021717a7f79.jpg',
                'https://img-pa.auto1.com/imga1/fd/a1fd09d47fd3f148e5f3249f28919fda/pa/UA27050_a7a0885de6086dfc2692381ece8732ee.jpg',
                'https://img-pa.auto1.com/imga1/fd/a1fd09d47fd3f148e5f3249f28919fda/pa/UA27050_bce24925810887e6551b0fe44bff7f83.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27275f83-23f6-5fa5-9c91-fa2d5f3374d0/27275f83-23f6-5fa5-9c91-fa2d5f3374d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/fd/a1fd09d47fd3f148e5f3249f28919fda/pa/UA27050_18d1ff413ce12e425912ded0d62fa8b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27275f83-23f6-5fa5-9c91-fa2d5f3374d0/27275f83-23f6-5fa5-9c91-fa2d5f3374d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/fd/a1fd09d47fd3f148e5f3249f28919fda/pa/UA27050_7651a7d37e2cc2ed6cdf56ec88028a32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27275f83-23f6-5fa5-9c91-fa2d5f3374d0/27275f83-23f6-5fa5-9c91-fa2d5f3374d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/fd/a1fd09d47fd3f148e5f3249f28919fda/pa/UA27050_f34a6b8ce71ea70d4b65a021717a7f79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27275f83-23f6-5fa5-9c91-fa2d5f3374d0/27275f83-23f6-5fa5-9c91-fa2d5f3374d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/fd/a1fd09d47fd3f148e5f3249f28919fda/pa/UA27050_a7a0885de6086dfc2692381ece8732ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27275f83-23f6-5fa5-9c91-fa2d5f3374d0/27275f83-23f6-5fa5-9c91-fa2d5f3374d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/fd/a1fd09d47fd3f148e5f3249f28919fda/pa/UA27050_bce24925810887e6551b0fe44bff7f83.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 ClearTec 35 Jahre',
 'transmission': 'manual',
 'trim': 'ClearTec 35 Jahre',
 'year': 2013}
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA27050%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [auto1.de] INFO: Saving data for UA27050: {'created_time': 1774866986.172594, 'last_price_update_time': 1774866986.172604, 'auction_closing_time': 1774970958.0}
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA27050') HTTP/1.1" 204 0
2026-03-30 10:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5e65a45-c396-596f-b681-2000d87b5570 with identifier: HC62061
2026-03-30 10:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e65a45-c396-596f-b681-2000d87b5570 with scrape type 1
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5e65a45-c396-596f-b681-2000d87b5570
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_b8cec2b0146ced317d27057d656a2874.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_b8cec2b0146ced317d27057d656a2874.jpg not downloaded yet
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_0be985e7f7ef021290e4e39fc7e3501c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_0be985e7f7ef021290e4e39fc7e3501c.jpg not downloaded yet
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_64a57d38a8c3af801083cab59d274ec9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_64a57d38a8c3af801083cab59d274ec9.jpg not downloaded yet
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_44f10be06df1d4d36b3158a31ca66d7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_44f10be06df1d4d36b3158a31ca66d7f.jpg not downloaded yet
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_5f7900ce2f62fdcbc7a106fb2266cb67.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_5f7900ce2f62fdcbc7a106fb2266cb67.jpg not downloaded yet
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_76fcf6f7c1dfc1e3b913909fdbae4317.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_76fcf6f7c1dfc1e3b913909fdbae4317.jpg not downloaded yet
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_67b487d60efd3f0b6ab762f6d2ed63ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_67b487d60efd3f0b6ab762f6d2ed63ef.jpg not downloaded yet
2026-03-30 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_b8cec2b0146ced317d27057d656a2874.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_1c3bb59e2599261633de2c307c0691a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_1c3bb59e2599261633de2c307c0691a7.jpg not downloaded yet
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_ad3041c7ed786a210848a7233e0a82e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_ad3041c7ed786a210848a7233e0a82e6.jpg not downloaded yet
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_270c3f2aaed032d0c62f4ce87bca6aa7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_270c3f2aaed032d0c62f4ce87bca6aa7.jpg not downloaded yet
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a76110>
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_b8cec2b0146ced317d27057d656a2874.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_b8cec2b0146ced317d27057d656a2874.jpg saved to cache
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5e65a45-c396-596f-b681-2000d87b5570
2026-03-30 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_64a57d38a8c3af801083cab59d274ec9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_5f7900ce2f62fdcbc7a106fb2266cb67.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_0be985e7f7ef021290e4e39fc7e3501c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_1c3bb59e2599261633de2c307c0691a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_44f10be06df1d4d36b3158a31ca66d7f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_76fcf6f7c1dfc1e3b913909fdbae4317.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_ad3041c7ed786a210848a7233e0a82e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_67b487d60efd3f0b6ab762f6d2ed63ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6b410>
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_64a57d38a8c3af801083cab59d274ec9.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_64a57d38a8c3af801083cab59d274ec9.jpg saved to cache
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5e65a45-c396-596f-b681-2000d87b5570
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b37010>
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_5f7900ce2f62fdcbc7a106fb2266cb67.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_5f7900ce2f62fdcbc7a106fb2266cb67.jpg saved to cache
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5e65a45-c396-596f-b681-2000d87b5570
2026-03-30 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_270c3f2aaed032d0c62f4ce87bca6aa7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b34710>
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_0be985e7f7ef021290e4e39fc7e3501c.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_0be985e7f7ef021290e4e39fc7e3501c.jpg saved to cache
2026-03-30 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5e65a45-c396-596f-b681-2000d87b5570
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a670d0>
2026-03-30 10:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_1c3bb59e2599261633de2c307c0691a7.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_1c3bb59e2599261633de2c307c0691a7.jpg saved to cache
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5e65a45-c396-596f-b681-2000d87b5570
2026-03-30 10:36:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5067010>
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_44f10be06df1d4d36b3158a31ca66d7f.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_44f10be06df1d4d36b3158a31ca66d7f.jpg saved to cache
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5e65a45-c396-596f-b681-2000d87b5570
2026-03-30 10:36:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f2cd0>
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_76fcf6f7c1dfc1e3b913909fdbae4317.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_76fcf6f7c1dfc1e3b913909fdbae4317.jpg saved to cache
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5e65a45-c396-596f-b681-2000d87b5570
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c24d0>
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_ad3041c7ed786a210848a7233e0a82e6.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_ad3041c7ed786a210848a7233e0a82e6.jpg saved to cache
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5e65a45-c396-596f-b681-2000d87b5570
2026-03-30 10:36:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a67150>
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_67b487d60efd3f0b6ab762f6d2ed63ef.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_67b487d60efd3f0b6ab762f6d2ed63ef.jpg saved to cache
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5e65a45-c396-596f-b681-2000d87b5570
2026-03-30 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF24454> (referer: https://www.auto1.com/v1/car-details-view/AF24454/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5999c90>
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Ffc%252F58fc43da97f977933cef58b4725a4f5c%252Fpa%252FHC62061_270c3f2aaed032d0c62f4ce87bca6aa7.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_270c3f2aaed032d0c62f4ce87bca6aa7.jpg saved to cache
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5e65a45-c396-596f-b681-2000d87b5570
2026-03-30 10:36:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5e65a45-c396-596f-b681-2000d87b5570, skipping ID generation
2026-03-30 10:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e65a45-c396-596f-b681-2000d87b5570 with scrape type 1
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5e65a45-c396-596f-b681-2000d87b5570 sending to next pipeline
2026-03-30 10:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5e65a45-c396-596f-b681-2000d87b5570, identifier: HC62061
2026-03-30 10:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5e65a45-c396-596f-b681-2000d87b5570 with identifier: HC62061
2026-03-30 10:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5e65a45-c396-596f-b681-2000d87b5570 with identifier: HC62061
2026-03-30 10:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5e65a45-c396-596f-b681-2000d87b5570 with identifier: HC62061 to the API
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_270c3f2aaed032d0c62f4ce87bca6aa7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:06:18Z',
 'fuel_type': 'petrol',
 'id': 'c5e65a45-c396-596f-b681-2000d87b5570',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC62061',
 'listing': 'auction',
 'location': 'DE, Dornach',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 80822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_b8cec2b0146ced317d27057d656a2874.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2671088,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_0be985e7f7ef021290e4e39fc7e3501c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_64a57d38a8c3af801083cab59d274ec9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2499694,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_44f10be06df1d4d36b3158a31ca66d7f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_5f7900ce2f62fdcbc7a106fb2266cb67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2683979,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_76fcf6f7c1dfc1e3b913909fdbae4317.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2603321,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_67b487d60efd3f0b6ab762f6d2ed63ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_1c3bb59e2599261633de2c307c0691a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_ad3041c7ed786a210848a7233e0a82e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e65a45-c396-596f-b681-2000d87b5570/c5e65a45-c396-596f-b681-2000d87b5570_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/fc/58fc43da97f977933cef58b4725a4f5c/pa/HC62061_270c3f2aaed032d0c62f4ce87bca6aa7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC62061%27 HTTP/1.1" 200 None
2026-03-30 10:36:27 [auto1.de] INFO: Saving data for HC62061: {'created_time': 1774866987.95419, 'last_price_update_time': 1774866987.9542, 'auction_closing_time': 1774969578.0}
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC62061') HTTP/1.1" 204 0
2026-03-30 10:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a43916f-a1dc-534f-9ed7-7cb508ffde13 with identifier: AF24454
2026-03-30 10:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a43916f-a1dc-534f-9ed7-7cb508ffde13 with scrape type 1
2026-03-30 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a43916f-a1dc-534f-9ed7-7cb508ffde13
2026-03-30 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_de5d64ee83928a96ef9cb939c5a2a683.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_de5d64ee83928a96ef9cb939c5a2a683.jpg not downloaded yet
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_bad507075a471072cec44b9ba24249cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_bad507075a471072cec44b9ba24249cc.jpg not downloaded yet
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_ac7a6ad9e52b5d601b89d4937f0e938a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_ac7a6ad9e52b5d601b89d4937f0e938a.jpg not downloaded yet
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_2b945699d86d9c91bfe121dbe4995a84.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_2b945699d86d9c91bfe121dbe4995a84.jpg not downloaded yet
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_9608ded13c7bcf7fd80d097065d7e11d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_9608ded13c7bcf7fd80d097065d7e11d.jpg not downloaded yet
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_d71b29d9307cbb62725d959ea0e97b93.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_d71b29d9307cbb62725d959ea0e97b93.jpg not downloaded yet
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_de52ab327896eaf9eaf2d6a92a2cc10c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_de52ab327896eaf9eaf2d6a92a2cc10c.jpg not downloaded yet
2026-03-30 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_de5d64ee83928a96ef9cb939c5a2a683.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_cd9ba8170e97fe54ab2f72db65c5b838.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_cd9ba8170e97fe54ab2f72db65c5b838.jpg not downloaded yet
2026-03-30 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_ac7a6ad9e52b5d601b89d4937f0e938a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_70ca8c2f58272ed7d75aa57c5305ec4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_70ca8c2f58272ed7d75aa57c5305ec4f.jpg not downloaded yet
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_7047abb8131d30c69e97cf3770d385ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_7047abb8131d30c69e97cf3770d385ff.jpg not downloaded yet
2026-03-30 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_d71b29d9307cbb62725d959ea0e97b93.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_7047abb8131d30c69e97cf3770d385ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5093710>
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_de5d64ee83928a96ef9cb939c5a2a683.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_de5d64ee83928a96ef9cb939c5a2a683.jpg saved to cache
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a43916f-a1dc-534f-9ed7-7cb508ffde13
2026-03-30 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_70ca8c2f58272ed7d75aa57c5305ec4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_cd9ba8170e97fe54ab2f72db65c5b838.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_bad507075a471072cec44b9ba24249cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5115450>
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_ac7a6ad9e52b5d601b89d4937f0e938a.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_ac7a6ad9e52b5d601b89d4937f0e938a.jpg saved to cache
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a43916f-a1dc-534f-9ed7-7cb508ffde13
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5072890>
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_d71b29d9307cbb62725d959ea0e97b93.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_d71b29d9307cbb62725d959ea0e97b93.jpg saved to cache
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a43916f-a1dc-534f-9ed7-7cb508ffde13
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f85010>
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_7047abb8131d30c69e97cf3770d385ff.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_7047abb8131d30c69e97cf3770d385ff.jpg saved to cache
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a43916f-a1dc-534f-9ed7-7cb508ffde13
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59bf5d0>
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_70ca8c2f58272ed7d75aa57c5305ec4f.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_70ca8c2f58272ed7d75aa57c5305ec4f.jpg saved to cache
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a43916f-a1dc-534f-9ed7-7cb508ffde13
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ab8710>
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_cd9ba8170e97fe54ab2f72db65c5b838.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_cd9ba8170e97fe54ab2f72db65c5b838.jpg saved to cache
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a43916f-a1dc-534f-9ed7-7cb508ffde13
2026-03-30 10:36:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef505dd10>
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_bad507075a471072cec44b9ba24249cc.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_bad507075a471072cec44b9ba24249cc.jpg saved to cache
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a43916f-a1dc-534f-9ed7-7cb508ffde13
2026-03-30 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_2b945699d86d9c91bfe121dbe4995a84.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_9608ded13c7bcf7fd80d097065d7e11d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_de52ab327896eaf9eaf2d6a92a2cc10c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50196d0>
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_2b945699d86d9c91bfe121dbe4995a84.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_2b945699d86d9c91bfe121dbe4995a84.jpg saved to cache
2026-03-30 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a43916f-a1dc-534f-9ed7-7cb508ffde13
2026-03-30 10:36:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a8c190>
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_9608ded13c7bcf7fd80d097065d7e11d.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_9608ded13c7bcf7fd80d097065d7e11d.jpg saved to cache
2026-03-30 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a43916f-a1dc-534f-9ed7-7cb508ffde13
2026-03-30 10:36:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b332d0>
2026-03-30 10:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F30%252F28302f6cf3bb4a37b06e2cd476f67532%252Fpa%252FAF24454_de52ab327896eaf9eaf2d6a92a2cc10c.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_de52ab327896eaf9eaf2d6a92a2cc10c.jpg saved to cache
2026-03-30 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a43916f-a1dc-534f-9ed7-7cb508ffde13
2026-03-30 10:36:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a43916f-a1dc-534f-9ed7-7cb508ffde13, skipping ID generation
2026-03-30 10:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a43916f-a1dc-534f-9ed7-7cb508ffde13 with scrape type 1
2026-03-30 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a43916f-a1dc-534f-9ed7-7cb508ffde13 sending to next pipeline
2026-03-30 10:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a43916f-a1dc-534f-9ed7-7cb508ffde13, identifier: AF24454
2026-03-30 10:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a43916f-a1dc-534f-9ed7-7cb508ffde13 with identifier: AF24454
2026-03-30 10:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a43916f-a1dc-534f-9ed7-7cb508ffde13 with identifier: AF24454
2026-03-30 10:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a43916f-a1dc-534f-9ed7-7cb508ffde13 with identifier: AF24454 to the API
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_de52ab327896eaf9eaf2d6a92a2cc10c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 380,
 'expiration_date': '2026-03-31T15:51:37Z',
 'fuel_type': 'petrol',
 'id': '1a43916f-a1dc-534f-9ed7-7cb508ffde13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF24454',
 'listing': 'auction',
 'location': 'DE, Bitburg',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 139616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_de5d64ee83928a96ef9cb939c5a2a683.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2602342,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_bad507075a471072cec44b9ba24249cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_ac7a6ad9e52b5d601b89d4937f0e938a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2369505,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_2b945699d86d9c91bfe121dbe4995a84.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2422789,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_9608ded13c7bcf7fd80d097065d7e11d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_d71b29d9307cbb62725d959ea0e97b93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2545438,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_de52ab327896eaf9eaf2d6a92a2cc10c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_cd9ba8170e97fe54ab2f72db65c5b838.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_70ca8c2f58272ed7d75aa57c5305ec4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a43916f-a1dc-534f-9ed7-7cb508ffde13/1a43916f-a1dc-534f-9ed7-7cb508ffde13_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/30/28302f6cf3bb4a37b06e2cd476f67532/pa/AF24454_7047abb8131d30c69e97cf3770d385ff.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 45 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2016}
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF24454%27 HTTP/1.1" 200 None
2026-03-30 10:36:29 [auto1.de] INFO: Saving data for AF24454: {'created_time': 1774866989.654604, 'last_price_update_time': 1774866989.654613, 'auction_closing_time': 1774972297.0}
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF24454') HTTP/1.1" 204 0
2026-03-30 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FY79679> (referer: https://www.auto1.com/v1/car-details-view/FY79679/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR78906> (referer: https://www.auto1.com/v1/car-details-view/SR78906/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b with identifier: FY79679
2026-03-30 10:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b with scrape type 1
2026-03-30 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_4d276abc63ff8fe4d12b92de01c861da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_4d276abc63ff8fe4d12b92de01c861da.jpg not downloaded yet
2026-03-30 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_7cd5908ac84e481dd082e6aaa20fc056.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_7cd5908ac84e481dd082e6aaa20fc056.jpg not downloaded yet
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_896dbe53e5413eabf0e225e9a40cc85c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_896dbe53e5413eabf0e225e9a40cc85c.jpg not downloaded yet
2026-03-30 10:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55b09e4a-4be8-5798-85eb-f7ce8f948c8a with identifier: SR78906
2026-03-30 10:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55b09e4a-4be8-5798-85eb-f7ce8f948c8a with scrape type 1
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55b09e4a-4be8-5798-85eb-f7ce8f948c8a
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_619e485599a7f60320681d718334d31f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_619e485599a7f60320681d718334d31f.jpg not downloaded yet
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_db49980b062ca2c4006a7fe452a8365f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_db49980b062ca2c4006a7fe452a8365f.jpg not downloaded yet
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_fbcb821fbf69b17959cdaa04cad9c76b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_fbcb821fbf69b17959cdaa04cad9c76b.jpg not downloaded yet
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_4d1a31843b3493b9ae6d54f4ae3aba86.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_4d1a31843b3493b9ae6d54f4ae3aba86.jpg not downloaded yet
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_4d276abc63ff8fe4d12b92de01c861da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_de42184161149ba143caeaed32cb5920.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_de42184161149ba143caeaed32cb5920.jpg not downloaded yet
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_3ce8a1e924ee97a4d9772dcac8415ffd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_3ce8a1e924ee97a4d9772dcac8415ffd.jpg not downloaded yet
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_38215a6c24de1c935eae4d14d3528e0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_38215a6c24de1c935eae4d14d3528e0a.jpg not downloaded yet
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_a1161b235bef419baa7d02e5091212c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_a1161b235bef419baa7d02e5091212c2.jpg not downloaded yet
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_619e485599a7f60320681d718334d31f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_1ccfd63d954e3ad43336e9b55c82b766.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_1ccfd63d954e3ad43336e9b55c82b766.jpg not downloaded yet
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_5aa5411998801d722fbd1d47c6f876f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_5aa5411998801d722fbd1d47c6f876f4.jpg not downloaded yet
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_766e77f9ee109a5d902dc3446042659d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_766e77f9ee109a5d902dc3446042659d.jpg not downloaded yet
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_ecf4a7228ca66895dfd4689f1dab93b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_ecf4a7228ca66895dfd4689f1dab93b7.jpg not downloaded yet
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b286d0>
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_4d276abc63ff8fe4d12b92de01c861da.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_4d276abc63ff8fe4d12b92de01c861da.jpg saved to cache
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_7cd5908ac84e481dd082e6aaa20fc056.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_278b54ffd22f13d1353fd23854c75105.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_278b54ffd22f13d1353fd23854c75105.jpg not downloaded yet
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_896dbe53e5413eabf0e225e9a40cc85c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_964a6dde3c30e1d9353e83914652dc7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_964a6dde3c30e1d9353e83914652dc7c.jpg not downloaded yet
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_db49980b062ca2c4006a7fe452a8365f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_3ce8a1e924ee97a4d9772dcac8415ffd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_4d1a31843b3493b9ae6d54f4ae3aba86.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_4384bd4d988529414940f085df9a9a4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_4384bd4d988529414940f085df9a9a4d.jpg not downloaded yet
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_38215a6c24de1c935eae4d14d3528e0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_0faebb10039ca7ae62534297d1980442.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_0faebb10039ca7ae62534297d1980442.jpg not downloaded yet
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd1f90>
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_619e485599a7f60320681d718334d31f.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_619e485599a7f60320681d718334d31f.jpg saved to cache
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55b09e4a-4be8-5798-85eb-f7ce8f948c8a
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_90b95e68ac26ee772c02e63db874990b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_90b95e68ac26ee772c02e63db874990b.jpg not downloaded yet
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe1150>
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_7cd5908ac84e481dd082e6aaa20fc056.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_7cd5908ac84e481dd082e6aaa20fc056.jpg saved to cache
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50a8090>
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_896dbe53e5413eabf0e225e9a40cc85c.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_896dbe53e5413eabf0e225e9a40cc85c.jpg saved to cache
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5047d90>
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_db49980b062ca2c4006a7fe452a8365f.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_db49980b062ca2c4006a7fe452a8365f.jpg saved to cache
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50a8710>
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_3ce8a1e924ee97a4d9772dcac8415ffd.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_3ce8a1e924ee97a4d9772dcac8415ffd.jpg saved to cache
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fa0390>
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_4d1a31843b3493b9ae6d54f4ae3aba86.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_4d1a31843b3493b9ae6d54f4ae3aba86.jpg saved to cache
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_a1161b235bef419baa7d02e5091212c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_5aa5411998801d722fbd1d47c6f876f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_ecf4a7228ca66895dfd4689f1dab93b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_278b54ffd22f13d1353fd23854c75105.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a79c50>
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_38215a6c24de1c935eae4d14d3528e0a.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_38215a6c24de1c935eae4d14d3528e0a.jpg saved to cache
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55b09e4a-4be8-5798-85eb-f7ce8f948c8a
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_de42184161149ba143caeaed32cb5920.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_fbcb821fbf69b17959cdaa04cad9c76b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_766e77f9ee109a5d902dc3446042659d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_1ccfd63d954e3ad43336e9b55c82b766.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f1090>
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_a1161b235bef419baa7d02e5091212c2.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_a1161b235bef419baa7d02e5091212c2.jpg saved to cache
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f70e90>
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_5aa5411998801d722fbd1d47c6f876f4.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_5aa5411998801d722fbd1d47c6f876f4.jpg saved to cache
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c27d0>
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_ecf4a7228ca66895dfd4689f1dab93b7.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_ecf4a7228ca66895dfd4689f1dab93b7.jpg saved to cache
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd2790>
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_278b54ffd22f13d1353fd23854c75105.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_278b54ffd22f13d1353fd23854c75105.jpg saved to cache
2026-03-30 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55b09e4a-4be8-5798-85eb-f7ce8f948c8a
2026-03-30 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_0faebb10039ca7ae62534297d1980442.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_4384bd4d988529414940f085df9a9a4d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_964a6dde3c30e1d9353e83914652dc7c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_90b95e68ac26ee772c02e63db874990b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe2090>
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_de42184161149ba143caeaed32cb5920.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_de42184161149ba143caeaed32cb5920.jpg saved to cache
2026-03-30 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55b09e4a-4be8-5798-85eb-f7ce8f948c8a
2026-03-30 10:36:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8ddd0>
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_fbcb821fbf69b17959cdaa04cad9c76b.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_fbcb821fbf69b17959cdaa04cad9c76b.jpg saved to cache
2026-03-30 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55b09e4a-4be8-5798-85eb-f7ce8f948c8a
2026-03-30 10:36:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe2510>
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_766e77f9ee109a5d902dc3446042659d.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_766e77f9ee109a5d902dc3446042659d.jpg saved to cache
2026-03-30 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55b09e4a-4be8-5798-85eb-f7ce8f948c8a
2026-03-30 10:36:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5119050>
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_1ccfd63d954e3ad43336e9b55c82b766.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_1ccfd63d954e3ad43336e9b55c82b766.jpg saved to cache
2026-03-30 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55b09e4a-4be8-5798-85eb-f7ce8f948c8a
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a327d0>
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_0faebb10039ca7ae62534297d1980442.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_0faebb10039ca7ae62534297d1980442.jpg saved to cache
2026-03-30 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55b09e4a-4be8-5798-85eb-f7ce8f948c8a
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef511c510>
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_4384bd4d988529414940f085df9a9a4d.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_4384bd4d988529414940f085df9a9a4d.jpg saved to cache
2026-03-30 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55b09e4a-4be8-5798-85eb-f7ce8f948c8a
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50e6f90>
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F6c%252F596ce04e44c9c05e82c351dbf50eac3f%252Fpa%252FFY79679_964a6dde3c30e1d9353e83914652dc7c.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_964a6dde3c30e1d9353e83914652dc7c.jpg saved to cache
2026-03-30 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b
2026-03-30 10:36:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b, skipping ID generation
2026-03-30 10:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b with scrape type 1
2026-03-30 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b sending to next pipeline
2026-03-30 10:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b, identifier: FY79679
2026-03-30 10:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b36410>
2026-03-30 10:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F6a%252F2e6adfb94d36ab0e391debc87744c81c%252Fpa%252FSR78906_90b95e68ac26ee772c02e63db874990b.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_90b95e68ac26ee772c02e63db874990b.jpg saved to cache
2026-03-30 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55b09e4a-4be8-5798-85eb-f7ce8f948c8a
2026-03-30 10:36:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55b09e4a-4be8-5798-85eb-f7ce8f948c8a, skipping ID generation
2026-03-30 10:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55b09e4a-4be8-5798-85eb-f7ce8f948c8a with scrape type 1
2026-03-30 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55b09e4a-4be8-5798-85eb-f7ce8f948c8a sending to next pipeline
2026-03-30 10:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55b09e4a-4be8-5798-85eb-f7ce8f948c8a, identifier: SR78906
2026-03-30 10:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE05106> (referer: https://www.auto1.com/v1/car-details-view/ZE05106/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b with identifier: FY79679
2026-03-30 10:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b with identifier: FY79679
2026-03-30 10:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b with identifier: FY79679 to the API
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_964a6dde3c30e1d9353e83914652dc7c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 181,
 'expiration_date': '2026-03-31T15:42:16Z',
 'fuel_type': 'petrol',
 'id': '7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY79679',
 'listing': 'auction',
 'location': 'DE, Saarlouis',
 'make': 'Citroen',
 'model': 'C4 Grand Spacetourer',
 'odometer': 115751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_4d276abc63ff8fe4d12b92de01c861da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_7cd5908ac84e481dd082e6aaa20fc056.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_896dbe53e5413eabf0e225e9a40cc85c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_db49980b062ca2c4006a7fe452a8365f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_4d1a31843b3493b9ae6d54f4ae3aba86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_3ce8a1e924ee97a4d9772dcac8415ffd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_a1161b235bef419baa7d02e5091212c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_5aa5411998801d722fbd1d47c6f876f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_ecf4a7228ca66895dfd4689f1dab93b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b/7e2e24de-e8e9-53dd-95e8-4f1e740d4b7b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/6c/596ce04e44c9c05e82c351dbf50eac3f/pa/FY79679_964a6dde3c30e1d9353e83914652dc7c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-24',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Spacetourer 1.6 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2019}
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY79679%27 HTTP/1.1" 200 None
2026-03-30 10:36:33 [auto1.de] INFO: Saving data for FY79679: {'created_time': 1774866993.538697, 'last_price_update_time': 1774866993.538707, 'auction_closing_time': 1774971736.0}
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY79679') HTTP/1.1" 204 0
2026-03-30 10:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55b09e4a-4be8-5798-85eb-f7ce8f948c8a with identifier: SR78906
2026-03-30 10:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55b09e4a-4be8-5798-85eb-f7ce8f948c8a with identifier: SR78906
2026-03-30 10:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55b09e4a-4be8-5798-85eb-f7ce8f948c8a with identifier: SR78906 to the API
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_90b95e68ac26ee772c02e63db874990b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.7L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:54:21Z',
 'fuel_type': 'diesel',
 'id': '55b09e4a-4be8-5798-85eb-f7ce8f948c8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR78906',
 'listing': 'auction',
 'location': 'DE, Heidelberg',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 123379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_619e485599a7f60320681d718334d31f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3288747,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_fbcb821fbf69b17959cdaa04cad9c76b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3028910,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_de42184161149ba143caeaed32cb5920.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_38215a6c24de1c935eae4d14d3528e0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3207399,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_1ccfd63d954e3ad43336e9b55c82b766.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2944509,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_766e77f9ee109a5d902dc3446042659d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_278b54ffd22f13d1353fd23854c75105.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_4384bd4d988529414940f085df9a9a4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_0faebb10039ca7ae62534297d1980442.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b09e4a-4be8-5798-85eb-f7ce8f948c8a/55b09e4a-4be8-5798-85eb-f7ce8f948c8a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/6a/2e6adfb94d36ab0e391debc87744c81c/pa/SR78906_90b95e68ac26ee772c02e63db874990b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi Style 2WD',
 'transmission': 'manual',
 'trim': 'Style 2WD',
 'year': 2011}
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR78906%27 HTTP/1.1" 200 None
2026-03-30 10:36:33 [auto1.de] INFO: Saving data for SR78906: {'created_time': 1774866993.90761, 'last_price_update_time': 1774866993.907621, 'auction_closing_time': 1774972461.0}
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR78906') HTTP/1.1" 204 0
2026-03-30 10:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8afc01fc-cdb8-5d87-be55-dc0bf9734b15 with identifier: ZE05106
2026-03-30 10:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8afc01fc-cdb8-5d87-be55-dc0bf9734b15 with scrape type 1
2026-03-30 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8afc01fc-cdb8-5d87-be55-dc0bf9734b15
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fef%252F1eef10bd4c168833e2aed0579e7bfc94%252Fpa%252FZE05106_396941dcb26e824d03060c4ab3445e21.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_396941dcb26e824d03060c4ab3445e21.jpg already downloaded
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fef%252F1eef10bd4c168833e2aed0579e7bfc94%252Fpa%252FZE05106_ad2d2803051314c1d6d2cab549119bfd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_ad2d2803051314c1d6d2cab549119bfd.jpg already downloaded
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fef%252F1eef10bd4c168833e2aed0579e7bfc94%252Fpa%252FZE05106_c849e50990d06eb12dca9533afba4d47.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_c849e50990d06eb12dca9533afba4d47.jpg already downloaded
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fef%252F1eef10bd4c168833e2aed0579e7bfc94%252Fpa%252FZE05106_ced0e0524fc0481438399df4aac2454a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_ced0e0524fc0481438399df4aac2454a.jpg already downloaded
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fef%252F1eef10bd4c168833e2aed0579e7bfc94%252Fpa%252FZE05106_d6f85a1f27be12bdfdbc8c964a1af064.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_d6f85a1f27be12bdfdbc8c964a1af064.jpg already downloaded
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fef%252F1eef10bd4c168833e2aed0579e7bfc94%252Fpa%252FZE05106_bd399d8073f440e860de0585055f53fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_bd399d8073f440e860de0585055f53fb.jpg already downloaded
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fef%252F1eef10bd4c168833e2aed0579e7bfc94%252Fpa%252FZE05106_387370631cbe59b6fefa36f571ce8877.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_387370631cbe59b6fefa36f571ce8877.jpg already downloaded
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fef%252F1eef10bd4c168833e2aed0579e7bfc94%252Fpa%252FZE05106_ff323bbe55341bd86245b398b98b94e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_ff323bbe55341bd86245b398b98b94e8.jpg already downloaded
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fef%252F1eef10bd4c168833e2aed0579e7bfc94%252Fpa%252FZE05106_fbcc75ebb2c36534a2d176e8925b2968.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_fbcc75ebb2c36534a2d176e8925b2968.jpg already downloaded
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fef%252F1eef10bd4c168833e2aed0579e7bfc94%252Fpa%252FZE05106_b49b990ebfbbbaae3fc32a311af2dc14.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_b49b990ebfbbbaae3fc32a311af2dc14.jpg already downloaded
2026-03-30 10:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8afc01fc-cdb8-5d87-be55-dc0bf9734b15, identifier: ZE05106
2026-03-30 10:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8afc01fc-cdb8-5d87-be55-dc0bf9734b15 with identifier: ZE05106
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 10:36:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8afc01fc-cdb8-5d87-be55-dc0bf9734b15 with identifier: ZE05106
2026-03-30 10:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8afc01fc-cdb8-5d87-be55-dc0bf9734b15 with identifier: ZE05106 to the API
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZE05106>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:10:38Z',
 'fuel_type': 'gas',
 'id': '8afc01fc-cdb8-5d87-be55-dc0bf9734b15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE05106',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Iveco',
 'model': 'Daily',
 'odometer': 28640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_396941dcb26e824d03060c4ab3445e21.jpg',
                'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_ad2d2803051314c1d6d2cab549119bfd.jpg',
                'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_c849e50990d06eb12dca9533afba4d47.jpg',
                'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_ced0e0524fc0481438399df4aac2454a.jpg',
                'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_d6f85a1f27be12bdfdbc8c964a1af064.jpg',
                'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_bd399d8073f440e860de0585055f53fb.jpg',
                'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_387370631cbe59b6fefa36f571ce8877.jpg',
                'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_ff323bbe55341bd86245b398b98b94e8.jpg',
                'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_fbcc75ebb2c36534a2d176e8925b2968.jpg',
                'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_b49b990ebfbbbaae3fc32a311af2dc14.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc01fc-cdb8-5d87-be55-dc0bf9734b15/8afc01fc-cdb8-5d87-be55-dc0bf9734b15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_396941dcb26e824d03060c4ab3445e21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc01fc-cdb8-5d87-be55-dc0bf9734b15/8afc01fc-cdb8-5d87-be55-dc0bf9734b15_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_ad2d2803051314c1d6d2cab549119bfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc01fc-cdb8-5d87-be55-dc0bf9734b15/8afc01fc-cdb8-5d87-be55-dc0bf9734b15_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_c849e50990d06eb12dca9533afba4d47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc01fc-cdb8-5d87-be55-dc0bf9734b15/8afc01fc-cdb8-5d87-be55-dc0bf9734b15_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_ced0e0524fc0481438399df4aac2454a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc01fc-cdb8-5d87-be55-dc0bf9734b15/8afc01fc-cdb8-5d87-be55-dc0bf9734b15_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_d6f85a1f27be12bdfdbc8c964a1af064.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc01fc-cdb8-5d87-be55-dc0bf9734b15/8afc01fc-cdb8-5d87-be55-dc0bf9734b15_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_bd399d8073f440e860de0585055f53fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc01fc-cdb8-5d87-be55-dc0bf9734b15/8afc01fc-cdb8-5d87-be55-dc0bf9734b15_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_387370631cbe59b6fefa36f571ce8877.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc01fc-cdb8-5d87-be55-dc0bf9734b15/8afc01fc-cdb8-5d87-be55-dc0bf9734b15_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_ff323bbe55341bd86245b398b98b94e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc01fc-cdb8-5d87-be55-dc0bf9734b15/8afc01fc-cdb8-5d87-be55-dc0bf9734b15_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2968788,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_fbcc75ebb2c36534a2d176e8925b2968.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8afc01fc-cdb8-5d87-be55-dc0bf9734b15/8afc01fc-cdb8-5d87-be55-dc0bf9734b15_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ef/1eef10bd4c168833e2aed0579e7bfc94/pa/ZE05106_b49b990ebfbbbaae3fc32a311af2dc14.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Iveco Daily 3.0 CNG HKa 50 C V Radstand 3520 L',
 'transmission': 'manual',
 'trim': 'HKa 50 C V Radstand 3520 L',
 'year': 2019}
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE05106%27 HTTP/1.1" 200 None
2026-03-30 10:36:34 [auto1.de] INFO: Saving data for ZE05106: {'created_time': 1774866994.739189, 'last_price_update_time': 1774866994.739201, 'auction_closing_time': 1774969838.0}
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE05106') HTTP/1.1" 204 0
2026-03-30 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH00073> (referer: https://www.auto1.com/v1/car-details-view/KH00073/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1296bbdb-727d-531b-934f-2715ef4778a4 with identifier: KH00073
2026-03-30 10:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1296bbdb-727d-531b-934f-2715ef4778a4 with scrape type 1
2026-03-30 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1296bbdb-727d-531b-934f-2715ef4778a4
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_2f9efdeafbbf901978148fe33a915619.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_2f9efdeafbbf901978148fe33a915619.jpg not downloaded yet
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_feba318c66ff898ca5c1f68a83d1974b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_feba318c66ff898ca5c1f68a83d1974b.jpg not downloaded yet
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_599dbcfd114326279a2c9f013b80a942.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_599dbcfd114326279a2c9f013b80a942.jpg not downloaded yet
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_fde5609896a3928d5e0f0aa3a53f4bb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_fde5609896a3928d5e0f0aa3a53f4bb3.jpg not downloaded yet
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_52ab21e4e9bcd74206e15da6917e4424.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_52ab21e4e9bcd74206e15da6917e4424.jpg not downloaded yet
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_c97924b4f4d63c4766e96f60743f48e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_c97924b4f4d63c4766e96f60743f48e0.jpg not downloaded yet
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_e0d37dd64724245d511fe986328d24e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_e0d37dd64724245d511fe986328d24e1.jpg not downloaded yet
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_8b95e32097b9a73dddc4d98582cc3ca9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_8b95e32097b9a73dddc4d98582cc3ca9.jpg not downloaded yet
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_9fffcb7174c328dbf723cdbdc4cd02c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_9fffcb7174c328dbf723cdbdc4cd02c1.jpg not downloaded yet
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_d7a1b690fdd468b652170b00b29e379e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_d7a1b690fdd468b652170b00b29e379e.jpg not downloaded yet
2026-03-30 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_52ab21e4e9bcd74206e15da6917e4424.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_c97924b4f4d63c4766e96f60743f48e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_e0d37dd64724245d511fe986328d24e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_9fffcb7174c328dbf723cdbdc4cd02c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_8b95e32097b9a73dddc4d98582cc3ca9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_d7a1b690fdd468b652170b00b29e379e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_599dbcfd114326279a2c9f013b80a942.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_2f9efdeafbbf901978148fe33a915619.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_fde5609896a3928d5e0f0aa3a53f4bb3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a960d0>
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_52ab21e4e9bcd74206e15da6917e4424.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_52ab21e4e9bcd74206e15da6917e4424.jpg saved to cache
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1296bbdb-727d-531b-934f-2715ef4778a4
2026-03-30 10:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_feba318c66ff898ca5c1f68a83d1974b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50cd850>
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_c97924b4f4d63c4766e96f60743f48e0.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_c97924b4f4d63c4766e96f60743f48e0.jpg saved to cache
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1296bbdb-727d-531b-934f-2715ef4778a4
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f1690>
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_e0d37dd64724245d511fe986328d24e1.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_e0d37dd64724245d511fe986328d24e1.jpg saved to cache
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1296bbdb-727d-531b-934f-2715ef4778a4
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5007b10>
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_9fffcb7174c328dbf723cdbdc4cd02c1.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_9fffcb7174c328dbf723cdbdc4cd02c1.jpg saved to cache
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1296bbdb-727d-531b-934f-2715ef4778a4
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a8f8d0>
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_8b95e32097b9a73dddc4d98582cc3ca9.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_8b95e32097b9a73dddc4d98582cc3ca9.jpg saved to cache
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1296bbdb-727d-531b-934f-2715ef4778a4
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b09950>
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_d7a1b690fdd468b652170b00b29e379e.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_d7a1b690fdd468b652170b00b29e379e.jpg saved to cache
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1296bbdb-727d-531b-934f-2715ef4778a4
2026-03-30 10:36:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fff810>
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_599dbcfd114326279a2c9f013b80a942.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_599dbcfd114326279a2c9f013b80a942.jpg saved to cache
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1296bbdb-727d-531b-934f-2715ef4778a4
2026-03-30 10:36:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a32d50>
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_2f9efdeafbbf901978148fe33a915619.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_2f9efdeafbbf901978148fe33a915619.jpg saved to cache
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1296bbdb-727d-531b-934f-2715ef4778a4
2026-03-30 10:36:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5aaf8d0>
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_fde5609896a3928d5e0f0aa3a53f4bb3.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_fde5609896a3928d5e0f0aa3a53f4bb3.jpg saved to cache
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1296bbdb-727d-531b-934f-2715ef4778a4
2026-03-30 10:36:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b0e90>
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252Fca%252F69ca9eba291e790576a3534874261753%252Fpa%252FKH00073_feba318c66ff898ca5c1f68a83d1974b.jpg') HTTP/1.1" 204 0
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_feba318c66ff898ca5c1f68a83d1974b.jpg saved to cache
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1296bbdb-727d-531b-934f-2715ef4778a4
2026-03-30 10:36:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1296bbdb-727d-531b-934f-2715ef4778a4, skipping ID generation
2026-03-30 10:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1296bbdb-727d-531b-934f-2715ef4778a4 with scrape type 1
2026-03-30 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1296bbdb-727d-531b-934f-2715ef4778a4 sending to next pipeline
2026-03-30 10:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1296bbdb-727d-531b-934f-2715ef4778a4, identifier: KH00073
2026-03-30 10:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1296bbdb-727d-531b-934f-2715ef4778a4 with identifier: KH00073
2026-03-30 10:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1296bbdb-727d-531b-934f-2715ef4778a4 with identifier: KH00073
2026-03-30 10:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1296bbdb-727d-531b-934f-2715ef4778a4 with identifier: KH00073 to the API
2026-03-30 10:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_feba318c66ff898ca5c1f68a83d1974b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:23:50Z',
 'fuel_type': 'petrol',
 'id': '1296bbdb-727d-531b-934f-2715ef4778a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH00073',
 'listing': 'auction',
 'location': 'DE, Bielefeld',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 45910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2574740,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_2f9efdeafbbf901978148fe33a915619.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2288392,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_feba318c66ff898ca5c1f68a83d1974b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2512039,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_599dbcfd114326279a2c9f013b80a942.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2380843,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_fde5609896a3928d5e0f0aa3a53f4bb3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_52ab21e4e9bcd74206e15da6917e4424.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_c97924b4f4d63c4766e96f60743f48e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_e0d37dd64724245d511fe986328d24e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_8b95e32097b9a73dddc4d98582cc3ca9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_9fffcb7174c328dbf723cdbdc4cd02c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1296bbdb-727d-531b-934f-2715ef4778a4/1296bbdb-727d-531b-934f-2715ef4778a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/ca/69ca9eba291e790576a3534874261753/pa/KH00073_d7a1b690fdd468b652170b00b29e379e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Grand Scenic 2.0 BOSE Edition',
 'transmission': 'automatic',
 'trim': 'BOSE Edition',
 'year': 2013}
2026-03-30 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH00073%27 HTTP/1.1" 200 None
2026-03-30 10:36:37 [auto1.de] INFO: Saving data for KH00073: {'created_time': 1774866997.695817, 'last_price_update_time': 1774866997.695827, 'auction_closing_time': 1774970630.0}
2026-03-30 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH00073') HTTP/1.1" 204 0
2026-03-30 10:37:03 [scrapy.extensions.logstats] INFO: Crawled 62 pages (at 25 pages/min), scraped 40 items (at 14 items/min)
2026-03-30 10:37:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-30 10:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:04 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 9422 | hits on page: 40
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: ND23678
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: YP09894
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: KH00073
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH00073%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [auto1.de] INFO: Scrape type for KH00073: 0
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: MW69190
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: UT23109
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT23109%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [auto1.de] INFO: Scrape type for UT23109: 0
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: HC62061
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC62061%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [auto1.de] INFO: Scrape type for HC62061: 0
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: DV69723
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: LJ61664
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: PT71111
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT71111%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [auto1.de] INFO: Scrape type for PT71111: 1
2026-03-30 10:37:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: MR59336
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: BZ99779
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ99779%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [auto1.de] INFO: Scrape type for BZ99779: 1
2026-03-30 10:37:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: KS12062
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: HP60079
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: EH27268
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: YY16041
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY16041%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [auto1.de] INFO: Scrape type for YY16041: 1
2026-03-30 10:37:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: NH36418
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: ME91178
2026-03-30 10:37:04 [auto1.de] INFO: Found listing with ID: CK82511
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK82511%27 HTTP/1.1" 200 None
2026-03-30 10:37:04 [auto1.de] INFO: Scrape type for CK82511: 2
2026-03-30 10:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d4b37f2-1cd7-592c-a835-c0f63e31afae with identifier: CK82511
2026-03-30 10:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d4b37f2-1cd7-592c-a835-c0f63e31afae with scrape type 2
2026-03-30 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d4b37f2-1cd7-592c-a835-c0f63e31afae with scrape type 2
2026-03-30 10:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d4b37f2-1cd7-592c-a835-c0f63e31afae, identifier: CK82511
2026-03-30 10:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d4b37f2-1cd7-592c-a835-c0f63e31afae with identifier: CK82511
2026-03-30 10:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d4b37f2-1cd7-592c-a835-c0f63e31afae with identifier: CK82511
2026-03-30 10:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d4b37f2-1cd7-592c-a835-c0f63e31afae with identifier: CK82511 to the API
2026-03-30 10:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:14:23Z',
 'fuel_type': 'petrol',
 'id': '3d4b37f2-1cd7-592c-a835-c0f63e31afae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK82511',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 158747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-28',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2019}
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK82511%27 HTTP/1.1" 200 None
2026-03-30 10:37:05 [auto1.de] INFO: Saving data for CK82511: {'auction_closing_time': 1774970063.0, 'created_time': 1773688520.516099, 'last_price_update_time': 1774867025.229967}
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK82511') HTTP/1.1" 204 0
2026-03-30 10:37:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:05 [auto1.de] INFO: Found listing with ID: HR29759
2026-03-30 10:37:05 [auto1.de] INFO: Found listing with ID: XU95663
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU95663%27 HTTP/1.1" 200 None
2026-03-30 10:37:05 [auto1.de] INFO: Scrape type for XU95663: 2
2026-03-30 10:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e8675fc-a230-53b1-9fb6-3e69b60c5e1b with identifier: XU95663
2026-03-30 10:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e8675fc-a230-53b1-9fb6-3e69b60c5e1b with scrape type 2
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e8675fc-a230-53b1-9fb6-3e69b60c5e1b with scrape type 2
2026-03-30 10:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e8675fc-a230-53b1-9fb6-3e69b60c5e1b, identifier: XU95663
2026-03-30 10:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e8675fc-a230-53b1-9fb6-3e69b60c5e1b with identifier: XU95663
2026-03-30 10:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e8675fc-a230-53b1-9fb6-3e69b60c5e1b with identifier: XU95663
2026-03-30 10:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e8675fc-a230-53b1-9fb6-3e69b60c5e1b with identifier: XU95663 to the API
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-31T15:14:01Z',
 'fuel_type': 'petrol',
 'id': '4e8675fc-a230-53b1-9fb6-3e69b60c5e1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU95663',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 94116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-28',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Skyactiv-G Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2019}
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU95663%27 HTTP/1.1" 200 None
2026-03-30 10:37:05 [auto1.de] INFO: Saving data for XU95663: {'auction_closing_time': 1774970041.0, 'created_time': 1773346180.606394, 'last_price_update_time': 1774867025.841059}
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU95663') HTTP/1.1" 204 0
2026-03-30 10:37:05 [auto1.de] INFO: Found listing with ID: DE87976
2026-03-30 10:37:05 [auto1.de] INFO: Found listing with ID: LA83514
2026-03-30 10:37:05 [auto1.de] INFO: Found listing with ID: EJ77666
2026-03-30 10:37:05 [auto1.de] INFO: Found listing with ID: FN78597
2026-03-30 10:37:05 [auto1.de] INFO: Found listing with ID: SH78977
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH78977%27 HTTP/1.1" 200 None
2026-03-30 10:37:05 [auto1.de] INFO: Scrape type for SH78977: 1
2026-03-30 10:37:05 [auto1.de] INFO: Found listing with ID: WF16279
2026-03-30 10:37:05 [auto1.de] INFO: Found listing with ID: HC77089
2026-03-30 10:37:05 [auto1.de] INFO: Found listing with ID: TV02686
2026-03-30 10:37:05 [auto1.de] INFO: Found listing with ID: BR45511
2026-03-30 10:37:05 [auto1.de] INFO: Found listing with ID: WW07802
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW07802%27 HTTP/1.1" 200 None
2026-03-30 10:37:05 [auto1.de] INFO: Scrape type for WW07802: 2
2026-03-30 10:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be02d30d-a4fd-5152-8905-665900070003 with identifier: WW07802
2026-03-30 10:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be02d30d-a4fd-5152-8905-665900070003 with scrape type 2
2026-03-30 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be02d30d-a4fd-5152-8905-665900070003 with scrape type 2
2026-03-30 10:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be02d30d-a4fd-5152-8905-665900070003, identifier: WW07802
2026-03-30 10:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be02d30d-a4fd-5152-8905-665900070003 with identifier: WW07802
2026-03-30 10:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be02d30d-a4fd-5152-8905-665900070003 with identifier: WW07802
2026-03-30 10:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be02d30d-a4fd-5152-8905-665900070003 with identifier: WW07802 to the API
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:52:17Z',
 'fuel_type': 'diesel',
 'id': 'be02d30d-a4fd-5152-8905-665900070003',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW07802',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 256641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-28',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW07802%27 HTTP/1.1" 200 None
2026-03-30 10:37:06 [auto1.de] INFO: Saving data for WW07802: {'auction_closing_time': 1774972337.0, 'created_time': 1773772581.661007, 'last_price_update_time': 1774867026.433042}
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW07802') HTTP/1.1" 204 0
2026-03-30 10:37:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:06 [auto1.de] INFO: Found listing with ID: WN73161
2026-03-30 10:37:06 [auto1.de] INFO: Found listing with ID: BH73994
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH73994%27 HTTP/1.1" 200 None
2026-03-30 10:37:06 [auto1.de] INFO: Scrape type for BH73994: 2
2026-03-30 10:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed380b25-3123-5dec-8fa8-000d3b04af9a with identifier: BH73994
2026-03-30 10:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed380b25-3123-5dec-8fa8-000d3b04af9a with scrape type 2
2026-03-30 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed380b25-3123-5dec-8fa8-000d3b04af9a with scrape type 2
2026-03-30 10:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed380b25-3123-5dec-8fa8-000d3b04af9a, identifier: BH73994
2026-03-30 10:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed380b25-3123-5dec-8fa8-000d3b04af9a with identifier: BH73994
2026-03-30 10:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed380b25-3123-5dec-8fa8-000d3b04af9a with identifier: BH73994
2026-03-30 10:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed380b25-3123-5dec-8fa8-000d3b04af9a with identifier: BH73994 to the API
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:19:22Z',
 'fuel_type': 'diesel',
 'id': 'ed380b25-3123-5dec-8fa8-000d3b04af9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH73994',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand Tourneo Connect',
 'odometer': 164237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-13',
 'seller_name': None,
 'title': 'Ford Grand Tourneo Connect 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH73994%27 HTTP/1.1" 200 None
2026-03-30 10:37:07 [auto1.de] INFO: Saving data for BH73994: {'auction_closing_time': 1774970362.0, 'created_time': 1772541530.410216, 'last_price_update_time': 1774867027.015991}
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH73994') HTTP/1.1" 204 0
2026-03-30 10:37:07 [auto1.de] INFO: Found listing with ID: KN66141
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN66141%27 HTTP/1.1" 200 None
2026-03-30 10:37:07 [auto1.de] INFO: Scrape type for KN66141: 1
2026-03-30 10:37:07 [auto1.de] INFO: Found listing with ID: PD23584
2026-03-30 10:37:07 [auto1.de] INFO: Found listing with ID: SE03800
2026-03-30 10:37:07 [auto1.de] INFO: Found listing with ID: DJ88162
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ88162%27 HTTP/1.1" 200 None
2026-03-30 10:37:07 [auto1.de] INFO: Scrape type for DJ88162: 2
2026-03-30 10:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f4028d1-ce25-510b-951c-61a73ca007ee with identifier: DJ88162
2026-03-30 10:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f4028d1-ce25-510b-951c-61a73ca007ee with scrape type 2
2026-03-30 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f4028d1-ce25-510b-951c-61a73ca007ee with scrape type 2
2026-03-30 10:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f4028d1-ce25-510b-951c-61a73ca007ee, identifier: DJ88162
2026-03-30 10:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f4028d1-ce25-510b-951c-61a73ca007ee with identifier: DJ88162
2026-03-30 10:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f4028d1-ce25-510b-951c-61a73ca007ee with identifier: DJ88162
2026-03-30 10:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f4028d1-ce25-510b-951c-61a73ca007ee with identifier: DJ88162 to the API
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:04:20Z',
 'fuel_type': 'diesel',
 'id': '5f4028d1-ce25-510b-951c-61a73ca007ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ88162',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 97842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-23',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ88162%27 HTTP/1.1" 200 None
2026-03-30 10:37:07 [auto1.de] INFO: Saving data for DJ88162: {'auction_closing_time': 1774969460.0, 'created_time': 1773305459.769915, 'last_price_update_time': 1774867027.51379}
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ88162') HTTP/1.1" 204 0
2026-03-30 10:37:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:07 [auto1.de] INFO: Found listing with ID: JB65863
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB65863%27 HTTP/1.1" 200 None
2026-03-30 10:37:07 [auto1.de] INFO: Scrape type for JB65863: 1
2026-03-30 10:37:07 [auto1.de] INFO: Found listing with ID: MN85536
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN85536%27 HTTP/1.1" 200 None
2026-03-30 10:37:07 [auto1.de] INFO: Scrape type for MN85536: 1
2026-03-30 10:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY16041/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:07 [auto1.de] INFO: Found listing with ID: WW55760
2026-03-30 10:37:07 [auto1.de] INFO: Found listing with ID: AH23390
2026-03-30 10:37:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:08 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 9422 | hits on page: 40
2026-03-30 10:37:08 [auto1.de] INFO: Found listing with ID: NG72110
2026-03-30 10:37:08 [auto1.de] INFO: Found listing with ID: WK80523
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK80523%27 HTTP/1.1" 200 None
2026-03-30 10:37:08 [auto1.de] INFO: Scrape type for WK80523: 1
2026-03-30 10:37:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:08 [auto1.de] INFO: Found listing with ID: UA29824
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA29824%27 HTTP/1.1" 200 None
2026-03-30 10:37:08 [auto1.de] INFO: Scrape type for UA29824: 1
2026-03-30 10:37:08 [auto1.de] INFO: Found listing with ID: TW83915
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW83915%27 HTTP/1.1" 200 None
2026-03-30 10:37:08 [auto1.de] INFO: Scrape type for TW83915: 1
2026-03-30 10:37:08 [auto1.de] INFO: Found listing with ID: AY86624
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY86624%27 HTTP/1.1" 200 None
2026-03-30 10:37:08 [auto1.de] INFO: Scrape type for AY86624: 1
2026-03-30 10:37:08 [auto1.de] INFO: Found listing with ID: AL36767
2026-03-30 10:37:08 [auto1.de] INFO: Found listing with ID: ZT34022
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT34022%27 HTTP/1.1" 200 None
2026-03-30 10:37:08 [auto1.de] INFO: Scrape type for ZT34022: 1
2026-03-30 10:37:08 [auto1.de] INFO: Found listing with ID: YL93340
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL93340%27 HTTP/1.1" 200 None
2026-03-30 10:37:08 [auto1.de] INFO: Scrape type for YL93340: 2
2026-03-30 10:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46548840-7088-5036-b9b3-22c580539e2b with identifier: YL93340
2026-03-30 10:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46548840-7088-5036-b9b3-22c580539e2b with scrape type 2
2026-03-30 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46548840-7088-5036-b9b3-22c580539e2b with scrape type 2
2026-03-30 10:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46548840-7088-5036-b9b3-22c580539e2b, identifier: YL93340
2026-03-30 10:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46548840-7088-5036-b9b3-22c580539e2b with identifier: YL93340
2026-03-30 10:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46548840-7088-5036-b9b3-22c580539e2b with identifier: YL93340
2026-03-30 10:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46548840-7088-5036-b9b3-22c580539e2b with identifier: YL93340 to the API
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:33:59Z',
 'fuel_type': 'petrol',
 'id': '46548840-7088-5036-b9b3-22c580539e2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL93340',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 46030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-19',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': '4Motion BlueMotion',
 'year': 2020}
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL93340%27 HTTP/1.1" 200 None
2026-03-30 10:37:08 [auto1.de] INFO: Saving data for YL93340: {'auction_closing_time': 1774971239.0, 'created_time': 1773775154.936816, 'last_price_update_time': 1774867028.812197}
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL93340') HTTP/1.1" 204 0
2026-03-30 10:37:08 [auto1.de] INFO: Found listing with ID: NV44287
2026-03-30 10:37:08 [auto1.de] INFO: Found listing with ID: ZW01245
2026-03-30 10:37:08 [auto1.de] INFO: Found listing with ID: CH19633
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH19633%27 HTTP/1.1" 200 None
2026-03-30 10:37:08 [auto1.de] INFO: Scrape type for CH19633: 1
2026-03-30 10:37:08 [auto1.de] INFO: Found listing with ID: KG08249
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG08249%27 HTTP/1.1" 200 None
2026-03-30 10:37:09 [auto1.de] INFO: Scrape type for KG08249: 2
2026-03-30 10:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7080290b-3ee9-5352-a977-0172e76b014f with identifier: KG08249
2026-03-30 10:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7080290b-3ee9-5352-a977-0172e76b014f with scrape type 2
2026-03-30 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7080290b-3ee9-5352-a977-0172e76b014f with scrape type 2
2026-03-30 10:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7080290b-3ee9-5352-a977-0172e76b014f, identifier: KG08249
2026-03-30 10:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ99779/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7080290b-3ee9-5352-a977-0172e76b014f with identifier: KG08249
2026-03-30 10:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7080290b-3ee9-5352-a977-0172e76b014f with identifier: KG08249
2026-03-30 10:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7080290b-3ee9-5352-a977-0172e76b014f with identifier: KG08249 to the API
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:54:37Z',
 'fuel_type': 'diesel',
 'id': '7080290b-3ee9-5352-a977-0172e76b014f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG08249',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 92679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-22',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG08249%27 HTTP/1.1" 200 None
2026-03-30 10:37:09 [auto1.de] INFO: Saving data for KG08249: {'auction_closing_time': 1774972477.0, 'created_time': 1774262564.097929, 'last_price_update_time': 1774867029.450242}
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG08249') HTTP/1.1" 204 0
2026-03-30 10:37:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB65863/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:09 [auto1.de] INFO: Found listing with ID: ZF42330
2026-03-30 10:37:09 [auto1.de] INFO: Found listing with ID: EL41101
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL41101%27 HTTP/1.1" 200 None
2026-03-30 10:37:09 [auto1.de] INFO: Scrape type for EL41101: 2
2026-03-30 10:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2de5568b-a790-59f9-8399-4954fdefe012 with identifier: EL41101
2026-03-30 10:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2de5568b-a790-59f9-8399-4954fdefe012 with scrape type 2
2026-03-30 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2de5568b-a790-59f9-8399-4954fdefe012 with scrape type 2
2026-03-30 10:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2de5568b-a790-59f9-8399-4954fdefe012, identifier: EL41101
2026-03-30 10:37:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2de5568b-a790-59f9-8399-4954fdefe012 with identifier: EL41101
2026-03-30 10:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2de5568b-a790-59f9-8399-4954fdefe012 with identifier: EL41101
2026-03-30 10:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2de5568b-a790-59f9-8399-4954fdefe012 with identifier: EL41101 to the API
2026-03-30 10:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:08:58Z',
 'fuel_type': 'diesel',
 'id': '2de5568b-a790-59f9-8399-4954fdefe012',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL41101',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 90147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-19',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 108 CDI Kompakt',
 'transmission': 'manual',
 'trim': 'Kompakt',
 'year': 2017}
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL41101%27 HTTP/1.1" 200 None
2026-03-30 10:37:10 [auto1.de] INFO: Saving data for EL41101: {'auction_closing_time': 1774969738.0, 'created_time': 1773775182.812685, 'last_price_update_time': 1774867030.732679}
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL41101') HTTP/1.1" 204 0
2026-03-30 10:37:10 [auto1.de] INFO: Found listing with ID: UZ88379
2026-03-30 10:37:10 [auto1.de] INFO: Found listing with ID: KF18796
2026-03-30 10:37:10 [auto1.de] INFO: Found listing with ID: VV15875
2026-03-30 10:37:10 [auto1.de] INFO: Found listing with ID: GT90153
2026-03-30 10:37:10 [auto1.de] INFO: Found listing with ID: YE41052
2026-03-30 10:37:10 [auto1.de] INFO: Found listing with ID: WL34445
2026-03-30 10:37:10 [auto1.de] INFO: Found listing with ID: VH91595
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH91595%27 HTTP/1.1" 200 None
2026-03-30 10:37:10 [auto1.de] INFO: Scrape type for VH91595: 2
2026-03-30 10:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fce4f634-462d-5b3e-b2b2-7bcc3a8cc0f6 with identifier: VH91595
2026-03-30 10:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce4f634-462d-5b3e-b2b2-7bcc3a8cc0f6 with scrape type 2
2026-03-30 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fce4f634-462d-5b3e-b2b2-7bcc3a8cc0f6 with scrape type 2
2026-03-30 10:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fce4f634-462d-5b3e-b2b2-7bcc3a8cc0f6, identifier: VH91595
2026-03-30 10:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fce4f634-462d-5b3e-b2b2-7bcc3a8cc0f6 with identifier: VH91595
2026-03-30 10:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fce4f634-462d-5b3e-b2b2-7bcc3a8cc0f6 with identifier: VH91595
2026-03-30 10:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fce4f634-462d-5b3e-b2b2-7bcc3a8cc0f6 with identifier: VH91595 to the API
2026-03-30 10:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:23:35Z',
 'fuel_type': 'petrol',
 'id': 'fce4f634-462d-5b3e-b2b2-7bcc3a8cc0f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH91595',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 60697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Cool&Connect',
 'transmission': 'automatic',
 'trim': 'Cool&Connect',
 'year': 2022}
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH91595%27 HTTP/1.1" 200 None
2026-03-30 10:37:11 [auto1.de] INFO: Saving data for VH91595: {'auction_closing_time': 1774970615.0, 'created_time': 1773687943.791962, 'last_price_update_time': 1774867031.189208}
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH91595') HTTP/1.1" 204 0
2026-03-30 10:37:11 [auto1.de] INFO: Found listing with ID: BX61235
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX61235%27 HTTP/1.1" 200 None
2026-03-30 10:37:11 [auto1.de] INFO: Scrape type for BX61235: 1
2026-03-30 10:37:11 [auto1.de] INFO: Found listing with ID: KV96760
2026-03-30 10:37:11 [auto1.de] INFO: Found listing with ID: JB89867
2026-03-30 10:37:11 [auto1.de] INFO: Found listing with ID: XR47953
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR47953%27 HTTP/1.1" 200 None
2026-03-30 10:37:11 [auto1.de] INFO: Scrape type for XR47953: 2
2026-03-30 10:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d2b1120-8190-56b8-8128-039b518f3dc8 with identifier: XR47953
2026-03-30 10:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d2b1120-8190-56b8-8128-039b518f3dc8 with scrape type 2
2026-03-30 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d2b1120-8190-56b8-8128-039b518f3dc8 with scrape type 2
2026-03-30 10:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d2b1120-8190-56b8-8128-039b518f3dc8, identifier: XR47953
2026-03-30 10:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d2b1120-8190-56b8-8128-039b518f3dc8 with identifier: XR47953
2026-03-30 10:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d2b1120-8190-56b8-8128-039b518f3dc8 with identifier: XR47953
2026-03-30 10:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d2b1120-8190-56b8-8128-039b518f3dc8 with identifier: XR47953 to the API
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 530,
 'expiration_date': '2026-03-31T15:21:44Z',
 'fuel_type': 'petrol',
 'id': '4d2b1120-8190-56b8-8128-039b518f3dc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR47953',
 'listing': 'auction',
 'make': 'BMW',
 'model': '8er',
 'odometer': 66382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-10',
 'seller_name': None,
 'title': 'BMW 8er M850i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2022}
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR47953%27 HTTP/1.1" 200 None
2026-03-30 10:37:12 [auto1.de] INFO: Saving data for XR47953: {'auction_closing_time': 1774970504.0, 'created_time': 1773775925.097939, 'last_price_update_time': 1774867032.077087}
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR47953') HTTP/1.1" 204 0
2026-03-30 10:37:12 [auto1.de] INFO: Found listing with ID: EH55820
2026-03-30 10:37:12 [auto1.de] INFO: Found listing with ID: MF71867
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF71867%27 HTTP/1.1" 200 None
2026-03-30 10:37:12 [auto1.de] INFO: Scrape type for MF71867: 2
2026-03-30 10:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22ad6dc2-4428-5db2-a262-380aaf44d4ea with identifier: MF71867
2026-03-30 10:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22ad6dc2-4428-5db2-a262-380aaf44d4ea with scrape type 2
2026-03-30 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22ad6dc2-4428-5db2-a262-380aaf44d4ea with scrape type 2
2026-03-30 10:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22ad6dc2-4428-5db2-a262-380aaf44d4ea, identifier: MF71867
2026-03-30 10:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22ad6dc2-4428-5db2-a262-380aaf44d4ea with identifier: MF71867
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 10:37:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22ad6dc2-4428-5db2-a262-380aaf44d4ea with identifier: MF71867
2026-03-30 10:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22ad6dc2-4428-5db2-a262-380aaf44d4ea with identifier: MF71867 to the API
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:13:08Z',
 'fuel_type': 'petrol',
 'id': '22ad6dc2-4428-5db2-a262-380aaf44d4ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF71867',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 80423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-28',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2013}
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF71867%27 HTTP/1.1" 200 None
2026-03-30 10:37:12 [auto1.de] INFO: Saving data for MF71867: {'auction_closing_time': 1774969988.0, 'created_time': 1774378322.493181, 'last_price_update_time': 1774867032.670033}
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF71867') HTTP/1.1" 204 0
2026-03-30 10:37:12 [auto1.de] INFO: Found listing with ID: WH35124
2026-03-30 10:37:12 [auto1.de] INFO: Found listing with ID: AN41238
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN41238%27 HTTP/1.1" 200 None
2026-03-30 10:37:12 [auto1.de] INFO: Scrape type for AN41238: 2
2026-03-30 10:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0efb1ed-02b1-5aeb-a8cd-a786553cf623 with identifier: AN41238
2026-03-30 10:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0efb1ed-02b1-5aeb-a8cd-a786553cf623 with scrape type 2
2026-03-30 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0efb1ed-02b1-5aeb-a8cd-a786553cf623 with scrape type 2
2026-03-30 10:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0efb1ed-02b1-5aeb-a8cd-a786553cf623, identifier: AN41238
2026-03-30 10:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0efb1ed-02b1-5aeb-a8cd-a786553cf623 with identifier: AN41238
2026-03-30 10:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0efb1ed-02b1-5aeb-a8cd-a786553cf623 with identifier: AN41238
2026-03-30 10:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0efb1ed-02b1-5aeb-a8cd-a786553cf623 with identifier: AN41238 to the API
2026-03-30 10:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:09:16Z',
 'fuel_type': 'diesel',
 'id': 'c0efb1ed-02b1-5aeb-a8cd-a786553cf623',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN41238',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 220601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-24',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI Individual',
 'transmission': 'automatic',
 'trim': 'Individual',
 'year': 2005}
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN41238%27 HTTP/1.1" 200 None
2026-03-30 10:37:13 [auto1.de] INFO: Saving data for AN41238: {'auction_closing_time': 1774969756.0, 'created_time': 1773659772.843541, 'last_price_update_time': 1774867033.230913}
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN41238') HTTP/1.1" 204 0
2026-03-30 10:37:13 [auto1.de] INFO: Found listing with ID: XB34738
2026-03-30 10:37:13 [auto1.de] INFO: Found listing with ID: XY53001
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY53001%27 HTTP/1.1" 200 None
2026-03-30 10:37:13 [auto1.de] INFO: Scrape type for XY53001: 2
2026-03-30 10:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 656b5fc6-79c8-57a8-b49b-3f908ad71194 with identifier: XY53001
2026-03-30 10:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 656b5fc6-79c8-57a8-b49b-3f908ad71194 with scrape type 2
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 656b5fc6-79c8-57a8-b49b-3f908ad71194 with scrape type 2
2026-03-30 10:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 656b5fc6-79c8-57a8-b49b-3f908ad71194, identifier: XY53001
2026-03-30 10:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 656b5fc6-79c8-57a8-b49b-3f908ad71194 with identifier: XY53001
2026-03-30 10:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 656b5fc6-79c8-57a8-b49b-3f908ad71194 with identifier: XY53001
2026-03-30 10:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 656b5fc6-79c8-57a8-b49b-3f908ad71194 with identifier: XY53001 to the API
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:56:53Z',
 'fuel_type': 'petrol',
 'id': '656b5fc6-79c8-57a8-b49b-3f908ad71194',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY53001',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 449254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-12',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2005}
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY53001%27 HTTP/1.1" 200 None
2026-03-30 10:37:13 [auto1.de] INFO: Saving data for XY53001: {'auction_closing_time': 1774972613.0, 'created_time': 1774379747.255269, 'last_price_update_time': 1774867033.676657}
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY53001') HTTP/1.1" 204 0
2026-03-30 10:37:13 [auto1.de] INFO: Found listing with ID: BK47474
2026-03-30 10:37:13 [auto1.de] INFO: Found listing with ID: UK28735
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28735%27 HTTP/1.1" 200 None
2026-03-30 10:37:13 [auto1.de] INFO: Scrape type for UK28735: 1
2026-03-30 10:37:13 [auto1.de] INFO: Found listing with ID: YS62418
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS62418%27 HTTP/1.1" 200 None
2026-03-30 10:37:13 [auto1.de] INFO: Scrape type for YS62418: 1
2026-03-30 10:37:13 [auto1.de] INFO: Found listing with ID: DJ38509
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ38509%27 HTTP/1.1" 200 None
2026-03-30 10:37:13 [auto1.de] INFO: Scrape type for DJ38509: 2
2026-03-30 10:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e50bfd6-7423-5a04-abcb-8c5d80becd4a with identifier: DJ38509
2026-03-30 10:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e50bfd6-7423-5a04-abcb-8c5d80becd4a with scrape type 2
2026-03-30 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e50bfd6-7423-5a04-abcb-8c5d80becd4a with scrape type 2
2026-03-30 10:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e50bfd6-7423-5a04-abcb-8c5d80becd4a, identifier: DJ38509
2026-03-30 10:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e50bfd6-7423-5a04-abcb-8c5d80becd4a with identifier: DJ38509
2026-03-30 10:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e50bfd6-7423-5a04-abcb-8c5d80becd4a with identifier: DJ38509
2026-03-30 10:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e50bfd6-7423-5a04-abcb-8c5d80becd4a with identifier: DJ38509 to the API
2026-03-30 10:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-31T15:29:26Z',
 'fuel_type': 'petrol',
 'id': '4e50bfd6-7423-5a04-abcb-8c5d80becd4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ38509',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 115305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-13',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2017}
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ38509%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [auto1.de] INFO: Saving data for DJ38509: {'auction_closing_time': 1774970966.0, 'created_time': 1774294793.544866, 'last_price_update_time': 1774867034.140849}
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ38509') HTTP/1.1" 204 0
2026-03-30 10:37:14 [auto1.de] INFO: Found listing with ID: BH58234
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH58234%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [auto1.de] INFO: Scrape type for BH58234: 1
2026-03-30 10:37:14 [auto1.de] INFO: Found listing with ID: HJ01307
2026-03-30 10:37:14 [auto1.de] INFO: Found listing with ID: PZ96037
2026-03-30 10:37:14 [auto1.de] INFO: Found listing with ID: BN24933
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN24933%27 HTTP/1.1" 200 None
2026-03-30 10:37:14 [auto1.de] INFO: Scrape type for BN24933: 1
2026-03-30 10:37:14 [auto1.de] INFO: Found listing with ID: TU30152
2026-03-30 10:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SH78977/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA29824/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY16041> (referer: https://www.auto1.com/v1/car-details-view/YY16041/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eb6a1a0-5e2a-5ada-9518-b6e5810da439 with identifier: YY16041
2026-03-30 10:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eb6a1a0-5e2a-5ada-9518-b6e5810da439 with scrape type 1
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4eb6a1a0-5e2a-5ada-9518-b6e5810da439
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1c%252F921c48a8700b9c299a58b535018307e5%252Fpa%252FYY16041_2922f71f6845d5b08547ed94ea347608.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_2922f71f6845d5b08547ed94ea347608.jpg not downloaded yet
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1c%252F921c48a8700b9c299a58b535018307e5%252Fpa%252FYY16041_8ddbc5605450664f3dc8ebb576ba7fd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_8ddbc5605450664f3dc8ebb576ba7fd9.jpg not downloaded yet
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1c%252F921c48a8700b9c299a58b535018307e5%252Fpa%252FYY16041_f9c5e81ed5f29e4e6000d287b88cfc49.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_f9c5e81ed5f29e4e6000d287b88cfc49.jpg not downloaded yet
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1c%252F921c48a8700b9c299a58b535018307e5%252Fpa%252FYY16041_ea96a2e86edd9499b0efbf402652c9e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_ea96a2e86edd9499b0efbf402652c9e5.jpg not downloaded yet
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1c%252F921c48a8700b9c299a58b535018307e5%252Fpa%252FYY16041_9332581a767d92c5da45bfe381ed422f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_9332581a767d92c5da45bfe381ed422f.jpg not downloaded yet
2026-03-30 10:37:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:16 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 9423 | hits on page: 40
2026-03-30 10:37:16 [auto1.de] INFO: Found listing with ID: TU30152
2026-03-30 10:37:16 [auto1.de] INFO: Found listing with ID: MW00897
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW00897%27 HTTP/1.1" 200 None
2026-03-30 10:37:16 [auto1.de] INFO: Scrape type for MW00897: 2
2026-03-30 10:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acc46005-3aec-5b02-8243-27044136696a with identifier: MW00897
2026-03-30 10:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acc46005-3aec-5b02-8243-27044136696a with scrape type 2
2026-03-30 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acc46005-3aec-5b02-8243-27044136696a with scrape type 2
2026-03-30 10:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acc46005-3aec-5b02-8243-27044136696a, identifier: MW00897
2026-03-30 10:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acc46005-3aec-5b02-8243-27044136696a with identifier: MW00897
2026-03-30 10:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acc46005-3aec-5b02-8243-27044136696a with identifier: MW00897
2026-03-30 10:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acc46005-3aec-5b02-8243-27044136696a with identifier: MW00897 to the API
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:40:34Z',
 'fuel_type': 'diesel',
 'id': 'acc46005-3aec-5b02-8243-27044136696a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW00897',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 186383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-18',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW00897%27 HTTP/1.1" 200 None
2026-03-30 10:37:17 [auto1.de] INFO: Saving data for MW00897: {'auction_closing_time': 1774971634.0, 'created_time': 1774294741.716487, 'last_price_update_time': 1774867037.085723}
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW00897') HTTP/1.1" 204 0
2026-03-30 10:37:17 [auto1.de] INFO: Found listing with ID: VY67471
2026-03-30 10:37:17 [auto1.de] INFO: Found listing with ID: UB22204
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB22204%27 HTTP/1.1" 200 None
2026-03-30 10:37:17 [auto1.de] INFO: Scrape type for UB22204: 1
2026-03-30 10:37:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_9332581a767d92c5da45bfe381ed422f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:17 [auto1.de] INFO: Found listing with ID: LG30254
2026-03-30 10:37:17 [auto1.de] INFO: Found listing with ID: ZU32637
2026-03-30 10:37:17 [auto1.de] INFO: Found listing with ID: ZA80746
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA80746%27 HTTP/1.1" 200 None
2026-03-30 10:37:17 [auto1.de] INFO: Scrape type for ZA80746: 1
2026-03-30 10:37:17 [auto1.de] INFO: Found listing with ID: ZZ54313
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ54313%27 HTTP/1.1" 200 None
2026-03-30 10:37:17 [auto1.de] INFO: Scrape type for ZZ54313: 1
2026-03-30 10:37:17 [auto1.de] INFO: Found listing with ID: LK73650
2026-03-30 10:37:17 [auto1.de] INFO: Found listing with ID: LK11873
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK11873%27 HTTP/1.1" 200 None
2026-03-30 10:37:17 [auto1.de] INFO: Scrape type for LK11873: 2
2026-03-30 10:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a34cfe0-9560-545a-80f8-03e216fde40d with identifier: LK11873
2026-03-30 10:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a34cfe0-9560-545a-80f8-03e216fde40d with scrape type 2
2026-03-30 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a34cfe0-9560-545a-80f8-03e216fde40d with scrape type 2
2026-03-30 10:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a34cfe0-9560-545a-80f8-03e216fde40d, identifier: LK11873
2026-03-30 10:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a34cfe0-9560-545a-80f8-03e216fde40d with identifier: LK11873
2026-03-30 10:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a34cfe0-9560-545a-80f8-03e216fde40d with identifier: LK11873
2026-03-30 10:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a34cfe0-9560-545a-80f8-03e216fde40d with identifier: LK11873 to the API
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:16:28Z',
 'fuel_type': 'petrol',
 'id': '8a34cfe0-9560-545a-80f8-03e216fde40d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK11873',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 58017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-25',
 'seller_name': None,
 'title': 'Fiat 500C 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2019}
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK11873%27 HTTP/1.1" 200 None
2026-03-30 10:37:17 [auto1.de] INFO: Saving data for LK11873: {'auction_closing_time': 1774970188.0, 'created_time': 1774551130.585278, 'last_price_update_time': 1774867037.804181}
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK11873') HTTP/1.1" 204 0
2026-03-30 10:37:17 [auto1.de] INFO: Found listing with ID: FW21815
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW21815%27 HTTP/1.1" 200 None
2026-03-30 10:37:17 [auto1.de] INFO: Scrape type for FW21815: 2
2026-03-30 10:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89a91f52-5516-5b00-b7fd-fb08af19f848 with identifier: FW21815
2026-03-30 10:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a91f52-5516-5b00-b7fd-fb08af19f848 with scrape type 2
2026-03-30 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89a91f52-5516-5b00-b7fd-fb08af19f848 with scrape type 2
2026-03-30 10:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89a91f52-5516-5b00-b7fd-fb08af19f848, identifier: FW21815
2026-03-30 10:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89a91f52-5516-5b00-b7fd-fb08af19f848 with identifier: FW21815
2026-03-30 10:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89a91f52-5516-5b00-b7fd-fb08af19f848 with identifier: FW21815
2026-03-30 10:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89a91f52-5516-5b00-b7fd-fb08af19f848 with identifier: FW21815 to the API
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:24:57Z',
 'fuel_type': 'petrol',
 'id': '89a91f52-5516-5b00-b7fd-fb08af19f848',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW21815',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 84370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-15',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW21815%27 HTTP/1.1" 200 None
2026-03-30 10:37:18 [auto1.de] INFO: Saving data for FW21815: {'auction_closing_time': 1774970697.0, 'created_time': 1772542547.703106, 'last_price_update_time': 1774867038.402821}
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW21815') HTTP/1.1" 204 0
2026-03-30 10:37:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5aace10>
2026-03-30 10:37:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eb6a1a0-5e2a-5ada-9518-b6e5810da439/4eb6a1a0-5e2a-5ada-9518-b6e5810da439_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1c%252F921c48a8700b9c299a58b535018307e5%252Fpa%252FYY16041_9332581a767d92c5da45bfe381ed422f.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_9332581a767d92c5da45bfe381ed422f.jpg saved to cache
2026-03-30 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4eb6a1a0-5e2a-5ada-9518-b6e5810da439
2026-03-30 10:37:18 [auto1.de] INFO: Found listing with ID: WD03646
2026-03-30 10:37:18 [auto1.de] INFO: Found listing with ID: VZ38032
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ38032%27 HTTP/1.1" 200 None
2026-03-30 10:37:18 [auto1.de] INFO: Scrape type for VZ38032: 1
2026-03-30 10:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WK80523/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:18 [auto1.de] INFO: Found listing with ID: KN27665
2026-03-30 10:37:18 [auto1.de] INFO: Found listing with ID: JA21775
2026-03-30 10:37:18 [auto1.de] INFO: Found listing with ID: VZ06022
2026-03-30 10:37:18 [auto1.de] INFO: Found listing with ID: KF51408
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF51408%27 HTTP/1.1" 200 None
2026-03-30 10:37:18 [auto1.de] INFO: Scrape type for KF51408: 2
2026-03-30 10:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5a7c15d-674d-5727-8c96-cd8d97068fca with identifier: KF51408
2026-03-30 10:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5a7c15d-674d-5727-8c96-cd8d97068fca with scrape type 2
2026-03-30 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5a7c15d-674d-5727-8c96-cd8d97068fca with scrape type 2
2026-03-30 10:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5a7c15d-674d-5727-8c96-cd8d97068fca, identifier: KF51408
2026-03-30 10:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5a7c15d-674d-5727-8c96-cd8d97068fca with identifier: KF51408
2026-03-30 10:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5a7c15d-674d-5727-8c96-cd8d97068fca with identifier: KF51408
2026-03-30 10:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5a7c15d-674d-5727-8c96-cd8d97068fca with identifier: KF51408 to the API
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:52:33Z',
 'fuel_type': 'petrol',
 'id': 'e5a7c15d-674d-5727-8c96-cd8d97068fca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF51408',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 47213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-04',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF51408%27 HTTP/1.1" 200 None
2026-03-30 10:37:18 [auto1.de] INFO: Saving data for KF51408: {'auction_closing_time': 1774972353.0, 'created_time': 1774350958.080064, 'last_price_update_time': 1774867038.969976}
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF51408') HTTP/1.1" 204 0
2026-03-30 10:37:18 [auto1.de] INFO: Found listing with ID: SK04411
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK04411%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [auto1.de] INFO: Scrape type for SK04411: 2
2026-03-30 10:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 587a9fce-3aee-5f64-9fde-2c96c5fe8168 with identifier: SK04411
2026-03-30 10:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 587a9fce-3aee-5f64-9fde-2c96c5fe8168 with scrape type 2
2026-03-30 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 587a9fce-3aee-5f64-9fde-2c96c5fe8168 with scrape type 2
2026-03-30 10:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 587a9fce-3aee-5f64-9fde-2c96c5fe8168, identifier: SK04411
2026-03-30 10:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 587a9fce-3aee-5f64-9fde-2c96c5fe8168 with identifier: SK04411
2026-03-30 10:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 587a9fce-3aee-5f64-9fde-2c96c5fe8168 with identifier: SK04411
2026-03-30 10:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 587a9fce-3aee-5f64-9fde-2c96c5fe8168 with identifier: SK04411 to the API
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:39:10Z',
 'fuel_type': 'petrol',
 'id': '587a9fce-3aee-5f64-9fde-2c96c5fe8168',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK04411',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 109937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-30',
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2017}
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK04411%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [auto1.de] INFO: Saving data for SK04411: {'auction_closing_time': 1774971550.0, 'created_time': 1773380358.978338, 'last_price_update_time': 1774867039.427085}
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK04411') HTTP/1.1" 204 0
2026-03-30 10:37:19 [auto1.de] INFO: Found listing with ID: FY02898
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY02898%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [auto1.de] INFO: Scrape type for FY02898: 1
2026-03-30 10:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT34022/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:19 [auto1.de] INFO: Found listing with ID: CY80853
2026-03-30 10:37:19 [auto1.de] INFO: Found listing with ID: ZZ25351
2026-03-30 10:37:19 [auto1.de] INFO: Found listing with ID: GB07563
2026-03-30 10:37:19 [auto1.de] INFO: Found listing with ID: KV37303
2026-03-30 10:37:19 [auto1.de] INFO: Found listing with ID: FW24951
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW24951%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [auto1.de] INFO: Scrape type for FW24951: 1
2026-03-30 10:37:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY86624/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:19 [auto1.de] INFO: Found listing with ID: SE83942
2026-03-30 10:37:19 [auto1.de] INFO: Found listing with ID: TR68176
2026-03-30 10:37:19 [auto1.de] INFO: Found listing with ID: LA66050
2026-03-30 10:37:19 [auto1.de] INFO: Found listing with ID: TV08904
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV08904%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [auto1.de] INFO: Scrape type for TV08904: 1
2026-03-30 10:37:19 [auto1.de] INFO: Found listing with ID: MR47328
2026-03-30 10:37:19 [auto1.de] INFO: Found listing with ID: RV63045
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV63045%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [auto1.de] INFO: Scrape type for RV63045: 1
2026-03-30 10:37:19 [auto1.de] INFO: Found listing with ID: AL74934
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL74934%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [auto1.de] INFO: Scrape type for AL74934: 2
2026-03-30 10:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 333c2459-fb7f-5426-b519-3f8998502ad9 with identifier: AL74934
2026-03-30 10:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 333c2459-fb7f-5426-b519-3f8998502ad9 with scrape type 2
2026-03-30 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 333c2459-fb7f-5426-b519-3f8998502ad9 with scrape type 2
2026-03-30 10:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 333c2459-fb7f-5426-b519-3f8998502ad9, identifier: AL74934
2026-03-30 10:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 333c2459-fb7f-5426-b519-3f8998502ad9 with identifier: AL74934
2026-03-30 10:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 333c2459-fb7f-5426-b519-3f8998502ad9 with identifier: AL74934
2026-03-30 10:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 333c2459-fb7f-5426-b519-3f8998502ad9 with identifier: AL74934 to the API
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:25:09Z',
 'fuel_type': 'diesel',
 'id': '333c2459-fb7f-5426-b519-3f8998502ad9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL74934',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 145448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-29',
 'seller_name': None,
 'title': 'Citroen C3 1.6 Blue-HDi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL74934%27 HTTP/1.1" 200 None
2026-03-30 10:37:19 [auto1.de] INFO: Saving data for AL74934: {'auction_closing_time': 1774970709.0, 'created_time': 1774294841.955146, 'last_price_update_time': 1774867039.980831}
2026-03-30 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL74934') HTTP/1.1" 204 0
2026-03-30 10:37:20 [auto1.de] INFO: Found listing with ID: KJ13654
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ13654%27 HTTP/1.1" 200 None
2026-03-30 10:37:20 [auto1.de] INFO: Scrape type for KJ13654: 1
2026-03-30 10:37:20 [auto1.de] INFO: Found listing with ID: YE31815
2026-03-30 10:37:20 [auto1.de] INFO: Found listing with ID: CL87122
2026-03-30 10:37:20 [auto1.de] INFO: Found listing with ID: KJ05833
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ05833%27 HTTP/1.1" 200 None
2026-03-30 10:37:20 [auto1.de] INFO: Scrape type for KJ05833: 1
2026-03-30 10:37:20 [auto1.de] INFO: Found listing with ID: DK89944
2026-03-30 10:37:20 [auto1.de] INFO: Found listing with ID: FM12370
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM12370%27 HTTP/1.1" 200 None
2026-03-30 10:37:20 [auto1.de] INFO: Scrape type for FM12370: 1
2026-03-30 10:37:20 [auto1.de] INFO: Found listing with ID: XR25787
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR25787%27 HTTP/1.1" 200 None
2026-03-30 10:37:20 [auto1.de] INFO: Scrape type for XR25787: 1
2026-03-30 10:37:20 [auto1.de] INFO: Found listing with ID: PC55242
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC55242%27 HTTP/1.1" 200 None
2026-03-30 10:37:20 [auto1.de] INFO: Scrape type for PC55242: 1
2026-03-30 10:37:20 [auto1.de] INFO: Found listing with ID: AM41059
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM41059%27 HTTP/1.1" 200 None
2026-03-30 10:37:20 [auto1.de] INFO: Scrape type for AM41059: 2
2026-03-30 10:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dcfc667-9e9f-5a3e-a8bf-0ae9a4935811 with identifier: AM41059
2026-03-30 10:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dcfc667-9e9f-5a3e-a8bf-0ae9a4935811 with scrape type 2
2026-03-30 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3dcfc667-9e9f-5a3e-a8bf-0ae9a4935811 with scrape type 2
2026-03-30 10:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3dcfc667-9e9f-5a3e-a8bf-0ae9a4935811, identifier: AM41059
2026-03-30 10:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3dcfc667-9e9f-5a3e-a8bf-0ae9a4935811 with identifier: AM41059
2026-03-30 10:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3dcfc667-9e9f-5a3e-a8bf-0ae9a4935811 with identifier: AM41059
2026-03-30 10:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3dcfc667-9e9f-5a3e-a8bf-0ae9a4935811 with identifier: AM41059 to the API
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-31T15:31:13Z',
 'fuel_type': 'petrol',
 'id': '3dcfc667-9e9f-5a3e-a8bf-0ae9a4935811',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM41059',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 140855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-28',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2015}
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM41059%27 HTTP/1.1" 200 None
2026-03-30 10:37:20 [auto1.de] INFO: Saving data for AM41059: {'auction_closing_time': 1774971073.0, 'created_time': 1773688529.006902, 'last_price_update_time': 1774867040.606418}
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM41059') HTTP/1.1" 204 0
2026-03-30 10:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT71111/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK28735/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN24933/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SH78977> (referer: https://www.auto1.com/v1/car-details-view/SH78977/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc with identifier: SH78977
2026-03-30 10:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc with scrape type 1
2026-03-30 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_ce5652c1cd145e46663c8776b835fac2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_ce5652c1cd145e46663c8776b835fac2.jpg not downloaded yet
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_bddc000d3c67ec77b621a87f57bace62.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_bddc000d3c67ec77b621a87f57bace62.jpg not downloaded yet
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_6a37c4547825f1a0dd5f15bf33dc19f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_6a37c4547825f1a0dd5f15bf33dc19f2.jpg not downloaded yet
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_e035641686ac4b0c8686444f08187996.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_e035641686ac4b0c8686444f08187996.jpg not downloaded yet
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_28c761002297842ab53dbff08d289317.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_28c761002297842ab53dbff08d289317.jpg not downloaded yet
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_5d5ac595ed3a17ec93f13cd90e1ce674.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_5d5ac595ed3a17ec93f13cd90e1ce674.jpg not downloaded yet
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_38588164739c32d1aed5a19fafd02e5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_38588164739c32d1aed5a19fafd02e5a.jpg not downloaded yet
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_385e6c9afc65c267fc56439c93645cb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_385e6c9afc65c267fc56439c93645cb9.jpg not downloaded yet
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_a3e3d0c001a6d102446e2f841e387d0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_a3e3d0c001a6d102446e2f841e387d0f.jpg not downloaded yet
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_04d2011b4eda2f23c963f584d6f78bf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_04d2011b4eda2f23c963f584d6f78bf2.jpg not downloaded yet
2026-03-30 10:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH19633/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ99779> (referer: https://www.auto1.com/v1/car-details-view/BZ99779/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc1abcf7-df26-5742-90d8-292b197832e4 with identifier: BZ99779
2026-03-30 10:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc1abcf7-df26-5742-90d8-292b197832e4 with scrape type 1
2026-03-30 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc1abcf7-df26-5742-90d8-292b197832e4
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_cd74fec63a3696af3bb4c18e14b7133d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_cd74fec63a3696af3bb4c18e14b7133d.jpg not downloaded yet
2026-03-30 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_04d2011b4eda2f23c963f584d6f78bf2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_9027fae506fb4d141359c6924f629611.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_9027fae506fb4d141359c6924f629611.jpg not downloaded yet
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_cf713011d8fa435b262b28d524305720.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_cf713011d8fa435b262b28d524305720.jpg not downloaded yet
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_2d65f0325b4854c0d4e9b8a9461f86cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_2d65f0325b4854c0d4e9b8a9461f86cf.jpg not downloaded yet
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_e63a1c5971e01c81d518b5c20f9d9dc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_e63a1c5971e01c81d518b5c20f9d9dc7.jpg not downloaded yet
2026-03-30 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_cd74fec63a3696af3bb4c18e14b7133d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_9d8f737b8f745c026dd02a87062e3553.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_9d8f737b8f745c026dd02a87062e3553.jpg not downloaded yet
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_acf63e9852e2ef4e5c7a05b08f3a1ee3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_acf63e9852e2ef4e5c7a05b08f3a1ee3.jpg not downloaded yet
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_92d749a39575cfd90c24f11ffba4a895.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_92d749a39575cfd90c24f11ffba4a895.jpg not downloaded yet
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a27d50>
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_04d2011b4eda2f23c963f584d6f78bf2.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_04d2011b4eda2f23c963f584d6f78bf2.jpg saved to cache
2026-03-30 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc
2026-03-30 10:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_2d65f0325b4854c0d4e9b8a9461f86cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_9cc56170bbdef11d5423e623984fa089.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_9cc56170bbdef11d5423e623984fa089.jpg not downloaded yet
2026-03-30 10:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fa00d0>
2026-03-30 10:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_cd74fec63a3696af3bb4c18e14b7133d.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_cd74fec63a3696af3bb4c18e14b7133d.jpg saved to cache
2026-03-30 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc1abcf7-df26-5742-90d8-292b197832e4
2026-03-30 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_f1b6fc8f2bec840219f1294e91b59027.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_f1b6fc8f2bec840219f1294e91b59027.jpg not downloaded yet
2026-03-30 10:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef78853d0>
2026-03-30 10:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_2d65f0325b4854c0d4e9b8a9461f86cf.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_2d65f0325b4854c0d4e9b8a9461f86cf.jpg saved to cache
2026-03-30 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc1abcf7-df26-5742-90d8-292b197832e4
2026-03-30 10:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_a3e3d0c001a6d102446e2f841e387d0f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_92d749a39575cfd90c24f11ffba4a895.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_f1b6fc8f2bec840219f1294e91b59027.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b088d0>
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_a3e3d0c001a6d102446e2f841e387d0f.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_a3e3d0c001a6d102446e2f841e387d0f.jpg saved to cache
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc
2026-03-30 10:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_acf63e9852e2ef4e5c7a05b08f3a1ee3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef593cf90>
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_92d749a39575cfd90c24f11ffba4a895.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_92d749a39575cfd90c24f11ffba4a895.jpg saved to cache
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc1abcf7-df26-5742-90d8-292b197832e4
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7f2d0>
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_f1b6fc8f2bec840219f1294e91b59027.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_f1b6fc8f2bec840219f1294e91b59027.jpg saved to cache
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc1abcf7-df26-5742-90d8-292b197832e4
2026-03-30 10:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_9cc56170bbdef11d5423e623984fa089.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_9d8f737b8f745c026dd02a87062e3553.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b0b510>
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_acf63e9852e2ef4e5c7a05b08f3a1ee3.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_acf63e9852e2ef4e5c7a05b08f3a1ee3.jpg saved to cache
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc1abcf7-df26-5742-90d8-292b197832e4
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a75110>
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_9cc56170bbdef11d5423e623984fa089.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_9cc56170bbdef11d5423e623984fa089.jpg saved to cache
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc1abcf7-df26-5742-90d8-292b197832e4
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59ab8d0>
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_9d8f737b8f745c026dd02a87062e3553.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_9d8f737b8f745c026dd02a87062e3553.jpg saved to cache
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc1abcf7-df26-5742-90d8-292b197832e4
2026-03-30 10:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_e63a1c5971e01c81d518b5c20f9d9dc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_cf713011d8fa435b262b28d524305720.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595d090>
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_e63a1c5971e01c81d518b5c20f9d9dc7.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_e63a1c5971e01c81d518b5c20f9d9dc7.jpg saved to cache
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc1abcf7-df26-5742-90d8-292b197832e4
2026-03-30 10:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_9027fae506fb4d141359c6924f629611.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59954d0>
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_cf713011d8fa435b262b28d524305720.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_cf713011d8fa435b262b28d524305720.jpg saved to cache
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc1abcf7-df26-5742-90d8-292b197832e4
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b0b2d0>
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fa6%252F6ca6e724dd72b5fc588800065429faab%252Fpa%252FBZ99779_9027fae506fb4d141359c6924f629611.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_9027fae506fb4d141359c6924f629611.jpg saved to cache
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc1abcf7-df26-5742-90d8-292b197832e4
2026-03-30 10:37:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc1abcf7-df26-5742-90d8-292b197832e4, skipping ID generation
2026-03-30 10:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc1abcf7-df26-5742-90d8-292b197832e4 with scrape type 1
2026-03-30 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc1abcf7-df26-5742-90d8-292b197832e4 sending to next pipeline
2026-03-30 10:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc1abcf7-df26-5742-90d8-292b197832e4, identifier: BZ99779
2026-03-30 10:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc1abcf7-df26-5742-90d8-292b197832e4 with identifier: BZ99779
2026-03-30 10:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc1abcf7-df26-5742-90d8-292b197832e4 with identifier: BZ99779
2026-03-30 10:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc1abcf7-df26-5742-90d8-292b197832e4 with identifier: BZ99779 to the API
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_9027fae506fb4d141359c6924f629611.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:32:24Z',
 'fuel_type': 'diesel',
 'id': 'cc1abcf7-df26-5742-90d8-292b197832e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ99779',
 'listing': 'auction',
 'location': 'DE, Flensburg',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 244178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_cd74fec63a3696af3bb4c18e14b7133d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_9027fae506fb4d141359c6924f629611.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2634776,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_cf713011d8fa435b262b28d524305720.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_2d65f0325b4854c0d4e9b8a9461f86cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_e63a1c5971e01c81d518b5c20f9d9dc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_9d8f737b8f745c026dd02a87062e3553.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_acf63e9852e2ef4e5c7a05b08f3a1ee3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_92d749a39575cfd90c24f11ffba4a895.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_9cc56170bbdef11d5423e623984fa089.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc1abcf7-df26-5742-90d8-292b197832e4/cc1abcf7-df26-5742-90d8-292b197832e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/a6/6ca6e724dd72b5fc588800065429faab/pa/BZ99779_f1b6fc8f2bec840219f1294e91b59027.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X6 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ99779%27 HTTP/1.1" 200 None
2026-03-30 10:37:32 [auto1.de] INFO: Saving data for BZ99779: {'created_time': 1774867052.679105, 'last_price_update_time': 1774867052.679121, 'auction_closing_time': 1774971144.0}
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ99779') HTTP/1.1" 204 0
2026-03-30 10:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW83915/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_385e6c9afc65c267fc56439c93645cb9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b34190>
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_385e6c9afc65c267fc56439c93645cb9.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_385e6c9afc65c267fc56439c93645cb9.jpg saved to cache
2026-03-30 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc
2026-03-30 10:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_38588164739c32d1aed5a19fafd02e5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_5d5ac595ed3a17ec93f13cd90e1ce674.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb1a10>
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_38588164739c32d1aed5a19fafd02e5a.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_38588164739c32d1aed5a19fafd02e5a.jpg saved to cache
2026-03-30 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc
2026-03-30 10:37:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef785f110>
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_5d5ac595ed3a17ec93f13cd90e1ce674.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_5d5ac595ed3a17ec93f13cd90e1ce674.jpg saved to cache
2026-03-30 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc
2026-03-30 10:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_28c761002297842ab53dbff08d289317.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a64490>
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_28c761002297842ab53dbff08d289317.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_28c761002297842ab53dbff08d289317.jpg saved to cache
2026-03-30 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc
2026-03-30 10:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_e035641686ac4b0c8686444f08187996.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b23a90>
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_e035641686ac4b0c8686444f08187996.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_e035641686ac4b0c8686444f08187996.jpg saved to cache
2026-03-30 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc
2026-03-30 10:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_6a37c4547825f1a0dd5f15bf33dc19f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_bddc000d3c67ec77b621a87f57bace62.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb1d50>
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_6a37c4547825f1a0dd5f15bf33dc19f2.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_6a37c4547825f1a0dd5f15bf33dc19f2.jpg saved to cache
2026-03-30 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc
2026-03-30 10:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_ce5652c1cd145e46663c8776b835fac2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb3550>
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_bddc000d3c67ec77b621a87f57bace62.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_bddc000d3c67ec77b621a87f57bace62.jpg saved to cache
2026-03-30 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef500b3d0>
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fdc%252F39dc8a4b318ede136379f853c0decc89%252Fpa%252FSH78977_ce5652c1cd145e46663c8776b835fac2.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_ce5652c1cd145e46663c8776b835fac2.jpg saved to cache
2026-03-30 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc
2026-03-30 10:37:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc, skipping ID generation
2026-03-30 10:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc with scrape type 1
2026-03-30 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc sending to next pipeline
2026-03-30 10:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc, identifier: SH78977
2026-03-30 10:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc with identifier: SH78977
2026-03-30 10:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc with identifier: SH78977
2026-03-30 10:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc with identifier: SH78977 to the API
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_ce5652c1cd145e46663c8776b835fac2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:31:13Z',
 'fuel_type': 'petrol',
 'id': '8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH78977',
 'listing': 'auction',
 'location': 'DE, Würzburg',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 116974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_ce5652c1cd145e46663c8776b835fac2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2312581,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_bddc000d3c67ec77b621a87f57bace62.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_6a37c4547825f1a0dd5f15bf33dc19f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2248555,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_e035641686ac4b0c8686444f08187996.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_28c761002297842ab53dbff08d289317.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2401810,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_5d5ac595ed3a17ec93f13cd90e1ce674.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_38588164739c32d1aed5a19fafd02e5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2434206,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_385e6c9afc65c267fc56439c93645cb9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2417790,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_a3e3d0c001a6d102446e2f841e387d0f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc/8bbffaf0-07e7-5b0e-9ff6-8dae811b6bbc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/dc/39dc8a4b318ede136379f853c0decc89/pa/SH78977_04d2011b4eda2f23c963f584d6f78bf2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Dream Team 2WD',
 'transmission': 'manual',
 'trim': 'Dream Team 2WD',
 'year': 2014}
2026-03-30 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH78977%27 HTTP/1.1" 200 None
2026-03-30 10:37:35 [auto1.de] INFO: Saving data for SH78977: {'created_time': 1774867055.110183, 'last_price_update_time': 1774867055.110196, 'auction_closing_time': 1774971073.0}
2026-03-30 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH78977') HTTP/1.1" 204 0
2026-03-30 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WK80523> (referer: https://www.auto1.com/v1/car-details-view/WK80523/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB65863> (referer: https://www.auto1.com/v1/car-details-view/JB65863/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 601d730c-450a-5757-ae10-fed766d9253d with identifier: WK80523
2026-03-30 10:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 601d730c-450a-5757-ae10-fed766d9253d with scrape type 1
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 601d730c-450a-5757-ae10-fed766d9253d
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_e23d8734d380b2afbfc3aa5bde7cb154.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_e23d8734d380b2afbfc3aa5bde7cb154.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_0c738941cc3fd88be8933ca7bc621ff2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_0c738941cc3fd88be8933ca7bc621ff2.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_d91a974b4ebbab8abef558fea1b4509f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_d91a974b4ebbab8abef558fea1b4509f.jpg not downloaded yet
2026-03-30 10:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5634ad05-1d77-5efe-862a-8449e1219515 with identifier: JB65863
2026-03-30 10:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5634ad05-1d77-5efe-862a-8449e1219515 with scrape type 1
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5634ad05-1d77-5efe-862a-8449e1219515
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_d1f8a2bc2f70de6a03b635c3e12b2ac3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_d1f8a2bc2f70de6a03b635c3e12b2ac3.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_47759cda14755ae2e7d6a2d88b7c4eb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_47759cda14755ae2e7d6a2d88b7c4eb6.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_cbd878f6aa087b2df4f069b790b2b444.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_cbd878f6aa087b2df4f069b790b2b444.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_e748dca9c83af2514ed28e0b88f559e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_e748dca9c83af2514ed28e0b88f559e0.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_cf4196035afc6d1d24c4f50c1b2881dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_cf4196035afc6d1d24c4f50c1b2881dd.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_911be794b082497194a86de0cb5e5396.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_911be794b082497194a86de0cb5e5396.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_34fd16c90a0af0636805578888f1913d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_34fd16c90a0af0636805578888f1913d.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_61ae69d8a0345cd90497a04603b330f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_61ae69d8a0345cd90497a04603b330f9.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_f5c7a4b5746a94bcefd53b9713b48bc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_f5c7a4b5746a94bcefd53b9713b48bc5.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_9d4895460594b0203c6e2ea41990fc41.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_9d4895460594b0203c6e2ea41990fc41.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_07675c285679b11dc0ee1249c8cb2e4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_07675c285679b11dc0ee1249c8cb2e4f.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_f83cf19db23f6f28132dc55f1fdeb5d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_f83cf19db23f6f28132dc55f1fdeb5d6.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_2457b6c1fbc7652d2ef26f883f683498.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_2457b6c1fbc7652d2ef26f883f683498.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_897f78a5253bdb851076e2b50353c349.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_897f78a5253bdb851076e2b50353c349.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_ca075998c1b48c043eac625d4b4a2568.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_ca075998c1b48c043eac625d4b4a2568.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_d433e9a9997b78ba5fb73d91e4fdd5d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_d433e9a9997b78ba5fb73d91e4fdd5d2.jpg not downloaded yet
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_38c448838705e9a49617f328025362da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_38c448838705e9a49617f328025362da.jpg not downloaded yet
2026-03-30 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FY02898/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_38c448838705e9a49617f328025362da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a68e50>
2026-03-30 10:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_38c448838705e9a49617f328025362da.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_38c448838705e9a49617f328025362da.jpg saved to cache
2026-03-30 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5634ad05-1d77-5efe-862a-8449e1219515
2026-03-30 10:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA29824> (referer: https://www.auto1.com/v1/car-details-view/UA29824/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1670435d-541f-558e-9197-1da5aff2010e with identifier: UA29824
2026-03-30 10:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1670435d-541f-558e-9197-1da5aff2010e with scrape type 1
2026-03-30 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1670435d-541f-558e-9197-1da5aff2010e
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F86%252F2686790434bfd8edbcd880a93f5f14cc%252Fpa%252FUA29824_39d3bb52d863ed87569cfe2ebdcc8c20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_39d3bb52d863ed87569cfe2ebdcc8c20.jpg not downloaded yet
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F86%252F2686790434bfd8edbcd880a93f5f14cc%252Fpa%252FUA29824_05736baadc485062a0f1fb9755089e48.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_05736baadc485062a0f1fb9755089e48.jpg not downloaded yet
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F86%252F2686790434bfd8edbcd880a93f5f14cc%252Fpa%252FUA29824_b9dafe727c8fcad0e44068a9f6c1aabf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_b9dafe727c8fcad0e44068a9f6c1aabf.jpg not downloaded yet
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F86%252F2686790434bfd8edbcd880a93f5f14cc%252Fpa%252FUA29824_c5ded389aeb01712be5313fb82300225.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_c5ded389aeb01712be5313fb82300225.jpg not downloaded yet
2026-03-30 10:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_d433e9a9997b78ba5fb73d91e4fdd5d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F86%252F2686790434bfd8edbcd880a93f5f14cc%252Fpa%252FUA29824_b9e3055fe7fc4ff71b6146984e111dce.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_b9e3055fe7fc4ff71b6146984e111dce.jpg not downloaded yet
2026-03-30 10:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_c5ded389aeb01712be5313fb82300225.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ffc610>
2026-03-30 10:37:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_d433e9a9997b78ba5fb73d91e4fdd5d2.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_d433e9a9997b78ba5fb73d91e4fdd5d2.jpg saved to cache
2026-03-30 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5634ad05-1d77-5efe-862a-8449e1219515
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ad4c50>
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1670435d-541f-558e-9197-1da5aff2010e/1670435d-541f-558e-9197-1da5aff2010e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F86%252F2686790434bfd8edbcd880a93f5f14cc%252Fpa%252FUA29824_c5ded389aeb01712be5313fb82300225.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_c5ded389aeb01712be5313fb82300225.jpg saved to cache
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1670435d-541f-558e-9197-1da5aff2010e
2026-03-30 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_b9e3055fe7fc4ff71b6146984e111dce.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_b9dafe727c8fcad0e44068a9f6c1aabf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe05d0>
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1670435d-541f-558e-9197-1da5aff2010e/1670435d-541f-558e-9197-1da5aff2010e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F86%252F2686790434bfd8edbcd880a93f5f14cc%252Fpa%252FUA29824_b9e3055fe7fc4ff71b6146984e111dce.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_b9e3055fe7fc4ff71b6146984e111dce.jpg saved to cache
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1670435d-541f-558e-9197-1da5aff2010e
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595e590>
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1670435d-541f-558e-9197-1da5aff2010e/1670435d-541f-558e-9197-1da5aff2010e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F86%252F2686790434bfd8edbcd880a93f5f14cc%252Fpa%252FUA29824_b9dafe727c8fcad0e44068a9f6c1aabf.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_b9dafe727c8fcad0e44068a9f6c1aabf.jpg saved to cache
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1670435d-541f-558e-9197-1da5aff2010e
2026-03-30 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_05736baadc485062a0f1fb9755089e48.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_39d3bb52d863ed87569cfe2ebdcc8c20.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595e3d0>
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1670435d-541f-558e-9197-1da5aff2010e/1670435d-541f-558e-9197-1da5aff2010e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F86%252F2686790434bfd8edbcd880a93f5f14cc%252Fpa%252FUA29824_05736baadc485062a0f1fb9755089e48.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_05736baadc485062a0f1fb9755089e48.jpg saved to cache
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1670435d-541f-558e-9197-1da5aff2010e
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50dd890>
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1670435d-541f-558e-9197-1da5aff2010e/1670435d-541f-558e-9197-1da5aff2010e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F86%252F2686790434bfd8edbcd880a93f5f14cc%252Fpa%252FUA29824_39d3bb52d863ed87569cfe2ebdcc8c20.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_39d3bb52d863ed87569cfe2ebdcc8c20.jpg saved to cache
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1670435d-541f-558e-9197-1da5aff2010e
2026-03-30 10:37:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1670435d-541f-558e-9197-1da5aff2010e, skipping ID generation
2026-03-30 10:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1670435d-541f-558e-9197-1da5aff2010e with scrape type 1
2026-03-30 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1670435d-541f-558e-9197-1da5aff2010e sending to next pipeline
2026-03-30 10:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1670435d-541f-558e-9197-1da5aff2010e, identifier: UA29824
2026-03-30 10:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1670435d-541f-558e-9197-1da5aff2010e with identifier: UA29824
2026-03-30 10:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1670435d-541f-558e-9197-1da5aff2010e with identifier: UA29824
2026-03-30 10:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1670435d-541f-558e-9197-1da5aff2010e with identifier: UA29824 to the API
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_39d3bb52d863ed87569cfe2ebdcc8c20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:32:05Z',
 'fuel_type': 'petrol',
 'id': '1670435d-541f-558e-9197-1da5aff2010e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA29824',
 'listing': 'auction',
 'location': 'DE, Bochum',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 61804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1670435d-541f-558e-9197-1da5aff2010e/1670435d-541f-558e-9197-1da5aff2010e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_39d3bb52d863ed87569cfe2ebdcc8c20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1670435d-541f-558e-9197-1da5aff2010e/1670435d-541f-558e-9197-1da5aff2010e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_05736baadc485062a0f1fb9755089e48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1670435d-541f-558e-9197-1da5aff2010e/1670435d-541f-558e-9197-1da5aff2010e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_b9dafe727c8fcad0e44068a9f6c1aabf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1670435d-541f-558e-9197-1da5aff2010e/1670435d-541f-558e-9197-1da5aff2010e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_c5ded389aeb01712be5313fb82300225.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1670435d-541f-558e-9197-1da5aff2010e/1670435d-541f-558e-9197-1da5aff2010e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/86/2686790434bfd8edbcd880a93f5f14cc/pa/UA29824_b9e3055fe7fc4ff71b6146984e111dce.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i C',
 'transmission': 'manual',
 'trim': 'C',
 'year': 2004}
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA29824%27 HTTP/1.1" 200 None
2026-03-30 10:37:45 [auto1.de] INFO: Saving data for UA29824: {'created_time': 1774867065.089501, 'last_price_update_time': 1774867065.089515, 'auction_closing_time': 1774971125.0}
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA29824') HTTP/1.1" 204 0
2026-03-30 10:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_ca075998c1b48c043eac625d4b4a2568.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b09e90>
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_ca075998c1b48c043eac625d4b4a2568.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_ca075998c1b48c043eac625d4b4a2568.jpg saved to cache
2026-03-30 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5634ad05-1d77-5efe-862a-8449e1219515
2026-03-30 10:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_897f78a5253bdb851076e2b50353c349.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7cc50>
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_897f78a5253bdb851076e2b50353c349.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_897f78a5253bdb851076e2b50353c349.jpg saved to cache
2026-03-30 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 601d730c-450a-5757-ae10-fed766d9253d
2026-03-30 10:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_2457b6c1fbc7652d2ef26f883f683498.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5983890>
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_2457b6c1fbc7652d2ef26f883f683498.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_2457b6c1fbc7652d2ef26f883f683498.jpg saved to cache
2026-03-30 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5634ad05-1d77-5efe-862a-8449e1219515
2026-03-30 10:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_f83cf19db23f6f28132dc55f1fdeb5d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7f850>
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_f83cf19db23f6f28132dc55f1fdeb5d6.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_f83cf19db23f6f28132dc55f1fdeb5d6.jpg saved to cache
2026-03-30 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 601d730c-450a-5757-ae10-fed766d9253d
2026-03-30 10:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_07675c285679b11dc0ee1249c8cb2e4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ffe390>
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_07675c285679b11dc0ee1249c8cb2e4f.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_07675c285679b11dc0ee1249c8cb2e4f.jpg saved to cache
2026-03-30 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5634ad05-1d77-5efe-862a-8449e1219515
2026-03-30 10:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_9d4895460594b0203c6e2ea41990fc41.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8e590>
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_9d4895460594b0203c6e2ea41990fc41.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_9d4895460594b0203c6e2ea41990fc41.jpg saved to cache
2026-03-30 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 601d730c-450a-5757-ae10-fed766d9253d
2026-03-30 10:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_f5c7a4b5746a94bcefd53b9713b48bc5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7f2d0>
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_f5c7a4b5746a94bcefd53b9713b48bc5.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_f5c7a4b5746a94bcefd53b9713b48bc5.jpg saved to cache
2026-03-30 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5634ad05-1d77-5efe-862a-8449e1219515
2026-03-30 10:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_61ae69d8a0345cd90497a04603b330f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef511d850>
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_61ae69d8a0345cd90497a04603b330f9.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_61ae69d8a0345cd90497a04603b330f9.jpg saved to cache
2026-03-30 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 601d730c-450a-5757-ae10-fed766d9253d
2026-03-30 10:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_34fd16c90a0af0636805578888f1913d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB22204/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50def50>
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_34fd16c90a0af0636805578888f1913d.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_34fd16c90a0af0636805578888f1913d.jpg saved to cache
2026-03-30 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5634ad05-1d77-5efe-862a-8449e1219515
2026-03-30 10:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_cf4196035afc6d1d24c4f50c1b2881dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_911be794b082497194a86de0cb5e5396.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5aae810>
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_cf4196035afc6d1d24c4f50c1b2881dd.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_cf4196035afc6d1d24c4f50c1b2881dd.jpg saved to cache
2026-03-30 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5634ad05-1d77-5efe-862a-8449e1219515
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a21610>
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_911be794b082497194a86de0cb5e5396.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_911be794b082497194a86de0cb5e5396.jpg saved to cache
2026-03-30 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 601d730c-450a-5757-ae10-fed766d9253d
2026-03-30 10:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_e748dca9c83af2514ed28e0b88f559e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50df190>
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_e748dca9c83af2514ed28e0b88f559e0.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_e748dca9c83af2514ed28e0b88f559e0.jpg saved to cache
2026-03-30 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 601d730c-450a-5757-ae10-fed766d9253d
2026-03-30 10:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_cbd878f6aa087b2df4f069b790b2b444.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fa1590>
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_cbd878f6aa087b2df4f069b790b2b444.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_cbd878f6aa087b2df4f069b790b2b444.jpg saved to cache
2026-03-30 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5634ad05-1d77-5efe-862a-8449e1219515
2026-03-30 10:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_47759cda14755ae2e7d6a2d88b7c4eb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fa0d90>
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_47759cda14755ae2e7d6a2d88b7c4eb6.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_47759cda14755ae2e7d6a2d88b7c4eb6.jpg saved to cache
2026-03-30 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 601d730c-450a-5757-ae10-fed766d9253d
2026-03-30 10:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_d1f8a2bc2f70de6a03b635c3e12b2ac3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8bbd0>
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Ff2%252F57f24b1316062860ead4fae989b49ee3%252Fpa%252FJB65863_d1f8a2bc2f70de6a03b635c3e12b2ac3.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_d1f8a2bc2f70de6a03b635c3e12b2ac3.jpg saved to cache
2026-03-30 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5634ad05-1d77-5efe-862a-8449e1219515
2026-03-30 10:37:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5634ad05-1d77-5efe-862a-8449e1219515, skipping ID generation
2026-03-30 10:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5634ad05-1d77-5efe-862a-8449e1219515 with scrape type 1
2026-03-30 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5634ad05-1d77-5efe-862a-8449e1219515 sending to next pipeline
2026-03-30 10:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5634ad05-1d77-5efe-862a-8449e1219515, identifier: JB65863
2026-03-30 10:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5634ad05-1d77-5efe-862a-8449e1219515 with identifier: JB65863
2026-03-30 10:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5634ad05-1d77-5efe-862a-8449e1219515 with identifier: JB65863
2026-03-30 10:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5634ad05-1d77-5efe-862a-8449e1219515 with identifier: JB65863 to the API
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_d1f8a2bc2f70de6a03b635c3e12b2ac3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:49:43Z',
 'fuel_type': 'petrol',
 'id': '5634ad05-1d77-5efe-862a-8449e1219515',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB65863',
 'listing': 'auction',
 'location': 'DE, Fürth',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 85250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2793127,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_d1f8a2bc2f70de6a03b635c3e12b2ac3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2963211,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_cbd878f6aa087b2df4f069b790b2b444.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_cf4196035afc6d1d24c4f50c1b2881dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_34fd16c90a0af0636805578888f1913d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_f5c7a4b5746a94bcefd53b9713b48bc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_07675c285679b11dc0ee1249c8cb2e4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_2457b6c1fbc7652d2ef26f883f683498.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_ca075998c1b48c043eac625d4b4a2568.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_d433e9a9997b78ba5fb73d91e4fdd5d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5634ad05-1d77-5efe-862a-8449e1219515/5634ad05-1d77-5efe-862a-8449e1219515_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2848182,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/f2/57f24b1316062860ead4fae989b49ee3/pa/JB65863_38c448838705e9a49617f328025362da.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB65863%27 HTTP/1.1" 200 None
2026-03-30 10:37:48 [auto1.de] INFO: Saving data for JB65863: {'created_time': 1774867068.473149, 'last_price_update_time': 1774867068.473161, 'auction_closing_time': 1774972183.0}
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB65863') HTTP/1.1" 204 0
2026-03-30 10:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_d91a974b4ebbab8abef558fea1b4509f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b0b510>
2026-03-30 10:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_d91a974b4ebbab8abef558fea1b4509f.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_d91a974b4ebbab8abef558fea1b4509f.jpg saved to cache
2026-03-30 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 601d730c-450a-5757-ae10-fed766d9253d
2026-03-30 10:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_0c738941cc3fd88be8933ca7bc621ff2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_e23d8734d380b2afbfc3aa5bde7cb154.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a24d10>
2026-03-30 10:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_0c738941cc3fd88be8933ca7bc621ff2.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_0c738941cc3fd88be8933ca7bc621ff2.jpg saved to cache
2026-03-30 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 601d730c-450a-5757-ae10-fed766d9253d
2026-03-30 10:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a42510>
2026-03-30 10:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fed%252Fbaed37ca64e15907ace15034ce39ecc0%252Fpa%252FWK80523_e23d8734d380b2afbfc3aa5bde7cb154.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_e23d8734d380b2afbfc3aa5bde7cb154.jpg saved to cache
2026-03-30 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 601d730c-450a-5757-ae10-fed766d9253d
2026-03-30 10:37:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 601d730c-450a-5757-ae10-fed766d9253d, skipping ID generation
2026-03-30 10:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 601d730c-450a-5757-ae10-fed766d9253d with scrape type 1
2026-03-30 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 601d730c-450a-5757-ae10-fed766d9253d sending to next pipeline
2026-03-30 10:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 601d730c-450a-5757-ae10-fed766d9253d, identifier: WK80523
2026-03-30 10:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 601d730c-450a-5757-ae10-fed766d9253d with identifier: WK80523
2026-03-30 10:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 601d730c-450a-5757-ae10-fed766d9253d with identifier: WK80523
2026-03-30 10:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 601d730c-450a-5757-ae10-fed766d9253d with identifier: WK80523 to the API
2026-03-30 10:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_e23d8734d380b2afbfc3aa5bde7cb154.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:29:56Z',
 'fuel_type': 'diesel',
 'id': '601d730c-450a-5757-ae10-fed766d9253d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK80523',
 'listing': 'auction',
 'location': 'DE, Köln',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 165414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_e23d8734d380b2afbfc3aa5bde7cb154.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2754151,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_0c738941cc3fd88be8933ca7bc621ff2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_d91a974b4ebbab8abef558fea1b4509f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_47759cda14755ae2e7d6a2d88b7c4eb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_e748dca9c83af2514ed28e0b88f559e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_911be794b082497194a86de0cb5e5396.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_61ae69d8a0345cd90497a04603b330f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_9d4895460594b0203c6e2ea41990fc41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_f83cf19db23f6f28132dc55f1fdeb5d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_601d730c-450a-5757-ae10-fed766d9253d/601d730c-450a-5757-ae10-fed766d9253d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/ed/baed37ca64e15907ace15034ce39ecc0/pa/WK80523_897f78a5253bdb851076e2b50353c349.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2017}
2026-03-30 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK80523%27 HTTP/1.1" 200 None
2026-03-30 10:37:49 [auto1.de] INFO: Saving data for WK80523: {'created_time': 1774867069.418296, 'last_price_update_time': 1774867069.418308, 'auction_closing_time': 1774970996.0}
2026-03-30 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK80523') HTTP/1.1" 204 0
2026-03-30 10:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN24933> (referer: https://www.auto1.com/v1/car-details-view/BN24933/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fe5d619-dc19-58f6-beef-90505673530a with identifier: BN24933
2026-03-30 10:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fe5d619-dc19-58f6-beef-90505673530a with scrape type 1
2026-03-30 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7fe5d619-dc19-58f6-beef-90505673530a
2026-03-30 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F38%252Ffb380718fcce0e11d8ead5c92294c990%252Fpa%252FBN24933_359fb4e8be880ab4072a4a9568cd434f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_359fb4e8be880ab4072a4a9568cd434f.jpg not downloaded yet
2026-03-30 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F38%252Ffb380718fcce0e11d8ead5c92294c990%252Fpa%252FBN24933_3615f27947ea788b4feb96f1175d5b0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_3615f27947ea788b4feb96f1175d5b0f.jpg not downloaded yet
2026-03-30 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F38%252Ffb380718fcce0e11d8ead5c92294c990%252Fpa%252FBN24933_5fd00f60712510acf4857d90b6ed1171.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_5fd00f60712510acf4857d90b6ed1171.jpg not downloaded yet
2026-03-30 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F38%252Ffb380718fcce0e11d8ead5c92294c990%252Fpa%252FBN24933_ebd7906841c004adb37db35298f90f12.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_ebd7906841c004adb37db35298f90f12.jpg not downloaded yet
2026-03-30 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F38%252Ffb380718fcce0e11d8ead5c92294c990%252Fpa%252FBN24933_1f530fee3963ffbd69be2177c4b0f7c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_1f530fee3963ffbd69be2177c4b0f7c3.jpg not downloaded yet
2026-03-30 10:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH19633> (referer: https://www.auto1.com/v1/car-details-view/CH19633/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f792308c-e8c3-5d3a-8118-c313a6e0ad13 with identifier: CH19633
2026-03-30 10:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f792308c-e8c3-5d3a-8118-c313a6e0ad13 with scrape type 1
2026-03-30 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f792308c-e8c3-5d3a-8118-c313a6e0ad13
2026-03-30 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_55f358a97336fd3aec7cc4aecaed28b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_55f358a97336fd3aec7cc4aecaed28b2.jpg not downloaded yet
2026-03-30 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_b954f2a570bb4ec4ac20d680e52acc10.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_b954f2a570bb4ec4ac20d680e52acc10.jpg not downloaded yet
2026-03-30 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_76af6b329ac068b4e413750ba01dcc16.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_76af6b329ac068b4e413750ba01dcc16.jpg not downloaded yet
2026-03-30 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_b105859409b740804d1a6c683c47e78a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_b105859409b740804d1a6c683c47e78a.jpg not downloaded yet
2026-03-30 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_bfdcc03b97de1a3627f122c60b78afb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_bfdcc03b97de1a3627f122c60b78afb4.jpg not downloaded yet
2026-03-30 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_6956448acf4f53969b6095c85d5481b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_6956448acf4f53969b6095c85d5481b0.jpg not downloaded yet
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_de8d2ece63d49fcbbdb1b77a34ce711c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_de8d2ece63d49fcbbdb1b77a34ce711c.jpg not downloaded yet
2026-03-30 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_1f530fee3963ffbd69be2177c4b0f7c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_8d133e5290bf787aeec18816856ffdec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_8d133e5290bf787aeec18816856ffdec.jpg not downloaded yet
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_fb0fdffaeecc6510db7186b46ecd1157.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_fb0fdffaeecc6510db7186b46ecd1157.jpg not downloaded yet
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_1c10fd2ec6a4fd51465661a3d702e6c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_1c10fd2ec6a4fd51465661a3d702e6c5.jpg not downloaded yet
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5965110>
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fe5d619-dc19-58f6-beef-90505673530a/7fe5d619-dc19-58f6-beef-90505673530a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F38%252Ffb380718fcce0e11d8ead5c92294c990%252Fpa%252FBN24933_1f530fee3963ffbd69be2177c4b0f7c3.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_1f530fee3963ffbd69be2177c4b0f7c3.jpg saved to cache
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7fe5d619-dc19-58f6-beef-90505673530a
2026-03-30 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_de8d2ece63d49fcbbdb1b77a34ce711c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_1c10fd2ec6a4fd51465661a3d702e6c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_fb0fdffaeecc6510db7186b46ecd1157.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59b53d0>
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_de8d2ece63d49fcbbdb1b77a34ce711c.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_de8d2ece63d49fcbbdb1b77a34ce711c.jpg saved to cache
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f792308c-e8c3-5d3a-8118-c313a6e0ad13
2026-03-30 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_8d133e5290bf787aeec18816856ffdec.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ffd750>
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_1c10fd2ec6a4fd51465661a3d702e6c5.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_1c10fd2ec6a4fd51465661a3d702e6c5.jpg saved to cache
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f792308c-e8c3-5d3a-8118-c313a6e0ad13
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8f5d0>
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_fb0fdffaeecc6510db7186b46ecd1157.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_fb0fdffaeecc6510db7186b46ecd1157.jpg saved to cache
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f792308c-e8c3-5d3a-8118-c313a6e0ad13
2026-03-30 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_6956448acf4f53969b6095c85d5481b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59627d0>
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_8d133e5290bf787aeec18816856ffdec.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_8d133e5290bf787aeec18816856ffdec.jpg saved to cache
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f792308c-e8c3-5d3a-8118-c313a6e0ad13
2026-03-30 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_bfdcc03b97de1a3627f122c60b78afb4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_b105859409b740804d1a6c683c47e78a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef593c7d0>
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_6956448acf4f53969b6095c85d5481b0.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_6956448acf4f53969b6095c85d5481b0.jpg saved to cache
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f792308c-e8c3-5d3a-8118-c313a6e0ad13
2026-03-30 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_76af6b329ac068b4e413750ba01dcc16.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8e910>
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_bfdcc03b97de1a3627f122c60b78afb4.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_bfdcc03b97de1a3627f122c60b78afb4.jpg saved to cache
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f792308c-e8c3-5d3a-8118-c313a6e0ad13
2026-03-30 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_b954f2a570bb4ec4ac20d680e52acc10.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c1850>
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_b105859409b740804d1a6c683c47e78a.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_b105859409b740804d1a6c683c47e78a.jpg saved to cache
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f792308c-e8c3-5d3a-8118-c313a6e0ad13
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ffd190>
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_76af6b329ac068b4e413750ba01dcc16.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_76af6b329ac068b4e413750ba01dcc16.jpg saved to cache
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f792308c-e8c3-5d3a-8118-c313a6e0ad13
2026-03-30 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_55f358a97336fd3aec7cc4aecaed28b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f88950>
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_b954f2a570bb4ec4ac20d680e52acc10.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_b954f2a570bb4ec4ac20d680e52acc10.jpg saved to cache
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f792308c-e8c3-5d3a-8118-c313a6e0ad13
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5960410>
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F18%252F4418599a2962a37f89e2b22e884c4119%252Fpa%252FCH19633_55f358a97336fd3aec7cc4aecaed28b2.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_55f358a97336fd3aec7cc4aecaed28b2.jpg saved to cache
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f792308c-e8c3-5d3a-8118-c313a6e0ad13
2026-03-30 10:37:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f792308c-e8c3-5d3a-8118-c313a6e0ad13, skipping ID generation
2026-03-30 10:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f792308c-e8c3-5d3a-8118-c313a6e0ad13 with scrape type 1
2026-03-30 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f792308c-e8c3-5d3a-8118-c313a6e0ad13 sending to next pipeline
2026-03-30 10:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f792308c-e8c3-5d3a-8118-c313a6e0ad13, identifier: CH19633
2026-03-30 10:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f792308c-e8c3-5d3a-8118-c313a6e0ad13 with identifier: CH19633
2026-03-30 10:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f792308c-e8c3-5d3a-8118-c313a6e0ad13 with identifier: CH19633
2026-03-30 10:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f792308c-e8c3-5d3a-8118-c313a6e0ad13 with identifier: CH19633 to the API
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_55f358a97336fd3aec7cc4aecaed28b2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 380,
 'expiration_date': '2026-03-31T15:18:59Z',
 'fuel_type': 'diesel',
 'id': 'f792308c-e8c3-5d3a-8118-c313a6e0ad13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH19633',
 'listing': 'auction',
 'location': 'DE',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 233711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_55f358a97336fd3aec7cc4aecaed28b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_b954f2a570bb4ec4ac20d680e52acc10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_76af6b329ac068b4e413750ba01dcc16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_b105859409b740804d1a6c683c47e78a.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_bfdcc03b97de1a3627f122c60b78afb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_6956448acf4f53969b6095c85d5481b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_de8d2ece63d49fcbbdb1b77a34ce711c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_8d133e5290bf787aeec18816856ffdec.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_fb0fdffaeecc6510db7186b46ecd1157.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f792308c-e8c3-5d3a-8118-c313a6e0ad13/f792308c-e8c3-5d3a-8118-c313a6e0ad13_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/18/4418599a2962a37f89e2b22e884c4119/pa/CH19633_1c10fd2ec6a4fd51465661a3d702e6c5.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 M50d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH19633%27 HTTP/1.1" 200 None
2026-03-30 10:37:52 [auto1.de] INFO: Saving data for CH19633: {'created_time': 1774867072.416914, 'last_price_update_time': 1774867072.416926, 'auction_closing_time': 1774970339.0}
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH19633') HTTP/1.1" 204 0
2026-03-30 10:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_ebd7906841c004adb37db35298f90f12.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW83915> (referer: https://www.auto1.com/v1/car-details-view/TW83915/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_5fd00f60712510acf4857d90b6ed1171.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_359fb4e8be880ab4072a4a9568cd434f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ffeb50>
2026-03-30 10:37:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fe5d619-dc19-58f6-beef-90505673530a/7fe5d619-dc19-58f6-beef-90505673530a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F38%252Ffb380718fcce0e11d8ead5c92294c990%252Fpa%252FBN24933_ebd7906841c004adb37db35298f90f12.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_ebd7906841c004adb37db35298f90f12.jpg saved to cache
2026-03-30 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7fe5d619-dc19-58f6-beef-90505673530a
2026-03-30 10:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee93a75b-3fb0-5b54-8865-06d0802a1d2e with identifier: TW83915
2026-03-30 10:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee93a75b-3fb0-5b54-8865-06d0802a1d2e with scrape type 1
2026-03-30 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee93a75b-3fb0-5b54-8865-06d0802a1d2e
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F35%252Fc3352a2ea23b520b577f80c1f247f2c5%252Fpa%252FTW83915_9909cf401c8608347117a254b90c49ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_9909cf401c8608347117a254b90c49ca.jpg already downloaded
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F35%252Fc3352a2ea23b520b577f80c1f247f2c5%252Fpa%252FTW83915_ad505ac201f9ddb0002985983a71ab79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_ad505ac201f9ddb0002985983a71ab79.jpg already downloaded
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F35%252Fc3352a2ea23b520b577f80c1f247f2c5%252Fpa%252FTW83915_3939ab337a41c05c93c470050dab2f45.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_3939ab337a41c05c93c470050dab2f45.jpg already downloaded
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F35%252Fc3352a2ea23b520b577f80c1f247f2c5%252Fpa%252FTW83915_d0f0e667ea17a48902e0a6f753f28ff9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_d0f0e667ea17a48902e0a6f753f28ff9.jpg already downloaded
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F35%252Fc3352a2ea23b520b577f80c1f247f2c5%252Fpa%252FTW83915_027b07f478391f9053cfbb9d46e34d2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_027b07f478391f9053cfbb9d46e34d2b.jpg already downloaded
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F35%252Fc3352a2ea23b520b577f80c1f247f2c5%252Fpa%252FTW83915_9642f679affb9b526203e6705bc56947.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_9642f679affb9b526203e6705bc56947.jpg already downloaded
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F35%252Fc3352a2ea23b520b577f80c1f247f2c5%252Fpa%252FTW83915_199f2f5bc85934b2b7c8d8f8286337e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_199f2f5bc85934b2b7c8d8f8286337e7.jpg already downloaded
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F35%252Fc3352a2ea23b520b577f80c1f247f2c5%252Fpa%252FTW83915_f82f4870a1d3f65e8fc7fcc49340f901.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_f82f4870a1d3f65e8fc7fcc49340f901.jpg already downloaded
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F35%252Fc3352a2ea23b520b577f80c1f247f2c5%252Fpa%252FTW83915_e2b94d6f37f48fb2cc84ca2b27a6b639.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_e2b94d6f37f48fb2cc84ca2b27a6b639.jpg already downloaded
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F35%252Fc3352a2ea23b520b577f80c1f247f2c5%252Fpa%252FTW83915_a867aa14bda12ad222aa6fbeeb5ad94f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_a867aa14bda12ad222aa6fbeeb5ad94f.jpg already downloaded
2026-03-30 10:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee93a75b-3fb0-5b54-8865-06d0802a1d2e, identifier: TW83915
2026-03-30 10:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee93a75b-3fb0-5b54-8865-06d0802a1d2e with identifier: TW83915
2026-03-30 10:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee93a75b-3fb0-5b54-8865-06d0802a1d2e with identifier: TW83915
2026-03-30 10:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee93a75b-3fb0-5b54-8865-06d0802a1d2e with identifier: TW83915 to the API
2026-03-30 10:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TW83915>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:44:47Z',
 'fuel_type': 'diesel',
 'id': 'ee93a75b-3fb0-5b54-8865-06d0802a1d2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW83915',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 175853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_9909cf401c8608347117a254b90c49ca.jpg',
                'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_ad505ac201f9ddb0002985983a71ab79.jpg',
                'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_3939ab337a41c05c93c470050dab2f45.jpg',
                'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_d0f0e667ea17a48902e0a6f753f28ff9.jpg',
                'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_027b07f478391f9053cfbb9d46e34d2b.jpg',
                'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_9642f679affb9b526203e6705bc56947.jpg',
                'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_199f2f5bc85934b2b7c8d8f8286337e7.jpg',
                'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_f82f4870a1d3f65e8fc7fcc49340f901.jpg',
                'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_e2b94d6f37f48fb2cc84ca2b27a6b639.jpg',
                'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_a867aa14bda12ad222aa6fbeeb5ad94f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee93a75b-3fb0-5b54-8865-06d0802a1d2e/ee93a75b-3fb0-5b54-8865-06d0802a1d2e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3268264,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_9909cf401c8608347117a254b90c49ca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee93a75b-3fb0-5b54-8865-06d0802a1d2e/ee93a75b-3fb0-5b54-8865-06d0802a1d2e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_ad505ac201f9ddb0002985983a71ab79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee93a75b-3fb0-5b54-8865-06d0802a1d2e/ee93a75b-3fb0-5b54-8865-06d0802a1d2e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_3939ab337a41c05c93c470050dab2f45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee93a75b-3fb0-5b54-8865-06d0802a1d2e/ee93a75b-3fb0-5b54-8865-06d0802a1d2e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3266085,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_d0f0e667ea17a48902e0a6f753f28ff9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee93a75b-3fb0-5b54-8865-06d0802a1d2e/ee93a75b-3fb0-5b54-8865-06d0802a1d2e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3023010,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_027b07f478391f9053cfbb9d46e34d2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee93a75b-3fb0-5b54-8865-06d0802a1d2e/ee93a75b-3fb0-5b54-8865-06d0802a1d2e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_9642f679affb9b526203e6705bc56947.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee93a75b-3fb0-5b54-8865-06d0802a1d2e/ee93a75b-3fb0-5b54-8865-06d0802a1d2e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3041770,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_199f2f5bc85934b2b7c8d8f8286337e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee93a75b-3fb0-5b54-8865-06d0802a1d2e/ee93a75b-3fb0-5b54-8865-06d0802a1d2e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3157993,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_f82f4870a1d3f65e8fc7fcc49340f901.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee93a75b-3fb0-5b54-8865-06d0802a1d2e/ee93a75b-3fb0-5b54-8865-06d0802a1d2e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3222714,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_e2b94d6f37f48fb2cc84ca2b27a6b639.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee93a75b-3fb0-5b54-8865-06d0802a1d2e/ee93a75b-3fb0-5b54-8865-06d0802a1d2e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/35/c3352a2ea23b520b577f80c1f247f2c5/pa/TW83915_a867aa14bda12ad222aa6fbeeb5ad94f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW83915%27 HTTP/1.1" 200 None
2026-03-30 10:37:53 [auto1.de] INFO: Saving data for TW83915: {'created_time': 1774867073.203417, 'last_price_update_time': 1774867073.20343, 'auction_closing_time': 1774971887.0}
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW83915') HTTP/1.1" 204 0
2026-03-30 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_3615f27947ea788b4feb96f1175d5b0f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b0a2d0>
2026-03-30 10:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fe5d619-dc19-58f6-beef-90505673530a/7fe5d619-dc19-58f6-beef-90505673530a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F38%252Ffb380718fcce0e11d8ead5c92294c990%252Fpa%252FBN24933_5fd00f60712510acf4857d90b6ed1171.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_5fd00f60712510acf4857d90b6ed1171.jpg saved to cache
2026-03-30 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7fe5d619-dc19-58f6-beef-90505673530a
2026-03-30 10:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6fa50>
2026-03-30 10:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fe5d619-dc19-58f6-beef-90505673530a/7fe5d619-dc19-58f6-beef-90505673530a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F38%252Ffb380718fcce0e11d8ead5c92294c990%252Fpa%252FBN24933_359fb4e8be880ab4072a4a9568cd434f.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_359fb4e8be880ab4072a4a9568cd434f.jpg saved to cache
2026-03-30 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fe5d619-dc19-58f6-beef-90505673530a
2026-03-30 10:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a31310>
2026-03-30 10:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fe5d619-dc19-58f6-beef-90505673530a/7fe5d619-dc19-58f6-beef-90505673530a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F38%252Ffb380718fcce0e11d8ead5c92294c990%252Fpa%252FBN24933_3615f27947ea788b4feb96f1175d5b0f.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_3615f27947ea788b4feb96f1175d5b0f.jpg saved to cache
2026-03-30 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7fe5d619-dc19-58f6-beef-90505673530a
2026-03-30 10:37:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fe5d619-dc19-58f6-beef-90505673530a, skipping ID generation
2026-03-30 10:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fe5d619-dc19-58f6-beef-90505673530a with scrape type 1
2026-03-30 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fe5d619-dc19-58f6-beef-90505673530a sending to next pipeline
2026-03-30 10:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fe5d619-dc19-58f6-beef-90505673530a, identifier: BN24933
2026-03-30 10:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fe5d619-dc19-58f6-beef-90505673530a with identifier: BN24933
2026-03-30 10:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fe5d619-dc19-58f6-beef-90505673530a with identifier: BN24933
2026-03-30 10:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fe5d619-dc19-58f6-beef-90505673530a with identifier: BN24933 to the API
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_3615f27947ea788b4feb96f1175d5b0f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:07:47Z',
 'fuel_type': 'petrol',
 'id': '7fe5d619-dc19-58f6-beef-90505673530a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN24933',
 'listing': 'auction',
 'location': 'DE, Eichenzell',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 220247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fe5d619-dc19-58f6-beef-90505673530a/7fe5d619-dc19-58f6-beef-90505673530a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_359fb4e8be880ab4072a4a9568cd434f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fe5d619-dc19-58f6-beef-90505673530a/7fe5d619-dc19-58f6-beef-90505673530a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_3615f27947ea788b4feb96f1175d5b0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fe5d619-dc19-58f6-beef-90505673530a/7fe5d619-dc19-58f6-beef-90505673530a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_5fd00f60712510acf4857d90b6ed1171.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fe5d619-dc19-58f6-beef-90505673530a/7fe5d619-dc19-58f6-beef-90505673530a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_ebd7906841c004adb37db35298f90f12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fe5d619-dc19-58f6-beef-90505673530a/7fe5d619-dc19-58f6-beef-90505673530a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/38/fb380718fcce0e11d8ead5c92294c990/pa/BN24933_1f530fee3963ffbd69be2177c4b0f7c3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN24933%27 HTTP/1.1" 200 None
2026-03-30 10:37:53 [auto1.de] INFO: Saving data for BN24933: {'created_time': 1774867073.84872, 'last_price_update_time': 1774867073.848731, 'auction_closing_time': 1774969667.0}
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN24933') HTTP/1.1" 204 0
2026-03-30 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR25787/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT71111> (referer: https://www.auto1.com/v1/car-details-view/PT71111/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82 with identifier: PT71111
2026-03-30 10:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82 with scrape type 1
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_f74ed8b0e48f4b00a629c6dd13a65e38.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_f74ed8b0e48f4b00a629c6dd13a65e38.jpg not downloaded yet
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_c09c18bdbcabec6c224426fe2ddb299f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_c09c18bdbcabec6c224426fe2ddb299f.jpg not downloaded yet
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_a18a6a35c65f23922c87ddb9fb446107.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_a18a6a35c65f23922c87ddb9fb446107.jpg not downloaded yet
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_acb1d62f85a76658db07dddbeaa400ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_acb1d62f85a76658db07dddbeaa400ba.jpg not downloaded yet
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_1097c3d9070134038716ace6a9a910a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_1097c3d9070134038716ace6a9a910a4.jpg not downloaded yet
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_d4b773e5e3aa58422f26547f8b3f73da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_d4b773e5e3aa58422f26547f8b3f73da.jpg not downloaded yet
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_9ee72c49e4b0478517b89c409115aa88.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_9ee72c49e4b0478517b89c409115aa88.jpg not downloaded yet
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_cdd80c9ab0725b8e1515c277ae3e7287.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_cdd80c9ab0725b8e1515c277ae3e7287.jpg not downloaded yet
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_c47d3572e1f80175efde0c0f14204f9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_c47d3572e1f80175efde0c0f14204f9d.jpg not downloaded yet
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_02c45f16cd38ca68144bb8dcb0964acd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_02c45f16cd38ca68144bb8dcb0964acd.jpg not downloaded yet
2026-03-30 10:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK28735> (referer: https://www.auto1.com/v1/car-details-view/UK28735/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cfd5441-d802-5a33-8d67-b1daee7389a5 with identifier: UK28735
2026-03-30 10:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cfd5441-d802-5a33-8d67-b1daee7389a5 with scrape type 1
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8cfd5441-d802-5a33-8d67-b1daee7389a5
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F40%252Fa440c3b893b3aaa3636f242d0e0312ae%252Fpa%252FUK28735_b6a23c62e757735e89e82669fe01767f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_b6a23c62e757735e89e82669fe01767f.jpg not downloaded yet
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F40%252Fa440c3b893b3aaa3636f242d0e0312ae%252Fpa%252FUK28735_913c37b193d47d1d6c31c77ce847b4b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_913c37b193d47d1d6c31c77ce847b4b1.jpg not downloaded yet
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F40%252Fa440c3b893b3aaa3636f242d0e0312ae%252Fpa%252FUK28735_d0bb9a5faaf9a64b2a21ef7f330e25ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_d0bb9a5faaf9a64b2a21ef7f330e25ba.jpg not downloaded yet
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F40%252Fa440c3b893b3aaa3636f242d0e0312ae%252Fpa%252FUK28735_8170d541822c0891ed2d0d6df36cfefb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_8170d541822c0891ed2d0d6df36cfefb.jpg not downloaded yet
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F40%252Fa440c3b893b3aaa3636f242d0e0312ae%252Fpa%252FUK28735_9f9afd5c7a4ee04d7bd70da0cab6ef81.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_9f9afd5c7a4ee04d7bd70da0cab6ef81.jpg not downloaded yet
2026-03-30 10:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_02c45f16cd38ca68144bb8dcb0964acd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a31810>
2026-03-30 10:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_02c45f16cd38ca68144bb8dcb0964acd.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_02c45f16cd38ca68144bb8dcb0964acd.jpg saved to cache
2026-03-30 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82
2026-03-30 10:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_9f9afd5c7a4ee04d7bd70da0cab6ef81.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_8170d541822c0891ed2d0d6df36cfefb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5108790>
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cfd5441-d802-5a33-8d67-b1daee7389a5/8cfd5441-d802-5a33-8d67-b1daee7389a5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F40%252Fa440c3b893b3aaa3636f242d0e0312ae%252Fpa%252FUK28735_9f9afd5c7a4ee04d7bd70da0cab6ef81.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_9f9afd5c7a4ee04d7bd70da0cab6ef81.jpg saved to cache
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8cfd5441-d802-5a33-8d67-b1daee7389a5
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7d250>
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cfd5441-d802-5a33-8d67-b1daee7389a5/8cfd5441-d802-5a33-8d67-b1daee7389a5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F40%252Fa440c3b893b3aaa3636f242d0e0312ae%252Fpa%252FUK28735_8170d541822c0891ed2d0d6df36cfefb.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_8170d541822c0891ed2d0d6df36cfefb.jpg saved to cache
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8cfd5441-d802-5a33-8d67-b1daee7389a5
2026-03-30 10:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_d0bb9a5faaf9a64b2a21ef7f330e25ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_913c37b193d47d1d6c31c77ce847b4b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ05833/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_b6a23c62e757735e89e82669fe01767f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef785e0d0>
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cfd5441-d802-5a33-8d67-b1daee7389a5/8cfd5441-d802-5a33-8d67-b1daee7389a5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F40%252Fa440c3b893b3aaa3636f242d0e0312ae%252Fpa%252FUK28735_d0bb9a5faaf9a64b2a21ef7f330e25ba.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_d0bb9a5faaf9a64b2a21ef7f330e25ba.jpg saved to cache
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8cfd5441-d802-5a33-8d67-b1daee7389a5
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6ba10>
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cfd5441-d802-5a33-8d67-b1daee7389a5/8cfd5441-d802-5a33-8d67-b1daee7389a5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F40%252Fa440c3b893b3aaa3636f242d0e0312ae%252Fpa%252FUK28735_913c37b193d47d1d6c31c77ce847b4b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_913c37b193d47d1d6c31c77ce847b4b1.jpg saved to cache
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8cfd5441-d802-5a33-8d67-b1daee7389a5
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef503e0d0>
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cfd5441-d802-5a33-8d67-b1daee7389a5/8cfd5441-d802-5a33-8d67-b1daee7389a5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F40%252Fa440c3b893b3aaa3636f242d0e0312ae%252Fpa%252FUK28735_b6a23c62e757735e89e82669fe01767f.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_b6a23c62e757735e89e82669fe01767f.jpg saved to cache
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8cfd5441-d802-5a33-8d67-b1daee7389a5
2026-03-30 10:37:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8cfd5441-d802-5a33-8d67-b1daee7389a5, skipping ID generation
2026-03-30 10:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cfd5441-d802-5a33-8d67-b1daee7389a5 with scrape type 1
2026-03-30 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8cfd5441-d802-5a33-8d67-b1daee7389a5 sending to next pipeline
2026-03-30 10:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cfd5441-d802-5a33-8d67-b1daee7389a5, identifier: UK28735
2026-03-30 10:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cfd5441-d802-5a33-8d67-b1daee7389a5 with identifier: UK28735
2026-03-30 10:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cfd5441-d802-5a33-8d67-b1daee7389a5 with identifier: UK28735
2026-03-30 10:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cfd5441-d802-5a33-8d67-b1daee7389a5 with identifier: UK28735 to the API
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_b6a23c62e757735e89e82669fe01767f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:40:55Z',
 'fuel_type': 'petrol',
 'id': '8cfd5441-d802-5a33-8d67-b1daee7389a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK28735',
 'listing': 'auction',
 'location': 'DE, Kassel',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 220110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cfd5441-d802-5a33-8d67-b1daee7389a5/8cfd5441-d802-5a33-8d67-b1daee7389a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_b6a23c62e757735e89e82669fe01767f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cfd5441-d802-5a33-8d67-b1daee7389a5/8cfd5441-d802-5a33-8d67-b1daee7389a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_913c37b193d47d1d6c31c77ce847b4b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cfd5441-d802-5a33-8d67-b1daee7389a5/8cfd5441-d802-5a33-8d67-b1daee7389a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_d0bb9a5faaf9a64b2a21ef7f330e25ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cfd5441-d802-5a33-8d67-b1daee7389a5/8cfd5441-d802-5a33-8d67-b1daee7389a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_8170d541822c0891ed2d0d6df36cfefb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cfd5441-d802-5a33-8d67-b1daee7389a5/8cfd5441-d802-5a33-8d67-b1daee7389a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/40/a440c3b893b3aaa3636f242d0e0312ae/pa/UK28735_9f9afd5c7a4ee04d7bd70da0cab6ef81.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-07-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2012}
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28735%27 HTTP/1.1" 200 None
2026-03-30 10:37:56 [auto1.de] INFO: Saving data for UK28735: {'created_time': 1774867076.899289, 'last_price_update_time': 1774867076.899303, 'auction_closing_time': 1774971655.0}
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK28735') HTTP/1.1" 204 0
2026-03-30 10:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_cdd80c9ab0725b8e1515c277ae3e7287.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_c47d3572e1f80175efde0c0f14204f9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_9ee72c49e4b0478517b89c409115aa88.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595f310>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_cdd80c9ab0725b8e1515c277ae3e7287.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_cdd80c9ab0725b8e1515c277ae3e7287.jpg saved to cache
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82
2026-03-30 10:37:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a43850>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_c47d3572e1f80175efde0c0f14204f9d.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_c47d3572e1f80175efde0c0f14204f9d.jpg saved to cache
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ffff90>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_9ee72c49e4b0478517b89c409115aa88.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_9ee72c49e4b0478517b89c409115aa88.jpg saved to cache
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_d4b773e5e3aa58422f26547f8b3f73da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ad7ed0>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_d4b773e5e3aa58422f26547f8b3f73da.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_d4b773e5e3aa58422f26547f8b3f73da.jpg saved to cache
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_1097c3d9070134038716ace6a9a910a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_acb1d62f85a76658db07dddbeaa400ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb28d0>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_1097c3d9070134038716ace6a9a910a4.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_1097c3d9070134038716ace6a9a910a4.jpg saved to cache
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82
2026-03-30 10:37:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5122cd0>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_acb1d62f85a76658db07dddbeaa400ba.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_acb1d62f85a76658db07dddbeaa400ba.jpg saved to cache
2026-03-30 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_a18a6a35c65f23922c87ddb9fb446107.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB22204> (referer: https://www.auto1.com/v1/car-details-view/UB22204/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_f74ed8b0e48f4b00a629c6dd13a65e38.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7cc67d0>
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_a18a6a35c65f23922c87ddb9fb446107.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_a18a6a35c65f23922c87ddb9fb446107.jpg saved to cache
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82
2026-03-30 10:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acfab000-a70e-5c00-a803-17ff7d5929c5 with identifier: UB22204
2026-03-30 10:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acfab000-a70e-5c00-a803-17ff7d5929c5 with scrape type 1
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item acfab000-a70e-5c00-a803-17ff7d5929c5
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_5815b0add7a5967f4223e638fa609f82.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_5815b0add7a5967f4223e638fa609f82.jpg not downloaded yet
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef51226d0>
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_f74ed8b0e48f4b00a629c6dd13a65e38.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_f74ed8b0e48f4b00a629c6dd13a65e38.jpg saved to cache
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_6149bcbc4137861039e6f3078bc5bce5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_6149bcbc4137861039e6f3078bc5bce5.jpg not downloaded yet
2026-03-30 10:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_c09c18bdbcabec6c224426fe2ddb299f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FY02898> (referer: https://www.auto1.com/v1/car-details-view/FY02898/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_dd9fcbf09e89b26765db06378e3d1001.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_dd9fcbf09e89b26765db06378e3d1001.jpg not downloaded yet
2026-03-30 10:37:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_5ce5a3e3f8c4704a19bf71a221130740.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_5ce5a3e3f8c4704a19bf71a221130740.jpg not downloaded yet
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_b923879e9b7f7dcf6758fcf5d5e43f4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_b923879e9b7f7dcf6758fcf5d5e43f4d.jpg not downloaded yet
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_cd855fc49938be85051e1637df9afe30.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_cd855fc49938be85051e1637df9afe30.jpg not downloaded yet
2026-03-30 10:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_5815b0add7a5967f4223e638fa609f82.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_9783240da95ccabbc9d25428960d96ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_9783240da95ccabbc9d25428960d96ff.jpg not downloaded yet
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_b11aeb78520f66a7eba84350f8bd0df7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_b11aeb78520f66a7eba84350f8bd0df7.jpg not downloaded yet
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_225cb51d61b634af6a2f8beb9334e7f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_225cb51d61b634af6a2f8beb9334e7f9.jpg not downloaded yet
2026-03-30 10:37:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b13d0>
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F5f%252F4b5feca1dc27d5b8bcf50a414e94ed60%252Fpa%252FPT71111_c09c18bdbcabec6c224426fe2ddb299f.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_c09c18bdbcabec6c224426fe2ddb299f.jpg saved to cache
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82
2026-03-30 10:37:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82, skipping ID generation
2026-03-30 10:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82 with scrape type 1
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82 sending to next pipeline
2026-03-30 10:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82, identifier: PT71111
2026-03-30 10:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71da2d52-5d14-5470-8eb1-8b3bbcc0e984 with identifier: FY02898
2026-03-30 10:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71da2d52-5d14-5470-8eb1-8b3bbcc0e984 with scrape type 1
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71da2d52-5d14-5470-8eb1-8b3bbcc0e984
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_29b19808223515f792b549ec4a9cfb49.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_29b19808223515f792b549ec4a9cfb49.jpg not downloaded yet
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_b5e24bf5aa16a7fc43a66182251027b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_b5e24bf5aa16a7fc43a66182251027b8.jpg not downloaded yet
2026-03-30 10:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82 with identifier: PT71111
2026-03-30 10:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82 with identifier: PT71111
2026-03-30 10:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82 with identifier: PT71111 to the API
2026-03-30 10:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_c09c18bdbcabec6c224426fe2ddb299f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:21:24Z',
 'fuel_type': 'diesel',
 'id': '8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT71111',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 175427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_f74ed8b0e48f4b00a629c6dd13a65e38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2482862,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_c09c18bdbcabec6c224426fe2ddb299f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_a18a6a35c65f23922c87ddb9fb446107.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2323506,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_acb1d62f85a76658db07dddbeaa400ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_1097c3d9070134038716ace6a9a910a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2723248,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_d4b773e5e3aa58422f26547f8b3f73da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_9ee72c49e4b0478517b89c409115aa88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_cdd80c9ab0725b8e1515c277ae3e7287.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2914376,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_c47d3572e1f80175efde0c0f14204f9d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82/8c9d8cb9-5286-55b5-a3ef-08f4a22b7a82_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2195955,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/5f/4b5feca1dc27d5b8bcf50a414e94ed60/pa/PT71111_02c45f16cd38ca68144bb8dcb0964acd.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT71111%27 HTTP/1.1" 200 None
2026-03-30 10:37:59 [auto1.de] INFO: Saving data for PT71111: {'created_time': 1774867079.344944, 'last_price_update_time': 1774867079.344957, 'auction_closing_time': 1774970484.0}
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT71111') HTTP/1.1" 204 0
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_e0aa75c05bfb45d4ff2c4f8521d496e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_e0aa75c05bfb45d4ff2c4f8521d496e9.jpg not downloaded yet
2026-03-30 10:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_6149bcbc4137861039e6f3078bc5bce5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_b923879e9b7f7dcf6758fcf5d5e43f4d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_bc015548e8cff09c6738035c54086e94.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_bc015548e8cff09c6738035c54086e94.jpg not downloaded yet
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508c850>
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_5815b0add7a5967f4223e638fa609f82.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_5815b0add7a5967f4223e638fa609f82.jpg saved to cache
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acfab000-a70e-5c00-a803-17ff7d5929c5
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_cd4275990132edb5d2e5b5aee46ec96f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_cd4275990132edb5d2e5b5aee46ec96f.jpg not downloaded yet
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_b60eeceff7ff19dbe30f8d32179de6d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_b60eeceff7ff19dbe30f8d32179de6d1.jpg not downloaded yet
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b36750>
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_6149bcbc4137861039e6f3078bc5bce5.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_6149bcbc4137861039e6f3078bc5bce5.jpg saved to cache
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acfab000-a70e-5c00-a803-17ff7d5929c5
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe0a10>
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_b923879e9b7f7dcf6758fcf5d5e43f4d.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_b923879e9b7f7dcf6758fcf5d5e43f4d.jpg saved to cache
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acfab000-a70e-5c00-a803-17ff7d5929c5
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_8074f388a2a630fab58dbcd2ee570eb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_8074f388a2a630fab58dbcd2ee570eb8.jpg not downloaded yet
2026-03-30 10:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_29b19808223515f792b549ec4a9cfb49.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_b5e24bf5aa16a7fc43a66182251027b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_f23b86364b3576801a778c059e70dd93.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_f23b86364b3576801a778c059e70dd93.jpg not downloaded yet
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_234b5c127d5cb14b724bd912aeb8121a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_234b5c127d5cb14b724bd912aeb8121a.jpg not downloaded yet
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_0a18e4d02258f297959482e6621ba63a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_0a18e4d02258f297959482e6621ba63a.jpg not downloaded yet
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_e72e5bed04d08e25bd13e00574faec20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_e72e5bed04d08e25bd13e00574faec20.jpg not downloaded yet
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a77050>
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_29b19808223515f792b549ec4a9cfb49.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_29b19808223515f792b549ec4a9cfb49.jpg saved to cache
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71da2d52-5d14-5470-8eb1-8b3bbcc0e984
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a427d0>
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_b5e24bf5aa16a7fc43a66182251027b8.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_b5e24bf5aa16a7fc43a66182251027b8.jpg saved to cache
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item acfab000-a70e-5c00-a803-17ff7d5929c5
2026-03-30 10:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_8074f388a2a630fab58dbcd2ee570eb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_b60eeceff7ff19dbe30f8d32179de6d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a75c90>
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_8074f388a2a630fab58dbcd2ee570eb8.jpg') HTTP/1.1" 204 0
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_8074f388a2a630fab58dbcd2ee570eb8.jpg saved to cache
2026-03-30 10:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71da2d52-5d14-5470-8eb1-8b3bbcc0e984
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59bdc90>
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_b60eeceff7ff19dbe30f8d32179de6d1.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_b60eeceff7ff19dbe30f8d32179de6d1.jpg saved to cache
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71da2d52-5d14-5470-8eb1-8b3bbcc0e984
2026-03-30 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_e72e5bed04d08e25bd13e00574faec20.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_0a18e4d02258f297959482e6621ba63a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_234b5c127d5cb14b724bd912aeb8121a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_cd4275990132edb5d2e5b5aee46ec96f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5011f90>
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_e72e5bed04d08e25bd13e00574faec20.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_e72e5bed04d08e25bd13e00574faec20.jpg saved to cache
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 71da2d52-5d14-5470-8eb1-8b3bbcc0e984
2026-03-30 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_bc015548e8cff09c6738035c54086e94.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50fded0>
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_0a18e4d02258f297959482e6621ba63a.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_0a18e4d02258f297959482e6621ba63a.jpg saved to cache
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 71da2d52-5d14-5470-8eb1-8b3bbcc0e984
2026-03-30 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_f23b86364b3576801a778c059e70dd93.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5996090>
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_234b5c127d5cb14b724bd912aeb8121a.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_234b5c127d5cb14b724bd912aeb8121a.jpg saved to cache
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71da2d52-5d14-5470-8eb1-8b3bbcc0e984
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8dbd0>
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_cd4275990132edb5d2e5b5aee46ec96f.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_cd4275990132edb5d2e5b5aee46ec96f.jpg saved to cache
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71da2d52-5d14-5470-8eb1-8b3bbcc0e984
2026-03-30 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_e0aa75c05bfb45d4ff2c4f8521d496e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5aacd10>
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_bc015548e8cff09c6738035c54086e94.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_bc015548e8cff09c6738035c54086e94.jpg saved to cache
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71da2d52-5d14-5470-8eb1-8b3bbcc0e984
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b0610>
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_f23b86364b3576801a778c059e70dd93.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_f23b86364b3576801a778c059e70dd93.jpg saved to cache
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71da2d52-5d14-5470-8eb1-8b3bbcc0e984
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef79fa690>
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F8d%252F368d4dbfa4ef164e4382eae1d4ce10b3%252Fpa%252FFY02898_e0aa75c05bfb45d4ff2c4f8521d496e9.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_e0aa75c05bfb45d4ff2c4f8521d496e9.jpg saved to cache
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71da2d52-5d14-5470-8eb1-8b3bbcc0e984
2026-03-30 10:38:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71da2d52-5d14-5470-8eb1-8b3bbcc0e984, skipping ID generation
2026-03-30 10:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71da2d52-5d14-5470-8eb1-8b3bbcc0e984 with scrape type 1
2026-03-30 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71da2d52-5d14-5470-8eb1-8b3bbcc0e984 sending to next pipeline
2026-03-30 10:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71da2d52-5d14-5470-8eb1-8b3bbcc0e984, identifier: FY02898
2026-03-30 10:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71da2d52-5d14-5470-8eb1-8b3bbcc0e984 with identifier: FY02898
2026-03-30 10:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71da2d52-5d14-5470-8eb1-8b3bbcc0e984 with identifier: FY02898
2026-03-30 10:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71da2d52-5d14-5470-8eb1-8b3bbcc0e984 with identifier: FY02898 to the API
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_e0aa75c05bfb45d4ff2c4f8521d496e9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:28:31Z',
 'fuel_type': 'petrol',
 'id': '71da2d52-5d14-5470-8eb1-8b3bbcc0e984',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY02898',
 'listing': 'auction',
 'location': 'DE, Ingolstadt',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 122327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_29b19808223515f792b549ec4a9cfb49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_e0aa75c05bfb45d4ff2c4f8521d496e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_bc015548e8cff09c6738035c54086e94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_cd4275990132edb5d2e5b5aee46ec96f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_b60eeceff7ff19dbe30f8d32179de6d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_8074f388a2a630fab58dbcd2ee570eb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_f23b86364b3576801a778c059e70dd93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_234b5c127d5cb14b724bd912aeb8121a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_0a18e4d02258f297959482e6621ba63a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71da2d52-5d14-5470-8eb1-8b3bbcc0e984/71da2d52-5d14-5470-8eb1-8b3bbcc0e984_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/8d/368d4dbfa4ef164e4382eae1d4ce10b3/pa/FY02898_e72e5bed04d08e25bd13e00574faec20.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2018}
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY02898%27 HTTP/1.1" 200 None
2026-03-30 10:38:00 [auto1.de] INFO: Saving data for FY02898: {'created_time': 1774867080.955419, 'last_price_update_time': 1774867080.955429, 'auction_closing_time': 1774970911.0}
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY02898') HTTP/1.1" 204 0
2026-03-30 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_225cb51d61b634af6a2f8beb9334e7f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_b11aeb78520f66a7eba84350f8bd0df7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef503f210>
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_225cb51d61b634af6a2f8beb9334e7f9.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_225cb51d61b634af6a2f8beb9334e7f9.jpg saved to cache
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item acfab000-a70e-5c00-a803-17ff7d5929c5
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b00110>
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_b11aeb78520f66a7eba84350f8bd0df7.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_b11aeb78520f66a7eba84350f8bd0df7.jpg saved to cache
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item acfab000-a70e-5c00-a803-17ff7d5929c5
2026-03-30 10:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_9783240da95ccabbc9d25428960d96ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_cd855fc49938be85051e1637df9afe30.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_dd9fcbf09e89b26765db06378e3d1001.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5124ed0>
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_9783240da95ccabbc9d25428960d96ff.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_9783240da95ccabbc9d25428960d96ff.jpg saved to cache
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item acfab000-a70e-5c00-a803-17ff7d5929c5
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5125110>
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_cd855fc49938be85051e1637df9afe30.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_cd855fc49938be85051e1637df9afe30.jpg saved to cache
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acfab000-a70e-5c00-a803-17ff7d5929c5
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b08c10>
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_dd9fcbf09e89b26765db06378e3d1001.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_dd9fcbf09e89b26765db06378e3d1001.jpg saved to cache
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acfab000-a70e-5c00-a803-17ff7d5929c5
2026-03-30 10:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_5ce5a3e3f8c4704a19bf71a221130740.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f1a10>
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F88%252Fbc88b4296cbe6e1d83dd056e93f21d9e%252Fpa%252FUB22204_5ce5a3e3f8c4704a19bf71a221130740.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_5ce5a3e3f8c4704a19bf71a221130740.jpg saved to cache
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acfab000-a70e-5c00-a803-17ff7d5929c5
2026-03-30 10:38:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acfab000-a70e-5c00-a803-17ff7d5929c5, skipping ID generation
2026-03-30 10:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acfab000-a70e-5c00-a803-17ff7d5929c5 with scrape type 1
2026-03-30 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acfab000-a70e-5c00-a803-17ff7d5929c5 sending to next pipeline
2026-03-30 10:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acfab000-a70e-5c00-a803-17ff7d5929c5, identifier: UB22204
2026-03-30 10:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acfab000-a70e-5c00-a803-17ff7d5929c5 with identifier: UB22204
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 10:38:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acfab000-a70e-5c00-a803-17ff7d5929c5 with identifier: UB22204
2026-03-30 10:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acfab000-a70e-5c00-a803-17ff7d5929c5 with identifier: UB22204 to the API
2026-03-30 10:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_5ce5a3e3f8c4704a19bf71a221130740.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:21:22Z',
 'fuel_type': 'petrol',
 'id': 'acfab000-a70e-5c00-a803-17ff7d5929c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB22204',
 'listing': 'auction',
 'location': 'DE, Mainz-Kastel (Wiesbaden)',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 106673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_5815b0add7a5967f4223e638fa609f82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_6149bcbc4137861039e6f3078bc5bce5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_dd9fcbf09e89b26765db06378e3d1001.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_5ce5a3e3f8c4704a19bf71a221130740.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_b923879e9b7f7dcf6758fcf5d5e43f4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_cd855fc49938be85051e1637df9afe30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_9783240da95ccabbc9d25428960d96ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_b11aeb78520f66a7eba84350f8bd0df7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_225cb51d61b634af6a2f8beb9334e7f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acfab000-a70e-5c00-a803-17ff7d5929c5/acfab000-a70e-5c00-a803-17ff7d5929c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/88/bc88b4296cbe6e1d83dd056e93f21d9e/pa/UB22204_b5e24bf5aa16a7fc43a66182251027b8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Adam 1.4 Slam',
 'transmission': 'manual',
 'trim': 'Slam',
 'year': 2014}
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB22204%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [auto1.de] INFO: Saving data for UB22204: {'created_time': 1774867082.195158, 'last_price_update_time': 1774867082.195171, 'auction_closing_time': 1774970482.0}
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB22204') HTTP/1.1" 204 0
2026-03-30 10:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ54313/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY86624> (referer: https://www.auto1.com/v1/car-details-view/AY86624/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_ea96a2e86edd9499b0efbf402652c9e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec919e33-6b80-5c7a-8f65-5e578aafdd31 with identifier: AY86624
2026-03-30 10:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec919e33-6b80-5c7a-8f65-5e578aafdd31 with scrape type 1
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec919e33-6b80-5c7a-8f65-5e578aafdd31
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_22cccc4dd250d88c00654193fe203282.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_22cccc4dd250d88c00654193fe203282.jpg not downloaded yet
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_0ae0f8186fe27abee11a5491bc6d8d4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_0ae0f8186fe27abee11a5491bc6d8d4f.jpg not downloaded yet
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_83266cc448331714d90575f77c80d422.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_83266cc448331714d90575f77c80d422.jpg not downloaded yet
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_e2434242f23e63404b9fd53171adbad1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_e2434242f23e63404b9fd53171adbad1.jpg not downloaded yet
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_9369e11b591dfbb9611fa4d8715bdf8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_9369e11b591dfbb9611fa4d8715bdf8c.jpg not downloaded yet
2026-03-30 10:38:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef92bf010>
2026-03-30 10:38:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eb6a1a0-5e2a-5ada-9518-b6e5810da439/4eb6a1a0-5e2a-5ada-9518-b6e5810da439_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1c%252F921c48a8700b9c299a58b535018307e5%252Fpa%252FYY16041_ea96a2e86edd9499b0efbf402652c9e5.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_ea96a2e86edd9499b0efbf402652c9e5.jpg saved to cache
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4eb6a1a0-5e2a-5ada-9518-b6e5810da439
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_cdbd612ba791480c307cc08b0a2fdf0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_cdbd612ba791480c307cc08b0a2fdf0b.jpg not downloaded yet
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_eb925c84732e00b64370d527c39f2b87.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_eb925c84732e00b64370d527c39f2b87.jpg not downloaded yet
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_8f28f595605cfb30a9469f633cea8b0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_8f28f595605cfb30a9469f633cea8b0d.jpg not downloaded yet
2026-03-30 10:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_f9c5e81ed5f29e4e6000d287b88cfc49.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_c7043e7f77a48f29e978bf44108a7ad8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_c7043e7f77a48f29e978bf44108a7ad8.jpg not downloaded yet
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_7e2a74608d46524546e1a5c91a3927da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_7e2a74608d46524546e1a5c91a3927da.jpg not downloaded yet
2026-03-30 10:38:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7e150>
2026-03-30 10:38:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eb6a1a0-5e2a-5ada-9518-b6e5810da439/4eb6a1a0-5e2a-5ada-9518-b6e5810da439_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1c%252F921c48a8700b9c299a58b535018307e5%252Fpa%252FYY16041_f9c5e81ed5f29e4e6000d287b88cfc49.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_f9c5e81ed5f29e4e6000d287b88cfc49.jpg saved to cache
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4eb6a1a0-5e2a-5ada-9518-b6e5810da439
2026-03-30 10:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_8f28f595605cfb30a9469f633cea8b0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595ff50>
2026-03-30 10:38:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_8f28f595605cfb30a9469f633cea8b0d.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_8f28f595605cfb30a9469f633cea8b0d.jpg saved to cache
2026-03-30 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec919e33-6b80-5c7a-8f65-5e578aafdd31
2026-03-30 10:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_7e2a74608d46524546e1a5c91a3927da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV63045/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c1b50>
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_7e2a74608d46524546e1a5c91a3927da.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_7e2a74608d46524546e1a5c91a3927da.jpg saved to cache
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec919e33-6b80-5c7a-8f65-5e578aafdd31
2026-03-30 10:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_c7043e7f77a48f29e978bf44108a7ad8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_eb925c84732e00b64370d527c39f2b87.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7cdd0>
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_c7043e7f77a48f29e978bf44108a7ad8.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_c7043e7f77a48f29e978bf44108a7ad8.jpg saved to cache
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec919e33-6b80-5c7a-8f65-5e578aafdd31
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b09650>
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_eb925c84732e00b64370d527c39f2b87.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_eb925c84732e00b64370d527c39f2b87.jpg saved to cache
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec919e33-6b80-5c7a-8f65-5e578aafdd31
2026-03-30 10:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_cdbd612ba791480c307cc08b0a2fdf0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5126dd0>
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_cdbd612ba791480c307cc08b0a2fdf0b.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_cdbd612ba791480c307cc08b0a2fdf0b.jpg saved to cache
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec919e33-6b80-5c7a-8f65-5e578aafdd31
2026-03-30 10:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_9369e11b591dfbb9611fa4d8715bdf8c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c1050>
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_9369e11b591dfbb9611fa4d8715bdf8c.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_9369e11b591dfbb9611fa4d8715bdf8c.jpg saved to cache
2026-03-30 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec919e33-6b80-5c7a-8f65-5e578aafdd31
2026-03-30 10:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_e2434242f23e63404b9fd53171adbad1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c5390>
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_e2434242f23e63404b9fd53171adbad1.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_e2434242f23e63404b9fd53171adbad1.jpg saved to cache
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec919e33-6b80-5c7a-8f65-5e578aafdd31
2026-03-30 10:38:04 [scrapy.extensions.logstats] INFO: Crawled 98 pages (at 36 pages/min), scraped 73 items (at 33 items/min)
2026-03-30 10:38:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-30 10:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_83266cc448331714d90575f77c80d422.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c2cd0>
2026-03-30 10:38:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_83266cc448331714d90575f77c80d422.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_83266cc448331714d90575f77c80d422.jpg saved to cache
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec919e33-6b80-5c7a-8f65-5e578aafdd31
2026-03-30 10:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_0ae0f8186fe27abee11a5491bc6d8d4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_22cccc4dd250d88c00654193fe203282.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ffdcd0>
2026-03-30 10:38:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_0ae0f8186fe27abee11a5491bc6d8d4f.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_0ae0f8186fe27abee11a5491bc6d8d4f.jpg saved to cache
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec919e33-6b80-5c7a-8f65-5e578aafdd31
2026-03-30 10:38:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59665d0>
2026-03-30 10:38:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F2c%252F662c07df6600670109318d86990cefba%252Fpa%252FAY86624_22cccc4dd250d88c00654193fe203282.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_22cccc4dd250d88c00654193fe203282.jpg saved to cache
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec919e33-6b80-5c7a-8f65-5e578aafdd31
2026-03-30 10:38:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec919e33-6b80-5c7a-8f65-5e578aafdd31, skipping ID generation
2026-03-30 10:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec919e33-6b80-5c7a-8f65-5e578aafdd31 with scrape type 1
2026-03-30 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec919e33-6b80-5c7a-8f65-5e578aafdd31 sending to next pipeline
2026-03-30 10:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec919e33-6b80-5c7a-8f65-5e578aafdd31, identifier: AY86624
2026-03-30 10:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec919e33-6b80-5c7a-8f65-5e578aafdd31 with identifier: AY86624
2026-03-30 10:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec919e33-6b80-5c7a-8f65-5e578aafdd31 with identifier: AY86624
2026-03-30 10:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec919e33-6b80-5c7a-8f65-5e578aafdd31 with identifier: AY86624 to the API
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_22cccc4dd250d88c00654193fe203282.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:40:58Z',
 'fuel_type': 'diesel',
 'id': 'ec919e33-6b80-5c7a-8f65-5e578aafdd31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY86624',
 'listing': 'auction',
 'location': 'DE, Gießen',
 'make': 'Volkswagen',
 'model': 'T4 Multivan',
 'odometer': 363909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_22cccc4dd250d88c00654193fe203282.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2484905,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_0ae0f8186fe27abee11a5491bc6d8d4f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_83266cc448331714d90575f77c80d422.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2766413,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_e2434242f23e63404b9fd53171adbad1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_9369e11b591dfbb9611fa4d8715bdf8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2719960,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_cdbd612ba791480c307cc08b0a2fdf0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_eb925c84732e00b64370d527c39f2b87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2594014,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_8f28f595605cfb30a9469f633cea8b0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2567693,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_c7043e7f77a48f29e978bf44108a7ad8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec919e33-6b80-5c7a-8f65-5e578aafdd31/ec919e33-6b80-5c7a-8f65-5e578aafdd31_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/2c/662c07df6600670109318d86990cefba/pa/AY86624_7e2a74608d46524546e1a5c91a3927da.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-06-11',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen T4 Multivan 2.5 TDI Generation',
 'transmission': 'manual',
 'trim': 'Generation',
 'year': 2001}
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY86624%27 HTTP/1.1" 200 None
2026-03-30 10:38:04 [auto1.de] INFO: Saving data for AY86624: {'created_time': 1774867084.88819, 'last_price_update_time': 1774867084.888201, 'auction_closing_time': 1774971658.0}
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY86624') HTTP/1.1" 204 0
2026-03-30 10:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM12370/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_8ddbc5605450664f3dc8ebb576ba7fd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_2922f71f6845d5b08547ed94ea347608.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a8fe90>
2026-03-30 10:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eb6a1a0-5e2a-5ada-9518-b6e5810da439/4eb6a1a0-5e2a-5ada-9518-b6e5810da439_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1c%252F921c48a8700b9c299a58b535018307e5%252Fpa%252FYY16041_8ddbc5605450664f3dc8ebb576ba7fd9.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_8ddbc5605450664f3dc8ebb576ba7fd9.jpg saved to cache
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4eb6a1a0-5e2a-5ada-9518-b6e5810da439
2026-03-30 10:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5aadcd0>
2026-03-30 10:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eb6a1a0-5e2a-5ada-9518-b6e5810da439/4eb6a1a0-5e2a-5ada-9518-b6e5810da439_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1c%252F921c48a8700b9c299a58b535018307e5%252Fpa%252FYY16041_2922f71f6845d5b08547ed94ea347608.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_2922f71f6845d5b08547ed94ea347608.jpg saved to cache
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4eb6a1a0-5e2a-5ada-9518-b6e5810da439
2026-03-30 10:38:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4eb6a1a0-5e2a-5ada-9518-b6e5810da439, skipping ID generation
2026-03-30 10:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eb6a1a0-5e2a-5ada-9518-b6e5810da439 with scrape type 1
2026-03-30 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4eb6a1a0-5e2a-5ada-9518-b6e5810da439 sending to next pipeline
2026-03-30 10:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4eb6a1a0-5e2a-5ada-9518-b6e5810da439, identifier: YY16041
2026-03-30 10:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4eb6a1a0-5e2a-5ada-9518-b6e5810da439 with identifier: YY16041
2026-03-30 10:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4eb6a1a0-5e2a-5ada-9518-b6e5810da439 with identifier: YY16041
2026-03-30 10:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4eb6a1a0-5e2a-5ada-9518-b6e5810da439 with identifier: YY16041 to the API
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_2922f71f6845d5b08547ed94ea347608.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:16:40Z',
 'fuel_type': 'petrol',
 'id': '4eb6a1a0-5e2a-5ada-9518-b6e5810da439',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY16041',
 'listing': 'auction',
 'location': 'DE, Seevetal',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 186354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eb6a1a0-5e2a-5ada-9518-b6e5810da439/4eb6a1a0-5e2a-5ada-9518-b6e5810da439_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_2922f71f6845d5b08547ed94ea347608.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eb6a1a0-5e2a-5ada-9518-b6e5810da439/4eb6a1a0-5e2a-5ada-9518-b6e5810da439_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_8ddbc5605450664f3dc8ebb576ba7fd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eb6a1a0-5e2a-5ada-9518-b6e5810da439/4eb6a1a0-5e2a-5ada-9518-b6e5810da439_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_f9c5e81ed5f29e4e6000d287b88cfc49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eb6a1a0-5e2a-5ada-9518-b6e5810da439/4eb6a1a0-5e2a-5ada-9518-b6e5810da439_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_ea96a2e86edd9499b0efbf402652c9e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eb6a1a0-5e2a-5ada-9518-b6e5810da439/4eb6a1a0-5e2a-5ada-9518-b6e5810da439_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1c/921c48a8700b9c299a58b535018307e5/pa/YY16041_9332581a767d92c5da45bfe381ed422f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-23',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Take up!',
 'transmission': 'manual',
 'trim': 'Take',
 'year': 2013}
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY16041%27 HTTP/1.1" 200 None
2026-03-30 10:38:05 [auto1.de] INFO: Saving data for YY16041: {'created_time': 1774867085.61726, 'last_price_update_time': 1774867085.61727, 'auction_closing_time': 1774970200.0}
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY16041') HTTP/1.1" 204 0
2026-03-30 10:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR25787> (referer: https://www.auto1.com/v1/car-details-view/XR25787/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d85976d2-8b6e-5814-9dca-163342d1ac15 with identifier: XR25787
2026-03-30 10:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d85976d2-8b6e-5814-9dca-163342d1ac15 with scrape type 1
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d85976d2-8b6e-5814-9dca-163342d1ac15
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_35460b4094900e5146aff0e5a4a4337b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_35460b4094900e5146aff0e5a4a4337b.jpg not downloaded yet
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_445edd3a235dddbda8a03a886f1e33a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_445edd3a235dddbda8a03a886f1e33a3.jpg not downloaded yet
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_61bf65db2647270dfcbf64ff64f6ff94.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_61bf65db2647270dfcbf64ff64f6ff94.jpg not downloaded yet
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_394b1f6752d3edb3aa3e330a4cfd55de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_394b1f6752d3edb3aa3e330a4cfd55de.jpg not downloaded yet
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_d04f5e2479ca15c1d5901452f01d0aa4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_d04f5e2479ca15c1d5901452f01d0aa4.jpg not downloaded yet
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_ae0d3872c8a2ae5ffcf1d9f2d2bd1eda.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_ae0d3872c8a2ae5ffcf1d9f2d2bd1eda.jpg not downloaded yet
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_c06ddfaf11523803c564da6d0bbdba53.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_c06ddfaf11523803c564da6d0bbdba53.jpg not downloaded yet
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_03a87bb90a37b4e5a6a9876b5d2796c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_03a87bb90a37b4e5a6a9876b5d2796c8.jpg not downloaded yet
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_efb6ebab87b88048541359945f7ee963.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_efb6ebab87b88048541359945f7ee963.jpg not downloaded yet
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_75ca8c6fbab47d61fe295a165f9c89de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_75ca8c6fbab47d61fe295a165f9c89de.jpg not downloaded yet
2026-03-30 10:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV08904/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_75ca8c6fbab47d61fe295a165f9c89de.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef785ffd0>
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_75ca8c6fbab47d61fe295a165f9c89de.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_75ca8c6fbab47d61fe295a165f9c89de.jpg saved to cache
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d85976d2-8b6e-5814-9dca-163342d1ac15
2026-03-30 10:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_efb6ebab87b88048541359945f7ee963.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b09810>
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_efb6ebab87b88048541359945f7ee963.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_efb6ebab87b88048541359945f7ee963.jpg saved to cache
2026-03-30 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d85976d2-8b6e-5814-9dca-163342d1ac15
2026-03-30 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW24951/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_03a87bb90a37b4e5a6a9876b5d2796c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59bdf50>
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_03a87bb90a37b4e5a6a9876b5d2796c8.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_03a87bb90a37b4e5a6a9876b5d2796c8.jpg saved to cache
2026-03-30 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d85976d2-8b6e-5814-9dca-163342d1ac15
2026-03-30 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ13654/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_c06ddfaf11523803c564da6d0bbdba53.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a272d0>
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_c06ddfaf11523803c564da6d0bbdba53.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_c06ddfaf11523803c564da6d0bbdba53.jpg saved to cache
2026-03-30 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d85976d2-8b6e-5814-9dca-163342d1ac15
2026-03-30 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT34022> (referer: https://www.auto1.com/v1/car-details-view/ZT34022/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d2a9b50-3d6c-56f3-9469-a9335239f313 with identifier: ZT34022
2026-03-30 10:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d2a9b50-3d6c-56f3-9469-a9335239f313 with scrape type 1
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6d2a9b50-3d6c-56f3-9469-a9335239f313
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F95%252F65952eb6ef067fbe5f4f1b83fb04bf4e%252Fpa%252FZT34022_4756bf5a11c5d62ee001b58270514e8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_4756bf5a11c5d62ee001b58270514e8f.jpg not downloaded yet
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F95%252F65952eb6ef067fbe5f4f1b83fb04bf4e%252Fpa%252FZT34022_c254c13bee97793202d97f052068b061.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_c254c13bee97793202d97f052068b061.jpg not downloaded yet
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F95%252F65952eb6ef067fbe5f4f1b83fb04bf4e%252Fpa%252FZT34022_f1c2e277e29dcf242e37c997fe0dbf64.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_f1c2e277e29dcf242e37c997fe0dbf64.jpg not downloaded yet
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F95%252F65952eb6ef067fbe5f4f1b83fb04bf4e%252Fpa%252FZT34022_cb93fea88cf0aba7f7378c83083da805.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_cb93fea88cf0aba7f7378c83083da805.jpg not downloaded yet
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F95%252F65952eb6ef067fbe5f4f1b83fb04bf4e%252Fpa%252FZT34022_882d717795973c0e9ea55be0df8eab48.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_882d717795973c0e9ea55be0df8eab48.jpg not downloaded yet
2026-03-30 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_ae0d3872c8a2ae5ffcf1d9f2d2bd1eda.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f32d0>
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_ae0d3872c8a2ae5ffcf1d9f2d2bd1eda.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_ae0d3872c8a2ae5ffcf1d9f2d2bd1eda.jpg saved to cache
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d85976d2-8b6e-5814-9dca-163342d1ac15
2026-03-30 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_882d717795973c0e9ea55be0df8eab48.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef785f950>
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d2a9b50-3d6c-56f3-9469-a9335239f313/6d2a9b50-3d6c-56f3-9469-a9335239f313_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F95%252F65952eb6ef067fbe5f4f1b83fb04bf4e%252Fpa%252FZT34022_882d717795973c0e9ea55be0df8eab48.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_882d717795973c0e9ea55be0df8eab48.jpg saved to cache
2026-03-30 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d2a9b50-3d6c-56f3-9469-a9335239f313
2026-03-30 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_cb93fea88cf0aba7f7378c83083da805.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef785f110>
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d2a9b50-3d6c-56f3-9469-a9335239f313/6d2a9b50-3d6c-56f3-9469-a9335239f313_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F95%252F65952eb6ef067fbe5f4f1b83fb04bf4e%252Fpa%252FZT34022_cb93fea88cf0aba7f7378c83083da805.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_cb93fea88cf0aba7f7378c83083da805.jpg saved to cache
2026-03-30 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d2a9b50-3d6c-56f3-9469-a9335239f313
2026-03-30 10:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_f1c2e277e29dcf242e37c997fe0dbf64.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a8f590>
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d2a9b50-3d6c-56f3-9469-a9335239f313/6d2a9b50-3d6c-56f3-9469-a9335239f313_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F95%252F65952eb6ef067fbe5f4f1b83fb04bf4e%252Fpa%252FZT34022_f1c2e277e29dcf242e37c997fe0dbf64.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_f1c2e277e29dcf242e37c997fe0dbf64.jpg saved to cache
2026-03-30 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d2a9b50-3d6c-56f3-9469-a9335239f313
2026-03-30 10:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_c254c13bee97793202d97f052068b061.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_4756bf5a11c5d62ee001b58270514e8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZA80746/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59bc390>
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d2a9b50-3d6c-56f3-9469-a9335239f313/6d2a9b50-3d6c-56f3-9469-a9335239f313_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F95%252F65952eb6ef067fbe5f4f1b83fb04bf4e%252Fpa%252FZT34022_c254c13bee97793202d97f052068b061.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_c254c13bee97793202d97f052068b061.jpg saved to cache
2026-03-30 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d2a9b50-3d6c-56f3-9469-a9335239f313
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b01d90>
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d2a9b50-3d6c-56f3-9469-a9335239f313/6d2a9b50-3d6c-56f3-9469-a9335239f313_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F95%252F65952eb6ef067fbe5f4f1b83fb04bf4e%252Fpa%252FZT34022_4756bf5a11c5d62ee001b58270514e8f.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_4756bf5a11c5d62ee001b58270514e8f.jpg saved to cache
2026-03-30 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d2a9b50-3d6c-56f3-9469-a9335239f313
2026-03-30 10:38:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d2a9b50-3d6c-56f3-9469-a9335239f313, skipping ID generation
2026-03-30 10:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d2a9b50-3d6c-56f3-9469-a9335239f313 with scrape type 1
2026-03-30 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d2a9b50-3d6c-56f3-9469-a9335239f313 sending to next pipeline
2026-03-30 10:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d2a9b50-3d6c-56f3-9469-a9335239f313, identifier: ZT34022
2026-03-30 10:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d2a9b50-3d6c-56f3-9469-a9335239f313 with identifier: ZT34022
2026-03-30 10:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d2a9b50-3d6c-56f3-9469-a9335239f313 with identifier: ZT34022
2026-03-30 10:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d2a9b50-3d6c-56f3-9469-a9335239f313 with identifier: ZT34022 to the API
2026-03-30 10:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_4756bf5a11c5d62ee001b58270514e8f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:30:20Z',
 'fuel_type': 'petrol',
 'id': '6d2a9b50-3d6c-56f3-9469-a9335239f313',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT34022',
 'listing': 'auction',
 'location': 'DE, Kaiserslautern',
 'make': 'Opel',
 'model': 'Agila',
 'odometer': 103078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d2a9b50-3d6c-56f3-9469-a9335239f313/6d2a9b50-3d6c-56f3-9469-a9335239f313_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_4756bf5a11c5d62ee001b58270514e8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d2a9b50-3d6c-56f3-9469-a9335239f313/6d2a9b50-3d6c-56f3-9469-a9335239f313_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_c254c13bee97793202d97f052068b061.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d2a9b50-3d6c-56f3-9469-a9335239f313/6d2a9b50-3d6c-56f3-9469-a9335239f313_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_f1c2e277e29dcf242e37c997fe0dbf64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d2a9b50-3d6c-56f3-9469-a9335239f313/6d2a9b50-3d6c-56f3-9469-a9335239f313_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_cb93fea88cf0aba7f7378c83083da805.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d2a9b50-3d6c-56f3-9469-a9335239f313/6d2a9b50-3d6c-56f3-9469-a9335239f313_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/95/65952eb6ef067fbe5f4f1b83fb04bf4e/pa/ZT34022_882d717795973c0e9ea55be0df8eab48.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Agila 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT34022%27 HTTP/1.1" 200 None
2026-03-30 10:38:11 [auto1.de] INFO: Saving data for ZT34022: {'created_time': 1774867091.251198, 'last_price_update_time': 1774867091.25121, 'auction_closing_time': 1774971020.0}
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT34022') HTTP/1.1" 204 0
2026-03-30 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_394b1f6752d3edb3aa3e330a4cfd55de.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_d04f5e2479ca15c1d5901452f01d0aa4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_445edd3a235dddbda8a03a886f1e33a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50cdb10>
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_394b1f6752d3edb3aa3e330a4cfd55de.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_394b1f6752d3edb3aa3e330a4cfd55de.jpg saved to cache
2026-03-30 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d85976d2-8b6e-5814-9dca-163342d1ac15
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b20e10>
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_d04f5e2479ca15c1d5901452f01d0aa4.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_d04f5e2479ca15c1d5901452f01d0aa4.jpg saved to cache
2026-03-30 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d85976d2-8b6e-5814-9dca-163342d1ac15
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595d7d0>
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_445edd3a235dddbda8a03a886f1e33a3.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_445edd3a235dddbda8a03a886f1e33a3.jpg saved to cache
2026-03-30 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d85976d2-8b6e-5814-9dca-163342d1ac15
2026-03-30 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_61bf65db2647270dfcbf64ff64f6ff94.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_35460b4094900e5146aff0e5a4a4337b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5aac710>
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_61bf65db2647270dfcbf64ff64f6ff94.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_61bf65db2647270dfcbf64ff64f6ff94.jpg saved to cache
2026-03-30 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d85976d2-8b6e-5814-9dca-163342d1ac15
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59bf210>
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F82%252F158250b1eb2324713521793be71cb239%252Fpa%252FXR25787_35460b4094900e5146aff0e5a4a4337b.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_35460b4094900e5146aff0e5a4a4337b.jpg saved to cache
2026-03-30 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d85976d2-8b6e-5814-9dca-163342d1ac15
2026-03-30 10:38:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d85976d2-8b6e-5814-9dca-163342d1ac15, skipping ID generation
2026-03-30 10:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d85976d2-8b6e-5814-9dca-163342d1ac15 with scrape type 1
2026-03-30 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d85976d2-8b6e-5814-9dca-163342d1ac15 sending to next pipeline
2026-03-30 10:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d85976d2-8b6e-5814-9dca-163342d1ac15, identifier: XR25787
2026-03-30 10:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d85976d2-8b6e-5814-9dca-163342d1ac15 with identifier: XR25787
2026-03-30 10:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d85976d2-8b6e-5814-9dca-163342d1ac15 with identifier: XR25787
2026-03-30 10:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d85976d2-8b6e-5814-9dca-163342d1ac15 with identifier: XR25787 to the API
2026-03-30 10:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_35460b4094900e5146aff0e5a4a4337b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:40:35Z',
 'fuel_type': 'diesel',
 'id': 'd85976d2-8b6e-5814-9dca-163342d1ac15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR25787',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 89432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_35460b4094900e5146aff0e5a4a4337b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_445edd3a235dddbda8a03a886f1e33a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_61bf65db2647270dfcbf64ff64f6ff94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_394b1f6752d3edb3aa3e330a4cfd55de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_d04f5e2479ca15c1d5901452f01d0aa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_ae0d3872c8a2ae5ffcf1d9f2d2bd1eda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_c06ddfaf11523803c564da6d0bbdba53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_03a87bb90a37b4e5a6a9876b5d2796c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_efb6ebab87b88048541359945f7ee963.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85976d2-8b6e-5814-9dca-163342d1ac15/d85976d2-8b6e-5814-9dca-163342d1ac15_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/82/158250b1eb2324713521793be71cb239/pa/XR25787_75ca8c6fbab47d61fe295a165f9c89de.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2021}
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR25787%27 HTTP/1.1" 200 None
2026-03-30 10:38:12 [auto1.de] INFO: Saving data for XR25787: {'created_time': 1774867092.154345, 'last_price_update_time': 1774867092.154355, 'auction_closing_time': 1774971635.0}
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR25787') HTTP/1.1" 204 0
2026-03-30 10:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ38032/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN66141/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:14 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 9426 | hits on page: 40
2026-03-30 10:38:14 [auto1.de] INFO: Found listing with ID: XR25787
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR25787%27 HTTP/1.1" 200 None
2026-03-30 10:38:14 [auto1.de] INFO: Scrape type for XR25787: 0
2026-03-30 10:38:14 [auto1.de] INFO: Found listing with ID: PC55242
2026-03-30 10:38:14 [auto1.de] INFO: Found listing with ID: AM41059
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM41059%27 HTTP/1.1" 200 None
2026-03-30 10:38:14 [auto1.de] INFO: Scrape type for AM41059: 0
2026-03-30 10:38:14 [auto1.de] INFO: Found listing with ID: WX33837
2026-03-30 10:38:14 [auto1.de] INFO: Found listing with ID: RM21186
2026-03-30 10:38:14 [auto1.de] INFO: Found listing with ID: CZ81825
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ81825%27 HTTP/1.1" 200 None
2026-03-30 10:38:14 [auto1.de] INFO: Scrape type for CZ81825: 2
2026-03-30 10:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 305a0c92-4105-592b-b4f7-5df8bd739adc with identifier: CZ81825
2026-03-30 10:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 305a0c92-4105-592b-b4f7-5df8bd739adc with scrape type 2
2026-03-30 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 305a0c92-4105-592b-b4f7-5df8bd739adc with scrape type 2
2026-03-30 10:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 305a0c92-4105-592b-b4f7-5df8bd739adc, identifier: CZ81825
2026-03-30 10:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 305a0c92-4105-592b-b4f7-5df8bd739adc with identifier: CZ81825
2026-03-30 10:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 305a0c92-4105-592b-b4f7-5df8bd739adc with identifier: CZ81825
2026-03-30 10:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 305a0c92-4105-592b-b4f7-5df8bd739adc with identifier: CZ81825 to the API
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:55:51Z',
 'fuel_type': 'petrol',
 'id': '305a0c92-4105-592b-b4f7-5df8bd739adc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ81825',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 148193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-23',
 'seller_name': None,
 'title': 'Audi Q3 1.4 TFSI ACT',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ81825%27 HTTP/1.1" 200 None
2026-03-30 10:38:14 [auto1.de] INFO: Saving data for CZ81825: {'auction_closing_time': 1774972551.0, 'created_time': 1773688525.542535, 'last_price_update_time': 1774867094.620036}
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ81825') HTTP/1.1" 204 0
2026-03-30 10:38:14 [auto1.de] INFO: Found listing with ID: TD64392
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD64392%27 HTTP/1.1" 200 None
2026-03-30 10:38:14 [auto1.de] INFO: Scrape type for TD64392: 1
2026-03-30 10:38:14 [auto1.de] INFO: Found listing with ID: KT88198
2026-03-30 10:38:14 [auto1.de] INFO: Found listing with ID: ZX44823
2026-03-30 10:38:14 [auto1.de] INFO: Found listing with ID: VX41327
2026-03-30 10:38:14 [auto1.de] INFO: Found listing with ID: YM81802
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM81802%27 HTTP/1.1" 200 None
2026-03-30 10:38:14 [auto1.de] INFO: Scrape type for YM81802: 1
2026-03-30 10:38:14 [auto1.de] INFO: Found listing with ID: JB14555
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB14555%27 HTTP/1.1" 200 None
2026-03-30 10:38:14 [auto1.de] INFO: Scrape type for JB14555: 1
2026-03-30 10:38:14 [auto1.de] INFO: Found listing with ID: DB12378
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB12378%27 HTTP/1.1" 200 None
2026-03-30 10:38:14 [auto1.de] INFO: Scrape type for DB12378: 2
2026-03-30 10:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8d9782d-0e8a-59c3-a3bd-894c8c4a9d44 with identifier: DB12378
2026-03-30 10:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8d9782d-0e8a-59c3-a3bd-894c8c4a9d44 with scrape type 2
2026-03-30 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8d9782d-0e8a-59c3-a3bd-894c8c4a9d44 with scrape type 2
2026-03-30 10:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8d9782d-0e8a-59c3-a3bd-894c8c4a9d44, identifier: DB12378
2026-03-30 10:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8d9782d-0e8a-59c3-a3bd-894c8c4a9d44 with identifier: DB12378
2026-03-30 10:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8d9782d-0e8a-59c3-a3bd-894c8c4a9d44 with identifier: DB12378
2026-03-30 10:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8d9782d-0e8a-59c3-a3bd-894c8c4a9d44 with identifier: DB12378 to the API
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:06:33Z',
 'fuel_type': 'petrol',
 'id': 'b8d9782d-0e8a-59c3-a3bd-894c8c4a9d44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB12378',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 111552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-14',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB12378%27 HTTP/1.1" 200 None
2026-03-30 10:38:15 [auto1.de] INFO: Saving data for DB12378: {'auction_closing_time': 1774969593.0, 'created_time': 1773226069.507528, 'last_price_update_time': 1774867095.241495}
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB12378') HTTP/1.1" 204 0
2026-03-30 10:38:15 [auto1.de] INFO: Found listing with ID: TH79589
2026-03-30 10:38:15 [auto1.de] INFO: Found listing with ID: PD59539
2026-03-30 10:38:15 [auto1.de] INFO: Found listing with ID: TZ25189
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ25189%27 HTTP/1.1" 200 None
2026-03-30 10:38:15 [auto1.de] INFO: Scrape type for TZ25189: 1
2026-03-30 10:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ05833> (referer: https://www.auto1.com/v1/car-details-view/KJ05833/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:15 [auto1.de] INFO: Found listing with ID: NG72078
2026-03-30 10:38:15 [auto1.de] INFO: Found listing with ID: KD91632
2026-03-30 10:38:15 [auto1.de] INFO: Found listing with ID: UD25726
2026-03-30 10:38:15 [auto1.de] INFO: Found listing with ID: VZ62992
2026-03-30 10:38:15 [auto1.de] INFO: Found listing with ID: AU07976
2026-03-30 10:38:15 [auto1.de] INFO: Found listing with ID: ZD62787
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD62787%27 HTTP/1.1" 200 None
2026-03-30 10:38:15 [auto1.de] INFO: Scrape type for ZD62787: 1
2026-03-30 10:38:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:15 [auto1.de] INFO: Found listing with ID: WG88044
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG88044%27 HTTP/1.1" 200 None
2026-03-30 10:38:15 [auto1.de] INFO: Scrape type for WG88044: 2
2026-03-30 10:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 139b38d0-bb93-50b2-b756-df6382d055ab with identifier: WG88044
2026-03-30 10:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 139b38d0-bb93-50b2-b756-df6382d055ab with scrape type 2
2026-03-30 10:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 139b38d0-bb93-50b2-b756-df6382d055ab with scrape type 2
2026-03-30 10:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 139b38d0-bb93-50b2-b756-df6382d055ab, identifier: WG88044
2026-03-30 10:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 139b38d0-bb93-50b2-b756-df6382d055ab with identifier: WG88044
2026-03-30 10:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 139b38d0-bb93-50b2-b756-df6382d055ab with identifier: WG88044
2026-03-30 10:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 139b38d0-bb93-50b2-b756-df6382d055ab with identifier: WG88044 to the API
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:21:08Z',
 'fuel_type': 'petrol',
 'id': '139b38d0-bb93-50b2-b756-df6382d055ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG88044',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 123491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-23',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Natural Power Panda',
 'transmission': 'manual',
 'trim': 'Natural Power',
 'year': 2010}
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG88044%27 HTTP/1.1" 200 None
2026-03-30 10:38:15 [auto1.de] INFO: Saving data for WG88044: {'auction_closing_time': 1774970468.0, 'created_time': 1774262643.576995, 'last_price_update_time': 1774867095.701963}
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG88044') HTTP/1.1" 204 0
2026-03-30 10:38:15 [auto1.de] INFO: Found listing with ID: SD14914
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD14914%27 HTTP/1.1" 200 None
2026-03-30 10:38:15 [auto1.de] INFO: Scrape type for SD14914: 1
2026-03-30 10:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e6d62f-e062-5a7d-ba3b-09941b697067 with identifier: KJ05833
2026-03-30 10:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e6d62f-e062-5a7d-ba3b-09941b697067 with scrape type 1
2026-03-30 10:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 96e6d62f-e062-5a7d-ba3b-09941b697067
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff2%252F34f2f23f75410ebae482ace0a53ab78a%252Fpa%252FKJ05833_8bbc921b9181218768c20e69269e263f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_8bbc921b9181218768c20e69269e263f.jpg not downloaded yet
2026-03-30 10:38:15 [auto1.de] INFO: Found listing with ID: RH79105
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH79105%27 HTTP/1.1" 200 None
2026-03-30 10:38:15 [auto1.de] INFO: Scrape type for RH79105: 2
2026-03-30 10:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eaf39746-f5cf-59f7-af77-42d58f1d9e8e with identifier: RH79105
2026-03-30 10:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eaf39746-f5cf-59f7-af77-42d58f1d9e8e with scrape type 2
2026-03-30 10:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eaf39746-f5cf-59f7-af77-42d58f1d9e8e with scrape type 2
2026-03-30 10:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eaf39746-f5cf-59f7-af77-42d58f1d9e8e, identifier: RH79105
2026-03-30 10:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eaf39746-f5cf-59f7-af77-42d58f1d9e8e with identifier: RH79105
2026-03-30 10:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eaf39746-f5cf-59f7-af77-42d58f1d9e8e with identifier: RH79105
2026-03-30 10:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eaf39746-f5cf-59f7-af77-42d58f1d9e8e with identifier: RH79105 to the API
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:22:26Z',
 'fuel_type': 'diesel',
 'id': 'eaf39746-f5cf-59f7-af77-42d58f1d9e8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH79105',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 153183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-09',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L1 Tourneo Titanium',
 'transmission': 'automatic',
 'trim': '310 L1 Tourneo Titanium',
 'year': 2017}
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH79105%27 HTTP/1.1" 200 None
2026-03-30 10:38:16 [auto1.de] INFO: Saving data for RH79105: {'auction_closing_time': 1774970546.0, 'created_time': 1774294495.518032, 'last_price_update_time': 1774867096.265032}
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RH79105') HTTP/1.1" 204 0
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff2%252F34f2f23f75410ebae482ace0a53ab78a%252Fpa%252FKJ05833_c310173d16c8c3c839a122eb0e319e76.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_c310173d16c8c3c839a122eb0e319e76.jpg not downloaded yet
2026-03-30 10:38:16 [auto1.de] INFO: Found listing with ID: BB09478
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB09478%27 HTTP/1.1" 200 None
2026-03-30 10:38:16 [auto1.de] INFO: Scrape type for BB09478: 2
2026-03-30 10:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a76833f-ceb1-5618-8d13-5eadae6178fe with identifier: BB09478
2026-03-30 10:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a76833f-ceb1-5618-8d13-5eadae6178fe with scrape type 2
2026-03-30 10:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a76833f-ceb1-5618-8d13-5eadae6178fe with scrape type 2
2026-03-30 10:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a76833f-ceb1-5618-8d13-5eadae6178fe, identifier: BB09478
2026-03-30 10:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a76833f-ceb1-5618-8d13-5eadae6178fe with identifier: BB09478
2026-03-30 10:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a76833f-ceb1-5618-8d13-5eadae6178fe with identifier: BB09478
2026-03-30 10:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a76833f-ceb1-5618-8d13-5eadae6178fe with identifier: BB09478 to the API
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-31T15:38:10Z',
 'fuel_type': 'petrol',
 'id': '7a76833f-ceb1-5618-8d13-5eadae6178fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB09478',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 179759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-28',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2011}
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB09478%27 HTTP/1.1" 200 None
2026-03-30 10:38:16 [auto1.de] INFO: Saving data for BB09478: {'auction_closing_time': 1774971490.0, 'created_time': 1774464537.8748, 'last_price_update_time': 1774867096.730738}
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB09478') HTTP/1.1" 204 0
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff2%252F34f2f23f75410ebae482ace0a53ab78a%252Fpa%252FKJ05833_c4d31abf243399da3bbb60281df8391e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_c4d31abf243399da3bbb60281df8391e.jpg not downloaded yet
2026-03-30 10:38:16 [auto1.de] INFO: Found listing with ID: UY94864
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY94864%27 HTTP/1.1" 200 None
2026-03-30 10:38:16 [auto1.de] INFO: Scrape type for UY94864: 2
2026-03-30 10:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 937826b1-94fd-5328-8cbe-88960d13fa07 with identifier: UY94864
2026-03-30 10:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 937826b1-94fd-5328-8cbe-88960d13fa07 with scrape type 2
2026-03-30 10:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 937826b1-94fd-5328-8cbe-88960d13fa07 with scrape type 2
2026-03-30 10:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 937826b1-94fd-5328-8cbe-88960d13fa07, identifier: UY94864
2026-03-30 10:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 937826b1-94fd-5328-8cbe-88960d13fa07 with identifier: UY94864
2026-03-30 10:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 937826b1-94fd-5328-8cbe-88960d13fa07 with identifier: UY94864
2026-03-30 10:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 937826b1-94fd-5328-8cbe-88960d13fa07 with identifier: UY94864 to the API
2026-03-30 10:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:42:02Z',
 'fuel_type': 'diesel',
 'id': '937826b1-94fd-5328-8cbe-88960d13fa07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY94864',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 154940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY94864%27 HTTP/1.1" 200 None
2026-03-30 10:38:17 [auto1.de] INFO: Saving data for UY94864: {'auction_closing_time': 1774971722.0, 'created_time': 1773380789.391841, 'last_price_update_time': 1774867097.213571}
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY94864') HTTP/1.1" 204 0
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff2%252F34f2f23f75410ebae482ace0a53ab78a%252Fpa%252FKJ05833_0936f387e9fd4b13ddb352238e940fe6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_0936f387e9fd4b13ddb352238e940fe6.jpg not downloaded yet
2026-03-30 10:38:17 [auto1.de] INFO: Found listing with ID: NB58576
2026-03-30 10:38:17 [auto1.de] INFO: Found listing with ID: ZM82524
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM82524%27 HTTP/1.1" 200 None
2026-03-30 10:38:17 [auto1.de] INFO: Scrape type for ZM82524: 1
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff2%252F34f2f23f75410ebae482ace0a53ab78a%252Fpa%252FKJ05833_9f4f97fba23e8f7f9021f27b05eec73e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_9f4f97fba23e8f7f9021f27b05eec73e.jpg not downloaded yet
2026-03-30 10:38:17 [auto1.de] INFO: Found listing with ID: VT56580
2026-03-30 10:38:17 [auto1.de] INFO: Found listing with ID: JZ36451
2026-03-30 10:38:17 [auto1.de] INFO: Found listing with ID: LJ01907
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ01907%27 HTTP/1.1" 200 None
2026-03-30 10:38:17 [auto1.de] INFO: Scrape type for LJ01907: 2
2026-03-30 10:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a6db9cc-641a-58c9-87c4-8ad14fac8b53 with identifier: LJ01907
2026-03-30 10:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a6db9cc-641a-58c9-87c4-8ad14fac8b53 with scrape type 2
2026-03-30 10:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a6db9cc-641a-58c9-87c4-8ad14fac8b53 with scrape type 2
2026-03-30 10:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a6db9cc-641a-58c9-87c4-8ad14fac8b53, identifier: LJ01907
2026-03-30 10:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a6db9cc-641a-58c9-87c4-8ad14fac8b53 with identifier: LJ01907
2026-03-30 10:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a6db9cc-641a-58c9-87c4-8ad14fac8b53 with identifier: LJ01907
2026-03-30 10:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a6db9cc-641a-58c9-87c4-8ad14fac8b53 with identifier: LJ01907 to the API
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-31T15:07:15Z',
 'fuel_type': 'petrol',
 'id': '5a6db9cc-641a-58c9-87c4-8ad14fac8b53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ01907',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 97088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-26',
 'seller_name': None,
 'title': 'Porsche Cayenne 3.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ01907%27 HTTP/1.1" 200 None
2026-03-30 10:38:17 [auto1.de] INFO: Saving data for LJ01907: {'auction_closing_time': 1774969635.0, 'created_time': 1773302004.180319, 'last_price_update_time': 1774867097.7442}
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ01907') HTTP/1.1" 204 0
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff2%252F34f2f23f75410ebae482ace0a53ab78a%252Fpa%252FKJ05833_1367089a85530c47dbb97138d3b2a7f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_1367089a85530c47dbb97138d3b2a7f7.jpg not downloaded yet
2026-03-30 10:38:17 [auto1.de] INFO: Found listing with ID: BP27054
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP27054%27 HTTP/1.1" 200 None
2026-03-30 10:38:17 [auto1.de] INFO: Scrape type for BP27054: 2
2026-03-30 10:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe6e105b-c5c4-5d1f-a19d-6027e1ec0f94 with identifier: BP27054
2026-03-30 10:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe6e105b-c5c4-5d1f-a19d-6027e1ec0f94 with scrape type 2
2026-03-30 10:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe6e105b-c5c4-5d1f-a19d-6027e1ec0f94 with scrape type 2
2026-03-30 10:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe6e105b-c5c4-5d1f-a19d-6027e1ec0f94, identifier: BP27054
2026-03-30 10:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe6e105b-c5c4-5d1f-a19d-6027e1ec0f94 with identifier: BP27054
2026-03-30 10:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe6e105b-c5c4-5d1f-a19d-6027e1ec0f94 with identifier: BP27054
2026-03-30 10:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe6e105b-c5c4-5d1f-a19d-6027e1ec0f94 with identifier: BP27054 to the API
2026-03-30 10:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-31T15:39:26Z',
 'fuel_type': 'petrol',
 'id': 'fe6e105b-c5c4-5d1f-a19d-6027e1ec0f94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP27054',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 27026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-12',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2021}
2026-03-30 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP27054%27 HTTP/1.1" 200 None
2026-03-30 10:38:18 [auto1.de] INFO: Saving data for BP27054: {'auction_closing_time': 1774971566.0, 'created_time': 1774294835.151352, 'last_price_update_time': 1774867098.207296}
2026-03-30 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP27054') HTTP/1.1" 204 0
2026-03-30 10:38:18 [auto1.de] INFO: Found listing with ID: FM86230
2026-03-30 10:38:18 [auto1.de] INFO: Found listing with ID: WB27214
2026-03-30 10:38:18 [auto1.de] INFO: Found listing with ID: BW18419
2026-03-30 10:38:18 [auto1.de] INFO: Found listing with ID: VP88886
2026-03-30 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP88886%27 HTTP/1.1" 200 None
2026-03-30 10:38:18 [auto1.de] INFO: Scrape type for VP88886: 1
2026-03-30 10:38:18 [auto1.de] INFO: Found listing with ID: WX76835
2026-03-30 10:38:18 [auto1.de] INFO: Found listing with ID: KP85790
2026-03-30 10:38:18 [auto1.de] INFO: Found listing with ID: CL77227
2026-03-30 10:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV08904> (referer: https://www.auto1.com/v1/car-details-view/TV08904/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d223a9a7-2f83-5999-a8fd-8a151b4b0ec1 with identifier: TV08904
2026-03-30 10:38:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d223a9a7-2f83-5999-a8fd-8a151b4b0ec1 with scrape type 1
2026-03-30 10:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d223a9a7-2f83-5999-a8fd-8a151b4b0ec1
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fd8%252Faad8007afd0e71778fe8a5c58963c15d%252Fpa%252FTV08904_a0a7e64d535fed8ff0976d885b005962.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_a0a7e64d535fed8ff0976d885b005962.jpg already downloaded
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fd8%252Faad8007afd0e71778fe8a5c58963c15d%252Fpa%252FTV08904_dc0121b0a2d46e58ac12aebaf2a11dca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_dc0121b0a2d46e58ac12aebaf2a11dca.jpg already downloaded
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fd8%252Faad8007afd0e71778fe8a5c58963c15d%252Fpa%252FTV08904_0f0e4b29f8a5469690ddd60f40279f3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_0f0e4b29f8a5469690ddd60f40279f3b.jpg already downloaded
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fd8%252Faad8007afd0e71778fe8a5c58963c15d%252Fpa%252FTV08904_647345b0d0ac7a9533bf74c042af5b68.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_647345b0d0ac7a9533bf74c042af5b68.jpg already downloaded
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fd8%252Faad8007afd0e71778fe8a5c58963c15d%252Fpa%252FTV08904_199aea5d80041e24e9530bdcdc4fab5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_199aea5d80041e24e9530bdcdc4fab5f.jpg already downloaded
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fd8%252Faad8007afd0e71778fe8a5c58963c15d%252Fpa%252FTV08904_0103dc61c07d974834af73d71a501171.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_0103dc61c07d974834af73d71a501171.jpg already downloaded
2026-03-30 10:38:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d223a9a7-2f83-5999-a8fd-8a151b4b0ec1, identifier: TV08904
2026-03-30 10:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d223a9a7-2f83-5999-a8fd-8a151b4b0ec1 with identifier: TV08904
2026-03-30 10:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d223a9a7-2f83-5999-a8fd-8a151b4b0ec1 with identifier: TV08904
2026-03-30 10:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d223a9a7-2f83-5999-a8fd-8a151b4b0ec1 with identifier: TV08904 to the API
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TV08904>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-31T15:44:27Z',
 'fuel_type': 'petrol',
 'id': 'd223a9a7-2f83-5999-a8fd-8a151b4b0ec1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV08904',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 120281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_a0a7e64d535fed8ff0976d885b005962.jpg',
                'https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_dc0121b0a2d46e58ac12aebaf2a11dca.jpg',
                'https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_0f0e4b29f8a5469690ddd60f40279f3b.jpg',
                'https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_647345b0d0ac7a9533bf74c042af5b68.jpg',
                'https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_199aea5d80041e24e9530bdcdc4fab5f.jpg',
                'https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_0103dc61c07d974834af73d71a501171.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d223a9a7-2f83-5999-a8fd-8a151b4b0ec1/d223a9a7-2f83-5999-a8fd-8a151b4b0ec1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_a0a7e64d535fed8ff0976d885b005962.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d223a9a7-2f83-5999-a8fd-8a151b4b0ec1/d223a9a7-2f83-5999-a8fd-8a151b4b0ec1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_dc0121b0a2d46e58ac12aebaf2a11dca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d223a9a7-2f83-5999-a8fd-8a151b4b0ec1/d223a9a7-2f83-5999-a8fd-8a151b4b0ec1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_0f0e4b29f8a5469690ddd60f40279f3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d223a9a7-2f83-5999-a8fd-8a151b4b0ec1/d223a9a7-2f83-5999-a8fd-8a151b4b0ec1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_647345b0d0ac7a9533bf74c042af5b68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d223a9a7-2f83-5999-a8fd-8a151b4b0ec1/d223a9a7-2f83-5999-a8fd-8a151b4b0ec1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_199aea5d80041e24e9530bdcdc4fab5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d223a9a7-2f83-5999-a8fd-8a151b4b0ec1/d223a9a7-2f83-5999-a8fd-8a151b4b0ec1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/d8/aad8007afd0e71778fe8a5c58963c15d/pa/TV08904_0103dc61c07d974834af73d71a501171.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 Black and White',
 'transmission': 'manual',
 'trim': 'Black and White',
 'year': 2009}
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV08904%27 HTTP/1.1" 200 None
2026-03-30 10:38:19 [auto1.de] INFO: Saving data for TV08904: {'created_time': 1774867099.785043, 'last_price_update_time': 1774867099.785063, 'auction_closing_time': 1774971867.0}
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV08904') HTTP/1.1" 204 0
2026-03-30 10:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ54313> (referer: https://www.auto1.com/v1/car-details-view/ZZ54313/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f0bf8bf-46d6-5c45-bb72-4210befeeefb with identifier: ZZ54313
2026-03-30 10:38:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f0bf8bf-46d6-5c45-bb72-4210befeeefb with scrape type 1
2026-03-30 10:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f0bf8bf-46d6-5c45-bb72-4210befeeefb
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd1%252Ffdd1fc698ad047afd16979d52a457fe3%252Fpa%252FZZ54313_13c67fb450e8ffe1290cf336e4ff1f7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_13c67fb450e8ffe1290cf336e4ff1f7d.jpg already downloaded
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd1%252Ffdd1fc698ad047afd16979d52a457fe3%252Fpa%252FZZ54313_b0fda08712627efe5d9ce945a283f352.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_b0fda08712627efe5d9ce945a283f352.jpg already downloaded
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd1%252Ffdd1fc698ad047afd16979d52a457fe3%252Fpa%252FZZ54313_e178dcf892d0874347f4c43a0f5e6dfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_e178dcf892d0874347f4c43a0f5e6dfb.jpg already downloaded
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd1%252Ffdd1fc698ad047afd16979d52a457fe3%252Fpa%252FZZ54313_897e9d8d868babd8b68156c7662eb50b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_897e9d8d868babd8b68156c7662eb50b.jpg already downloaded
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd1%252Ffdd1fc698ad047afd16979d52a457fe3%252Fpa%252FZZ54313_ae0b8c2313c93d6d5544a7dbb9481216.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_ae0b8c2313c93d6d5544a7dbb9481216.jpg already downloaded
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd1%252Ffdd1fc698ad047afd16979d52a457fe3%252Fpa%252FZZ54313_4e913e3ad289bdb51bffdcc5f8237b2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_4e913e3ad289bdb51bffdcc5f8237b2b.jpg already downloaded
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd1%252Ffdd1fc698ad047afd16979d52a457fe3%252Fpa%252FZZ54313_f96c9978a32d2ea74c8e6aaa81aa9711.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_f96c9978a32d2ea74c8e6aaa81aa9711.jpg already downloaded
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd1%252Ffdd1fc698ad047afd16979d52a457fe3%252Fpa%252FZZ54313_ea6b08b2bb5e028027f15671749c7d62.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_ea6b08b2bb5e028027f15671749c7d62.jpg already downloaded
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd1%252Ffdd1fc698ad047afd16979d52a457fe3%252Fpa%252FZZ54313_f138e3e3bb10b0a7c104a88f0cfa01fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_f138e3e3bb10b0a7c104a88f0cfa01fe.jpg already downloaded
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd1%252Ffdd1fc698ad047afd16979d52a457fe3%252Fpa%252FZZ54313_2cdd4d4eef9067030f390b8bad853d10.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_2cdd4d4eef9067030f390b8bad853d10.jpg already downloaded
2026-03-30 10:38:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f0bf8bf-46d6-5c45-bb72-4210befeeefb, identifier: ZZ54313
2026-03-30 10:38:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f0bf8bf-46d6-5c45-bb72-4210befeeefb with identifier: ZZ54313
2026-03-30 10:38:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f0bf8bf-46d6-5c45-bb72-4210befeeefb with identifier: ZZ54313
2026-03-30 10:38:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f0bf8bf-46d6-5c45-bb72-4210befeeefb with identifier: ZZ54313 to the API
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZZ54313>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:55:31Z',
 'fuel_type': 'diesel',
 'id': '0f0bf8bf-46d6-5c45-bb72-4210befeeefb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ54313',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 127155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_13c67fb450e8ffe1290cf336e4ff1f7d.jpg',
                'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_b0fda08712627efe5d9ce945a283f352.jpg',
                'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_e178dcf892d0874347f4c43a0f5e6dfb.jpg',
                'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_897e9d8d868babd8b68156c7662eb50b.jpg',
                'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_ae0b8c2313c93d6d5544a7dbb9481216.jpg',
                'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_4e913e3ad289bdb51bffdcc5f8237b2b.jpg',
                'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_f96c9978a32d2ea74c8e6aaa81aa9711.jpg',
                'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_ea6b08b2bb5e028027f15671749c7d62.jpg',
                'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_f138e3e3bb10b0a7c104a88f0cfa01fe.jpg',
                'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_2cdd4d4eef9067030f390b8bad853d10.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0bf8bf-46d6-5c45-bb72-4210befeeefb/0f0bf8bf-46d6-5c45-bb72-4210befeeefb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_13c67fb450e8ffe1290cf336e4ff1f7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0bf8bf-46d6-5c45-bb72-4210befeeefb/0f0bf8bf-46d6-5c45-bb72-4210befeeefb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_b0fda08712627efe5d9ce945a283f352.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0bf8bf-46d6-5c45-bb72-4210befeeefb/0f0bf8bf-46d6-5c45-bb72-4210befeeefb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_e178dcf892d0874347f4c43a0f5e6dfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0bf8bf-46d6-5c45-bb72-4210befeeefb/0f0bf8bf-46d6-5c45-bb72-4210befeeefb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_897e9d8d868babd8b68156c7662eb50b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0bf8bf-46d6-5c45-bb72-4210befeeefb/0f0bf8bf-46d6-5c45-bb72-4210befeeefb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_ae0b8c2313c93d6d5544a7dbb9481216.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0bf8bf-46d6-5c45-bb72-4210befeeefb/0f0bf8bf-46d6-5c45-bb72-4210befeeefb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_4e913e3ad289bdb51bffdcc5f8237b2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0bf8bf-46d6-5c45-bb72-4210befeeefb/0f0bf8bf-46d6-5c45-bb72-4210befeeefb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_f96c9978a32d2ea74c8e6aaa81aa9711.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0bf8bf-46d6-5c45-bb72-4210befeeefb/0f0bf8bf-46d6-5c45-bb72-4210befeeefb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_ea6b08b2bb5e028027f15671749c7d62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0bf8bf-46d6-5c45-bb72-4210befeeefb/0f0bf8bf-46d6-5c45-bb72-4210befeeefb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331271,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_f138e3e3bb10b0a7c104a88f0cfa01fe.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0bf8bf-46d6-5c45-bb72-4210befeeefb/0f0bf8bf-46d6-5c45-bb72-4210befeeefb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/d1/fdd1fc698ad047afd16979d52a457fe3/pa/ZZ54313_2cdd4d4eef9067030f390b8bad853d10.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 BLUE dCi Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2019}
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ54313%27 HTTP/1.1" 200 None
2026-03-30 10:38:20 [auto1.de] INFO: Saving data for ZZ54313: {'created_time': 1774867100.602827, 'last_price_update_time': 1774867100.602838, 'auction_closing_time': 1774972531.0}
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ54313') HTTP/1.1" 204 0
2026-03-30 10:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_1367089a85530c47dbb97138d3b2a7f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_9f4f97fba23e8f7f9021f27b05eec73e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a21d50>
2026-03-30 10:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e6d62f-e062-5a7d-ba3b-09941b697067/96e6d62f-e062-5a7d-ba3b-09941b697067_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff2%252F34f2f23f75410ebae482ace0a53ab78a%252Fpa%252FKJ05833_1367089a85530c47dbb97138d3b2a7f7.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_1367089a85530c47dbb97138d3b2a7f7.jpg saved to cache
2026-03-30 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96e6d62f-e062-5a7d-ba3b-09941b697067
2026-03-30 10:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a23a90>
2026-03-30 10:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e6d62f-e062-5a7d-ba3b-09941b697067/96e6d62f-e062-5a7d-ba3b-09941b697067_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff2%252F34f2f23f75410ebae482ace0a53ab78a%252Fpa%252FKJ05833_9f4f97fba23e8f7f9021f27b05eec73e.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_9f4f97fba23e8f7f9021f27b05eec73e.jpg saved to cache
2026-03-30 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96e6d62f-e062-5a7d-ba3b-09941b697067
2026-03-30 10:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV63045> (referer: https://www.auto1.com/v1/car-details-view/RV63045/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7104a60-60b4-51cf-a3d1-0341b1adff10 with identifier: RV63045
2026-03-30 10:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7104a60-60b4-51cf-a3d1-0341b1adff10 with scrape type 1
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7104a60-60b4-51cf-a3d1-0341b1adff10
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F1b%252Fbe1b7ee38487e7d21aea17c036e08295%252Fpa%252FRV63045_c4db46393d9b538688e05670c88684d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_c4db46393d9b538688e05670c88684d8.jpg already downloaded
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F1b%252Fbe1b7ee38487e7d21aea17c036e08295%252Fpa%252FRV63045_132c494cb58326fce7cc8e5f0bcdc74e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_132c494cb58326fce7cc8e5f0bcdc74e.jpg already downloaded
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F1b%252Fbe1b7ee38487e7d21aea17c036e08295%252Fpa%252FRV63045_14f53eb686de464936d821b27d62a52d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_14f53eb686de464936d821b27d62a52d.jpg already downloaded
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F1b%252Fbe1b7ee38487e7d21aea17c036e08295%252Fpa%252FRV63045_b7df5edc43d5d7d069bc497a343f96d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_b7df5edc43d5d7d069bc497a343f96d5.jpg already downloaded
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F1b%252Fbe1b7ee38487e7d21aea17c036e08295%252Fpa%252FRV63045_28a76dfaf3d924ee1b2920f299817356.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_28a76dfaf3d924ee1b2920f299817356.jpg already downloaded
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F1b%252Fbe1b7ee38487e7d21aea17c036e08295%252Fpa%252FRV63045_2d31aba0841f59e0b469839de64c6dda.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_2d31aba0841f59e0b469839de64c6dda.jpg already downloaded
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F1b%252Fbe1b7ee38487e7d21aea17c036e08295%252Fpa%252FRV63045_a30beb572ea55e967393cd992e207d96.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_a30beb572ea55e967393cd992e207d96.jpg already downloaded
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F1b%252Fbe1b7ee38487e7d21aea17c036e08295%252Fpa%252FRV63045_deb64bd05da1c54000c9084540695512.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_deb64bd05da1c54000c9084540695512.jpg already downloaded
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F1b%252Fbe1b7ee38487e7d21aea17c036e08295%252Fpa%252FRV63045_4232656e824d5be9187921eafd3ea21e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_4232656e824d5be9187921eafd3ea21e.jpg already downloaded
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F1b%252Fbe1b7ee38487e7d21aea17c036e08295%252Fpa%252FRV63045_b0da5bcc3a97e96d2aa979a6dcb4d6c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_b0da5bcc3a97e96d2aa979a6dcb4d6c7.jpg already downloaded
2026-03-30 10:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7104a60-60b4-51cf-a3d1-0341b1adff10, identifier: RV63045
2026-03-30 10:38:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7104a60-60b4-51cf-a3d1-0341b1adff10 with identifier: RV63045
2026-03-30 10:38:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7104a60-60b4-51cf-a3d1-0341b1adff10 with identifier: RV63045
2026-03-30 10:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7104a60-60b4-51cf-a3d1-0341b1adff10 with identifier: RV63045 to the API
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RV63045>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:35:31Z',
 'fuel_type': 'diesel',
 'id': 'f7104a60-60b4-51cf-a3d1-0341b1adff10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV63045',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 215613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_c4db46393d9b538688e05670c88684d8.jpg',
                'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_132c494cb58326fce7cc8e5f0bcdc74e.jpg',
                'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_14f53eb686de464936d821b27d62a52d.jpg',
                'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_b7df5edc43d5d7d069bc497a343f96d5.jpg',
                'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_28a76dfaf3d924ee1b2920f299817356.jpg',
                'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_2d31aba0841f59e0b469839de64c6dda.jpg',
                'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_a30beb572ea55e967393cd992e207d96.jpg',
                'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_deb64bd05da1c54000c9084540695512.jpg',
                'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_4232656e824d5be9187921eafd3ea21e.jpg',
                'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_b0da5bcc3a97e96d2aa979a6dcb4d6c7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7104a60-60b4-51cf-a3d1-0341b1adff10/f7104a60-60b4-51cf-a3d1-0341b1adff10_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2204141,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_c4db46393d9b538688e05670c88684d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7104a60-60b4-51cf-a3d1-0341b1adff10/f7104a60-60b4-51cf-a3d1-0341b1adff10_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_132c494cb58326fce7cc8e5f0bcdc74e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7104a60-60b4-51cf-a3d1-0341b1adff10/f7104a60-60b4-51cf-a3d1-0341b1adff10_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_14f53eb686de464936d821b27d62a52d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7104a60-60b4-51cf-a3d1-0341b1adff10/f7104a60-60b4-51cf-a3d1-0341b1adff10_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2256569,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_b7df5edc43d5d7d069bc497a343f96d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7104a60-60b4-51cf-a3d1-0341b1adff10/f7104a60-60b4-51cf-a3d1-0341b1adff10_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2367686,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_28a76dfaf3d924ee1b2920f299817356.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7104a60-60b4-51cf-a3d1-0341b1adff10/f7104a60-60b4-51cf-a3d1-0341b1adff10_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2243952,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_2d31aba0841f59e0b469839de64c6dda.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7104a60-60b4-51cf-a3d1-0341b1adff10/f7104a60-60b4-51cf-a3d1-0341b1adff10_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_a30beb572ea55e967393cd992e207d96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7104a60-60b4-51cf-a3d1-0341b1adff10/f7104a60-60b4-51cf-a3d1-0341b1adff10_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2161762,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_deb64bd05da1c54000c9084540695512.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7104a60-60b4-51cf-a3d1-0341b1adff10/f7104a60-60b4-51cf-a3d1-0341b1adff10_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_4232656e824d5be9187921eafd3ea21e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7104a60-60b4-51cf-a3d1-0341b1adff10/f7104a60-60b4-51cf-a3d1-0341b1adff10_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/1b/be1b7ee38487e7d21aea17c036e08295/pa/RV63045_b0da5bcc3a97e96d2aa979a6dcb4d6c7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV63045%27 HTTP/1.1" 200 None
2026-03-30 10:38:21 [auto1.de] INFO: Saving data for RV63045: {'created_time': 1774867101.694707, 'last_price_update_time': 1774867101.694718, 'auction_closing_time': 1774971331.0}
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV63045') HTTP/1.1" 204 0
2026-03-30 10:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_0936f387e9fd4b13ddb352238e940fe6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_c4d31abf243399da3bbb60281df8391e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595f810>
2026-03-30 10:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e6d62f-e062-5a7d-ba3b-09941b697067/96e6d62f-e062-5a7d-ba3b-09941b697067_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff2%252F34f2f23f75410ebae482ace0a53ab78a%252Fpa%252FKJ05833_0936f387e9fd4b13ddb352238e940fe6.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_0936f387e9fd4b13ddb352238e940fe6.jpg saved to cache
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96e6d62f-e062-5a7d-ba3b-09941b697067
2026-03-30 10:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59bd710>
2026-03-30 10:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e6d62f-e062-5a7d-ba3b-09941b697067/96e6d62f-e062-5a7d-ba3b-09941b697067_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff2%252F34f2f23f75410ebae482ace0a53ab78a%252Fpa%252FKJ05833_c4d31abf243399da3bbb60281df8391e.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_c4d31abf243399da3bbb60281df8391e.jpg saved to cache
2026-03-30 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96e6d62f-e062-5a7d-ba3b-09941b697067
2026-03-30 10:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_c310173d16c8c3c839a122eb0e319e76.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_8bbc921b9181218768c20e69269e263f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a74610>
2026-03-30 10:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e6d62f-e062-5a7d-ba3b-09941b697067/96e6d62f-e062-5a7d-ba3b-09941b697067_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff2%252F34f2f23f75410ebae482ace0a53ab78a%252Fpa%252FKJ05833_c310173d16c8c3c839a122eb0e319e76.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_c310173d16c8c3c839a122eb0e319e76.jpg saved to cache
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96e6d62f-e062-5a7d-ba3b-09941b697067
2026-03-30 10:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5aad610>
2026-03-30 10:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e6d62f-e062-5a7d-ba3b-09941b697067/96e6d62f-e062-5a7d-ba3b-09941b697067_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Ff2%252F34f2f23f75410ebae482ace0a53ab78a%252Fpa%252FKJ05833_8bbc921b9181218768c20e69269e263f.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_8bbc921b9181218768c20e69269e263f.jpg saved to cache
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96e6d62f-e062-5a7d-ba3b-09941b697067
2026-03-30 10:38:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96e6d62f-e062-5a7d-ba3b-09941b697067, skipping ID generation
2026-03-30 10:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e6d62f-e062-5a7d-ba3b-09941b697067 with scrape type 1
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96e6d62f-e062-5a7d-ba3b-09941b697067 sending to next pipeline
2026-03-30 10:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96e6d62f-e062-5a7d-ba3b-09941b697067, identifier: KJ05833
2026-03-30 10:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96e6d62f-e062-5a7d-ba3b-09941b697067 with identifier: KJ05833
2026-03-30 10:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96e6d62f-e062-5a7d-ba3b-09941b697067 with identifier: KJ05833
2026-03-30 10:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96e6d62f-e062-5a7d-ba3b-09941b697067 with identifier: KJ05833 to the API
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_8bbc921b9181218768c20e69269e263f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:30:16Z',
 'fuel_type': 'petrol',
 'id': '96e6d62f-e062-5a7d-ba3b-09941b697067',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ05833',
 'listing': 'auction',
 'location': 'DE, Dornach',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 134647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e6d62f-e062-5a7d-ba3b-09941b697067/96e6d62f-e062-5a7d-ba3b-09941b697067_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_8bbc921b9181218768c20e69269e263f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e6d62f-e062-5a7d-ba3b-09941b697067/96e6d62f-e062-5a7d-ba3b-09941b697067_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_c310173d16c8c3c839a122eb0e319e76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e6d62f-e062-5a7d-ba3b-09941b697067/96e6d62f-e062-5a7d-ba3b-09941b697067_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_c4d31abf243399da3bbb60281df8391e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e6d62f-e062-5a7d-ba3b-09941b697067/96e6d62f-e062-5a7d-ba3b-09941b697067_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_0936f387e9fd4b13ddb352238e940fe6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e6d62f-e062-5a7d-ba3b-09941b697067/96e6d62f-e062-5a7d-ba3b-09941b697067_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_9f4f97fba23e8f7f9021f27b05eec73e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e6d62f-e062-5a7d-ba3b-09941b697067/96e6d62f-e062-5a7d-ba3b-09941b697067_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/f2/34f2f23f75410ebae482ace0a53ab78a/pa/KJ05833_1367089a85530c47dbb97138d3b2a7f7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ05833%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [auto1.de] INFO: Saving data for KJ05833: {'created_time': 1774867102.600847, 'last_price_update_time': 1774867102.600857, 'auction_closing_time': 1774971016.0}
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ05833') HTTP/1.1" 204 0
2026-03-30 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH58234/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM12370> (referer: https://www.auto1.com/v1/car-details-view/FM12370/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9f9f316-999f-5704-b4cd-b82390311b6e with identifier: FM12370
2026-03-30 10:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9f9f316-999f-5704-b4cd-b82390311b6e with scrape type 1
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9f9f316-999f-5704-b4cd-b82390311b6e
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f17ff3e16f19d99915b236d3f5db70%252Fpa%252FFM12370_6d3e9c94426594eae6f888e3b85699b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_6d3e9c94426594eae6f888e3b85699b3.jpg already downloaded
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f17ff3e16f19d99915b236d3f5db70%252Fpa%252FFM12370_c6c1c67aeac8ceb5af1da36ab558660a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_c6c1c67aeac8ceb5af1da36ab558660a.jpg already downloaded
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f17ff3e16f19d99915b236d3f5db70%252Fpa%252FFM12370_68f2527f10c3e0c91c3182a31409378f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_68f2527f10c3e0c91c3182a31409378f.jpg already downloaded
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f17ff3e16f19d99915b236d3f5db70%252Fpa%252FFM12370_17cc9d1d09b6850c1592e06fc1bbfe4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_17cc9d1d09b6850c1592e06fc1bbfe4a.jpg already downloaded
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f17ff3e16f19d99915b236d3f5db70%252Fpa%252FFM12370_7494ce61c9bcb5c85d87d5925ad51326.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_7494ce61c9bcb5c85d87d5925ad51326.jpg already downloaded
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f17ff3e16f19d99915b236d3f5db70%252Fpa%252FFM12370_f5066451aced4c37db979b99f972e285.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_f5066451aced4c37db979b99f972e285.jpg already downloaded
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f17ff3e16f19d99915b236d3f5db70%252Fpa%252FFM12370_bea759db20cb78e5c35a691f859cb0d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_bea759db20cb78e5c35a691f859cb0d5.jpg already downloaded
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f17ff3e16f19d99915b236d3f5db70%252Fpa%252FFM12370_1ea55b6a82190cdb9d1c2ab61c35b55c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_1ea55b6a82190cdb9d1c2ab61c35b55c.jpg already downloaded
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f17ff3e16f19d99915b236d3f5db70%252Fpa%252FFM12370_b01886167f50fccf51ac7891606c0722.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_b01886167f50fccf51ac7891606c0722.jpg already downloaded
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Ff1%252Ff4f17ff3e16f19d99915b236d3f5db70%252Fpa%252FFM12370_eb3dd67e3589eb35c6c64458c4167fde.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_eb3dd67e3589eb35c6c64458c4167fde.jpg already downloaded
2026-03-30 10:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9f9f316-999f-5704-b4cd-b82390311b6e, identifier: FM12370
2026-03-30 10:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9f9f316-999f-5704-b4cd-b82390311b6e with identifier: FM12370
2026-03-30 10:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9f9f316-999f-5704-b4cd-b82390311b6e with identifier: FM12370
2026-03-30 10:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9f9f316-999f-5704-b4cd-b82390311b6e with identifier: FM12370 to the API
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FM12370>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:37:48Z',
 'fuel_type': 'petrol',
 'id': 'e9f9f316-999f-5704-b4cd-b82390311b6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM12370',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 70106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_6d3e9c94426594eae6f888e3b85699b3.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_c6c1c67aeac8ceb5af1da36ab558660a.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_68f2527f10c3e0c91c3182a31409378f.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_17cc9d1d09b6850c1592e06fc1bbfe4a.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_7494ce61c9bcb5c85d87d5925ad51326.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_f5066451aced4c37db979b99f972e285.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_bea759db20cb78e5c35a691f859cb0d5.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_1ea55b6a82190cdb9d1c2ab61c35b55c.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_b01886167f50fccf51ac7891606c0722.jpg',
                'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_eb3dd67e3589eb35c6c64458c4167fde.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f9f316-999f-5704-b4cd-b82390311b6e/e9f9f316-999f-5704-b4cd-b82390311b6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2577822,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_6d3e9c94426594eae6f888e3b85699b3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f9f316-999f-5704-b4cd-b82390311b6e/e9f9f316-999f-5704-b4cd-b82390311b6e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_c6c1c67aeac8ceb5af1da36ab558660a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f9f316-999f-5704-b4cd-b82390311b6e/e9f9f316-999f-5704-b4cd-b82390311b6e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_68f2527f10c3e0c91c3182a31409378f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f9f316-999f-5704-b4cd-b82390311b6e/e9f9f316-999f-5704-b4cd-b82390311b6e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_17cc9d1d09b6850c1592e06fc1bbfe4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f9f316-999f-5704-b4cd-b82390311b6e/e9f9f316-999f-5704-b4cd-b82390311b6e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2829399,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_7494ce61c9bcb5c85d87d5925ad51326.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f9f316-999f-5704-b4cd-b82390311b6e/e9f9f316-999f-5704-b4cd-b82390311b6e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2716820,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_f5066451aced4c37db979b99f972e285.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f9f316-999f-5704-b4cd-b82390311b6e/e9f9f316-999f-5704-b4cd-b82390311b6e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_bea759db20cb78e5c35a691f859cb0d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f9f316-999f-5704-b4cd-b82390311b6e/e9f9f316-999f-5704-b4cd-b82390311b6e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2491953,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_1ea55b6a82190cdb9d1c2ab61c35b55c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f9f316-999f-5704-b4cd-b82390311b6e/e9f9f316-999f-5704-b4cd-b82390311b6e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2566829,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_b01886167f50fccf51ac7891606c0722.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f9f316-999f-5704-b4cd-b82390311b6e/e9f9f316-999f-5704-b4cd-b82390311b6e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3116396,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/f1/f4f17ff3e16f19d99915b236d3f5db70/pa/FM12370_eb3dd67e3589eb35c6c64458c4167fde.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Start/Stop',
 'transmission': 'manual',
 'trim': 'Start/Stop',
 'year': 2020}
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM12370%27 HTTP/1.1" 200 None
2026-03-30 10:38:23 [auto1.de] INFO: Saving data for FM12370: {'created_time': 1774867103.34284, 'last_price_update_time': 1774867103.342852, 'auction_closing_time': 1774971468.0}
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM12370') HTTP/1.1" 204 0
2026-03-30 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS62418/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ38032> (referer: https://www.auto1.com/v1/car-details-view/VZ38032/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5 with identifier: VZ38032
2026-03-30 10:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5 with scrape type 1
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F37%252Fe337509d7f40d3248fbd0e57ef916b6a%252Fpa%252FVZ38032_501d63f6b194797444ec2b09c4950908.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_501d63f6b194797444ec2b09c4950908.jpg already downloaded
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F37%252Fe337509d7f40d3248fbd0e57ef916b6a%252Fpa%252FVZ38032_33f8a648e66307a602407dc20b38593c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_33f8a648e66307a602407dc20b38593c.jpg already downloaded
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F37%252Fe337509d7f40d3248fbd0e57ef916b6a%252Fpa%252FVZ38032_873e45fd8741753fe1f4bd31571b7264.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_873e45fd8741753fe1f4bd31571b7264.jpg already downloaded
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F37%252Fe337509d7f40d3248fbd0e57ef916b6a%252Fpa%252FVZ38032_5e3e26453958add29843aa31302065f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_5e3e26453958add29843aa31302065f3.jpg already downloaded
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F37%252Fe337509d7f40d3248fbd0e57ef916b6a%252Fpa%252FVZ38032_97d0153a0b34178b67d6c9cebfdc58fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_97d0153a0b34178b67d6c9cebfdc58fd.jpg already downloaded
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F37%252Fe337509d7f40d3248fbd0e57ef916b6a%252Fpa%252FVZ38032_305d4235f49b0f7a5062c58c0d1029f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_305d4235f49b0f7a5062c58c0d1029f4.jpg already downloaded
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F37%252Fe337509d7f40d3248fbd0e57ef916b6a%252Fpa%252FVZ38032_cd1ae41b4de21f9b9c18f373915b4501.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_cd1ae41b4de21f9b9c18f373915b4501.jpg already downloaded
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F37%252Fe337509d7f40d3248fbd0e57ef916b6a%252Fpa%252FVZ38032_81e2fad1d371f9dbfc6fa4f96415962f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_81e2fad1d371f9dbfc6fa4f96415962f.jpg already downloaded
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F37%252Fe337509d7f40d3248fbd0e57ef916b6a%252Fpa%252FVZ38032_821cb454417e3a6b60918e356cb9c9e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_821cb454417e3a6b60918e356cb9c9e9.jpg already downloaded
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F37%252Fe337509d7f40d3248fbd0e57ef916b6a%252Fpa%252FVZ38032_5556dc6635d1d2c6fd6ec0a2114f038b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_5556dc6635d1d2c6fd6ec0a2114f038b.jpg already downloaded
2026-03-30 10:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5, identifier: VZ38032
2026-03-30 10:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5 with identifier: VZ38032
2026-03-30 10:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5 with identifier: VZ38032
2026-03-30 10:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5 with identifier: VZ38032 to the API
2026-03-30 10:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VZ38032>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 306,
 'expiration_date': '2026-03-31T15:00:53Z',
 'fuel_type': 'petrol',
 'id': 'd6bf55b3-3d9d-5319-963b-e34f8f8d0ad5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ38032',
 'listing': 'auction',
 'location': 'DE, Lahr',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 80909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_501d63f6b194797444ec2b09c4950908.jpg',
                'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_33f8a648e66307a602407dc20b38593c.jpg',
                'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_873e45fd8741753fe1f4bd31571b7264.jpg',
                'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_5e3e26453958add29843aa31302065f3.jpg',
                'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_97d0153a0b34178b67d6c9cebfdc58fd.jpg',
                'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_305d4235f49b0f7a5062c58c0d1029f4.jpg',
                'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_cd1ae41b4de21f9b9c18f373915b4501.jpg',
                'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_81e2fad1d371f9dbfc6fa4f96415962f.jpg',
                'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_821cb454417e3a6b60918e356cb9c9e9.jpg',
                'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_5556dc6635d1d2c6fd6ec0a2114f038b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5/d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_501d63f6b194797444ec2b09c4950908.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5/d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_33f8a648e66307a602407dc20b38593c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5/d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_873e45fd8741753fe1f4bd31571b7264.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5/d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_5e3e26453958add29843aa31302065f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5/d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_97d0153a0b34178b67d6c9cebfdc58fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5/d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_305d4235f49b0f7a5062c58c0d1029f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5/d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_cd1ae41b4de21f9b9c18f373915b4501.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5/d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_81e2fad1d371f9dbfc6fa4f96415962f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5/d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_821cb454417e3a6b60918e356cb9c9e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5/d6bf55b3-3d9d-5319-963b-e34f8f8d0ad5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/37/e337509d7f40d3248fbd0e57ef916b6a/pa/VZ38032_5556dc6635d1d2c6fd6ec0a2114f038b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 35 Shooting Brake AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ38032%27 HTTP/1.1" 200 None
2026-03-30 10:38:25 [auto1.de] INFO: Saving data for VZ38032: {'created_time': 1774867105.166177, 'last_price_update_time': 1774867105.166187, 'auction_closing_time': 1774969253.0}
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ38032') HTTP/1.1" 204 0
2026-03-30 10:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN66141> (referer: https://www.auto1.com/v1/car-details-view/KN66141/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1 with identifier: KN66141
2026-03-30 10:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1 with scrape type 1
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_535c82d7412e35d3406ff1ab6b1e2c46.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_535c82d7412e35d3406ff1ab6b1e2c46.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_67f7ffa6b3fbc28e02ac8650d99bcb9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_67f7ffa6b3fbc28e02ac8650d99bcb9f.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_c8636cfeb351d242edb0372cb386664f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_c8636cfeb351d242edb0372cb386664f.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_9f31ab84d4c135aa67e452c5a897b766.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_9f31ab84d4c135aa67e452c5a897b766.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_b72fd3cfe4897d0ee0744f51e359ae3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_b72fd3cfe4897d0ee0744f51e359ae3f.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_c0588aaa672313e0f5b0c68856822e36.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_c0588aaa672313e0f5b0c68856822e36.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_7b89d67149341056675694d7f9828baf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_7b89d67149341056675694d7f9828baf.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_6f11f4e5f9b3a05b3d1e846354c210ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_6f11f4e5f9b3a05b3d1e846354c210ad.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_2d483b487a0a43bdc38c7694dbeecefc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_2d483b487a0a43bdc38c7694dbeecefc.jpg not downloaded yet
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_1fb9a5db831522ce9283594f432f699e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_1fb9a5db831522ce9283594f432f699e.jpg not downloaded yet
2026-03-30 10:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:32 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 9428 | hits on page: 40
2026-03-30 10:38:32 [auto1.de] INFO: Found listing with ID: KP85790
2026-03-30 10:38:32 [auto1.de] INFO: Found listing with ID: CL77227
2026-03-30 10:38:32 [auto1.de] INFO: Found listing with ID: SV86811
2026-03-30 10:38:32 [auto1.de] INFO: Found listing with ID: WK34527
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK34527%27 HTTP/1.1" 200 None
2026-03-30 10:38:32 [auto1.de] INFO: Scrape type for WK34527: 2
2026-03-30 10:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de15d1a1-8d7a-52f2-8446-c505776e2e3a with identifier: WK34527
2026-03-30 10:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de15d1a1-8d7a-52f2-8446-c505776e2e3a with scrape type 2
2026-03-30 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de15d1a1-8d7a-52f2-8446-c505776e2e3a with scrape type 2
2026-03-30 10:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de15d1a1-8d7a-52f2-8446-c505776e2e3a, identifier: WK34527
2026-03-30 10:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de15d1a1-8d7a-52f2-8446-c505776e2e3a with identifier: WK34527
2026-03-30 10:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de15d1a1-8d7a-52f2-8446-c505776e2e3a with identifier: WK34527
2026-03-30 10:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de15d1a1-8d7a-52f2-8446-c505776e2e3a with identifier: WK34527 to the API
2026-03-30 10:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:28:45Z',
 'fuel_type': 'petrol',
 'id': 'de15d1a1-8d7a-52f2-8446-c505776e2e3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK34527',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 15940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-25',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2021}
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK34527%27 HTTP/1.1" 200 None
2026-03-30 10:38:33 [auto1.de] INFO: Saving data for WK34527: {'auction_closing_time': 1774970925.0, 'created_time': 1773741534.863786, 'last_price_update_time': 1774867113.205739}
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK34527') HTTP/1.1" 204 0
2026-03-30 10:38:33 [auto1.de] INFO: Found listing with ID: GW16115
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW16115%27 HTTP/1.1" 200 None
2026-03-30 10:38:33 [auto1.de] INFO: Scrape type for GW16115: 1
2026-03-30 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_1fb9a5db831522ce9283594f432f699e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:33 [auto1.de] INFO: Found listing with ID: KY27075
2026-03-30 10:38:33 [auto1.de] INFO: Found listing with ID: ZK56270
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK56270%27 HTTP/1.1" 200 None
2026-03-30 10:38:33 [auto1.de] INFO: Scrape type for ZK56270: 1
2026-03-30 10:38:33 [auto1.de] INFO: Found listing with ID: DC27012
2026-03-30 10:38:33 [auto1.de] INFO: Found listing with ID: TR56494
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR56494%27 HTTP/1.1" 200 None
2026-03-30 10:38:33 [auto1.de] INFO: Scrape type for TR56494: 2
2026-03-30 10:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c235654-577a-5481-8dc4-666c4f04888e with identifier: TR56494
2026-03-30 10:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c235654-577a-5481-8dc4-666c4f04888e with scrape type 2
2026-03-30 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c235654-577a-5481-8dc4-666c4f04888e with scrape type 2
2026-03-30 10:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c235654-577a-5481-8dc4-666c4f04888e, identifier: TR56494
2026-03-30 10:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c235654-577a-5481-8dc4-666c4f04888e with identifier: TR56494
2026-03-30 10:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c235654-577a-5481-8dc4-666c4f04888e with identifier: TR56494
2026-03-30 10:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c235654-577a-5481-8dc4-666c4f04888e with identifier: TR56494 to the API
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:54:08Z',
 'fuel_type': 'diesel',
 'id': '7c235654-577a-5481-8dc4-666c4f04888e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR56494',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 127667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'BMW X5 xDrive 40d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR56494%27 HTTP/1.1" 200 None
2026-03-30 10:38:33 [auto1.de] INFO: Saving data for TR56494: {'auction_closing_time': 1774972448.0, 'created_time': 1774264367.63772, 'last_price_update_time': 1774867113.697826}
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR56494') HTTP/1.1" 204 0
2026-03-30 10:38:33 [auto1.de] INFO: Found listing with ID: UE91025
2026-03-30 10:38:33 [auto1.de] INFO: Found listing with ID: AE19872
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE19872%27 HTTP/1.1" 200 None
2026-03-30 10:38:33 [auto1.de] INFO: Scrape type for AE19872: 1
2026-03-30 10:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef500b510>
2026-03-30 10:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_1fb9a5db831522ce9283594f432f699e.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_1fb9a5db831522ce9283594f432f699e.jpg saved to cache
2026-03-30 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1
2026-03-30 10:38:33 [auto1.de] INFO: Found listing with ID: GX87704
2026-03-30 10:38:33 [auto1.de] INFO: Found listing with ID: BG55575
2026-03-30 10:38:33 [auto1.de] INFO: Found listing with ID: GM26241
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM26241%27 HTTP/1.1" 200 None
2026-03-30 10:38:33 [auto1.de] INFO: Scrape type for GM26241: 2
2026-03-30 10:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6334e9bb-547e-51c2-bda8-b609649751c8 with identifier: GM26241
2026-03-30 10:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6334e9bb-547e-51c2-bda8-b609649751c8 with scrape type 2
2026-03-30 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6334e9bb-547e-51c2-bda8-b609649751c8 with scrape type 2
2026-03-30 10:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6334e9bb-547e-51c2-bda8-b609649751c8, identifier: GM26241
2026-03-30 10:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6334e9bb-547e-51c2-bda8-b609649751c8 with identifier: GM26241
2026-03-30 10:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6334e9bb-547e-51c2-bda8-b609649751c8 with identifier: GM26241
2026-03-30 10:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6334e9bb-547e-51c2-bda8-b609649751c8 with identifier: GM26241 to the API
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-31T15:30:13Z',
 'fuel_type': 'petrol',
 'id': '6334e9bb-547e-51c2-bda8-b609649751c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM26241',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 33717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-13',
 'seller_name': None,
 'title': 'BMW 2er M235i Gran Coupe xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2023}
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM26241%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [auto1.de] INFO: Saving data for GM26241: {'auction_closing_time': 1774971013.0, 'created_time': 1773134273.835797, 'last_price_update_time': 1774867114.235516}
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM26241') HTTP/1.1" 204 0
2026-03-30 10:38:34 [auto1.de] INFO: Found listing with ID: FR16544
2026-03-30 10:38:34 [auto1.de] INFO: Found listing with ID: SF86380
2026-03-30 10:38:34 [auto1.de] INFO: Found listing with ID: DZ96943
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ96943%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [auto1.de] INFO: Scrape type for DZ96943: 2
2026-03-30 10:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 515b47aa-e1b4-500f-8573-89e0328b2634 with identifier: DZ96943
2026-03-30 10:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 515b47aa-e1b4-500f-8573-89e0328b2634 with scrape type 2
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 515b47aa-e1b4-500f-8573-89e0328b2634 with scrape type 2
2026-03-30 10:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 515b47aa-e1b4-500f-8573-89e0328b2634, identifier: DZ96943
2026-03-30 10:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 515b47aa-e1b4-500f-8573-89e0328b2634 with identifier: DZ96943
2026-03-30 10:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 515b47aa-e1b4-500f-8573-89e0328b2634 with identifier: DZ96943
2026-03-30 10:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 515b47aa-e1b4-500f-8573-89e0328b2634 with identifier: DZ96943 to the API
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:59:47Z',
 'fuel_type': 'petrol',
 'id': '515b47aa-e1b4-500f-8573-89e0328b2634',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ96943',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 162398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-23',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Premium 2WD',
 'transmission': 'manual',
 'trim': 'Premium 2WD',
 'year': 2018}
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ96943%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [auto1.de] INFO: Saving data for DZ96943: {'auction_closing_time': 1774972787.0, 'created_time': 1774294491.125588, 'last_price_update_time': 1774867114.856029}
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ96943') HTTP/1.1" 204 0
2026-03-30 10:38:34 [auto1.de] INFO: Found listing with ID: HK07148
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK07148%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [auto1.de] INFO: Scrape type for HK07148: 1
2026-03-30 10:38:34 [auto1.de] INFO: Found listing with ID: WJ62591
2026-03-30 10:38:34 [auto1.de] INFO: Found listing with ID: CF24380
2026-03-30 10:38:34 [auto1.de] INFO: Found listing with ID: AN69770
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN69770%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [auto1.de] INFO: Scrape type for AN69770: 1
2026-03-30 10:38:34 [auto1.de] INFO: Found listing with ID: WA34292
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA34292%27 HTTP/1.1" 200 None
2026-03-30 10:38:34 [auto1.de] INFO: Scrape type for WA34292: 2
2026-03-30 10:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3cb0f18-467b-5981-9e12-40b8b21ed0b0 with identifier: WA34292
2026-03-30 10:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3cb0f18-467b-5981-9e12-40b8b21ed0b0 with scrape type 2
2026-03-30 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3cb0f18-467b-5981-9e12-40b8b21ed0b0 with scrape type 2
2026-03-30 10:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3cb0f18-467b-5981-9e12-40b8b21ed0b0, identifier: WA34292
2026-03-30 10:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3cb0f18-467b-5981-9e12-40b8b21ed0b0 with identifier: WA34292
2026-03-30 10:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3cb0f18-467b-5981-9e12-40b8b21ed0b0 with identifier: WA34292
2026-03-30 10:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3cb0f18-467b-5981-9e12-40b8b21ed0b0 with identifier: WA34292 to the API
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:13:08Z',
 'fuel_type': 'petrol',
 'id': 'a3cb0f18-467b-5981-9e12-40b8b21ed0b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA34292',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 175663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-29',
 'seller_name': None,
 'title': 'Audi A6 2.8 V6 FSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA34292%27 HTTP/1.1" 200 None
2026-03-30 10:38:35 [auto1.de] INFO: Saving data for WA34292: {'auction_closing_time': 1774969988.0, 'created_time': 1773230535.544516, 'last_price_update_time': 1774867115.353451}
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA34292') HTTP/1.1" 204 0
2026-03-30 10:38:35 [auto1.de] INFO: Found listing with ID: PH80163
2026-03-30 10:38:35 [auto1.de] INFO: Found listing with ID: YP01427
2026-03-30 10:38:35 [auto1.de] INFO: Found listing with ID: EC09035
2026-03-30 10:38:35 [auto1.de] INFO: Found listing with ID: WR86170
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR86170%27 HTTP/1.1" 200 None
2026-03-30 10:38:35 [auto1.de] INFO: Scrape type for WR86170: 1
2026-03-30 10:38:35 [auto1.de] INFO: Found listing with ID: TM34763
2026-03-30 10:38:35 [auto1.de] INFO: Found listing with ID: FZ80671
2026-03-30 10:38:35 [auto1.de] INFO: Found listing with ID: PZ26473
2026-03-30 10:38:35 [auto1.de] INFO: Found listing with ID: MH98212
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH98212%27 HTTP/1.1" 200 None
2026-03-30 10:38:35 [auto1.de] INFO: Scrape type for MH98212: 2
2026-03-30 10:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6903364-3b1a-5b6b-bb81-0fba764edd66 with identifier: MH98212
2026-03-30 10:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6903364-3b1a-5b6b-bb81-0fba764edd66 with scrape type 2
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6903364-3b1a-5b6b-bb81-0fba764edd66 with scrape type 2
2026-03-30 10:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6903364-3b1a-5b6b-bb81-0fba764edd66, identifier: MH98212
2026-03-30 10:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6903364-3b1a-5b6b-bb81-0fba764edd66 with identifier: MH98212
2026-03-30 10:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6903364-3b1a-5b6b-bb81-0fba764edd66 with identifier: MH98212
2026-03-30 10:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6903364-3b1a-5b6b-bb81-0fba764edd66 with identifier: MH98212 to the API
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:15:35Z',
 'fuel_type': 'petrol',
 'id': 'c6903364-3b1a-5b6b-bb81-0fba764edd66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH98212',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 215778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-08',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH98212%27 HTTP/1.1" 200 None
2026-03-30 10:38:35 [auto1.de] INFO: Saving data for MH98212: {'auction_closing_time': 1774970135.0, 'created_time': 1774294107.36017, 'last_price_update_time': 1774867115.822768}
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH98212') HTTP/1.1" 204 0
2026-03-30 10:38:35 [auto1.de] INFO: Found listing with ID: VN28198
2026-03-30 10:38:35 [auto1.de] INFO: Found listing with ID: JC14226
2026-03-30 10:38:35 [auto1.de] INFO: Found listing with ID: KS67117
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS67117%27 HTTP/1.1" 200 None
2026-03-30 10:38:35 [auto1.de] INFO: Scrape type for KS67117: 2
2026-03-30 10:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca159827-03ff-538b-b4fc-c19cc80e7cbf with identifier: KS67117
2026-03-30 10:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca159827-03ff-538b-b4fc-c19cc80e7cbf with scrape type 2
2026-03-30 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca159827-03ff-538b-b4fc-c19cc80e7cbf with scrape type 2
2026-03-30 10:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca159827-03ff-538b-b4fc-c19cc80e7cbf, identifier: KS67117
2026-03-30 10:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca159827-03ff-538b-b4fc-c19cc80e7cbf with identifier: KS67117
2026-03-30 10:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca159827-03ff-538b-b4fc-c19cc80e7cbf with identifier: KS67117
2026-03-30 10:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca159827-03ff-538b-b4fc-c19cc80e7cbf with identifier: KS67117 to the API
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:52:51Z',
 'fuel_type': 'diesel',
 'id': 'ca159827-03ff-538b-b4fc-c19cc80e7cbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS67117',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 121024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-04',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.6 CDTI DPF Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2016}
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS67117%27 HTTP/1.1" 200 None
2026-03-30 10:38:36 [auto1.de] INFO: Saving data for KS67117: {'auction_closing_time': 1774972371.0, 'created_time': 1773308063.308122, 'last_price_update_time': 1774867116.459712}
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS67117') HTTP/1.1" 204 0
2026-03-30 10:38:36 [auto1.de] INFO: Found listing with ID: RL84583
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL84583%27 HTTP/1.1" 200 None
2026-03-30 10:38:36 [auto1.de] INFO: Scrape type for RL84583: 1
2026-03-30 10:38:36 [auto1.de] INFO: Found listing with ID: GW35897
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW35897%27 HTTP/1.1" 200 None
2026-03-30 10:38:36 [auto1.de] INFO: Scrape type for GW35897: 2
2026-03-30 10:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b0823b6-9b24-522c-af37-e116d88c23c6 with identifier: GW35897
2026-03-30 10:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b0823b6-9b24-522c-af37-e116d88c23c6 with scrape type 2
2026-03-30 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b0823b6-9b24-522c-af37-e116d88c23c6 with scrape type 2
2026-03-30 10:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b0823b6-9b24-522c-af37-e116d88c23c6, identifier: GW35897
2026-03-30 10:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b0823b6-9b24-522c-af37-e116d88c23c6 with identifier: GW35897
2026-03-30 10:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b0823b6-9b24-522c-af37-e116d88c23c6 with identifier: GW35897
2026-03-30 10:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b0823b6-9b24-522c-af37-e116d88c23c6 with identifier: GW35897 to the API
2026-03-30 10:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:47:14Z',
 'fuel_type': 'petrol',
 'id': '1b0823b6-9b24-522c-af37-e116d88c23c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW35897',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 128313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-30',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW35897%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [auto1.de] INFO: Saving data for GW35897: {'auction_closing_time': 1774972034.0, 'created_time': 1773428925.159274, 'last_price_update_time': 1774867117.691165}
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW35897') HTTP/1.1" 204 0
2026-03-30 10:38:37 [auto1.de] INFO: Found listing with ID: XM57589
2026-03-30 10:38:37 [auto1.de] INFO: Found listing with ID: DY18162
2026-03-30 10:38:37 [auto1.de] INFO: Found listing with ID: XV98071
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV98071%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [auto1.de] INFO: Scrape type for XV98071: 1
2026-03-30 10:38:37 [auto1.de] INFO: Found listing with ID: KE92414
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE92414%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [auto1.de] INFO: Scrape type for KE92414: 1
2026-03-30 10:38:37 [auto1.de] INFO: Found listing with ID: DW30618
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW30618%27 HTTP/1.1" 200 None
2026-03-30 10:38:37 [auto1.de] INFO: Scrape type for DW30618: 1
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP88886/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ13654> (referer: https://www.auto1.com/v1/car-details-view/KJ13654/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e662cd2b-d506-5b91-8294-b761a420b905 with identifier: KJ13654
2026-03-30 10:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e662cd2b-d506-5b91-8294-b761a420b905 with scrape type 1
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e662cd2b-d506-5b91-8294-b761a420b905
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_352ea6544baf5898e7d5f8c8cea50b1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_352ea6544baf5898e7d5f8c8cea50b1a.jpg not downloaded yet
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_4d0252382885a25d11cf98d531712224.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_4d0252382885a25d11cf98d531712224.jpg not downloaded yet
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_53ad80dc90d5e992297bb6812deda0e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_53ad80dc90d5e992297bb6812deda0e0.jpg not downloaded yet
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_50eedf374a12579ed5df4d709dd5ee03.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_50eedf374a12579ed5df4d709dd5ee03.jpg not downloaded yet
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_9e90dd2f88c6dcdca52c6ec4356ecf31.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_9e90dd2f88c6dcdca52c6ec4356ecf31.jpg not downloaded yet
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_7384768c012e924661bf0e0e603d0262.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_7384768c012e924661bf0e0e603d0262.jpg not downloaded yet
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_59e0c8c28a56c7380de7f2245b7e042a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_59e0c8c28a56c7380de7f2245b7e042a.jpg not downloaded yet
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_d056acfd8692e0bcb68eb7f745bded99.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_d056acfd8692e0bcb68eb7f745bded99.jpg not downloaded yet
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_6358020b2177dd5fc7add14485c7abb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_6358020b2177dd5fc7add14485c7abb8.jpg not downloaded yet
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_fbe14f05488a1766b6da55c0effd9c90.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_fbe14f05488a1766b6da55c0effd9c90.jpg not downloaded yet
2026-03-30 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ25189/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_fbe14f05488a1766b6da55c0effd9c90.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50fe7d0>
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_fbe14f05488a1766b6da55c0effd9c90.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_fbe14f05488a1766b6da55c0effd9c90.jpg saved to cache
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e662cd2b-d506-5b91-8294-b761a420b905
2026-03-30 10:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM82524/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD14914/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_6358020b2177dd5fc7add14485c7abb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50ff510>
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_6358020b2177dd5fc7add14485c7abb8.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_6358020b2177dd5fc7add14485c7abb8.jpg saved to cache
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e662cd2b-d506-5b91-8294-b761a420b905
2026-03-30 10:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW24951> (referer: https://www.auto1.com/v1/car-details-view/FW24951/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_d056acfd8692e0bcb68eb7f745bded99.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42b6ba55-80fb-5079-84aa-6bf741c92215 with identifier: FW24951
2026-03-30 10:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42b6ba55-80fb-5079-84aa-6bf741c92215 with scrape type 1
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 42b6ba55-80fb-5079-84aa-6bf741c92215
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb5%252Fdcb52d09d04e1767028180e52082f276%252Fpa%252FFW24951_61ad98b549747436af325d3ff4c014b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_61ad98b549747436af325d3ff4c014b2.jpg already downloaded
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb5%252Fdcb52d09d04e1767028180e52082f276%252Fpa%252FFW24951_4a5b6d839b9a76d0b39dd694bc854d36.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_4a5b6d839b9a76d0b39dd694bc854d36.jpg already downloaded
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb5%252Fdcb52d09d04e1767028180e52082f276%252Fpa%252FFW24951_0a9e40432da2199f439d442bf4a2f98f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_0a9e40432da2199f439d442bf4a2f98f.jpg already downloaded
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb5%252Fdcb52d09d04e1767028180e52082f276%252Fpa%252FFW24951_34d13cd70b835f346340c722188303e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_34d13cd70b835f346340c722188303e7.jpg already downloaded
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb5%252Fdcb52d09d04e1767028180e52082f276%252Fpa%252FFW24951_e92a8f23835f6b45adee51512e6855da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_e92a8f23835f6b45adee51512e6855da.jpg already downloaded
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb5%252Fdcb52d09d04e1767028180e52082f276%252Fpa%252FFW24951_53a090fd8a34d1266f1ad9012cdbfa18.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_53a090fd8a34d1266f1ad9012cdbfa18.jpg already downloaded
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb5%252Fdcb52d09d04e1767028180e52082f276%252Fpa%252FFW24951_1e3a8647e05352f137600d0846e9a210.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_1e3a8647e05352f137600d0846e9a210.jpg already downloaded
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb5%252Fdcb52d09d04e1767028180e52082f276%252Fpa%252FFW24951_21c966372ff6f102210e548e2f07eae2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_21c966372ff6f102210e548e2f07eae2.jpg already downloaded
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb5%252Fdcb52d09d04e1767028180e52082f276%252Fpa%252FFW24951_e1557581e9b1a8cb1d6d45ff307b1dbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_e1557581e9b1a8cb1d6d45ff307b1dbf.jpg already downloaded
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb5%252Fdcb52d09d04e1767028180e52082f276%252Fpa%252FFW24951_ad68ed6812c0f021303c5f3e0cd6e0f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_ad68ed6812c0f021303c5f3e0cd6e0f8.jpg already downloaded
2026-03-30 10:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42b6ba55-80fb-5079-84aa-6bf741c92215, identifier: FW24951
2026-03-30 10:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42b6ba55-80fb-5079-84aa-6bf741c92215 with identifier: FW24951
2026-03-30 10:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42b6ba55-80fb-5079-84aa-6bf741c92215 with identifier: FW24951
2026-03-30 10:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42b6ba55-80fb-5079-84aa-6bf741c92215 with identifier: FW24951 to the API
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FW24951>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:44:27Z',
 'fuel_type': 'petrol',
 'id': '42b6ba55-80fb-5079-84aa-6bf741c92215',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW24951',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 255271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_61ad98b549747436af325d3ff4c014b2.jpg',
                'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_4a5b6d839b9a76d0b39dd694bc854d36.jpg',
                'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_0a9e40432da2199f439d442bf4a2f98f.jpg',
                'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_34d13cd70b835f346340c722188303e7.jpg',
                'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_e92a8f23835f6b45adee51512e6855da.jpg',
                'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_53a090fd8a34d1266f1ad9012cdbfa18.jpg',
                'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_1e3a8647e05352f137600d0846e9a210.jpg',
                'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_21c966372ff6f102210e548e2f07eae2.jpg',
                'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_e1557581e9b1a8cb1d6d45ff307b1dbf.jpg',
                'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_ad68ed6812c0f021303c5f3e0cd6e0f8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b6ba55-80fb-5079-84aa-6bf741c92215/42b6ba55-80fb-5079-84aa-6bf741c92215_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_61ad98b549747436af325d3ff4c014b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b6ba55-80fb-5079-84aa-6bf741c92215/42b6ba55-80fb-5079-84aa-6bf741c92215_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_4a5b6d839b9a76d0b39dd694bc854d36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b6ba55-80fb-5079-84aa-6bf741c92215/42b6ba55-80fb-5079-84aa-6bf741c92215_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_0a9e40432da2199f439d442bf4a2f98f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b6ba55-80fb-5079-84aa-6bf741c92215/42b6ba55-80fb-5079-84aa-6bf741c92215_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_34d13cd70b835f346340c722188303e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b6ba55-80fb-5079-84aa-6bf741c92215/42b6ba55-80fb-5079-84aa-6bf741c92215_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_e92a8f23835f6b45adee51512e6855da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b6ba55-80fb-5079-84aa-6bf741c92215/42b6ba55-80fb-5079-84aa-6bf741c92215_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_53a090fd8a34d1266f1ad9012cdbfa18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b6ba55-80fb-5079-84aa-6bf741c92215/42b6ba55-80fb-5079-84aa-6bf741c92215_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_1e3a8647e05352f137600d0846e9a210.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b6ba55-80fb-5079-84aa-6bf741c92215/42b6ba55-80fb-5079-84aa-6bf741c92215_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_21c966372ff6f102210e548e2f07eae2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b6ba55-80fb-5079-84aa-6bf741c92215/42b6ba55-80fb-5079-84aa-6bf741c92215_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_e1557581e9b1a8cb1d6d45ff307b1dbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b6ba55-80fb-5079-84aa-6bf741c92215/42b6ba55-80fb-5079-84aa-6bf741c92215_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b5/dcb52d09d04e1767028180e52082f276/pa/FW24951_ad68ed6812c0f021303c5f3e0cd6e0f8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CGI T BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Elegance',
 'year': 2013}
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW24951%27 HTTP/1.1" 200 None
2026-03-30 10:38:40 [auto1.de] INFO: Saving data for FW24951: {'created_time': 1774867120.526034, 'last_price_update_time': 1774867120.526046, 'auction_closing_time': 1774971867.0}
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW24951') HTTP/1.1" 204 0
2026-03-30 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_59e0c8c28a56c7380de7f2245b7e042a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b21890>
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_d056acfd8692e0bcb68eb7f745bded99.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_d056acfd8692e0bcb68eb7f745bded99.jpg saved to cache
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e662cd2b-d506-5b91-8294-b761a420b905
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50cce10>
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_59e0c8c28a56c7380de7f2245b7e042a.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_59e0c8c28a56c7380de7f2245b7e042a.jpg saved to cache
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e662cd2b-d506-5b91-8294-b761a420b905
2026-03-30 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_7384768c012e924661bf0e0e603d0262.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50fd1d0>
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_7384768c012e924661bf0e0e603d0262.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_7384768c012e924661bf0e0e603d0262.jpg saved to cache
2026-03-30 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e662cd2b-d506-5b91-8294-b761a420b905
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_9e90dd2f88c6dcdca52c6ec4356ecf31.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595e4d0>
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_9e90dd2f88c6dcdca52c6ec4356ecf31.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_9e90dd2f88c6dcdca52c6ec4356ecf31.jpg saved to cache
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e662cd2b-d506-5b91-8294-b761a420b905
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB14555/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_50eedf374a12579ed5df4d709dd5ee03.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef510a950>
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_50eedf374a12579ed5df4d709dd5ee03.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_50eedf374a12579ed5df4d709dd5ee03.jpg saved to cache
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e662cd2b-d506-5b91-8294-b761a420b905
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_53ad80dc90d5e992297bb6812deda0e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_4d0252382885a25d11cf98d531712224.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_352ea6544baf5898e7d5f8c8cea50b1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS62418> (referer: https://www.auto1.com/v1/car-details-view/YS62418/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a303d0>
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_53ad80dc90d5e992297bb6812deda0e0.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_53ad80dc90d5e992297bb6812deda0e0.jpg saved to cache
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e662cd2b-d506-5b91-8294-b761a420b905
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a27510>
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_4d0252382885a25d11cf98d531712224.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_4d0252382885a25d11cf98d531712224.jpg saved to cache
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e662cd2b-d506-5b91-8294-b761a420b905
2026-03-30 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH58234> (referer: https://www.auto1.com/v1/car-details-view/BH58234/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595d010>
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F64%252F39648f7ec7c1f9247c987d3ae982884e%252Fpa%252FKJ13654_352ea6544baf5898e7d5f8c8cea50b1a.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_352ea6544baf5898e7d5f8c8cea50b1a.jpg saved to cache
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e662cd2b-d506-5b91-8294-b761a420b905
2026-03-30 10:38:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e662cd2b-d506-5b91-8294-b761a420b905, skipping ID generation
2026-03-30 10:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e662cd2b-d506-5b91-8294-b761a420b905 with scrape type 1
2026-03-30 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e662cd2b-d506-5b91-8294-b761a420b905 sending to next pipeline
2026-03-30 10:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e662cd2b-d506-5b91-8294-b761a420b905, identifier: KJ13654
2026-03-30 10:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e662cd2b-d506-5b91-8294-b761a420b905 with identifier: KJ13654
2026-03-30 10:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e662cd2b-d506-5b91-8294-b761a420b905 with identifier: KJ13654
2026-03-30 10:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e662cd2b-d506-5b91-8294-b761a420b905 with identifier: KJ13654 to the API
2026-03-30 10:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_352ea6544baf5898e7d5f8c8cea50b1a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:16:11Z',
 'fuel_type': 'petrol',
 'id': 'e662cd2b-d506-5b91-8294-b761a420b905',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ13654',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 64424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_352ea6544baf5898e7d5f8c8cea50b1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_4d0252382885a25d11cf98d531712224.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_53ad80dc90d5e992297bb6812deda0e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_50eedf374a12579ed5df4d709dd5ee03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_9e90dd2f88c6dcdca52c6ec4356ecf31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_7384768c012e924661bf0e0e603d0262.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_59e0c8c28a56c7380de7f2245b7e042a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_d056acfd8692e0bcb68eb7f745bded99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_6358020b2177dd5fc7add14485c7abb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e662cd2b-d506-5b91-8294-b761a420b905/e662cd2b-d506-5b91-8294-b761a420b905_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/64/39648f7ec7c1f9247c987d3ae982884e/pa/KJ13654_fbe14f05488a1766b6da55c0effd9c90.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2019}
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ13654%27 HTTP/1.1" 200 None
2026-03-30 10:38:42 [auto1.de] INFO: Saving data for KJ13654: {'created_time': 1774867122.143291, 'last_price_update_time': 1774867122.143301, 'auction_closing_time': 1774970171.0}
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ13654') HTTP/1.1" 204 0
2026-03-30 10:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM81802/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f26356c4-2f8f-5c20-9ba0-409993a1b682 with identifier: YS62418
2026-03-30 10:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f26356c4-2f8f-5c20-9ba0-409993a1b682 with scrape type 1
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f26356c4-2f8f-5c20-9ba0-409993a1b682
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_9ed4c6087d39692ccecada03a9521e71.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_9ed4c6087d39692ccecada03a9521e71.jpg not downloaded yet
2026-03-30 10:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea6b5389-68a6-5450-8263-4094ff34c83c with identifier: BH58234
2026-03-30 10:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea6b5389-68a6-5450-8263-4094ff34c83c with scrape type 1
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea6b5389-68a6-5450-8263-4094ff34c83c
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fef%252F77efb1436ad03464e308941e2b3e06d2%252Fpa%252FBH58234_4a325849b3999d8c7dfe6932a3beee2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_4a325849b3999d8c7dfe6932a3beee2f.jpg already downloaded
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fef%252F77efb1436ad03464e308941e2b3e06d2%252Fpa%252FBH58234_01089afa4141233cf3521e0159c52074.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_01089afa4141233cf3521e0159c52074.jpg already downloaded
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fef%252F77efb1436ad03464e308941e2b3e06d2%252Fpa%252FBH58234_6df596f15405d015a1f2fca18c0b907a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_6df596f15405d015a1f2fca18c0b907a.jpg already downloaded
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fef%252F77efb1436ad03464e308941e2b3e06d2%252Fpa%252FBH58234_0a4ca3b4e6a1d90bb9423e5c142326d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_0a4ca3b4e6a1d90bb9423e5c142326d4.jpg already downloaded
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fef%252F77efb1436ad03464e308941e2b3e06d2%252Fpa%252FBH58234_556e101a46dd713112e817af22787cab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_556e101a46dd713112e817af22787cab.jpg already downloaded
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fef%252F77efb1436ad03464e308941e2b3e06d2%252Fpa%252FBH58234_b43ad5c57e51c1e4fee1d1eb77a87ec8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_b43ad5c57e51c1e4fee1d1eb77a87ec8.jpg already downloaded
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fef%252F77efb1436ad03464e308941e2b3e06d2%252Fpa%252FBH58234_8836ad040c96430fae4ea4cb525acd4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_8836ad040c96430fae4ea4cb525acd4e.jpg already downloaded
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fef%252F77efb1436ad03464e308941e2b3e06d2%252Fpa%252FBH58234_d494010425a3196935156eaf1619cb8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_d494010425a3196935156eaf1619cb8c.jpg already downloaded
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fef%252F77efb1436ad03464e308941e2b3e06d2%252Fpa%252FBH58234_987cac015088997408c6c77fe86204f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_987cac015088997408c6c77fe86204f1.jpg already downloaded
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fef%252F77efb1436ad03464e308941e2b3e06d2%252Fpa%252FBH58234_5f728e115165b61b9d46f2d419f0e34c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_5f728e115165b61b9d46f2d419f0e34c.jpg already downloaded
2026-03-30 10:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea6b5389-68a6-5450-8263-4094ff34c83c, identifier: BH58234
2026-03-30 10:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea6b5389-68a6-5450-8263-4094ff34c83c with identifier: BH58234
2026-03-30 10:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea6b5389-68a6-5450-8263-4094ff34c83c with identifier: BH58234
2026-03-30 10:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea6b5389-68a6-5450-8263-4094ff34c83c with identifier: BH58234 to the API
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BH58234>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:00:11Z',
 'fuel_type': 'petrol',
 'id': 'ea6b5389-68a6-5450-8263-4094ff34c83c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH58234',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 74901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_4a325849b3999d8c7dfe6932a3beee2f.jpg',
                'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_01089afa4141233cf3521e0159c52074.jpg',
                'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_6df596f15405d015a1f2fca18c0b907a.jpg',
                'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_0a4ca3b4e6a1d90bb9423e5c142326d4.jpg',
                'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_556e101a46dd713112e817af22787cab.jpg',
                'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_b43ad5c57e51c1e4fee1d1eb77a87ec8.jpg',
                'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_8836ad040c96430fae4ea4cb525acd4e.jpg',
                'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_d494010425a3196935156eaf1619cb8c.jpg',
                'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_987cac015088997408c6c77fe86204f1.jpg',
                'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_5f728e115165b61b9d46f2d419f0e34c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea6b5389-68a6-5450-8263-4094ff34c83c/ea6b5389-68a6-5450-8263-4094ff34c83c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_4a325849b3999d8c7dfe6932a3beee2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea6b5389-68a6-5450-8263-4094ff34c83c/ea6b5389-68a6-5450-8263-4094ff34c83c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_01089afa4141233cf3521e0159c52074.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea6b5389-68a6-5450-8263-4094ff34c83c/ea6b5389-68a6-5450-8263-4094ff34c83c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_6df596f15405d015a1f2fca18c0b907a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea6b5389-68a6-5450-8263-4094ff34c83c/ea6b5389-68a6-5450-8263-4094ff34c83c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2997072,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_0a4ca3b4e6a1d90bb9423e5c142326d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea6b5389-68a6-5450-8263-4094ff34c83c/ea6b5389-68a6-5450-8263-4094ff34c83c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_556e101a46dd713112e817af22787cab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea6b5389-68a6-5450-8263-4094ff34c83c/ea6b5389-68a6-5450-8263-4094ff34c83c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2951948,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_b43ad5c57e51c1e4fee1d1eb77a87ec8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea6b5389-68a6-5450-8263-4094ff34c83c/ea6b5389-68a6-5450-8263-4094ff34c83c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2652513,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_8836ad040c96430fae4ea4cb525acd4e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea6b5389-68a6-5450-8263-4094ff34c83c/ea6b5389-68a6-5450-8263-4094ff34c83c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_d494010425a3196935156eaf1619cb8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea6b5389-68a6-5450-8263-4094ff34c83c/ea6b5389-68a6-5450-8263-4094ff34c83c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_987cac015088997408c6c77fe86204f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea6b5389-68a6-5450-8263-4094ff34c83c/ea6b5389-68a6-5450-8263-4094ff34c83c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/ef/77efb1436ad03464e308941e2b3e06d2/pa/BH58234_5f728e115165b61b9d46f2d419f0e34c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford B-Max 1.6 Ti-VCT Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2014}
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH58234%27 HTTP/1.1" 200 None
2026-03-30 10:38:42 [auto1.de] INFO: Saving data for BH58234: {'created_time': 1774867122.837693, 'last_price_update_time': 1774867122.837704, 'auction_closing_time': 1774969211.0}
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH58234') HTTP/1.1" 204 0
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_d3998d4b2c5b32ccd8302bf4e121a4cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_d3998d4b2c5b32ccd8302bf4e121a4cc.jpg not downloaded yet
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_4170f66c87e977e3910646f27ebfa72d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_4170f66c87e977e3910646f27ebfa72d.jpg not downloaded yet
2026-03-30 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_e665c5a7698a538a06f55b33fc1a5449.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_e665c5a7698a538a06f55b33fc1a5449.jpg not downloaded yet
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_cc0f2aa79b279d4927c1c71ab2a4b01c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_cc0f2aa79b279d4927c1c71ab2a4b01c.jpg not downloaded yet
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_a6078d9a5b185c44898320ee8a22df13.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_a6078d9a5b185c44898320ee8a22df13.jpg not downloaded yet
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_dc946c03f00cff78ca7f5b55d8e622ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_dc946c03f00cff78ca7f5b55d8e622ce.jpg not downloaded yet
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_44483103682863bf3875698e10621b5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_44483103682863bf3875698e10621b5e.jpg not downloaded yet
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_6e94a712de9d5554e1d3f06c7e4032d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_6e94a712de9d5554e1d3f06c7e4032d9.jpg not downloaded yet
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_46d50aba3ff98fa9c8c874dd53760231.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_46d50aba3ff98fa9c8c874dd53760231.jpg not downloaded yet
2026-03-30 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DW30618/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_46d50aba3ff98fa9c8c874dd53760231.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:43 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 9429 | hits on page: 40
2026-03-30 10:38:43 [auto1.de] INFO: Found listing with ID: DW30618
2026-03-30 10:38:43 [auto1.de] INFO: Found listing with ID: GC48113
2026-03-30 10:38:43 [auto1.de] INFO: Found listing with ID: XJ52167
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ52167%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [auto1.de] INFO: Scrape type for XJ52167: 1
2026-03-30 10:38:43 [auto1.de] INFO: Found listing with ID: GE74181
2026-03-30 10:38:43 [auto1.de] INFO: Found listing with ID: XT86965
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT86965%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [auto1.de] INFO: Scrape type for XT86965: 1
2026-03-30 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_44483103682863bf3875698e10621b5e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:43 [auto1.de] INFO: Found listing with ID: FK50326
2026-03-30 10:38:43 [auto1.de] INFO: Found listing with ID: WY58747
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY58747%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [auto1.de] INFO: Scrape type for WY58747: 1
2026-03-30 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC55242/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:43 [auto1.de] INFO: Found listing with ID: TT41826
2026-03-30 10:38:43 [auto1.de] INFO: Found listing with ID: YY59176
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY59176%27 HTTP/1.1" 200 None
2026-03-30 10:38:43 [auto1.de] INFO: Scrape type for YY59176: 2
2026-03-30 10:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7925d4fc-fec7-572a-94f0-9138c177d6e9 with identifier: YY59176
2026-03-30 10:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7925d4fc-fec7-572a-94f0-9138c177d6e9 with scrape type 2
2026-03-30 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7925d4fc-fec7-572a-94f0-9138c177d6e9 with scrape type 2
2026-03-30 10:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7925d4fc-fec7-572a-94f0-9138c177d6e9, identifier: YY59176
2026-03-30 10:38:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7925d4fc-fec7-572a-94f0-9138c177d6e9 with identifier: YY59176
2026-03-30 10:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7925d4fc-fec7-572a-94f0-9138c177d6e9 with identifier: YY59176
2026-03-30 10:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7925d4fc-fec7-572a-94f0-9138c177d6e9 with identifier: YY59176 to the API
2026-03-30 10:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:23:51Z',
 'fuel_type': 'petrol',
 'id': '7925d4fc-fec7-572a-94f0-9138c177d6e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY59176',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 160133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seller_name': None,
 'title': "Kia cee'd 1.6 GDI Spirit",
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2018}
2026-03-30 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY59176%27 HTTP/1.1" 200 None
2026-03-30 10:38:44 [auto1.de] INFO: Saving data for YY59176: {'auction_closing_time': 1774970631.0, 'created_time': 1773687897.869504, 'last_price_update_time': 1774867124.156465}
2026-03-30 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY59176') HTTP/1.1" 204 0
2026-03-30 10:38:44 [auto1.de] INFO: Found listing with ID: HC21911
2026-03-30 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC21911%27 HTTP/1.1" 200 None
2026-03-30 10:38:44 [auto1.de] INFO: Scrape type for HC21911: 2
2026-03-30 10:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db49da57-7701-5b39-94e8-46687329f20a with identifier: HC21911
2026-03-30 10:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db49da57-7701-5b39-94e8-46687329f20a with scrape type 2
2026-03-30 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db49da57-7701-5b39-94e8-46687329f20a with scrape type 2
2026-03-30 10:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db49da57-7701-5b39-94e8-46687329f20a, identifier: HC21911
2026-03-30 10:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_6e94a712de9d5554e1d3f06c7e4032d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db49da57-7701-5b39-94e8-46687329f20a with identifier: HC21911
2026-03-30 10:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db49da57-7701-5b39-94e8-46687329f20a with identifier: HC21911
2026-03-30 10:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db49da57-7701-5b39-94e8-46687329f20a with identifier: HC21911 to the API
2026-03-30 10:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:56:27Z',
 'fuel_type': 'diesel',
 'id': 'db49da57-7701-5b39-94e8-46687329f20a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC21911',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 338880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-16',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC21911%27 HTTP/1.1" 200 None
2026-03-30 10:38:45 [auto1.de] INFO: Saving data for HC21911: {'auction_closing_time': 1774972587.0, 'created_time': 1773344627.9428, 'last_price_update_time': 1774867125.156645}
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC21911') HTTP/1.1" 204 0
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a25750>
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_46d50aba3ff98fa9c8c874dd53760231.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_46d50aba3ff98fa9c8c874dd53760231.jpg saved to cache
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f26356c4-2f8f-5c20-9ba0-409993a1b682
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50d43d0>
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_44483103682863bf3875698e10621b5e.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_44483103682863bf3875698e10621b5e.jpg saved to cache
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f26356c4-2f8f-5c20-9ba0-409993a1b682
2026-03-30 10:38:45 [auto1.de] INFO: Found listing with ID: DU23790
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU23790%27 HTTP/1.1" 200 None
2026-03-30 10:38:45 [auto1.de] INFO: Scrape type for DU23790: 2
2026-03-30 10:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a02c5b6-5e1b-543f-8c6d-b6fee0df7474 with identifier: DU23790
2026-03-30 10:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a02c5b6-5e1b-543f-8c6d-b6fee0df7474 with scrape type 2
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a02c5b6-5e1b-543f-8c6d-b6fee0df7474 with scrape type 2
2026-03-30 10:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a02c5b6-5e1b-543f-8c6d-b6fee0df7474, identifier: DU23790
2026-03-30 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP88886> (referer: https://www.auto1.com/v1/car-details-view/VP88886/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a02c5b6-5e1b-543f-8c6d-b6fee0df7474 with identifier: DU23790
2026-03-30 10:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a02c5b6-5e1b-543f-8c6d-b6fee0df7474 with identifier: DU23790
2026-03-30 10:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a02c5b6-5e1b-543f-8c6d-b6fee0df7474 with identifier: DU23790 to the API
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:26:13Z',
 'fuel_type': 'diesel',
 'id': '0a02c5b6-5e1b-543f-8c6d-b6fee0df7474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU23790',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 171270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-21',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU23790%27 HTTP/1.1" 200 None
2026-03-30 10:38:45 [auto1.de] INFO: Saving data for DU23790: {'auction_closing_time': 1774970773.0, 'created_time': 1773776147.469436, 'last_price_update_time': 1774867125.748294}
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU23790') HTTP/1.1" 204 0
2026-03-30 10:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:45 [auto1.de] INFO: Found listing with ID: NX05190
2026-03-30 10:38:45 [auto1.de] INFO: Found listing with ID: YV11797
2026-03-30 10:38:45 [auto1.de] INFO: Found listing with ID: CN97004
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN97004%27 HTTP/1.1" 200 None
2026-03-30 10:38:45 [auto1.de] INFO: Scrape type for CN97004: 1
2026-03-30 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZA80746> (referer: https://www.auto1.com/v1/car-details-view/ZA80746/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:45 [auto1.de] INFO: Found listing with ID: WS55091
2026-03-30 10:38:45 [auto1.de] INFO: Found listing with ID: AL20723
2026-03-30 10:38:45 [auto1.de] INFO: Found listing with ID: SE11859
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE11859%27 HTTP/1.1" 200 None
2026-03-30 10:38:45 [auto1.de] INFO: Scrape type for SE11859: 1
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5065950>
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_6e94a712de9d5554e1d3f06c7e4032d9.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_6e94a712de9d5554e1d3f06c7e4032d9.jpg saved to cache
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f26356c4-2f8f-5c20-9ba0-409993a1b682
2026-03-30 10:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 382db325-3222-5c2d-914a-654d37707f1c with identifier: VP88886
2026-03-30 10:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 382db325-3222-5c2d-914a-654d37707f1c with scrape type 1
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 382db325-3222-5c2d-914a-654d37707f1c
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_fe202b164e08a91626efb39eec77e591.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_fe202b164e08a91626efb39eec77e591.jpg not downloaded yet
2026-03-30 10:38:45 [auto1.de] INFO: Found listing with ID: BC50788
2026-03-30 10:38:45 [auto1.de] INFO: Found listing with ID: MD03906
2026-03-30 10:38:45 [auto1.de] INFO: Found listing with ID: UB09336
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB09336%27 HTTP/1.1" 200 None
2026-03-30 10:38:45 [auto1.de] INFO: Scrape type for UB09336: 2
2026-03-30 10:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80440e23-7d8b-55e6-81a3-593ffcb80ca2 with identifier: UB09336
2026-03-30 10:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80440e23-7d8b-55e6-81a3-593ffcb80ca2 with scrape type 2
2026-03-30 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80440e23-7d8b-55e6-81a3-593ffcb80ca2 with scrape type 2
2026-03-30 10:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80440e23-7d8b-55e6-81a3-593ffcb80ca2, identifier: UB09336
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_d3f760ec655098a9f39a116c3f4e3154.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_d3f760ec655098a9f39a116c3f4e3154.jpg not downloaded yet
2026-03-30 10:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80440e23-7d8b-55e6-81a3-593ffcb80ca2 with identifier: UB09336
2026-03-30 10:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80440e23-7d8b-55e6-81a3-593ffcb80ca2 with identifier: UB09336
2026-03-30 10:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80440e23-7d8b-55e6-81a3-593ffcb80ca2 with identifier: UB09336 to the API
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:27:50Z',
 'fuel_type': 'diesel',
 'id': '80440e23-7d8b-55e6-81a3-593ffcb80ca2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB09336',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 299084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-04',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB09336%27 HTTP/1.1" 200 None
2026-03-30 10:38:46 [auto1.de] INFO: Saving data for UB09336: {'auction_closing_time': 1774970870.0, 'created_time': 1774292750.492512, 'last_price_update_time': 1774867126.349907}
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB09336') HTTP/1.1" 204 0
2026-03-30 10:38:46 [auto1.de] INFO: Found listing with ID: KX13373
2026-03-30 10:38:46 [auto1.de] INFO: Found listing with ID: WT92496
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92496%27 HTTP/1.1" 200 None
2026-03-30 10:38:46 [auto1.de] INFO: Scrape type for WT92496: 2
2026-03-30 10:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86adff88-dfec-50bb-b3b9-d6bbf5eb3da4 with identifier: WT92496
2026-03-30 10:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86adff88-dfec-50bb-b3b9-d6bbf5eb3da4 with scrape type 2
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86adff88-dfec-50bb-b3b9-d6bbf5eb3da4 with scrape type 2
2026-03-30 10:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86adff88-dfec-50bb-b3b9-d6bbf5eb3da4, identifier: WT92496
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_0b721d8253d302d3fb7741394d57924e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_0b721d8253d302d3fb7741394d57924e.jpg not downloaded yet
2026-03-30 10:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86adff88-dfec-50bb-b3b9-d6bbf5eb3da4 with identifier: WT92496
2026-03-30 10:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86adff88-dfec-50bb-b3b9-d6bbf5eb3da4 with identifier: WT92496
2026-03-30 10:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86adff88-dfec-50bb-b3b9-d6bbf5eb3da4 with identifier: WT92496 to the API
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:02:39Z',
 'fuel_type': 'diesel',
 'id': '86adff88-dfec-50bb-b3b9-d6bbf5eb3da4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT92496',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 27410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-05',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Mild-Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2024}
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92496%27 HTTP/1.1" 200 None
2026-03-30 10:38:46 [auto1.de] INFO: Saving data for WT92496: {'auction_closing_time': 1774969359.0, 'created_time': 1774003282.651985, 'last_price_update_time': 1774867126.987562}
2026-03-30 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT92496') HTTP/1.1" 204 0
2026-03-30 10:38:47 [auto1.de] INFO: Found listing with ID: GD33265
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD33265%27 HTTP/1.1" 200 None
2026-03-30 10:38:47 [auto1.de] INFO: Scrape type for GD33265: 2
2026-03-30 10:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 852cc020-694b-51fe-b52b-9c1c37ab1334 with identifier: GD33265
2026-03-30 10:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 852cc020-694b-51fe-b52b-9c1c37ab1334 with scrape type 2
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 852cc020-694b-51fe-b52b-9c1c37ab1334 with scrape type 2
2026-03-30 10:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 852cc020-694b-51fe-b52b-9c1c37ab1334, identifier: GD33265
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_4c3a2550f1ed143f7f32c6e45cb1d3a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_4c3a2550f1ed143f7f32c6e45cb1d3a4.jpg not downloaded yet
2026-03-30 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ25189> (referer: https://www.auto1.com/v1/car-details-view/TZ25189/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed01a294-f8a9-56e4-9db0-cf59edba63af with identifier: ZA80746
2026-03-30 10:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed01a294-f8a9-56e4-9db0-cf59edba63af with scrape type 1
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed01a294-f8a9-56e4-9db0-cf59edba63af
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fc3%252Fbec3e66cbbd6fad9b298579e7bf65fcf%252Fpa%252FZA80746_48e2cae05bfa44b30749a8c0faa0c227.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_48e2cae05bfa44b30749a8c0faa0c227.jpg already downloaded
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fc3%252Fbec3e66cbbd6fad9b298579e7bf65fcf%252Fpa%252FZA80746_32fc955fd22bae85b1c0bc0e92e993a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_32fc955fd22bae85b1c0bc0e92e993a4.jpg already downloaded
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fc3%252Fbec3e66cbbd6fad9b298579e7bf65fcf%252Fpa%252FZA80746_93e801c9544f7325051d6447c9d30dc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_93e801c9544f7325051d6447c9d30dc0.jpg already downloaded
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fc3%252Fbec3e66cbbd6fad9b298579e7bf65fcf%252Fpa%252FZA80746_0a69612afcdebd1a5b8383a95f8823e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_0a69612afcdebd1a5b8383a95f8823e0.jpg already downloaded
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fc3%252Fbec3e66cbbd6fad9b298579e7bf65fcf%252Fpa%252FZA80746_1db3289b0b7ac8287ad72c7f1057fc37.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_1db3289b0b7ac8287ad72c7f1057fc37.jpg already downloaded
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fc3%252Fbec3e66cbbd6fad9b298579e7bf65fcf%252Fpa%252FZA80746_aa037a7518381aa65aa02d3ae8483dd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_aa037a7518381aa65aa02d3ae8483dd9.jpg already downloaded
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fc3%252Fbec3e66cbbd6fad9b298579e7bf65fcf%252Fpa%252FZA80746_6e336340695c277cca0378a5db047d41.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_6e336340695c277cca0378a5db047d41.jpg already downloaded
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fc3%252Fbec3e66cbbd6fad9b298579e7bf65fcf%252Fpa%252FZA80746_853955b9dd9c9eca82f1227dfa6e136e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_853955b9dd9c9eca82f1227dfa6e136e.jpg already downloaded
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fc3%252Fbec3e66cbbd6fad9b298579e7bf65fcf%252Fpa%252FZA80746_0f3fa117977cb4eaeb121ada6ff15a0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_0f3fa117977cb4eaeb121ada6ff15a0d.jpg already downloaded
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fc3%252Fbec3e66cbbd6fad9b298579e7bf65fcf%252Fpa%252FZA80746_b828e1d4d9c1d128b7952b0b7717aa53.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_b828e1d4d9c1d128b7952b0b7717aa53.jpg already downloaded
2026-03-30 10:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed01a294-f8a9-56e4-9db0-cf59edba63af, identifier: ZA80746
2026-03-30 10:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 852cc020-694b-51fe-b52b-9c1c37ab1334 with identifier: GD33265
2026-03-30 10:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 852cc020-694b-51fe-b52b-9c1c37ab1334 with identifier: GD33265
2026-03-30 10:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 852cc020-694b-51fe-b52b-9c1c37ab1334 with identifier: GD33265 to the API
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:26:53Z',
 'fuel_type': 'gas',
 'id': '852cc020-694b-51fe-b52b-9c1c37ab1334',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD33265',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 151924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-29',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2015}
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD33265%27 HTTP/1.1" 200 None
2026-03-30 10:38:47 [auto1.de] INFO: Saving data for GD33265: {'auction_closing_time': 1774970813.0, 'created_time': 1773659798.397741, 'last_price_update_time': 1774867127.844675}
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD33265') HTTP/1.1" 204 0
2026-03-30 10:38:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD14914> (referer: https://www.auto1.com/v1/car-details-view/SD14914/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed01a294-f8a9-56e4-9db0-cf59edba63af with identifier: ZA80746
2026-03-30 10:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed01a294-f8a9-56e4-9db0-cf59edba63af with identifier: ZA80746
2026-03-30 10:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed01a294-f8a9-56e4-9db0-cf59edba63af with identifier: ZA80746 to the API
2026-03-30 10:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZA80746>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:00:27Z',
 'fuel_type': 'petrol',
 'id': 'ed01a294-f8a9-56e4-9db0-cf59edba63af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA80746',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 81925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_48e2cae05bfa44b30749a8c0faa0c227.jpg',
                'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_32fc955fd22bae85b1c0bc0e92e993a4.jpg',
                'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_93e801c9544f7325051d6447c9d30dc0.jpg',
                'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_0a69612afcdebd1a5b8383a95f8823e0.jpg',
                'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_1db3289b0b7ac8287ad72c7f1057fc37.jpg',
                'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_aa037a7518381aa65aa02d3ae8483dd9.jpg',
                'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_6e336340695c277cca0378a5db047d41.jpg',
                'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_853955b9dd9c9eca82f1227dfa6e136e.jpg',
                'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_0f3fa117977cb4eaeb121ada6ff15a0d.jpg',
                'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_b828e1d4d9c1d128b7952b0b7717aa53.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed01a294-f8a9-56e4-9db0-cf59edba63af/ed01a294-f8a9-56e4-9db0-cf59edba63af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2525293,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_48e2cae05bfa44b30749a8c0faa0c227.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed01a294-f8a9-56e4-9db0-cf59edba63af/ed01a294-f8a9-56e4-9db0-cf59edba63af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2359358,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_32fc955fd22bae85b1c0bc0e92e993a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed01a294-f8a9-56e4-9db0-cf59edba63af/ed01a294-f8a9-56e4-9db0-cf59edba63af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2354555,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_93e801c9544f7325051d6447c9d30dc0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed01a294-f8a9-56e4-9db0-cf59edba63af/ed01a294-f8a9-56e4-9db0-cf59edba63af_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_0a69612afcdebd1a5b8383a95f8823e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed01a294-f8a9-56e4-9db0-cf59edba63af/ed01a294-f8a9-56e4-9db0-cf59edba63af_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_1db3289b0b7ac8287ad72c7f1057fc37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed01a294-f8a9-56e4-9db0-cf59edba63af/ed01a294-f8a9-56e4-9db0-cf59edba63af_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2536341,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_aa037a7518381aa65aa02d3ae8483dd9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed01a294-f8a9-56e4-9db0-cf59edba63af/ed01a294-f8a9-56e4-9db0-cf59edba63af_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2472571,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_6e336340695c277cca0378a5db047d41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed01a294-f8a9-56e4-9db0-cf59edba63af/ed01a294-f8a9-56e4-9db0-cf59edba63af_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2352773,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_853955b9dd9c9eca82f1227dfa6e136e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed01a294-f8a9-56e4-9db0-cf59edba63af/ed01a294-f8a9-56e4-9db0-cf59edba63af_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_0f3fa117977cb4eaeb121ada6ff15a0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed01a294-f8a9-56e4-9db0-cf59edba63af/ed01a294-f8a9-56e4-9db0-cf59edba63af_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/c3/bec3e66cbbd6fad9b298579e7bf65fcf/pa/ZA80746_b828e1d4d9c1d128b7952b0b7717aa53.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Monte Carlo',
 'transmission': 'manual',
 'trim': 'Monte Carlo',
 'year': 2019}
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA80746%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [auto1.de] INFO: Saving data for ZA80746: {'created_time': 1774867128.215492, 'last_price_update_time': 1774867128.215502, 'auction_closing_time': 1774969227.0}
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA80746') HTTP/1.1" 204 0
2026-03-30 10:38:48 [auto1.de] INFO: Found listing with ID: MC21805
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC21805%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [auto1.de] INFO: Scrape type for MC21805: 2
2026-03-30 10:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04f12790-4de7-53f9-8d60-0b26039eb4a1 with identifier: MC21805
2026-03-30 10:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04f12790-4de7-53f9-8d60-0b26039eb4a1 with scrape type 2
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04f12790-4de7-53f9-8d60-0b26039eb4a1 with scrape type 2
2026-03-30 10:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04f12790-4de7-53f9-8d60-0b26039eb4a1, identifier: MC21805
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_cd115c1146ea0341768627f973be0054.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_cd115c1146ea0341768627f973be0054.jpg not downloaded yet
2026-03-30 10:38:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM82524> (referer: https://www.auto1.com/v1/car-details-view/ZM82524/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04f12790-4de7-53f9-8d60-0b26039eb4a1 with identifier: MC21805
2026-03-30 10:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04f12790-4de7-53f9-8d60-0b26039eb4a1 with identifier: MC21805
2026-03-30 10:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04f12790-4de7-53f9-8d60-0b26039eb4a1 with identifier: MC21805 to the API
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-31T15:40:09Z',
 'fuel_type': 'diesel',
 'id': '04f12790-4de7-53f9-8d60-0b26039eb4a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC21805',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 59150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seller_name': None,
 'title': 'BMW X4 xDrive 30d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC21805%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [auto1.de] INFO: Saving data for MC21805: {'auction_closing_time': 1774971609.0, 'created_time': 1773136605.259082, 'last_price_update_time': 1774867128.706254}
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC21805') HTTP/1.1" 204 0
2026-03-30 10:38:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:48 [auto1.de] INFO: Found listing with ID: ZT80632
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT80632%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [auto1.de] INFO: Scrape type for ZT80632: 1
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_4b0566f648650d44e4bb3bb44dc79c82.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_4b0566f648650d44e4bb3bb44dc79c82.jpg not downloaded yet
2026-03-30 10:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abb9ba8e-1040-5bb8-8c9c-45cf5758082c with identifier: TZ25189
2026-03-30 10:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abb9ba8e-1040-5bb8-8c9c-45cf5758082c with scrape type 1
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item abb9ba8e-1040-5bb8-8c9c-45cf5758082c
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F7f%252Fb37fcfccd98f760a21f7c407f21b0ef2%252Fpa%252FTZ25189_9aac4873927dc0d3dd6c47fe30ba589f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_9aac4873927dc0d3dd6c47fe30ba589f.jpg already downloaded
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F7f%252Fb37fcfccd98f760a21f7c407f21b0ef2%252Fpa%252FTZ25189_514417318fa0ecff6293d46f60fd44c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_514417318fa0ecff6293d46f60fd44c5.jpg already downloaded
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F7f%252Fb37fcfccd98f760a21f7c407f21b0ef2%252Fpa%252FTZ25189_f9ac3387c1d075f791aa8344fb3b616b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_f9ac3387c1d075f791aa8344fb3b616b.jpg already downloaded
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F7f%252Fb37fcfccd98f760a21f7c407f21b0ef2%252Fpa%252FTZ25189_376540d7b74790d83396fa26199c5276.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_376540d7b74790d83396fa26199c5276.jpg already downloaded
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F7f%252Fb37fcfccd98f760a21f7c407f21b0ef2%252Fpa%252FTZ25189_c2a54ac62586a52eff18941bbee546dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_c2a54ac62586a52eff18941bbee546dd.jpg already downloaded
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F7f%252Fb37fcfccd98f760a21f7c407f21b0ef2%252Fpa%252FTZ25189_c5800e81c02a5b57706f72afced31a30.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_c5800e81c02a5b57706f72afced31a30.jpg already downloaded
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F7f%252Fb37fcfccd98f760a21f7c407f21b0ef2%252Fpa%252FTZ25189_c3285f802ba3f9d33e456850e4f22a8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_c3285f802ba3f9d33e456850e4f22a8a.jpg already downloaded
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F7f%252Fb37fcfccd98f760a21f7c407f21b0ef2%252Fpa%252FTZ25189_dd95e7e2d01de976eed870f3e70a8b84.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_dd95e7e2d01de976eed870f3e70a8b84.jpg already downloaded
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F7f%252Fb37fcfccd98f760a21f7c407f21b0ef2%252Fpa%252FTZ25189_9da54af6375d8fac1ae2ac8508839570.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_9da54af6375d8fac1ae2ac8508839570.jpg already downloaded
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F7f%252Fb37fcfccd98f760a21f7c407f21b0ef2%252Fpa%252FTZ25189_8024943b3d9a2beaebe6ad2461b33454.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_8024943b3d9a2beaebe6ad2461b33454.jpg already downloaded
2026-03-30 10:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abb9ba8e-1040-5bb8-8c9c-45cf5758082c, identifier: TZ25189
2026-03-30 10:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4529458b-3015-5e6e-a612-b45ba7ee8a2e with identifier: SD14914
2026-03-30 10:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4529458b-3015-5e6e-a612-b45ba7ee8a2e with scrape type 1
2026-03-30 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4529458b-3015-5e6e-a612-b45ba7ee8a2e
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_248421bc62f3520d36e1cc43852bb288.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_248421bc62f3520d36e1cc43852bb288.jpg not downloaded yet
2026-03-30 10:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abb9ba8e-1040-5bb8-8c9c-45cf5758082c with identifier: TZ25189
2026-03-30 10:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abb9ba8e-1040-5bb8-8c9c-45cf5758082c with identifier: TZ25189
2026-03-30 10:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abb9ba8e-1040-5bb8-8c9c-45cf5758082c with identifier: TZ25189 to the API
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TZ25189>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 238,
 'expiration_date': '2026-03-31T15:07:58Z',
 'fuel_type': 'diesel',
 'id': 'abb9ba8e-1040-5bb8-8c9c-45cf5758082c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ25189',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 246150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_9aac4873927dc0d3dd6c47fe30ba589f.jpg',
                'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_514417318fa0ecff6293d46f60fd44c5.jpg',
                'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_f9ac3387c1d075f791aa8344fb3b616b.jpg',
                'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_376540d7b74790d83396fa26199c5276.jpg',
                'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_c2a54ac62586a52eff18941bbee546dd.jpg',
                'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_c5800e81c02a5b57706f72afced31a30.jpg',
                'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_c3285f802ba3f9d33e456850e4f22a8a.jpg',
                'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_dd95e7e2d01de976eed870f3e70a8b84.jpg',
                'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_9da54af6375d8fac1ae2ac8508839570.jpg',
                'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_8024943b3d9a2beaebe6ad2461b33454.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb9ba8e-1040-5bb8-8c9c-45cf5758082c/abb9ba8e-1040-5bb8-8c9c-45cf5758082c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_9aac4873927dc0d3dd6c47fe30ba589f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb9ba8e-1040-5bb8-8c9c-45cf5758082c/abb9ba8e-1040-5bb8-8c9c-45cf5758082c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_514417318fa0ecff6293d46f60fd44c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb9ba8e-1040-5bb8-8c9c-45cf5758082c/abb9ba8e-1040-5bb8-8c9c-45cf5758082c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_f9ac3387c1d075f791aa8344fb3b616b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb9ba8e-1040-5bb8-8c9c-45cf5758082c/abb9ba8e-1040-5bb8-8c9c-45cf5758082c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_376540d7b74790d83396fa26199c5276.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb9ba8e-1040-5bb8-8c9c-45cf5758082c/abb9ba8e-1040-5bb8-8c9c-45cf5758082c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_c2a54ac62586a52eff18941bbee546dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb9ba8e-1040-5bb8-8c9c-45cf5758082c/abb9ba8e-1040-5bb8-8c9c-45cf5758082c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_c5800e81c02a5b57706f72afced31a30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb9ba8e-1040-5bb8-8c9c-45cf5758082c/abb9ba8e-1040-5bb8-8c9c-45cf5758082c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_c3285f802ba3f9d33e456850e4f22a8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb9ba8e-1040-5bb8-8c9c-45cf5758082c/abb9ba8e-1040-5bb8-8c9c-45cf5758082c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_dd95e7e2d01de976eed870f3e70a8b84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb9ba8e-1040-5bb8-8c9c-45cf5758082c/abb9ba8e-1040-5bb8-8c9c-45cf5758082c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_9da54af6375d8fac1ae2ac8508839570.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abb9ba8e-1040-5bb8-8c9c-45cf5758082c/abb9ba8e-1040-5bb8-8c9c-45cf5758082c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/7f/b37fcfccd98f760a21f7c407f21b0ef2/pa/TZ25189_8024943b3d9a2beaebe6ad2461b33454.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi EcoBlue Vignale 4x4',
 'transmission': 'automatic',
 'trim': 'Vignale 4x4',
 'year': 2019}
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ25189%27 HTTP/1.1" 200 None
2026-03-30 10:38:49 [auto1.de] INFO: Saving data for TZ25189: {'created_time': 1774867129.41735, 'last_price_update_time': 1774867129.417361, 'auction_closing_time': 1774969678.0}
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ25189') HTTP/1.1" 204 0
2026-03-30 10:38:49 [auto1.de] INFO: Found listing with ID: ED86664
2026-03-30 10:38:49 [auto1.de] INFO: Found listing with ID: ME32399
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME32399%27 HTTP/1.1" 200 None
2026-03-30 10:38:49 [auto1.de] INFO: Scrape type for ME32399: 2
2026-03-30 10:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f28acc88-0151-5622-9dad-be79e1554dda with identifier: ME32399
2026-03-30 10:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f28acc88-0151-5622-9dad-be79e1554dda with scrape type 2
2026-03-30 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f28acc88-0151-5622-9dad-be79e1554dda with scrape type 2
2026-03-30 10:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f28acc88-0151-5622-9dad-be79e1554dda, identifier: ME32399
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_a561ff9292cc056cf1c624dffccddbe8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_a561ff9292cc056cf1c624dffccddbe8.jpg not downloaded yet
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_8fc42984ecc3233c68186aa003c67565.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_8fc42984ecc3233c68186aa003c67565.jpg not downloaded yet
2026-03-30 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB14555> (referer: https://www.auto1.com/v1/car-details-view/JB14555/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9d9b3c6-7f0d-5c08-b4a3-aaad26659400 with identifier: ZM82524
2026-03-30 10:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9d9b3c6-7f0d-5c08-b4a3-aaad26659400 with scrape type 1
2026-03-30 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9d9b3c6-7f0d-5c08-b4a3-aaad26659400
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_73038582ca2f87e15c75cfafa5468ebd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_73038582ca2f87e15c75cfafa5468ebd.jpg not downloaded yet
2026-03-30 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_4c3a2550f1ed143f7f32c6e45cb1d3a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_0b721d8253d302d3fb7741394d57924e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f28acc88-0151-5622-9dad-be79e1554dda with identifier: ME32399
2026-03-30 10:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f28acc88-0151-5622-9dad-be79e1554dda with identifier: ME32399
2026-03-30 10:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f28acc88-0151-5622-9dad-be79e1554dda with identifier: ME32399 to the API
2026-03-30 10:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:32:56Z',
 'fuel_type': 'petrol',
 'id': 'f28acc88-0151-5622-9dad-be79e1554dda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME32399',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 158155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-27',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME32399%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [auto1.de] INFO: Saving data for ME32399: {'auction_closing_time': 1774971176.0, 'created_time': 1773226160.523584, 'last_price_update_time': 1774867130.167359}
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME32399') HTTP/1.1" 204 0
2026-03-30 10:38:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:50 [auto1.de] INFO: Found listing with ID: CX78933
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX78933%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [auto1.de] INFO: Scrape type for CX78933: 1
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_1a32e039e606f436d9a59d488b55200f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_1a32e039e606f436d9a59d488b55200f.jpg not downloaded yet
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_e16cc36a63daa3347f6eec471a234a59.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_e16cc36a63daa3347f6eec471a234a59.jpg not downloaded yet
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_6795cb1cf228c255035c23aa834983da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_6795cb1cf228c255035c23aa834983da.jpg not downloaded yet
2026-03-30 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE92414/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:50 [auto1.de] INFO: Found listing with ID: XP42912
2026-03-30 10:38:50 [auto1.de] INFO: Found listing with ID: LD24624
2026-03-30 10:38:50 [auto1.de] INFO: Found listing with ID: BJ16323
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ16323%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [auto1.de] INFO: Scrape type for BJ16323: 2
2026-03-30 10:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0708a61a-f926-53fe-9a72-1da7d6c176bf with identifier: BJ16323
2026-03-30 10:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0708a61a-f926-53fe-9a72-1da7d6c176bf with scrape type 2
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0708a61a-f926-53fe-9a72-1da7d6c176bf with scrape type 2
2026-03-30 10:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0708a61a-f926-53fe-9a72-1da7d6c176bf, identifier: BJ16323
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_1687a128d04cbc2ec4257759b2f281fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_1687a128d04cbc2ec4257759b2f281fa.jpg not downloaded yet
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_f85da965ef60ca27965d41a10fedd4e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_f85da965ef60ca27965d41a10fedd4e6.jpg not downloaded yet
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_707f47a41f192a43844d9cad06f11652.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_707f47a41f192a43844d9cad06f11652.jpg not downloaded yet
2026-03-30 10:38:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD62787/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0708a61a-f926-53fe-9a72-1da7d6c176bf with identifier: BJ16323
2026-03-30 10:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0708a61a-f926-53fe-9a72-1da7d6c176bf with identifier: BJ16323
2026-03-30 10:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0708a61a-f926-53fe-9a72-1da7d6c176bf with identifier: BJ16323 to the API
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:55:41Z',
 'fuel_type': 'diesel',
 'id': '0708a61a-f926-53fe-9a72-1da7d6c176bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ16323',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 46574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-13',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2022}
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ16323%27 HTTP/1.1" 200 None
2026-03-30 10:38:50 [auto1.de] INFO: Saving data for BJ16323: {'auction_closing_time': 1774972541.0, 'created_time': 1773687272.897488, 'last_price_update_time': 1774867130.855448}
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ16323') HTTP/1.1" 204 0
2026-03-30 10:38:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17b8e012-578d-5566-b6ac-73e0be127174 with identifier: JB14555
2026-03-30 10:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17b8e012-578d-5566-b6ac-73e0be127174 with scrape type 1
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17b8e012-578d-5566-b6ac-73e0be127174
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F25%252Feb2545ea372b1f1e7459127d5c671528%252Fpa%252FJB14555_5b315f204c7e4f9b01b12baa8cf2e898.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_5b315f204c7e4f9b01b12baa8cf2e898.jpg already downloaded
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F25%252Feb2545ea372b1f1e7459127d5c671528%252Fpa%252FJB14555_950ba7247d740a7dbae54b65fe7cb2cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_950ba7247d740a7dbae54b65fe7cb2cf.jpg already downloaded
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F25%252Feb2545ea372b1f1e7459127d5c671528%252Fpa%252FJB14555_c18570b8ed36f6b0f01e13b9fdc3f4fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_c18570b8ed36f6b0f01e13b9fdc3f4fe.jpg already downloaded
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F25%252Feb2545ea372b1f1e7459127d5c671528%252Fpa%252FJB14555_6181025a05b12647ec0d09e092033845.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_6181025a05b12647ec0d09e092033845.jpg already downloaded
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F25%252Feb2545ea372b1f1e7459127d5c671528%252Fpa%252FJB14555_3b872f89ea3a967b228cefd9d3895c49.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_3b872f89ea3a967b228cefd9d3895c49.jpg already downloaded
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F25%252Feb2545ea372b1f1e7459127d5c671528%252Fpa%252FJB14555_3b12c5024a5dec9bbfd4f8a3e60dde5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_3b12c5024a5dec9bbfd4f8a3e60dde5e.jpg already downloaded
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F25%252Feb2545ea372b1f1e7459127d5c671528%252Fpa%252FJB14555_3e7a83d8a7ff2ad207a685aa80597757.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_3e7a83d8a7ff2ad207a685aa80597757.jpg already downloaded
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F25%252Feb2545ea372b1f1e7459127d5c671528%252Fpa%252FJB14555_6ceade964402949040be31eb6302b51b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_6ceade964402949040be31eb6302b51b.jpg already downloaded
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F25%252Feb2545ea372b1f1e7459127d5c671528%252Fpa%252FJB14555_f19379037586761e2f9e902ed2bec0a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_f19379037586761e2f9e902ed2bec0a7.jpg already downloaded
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F25%252Feb2545ea372b1f1e7459127d5c671528%252Fpa%252FJB14555_2d258b417b6476367cc26d7c4e31917b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_2d258b417b6476367cc26d7c4e31917b.jpg already downloaded
2026-03-30 10:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17b8e012-578d-5566-b6ac-73e0be127174, identifier: JB14555
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5010b10>
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_4c3a2550f1ed143f7f32c6e45cb1d3a4.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_4c3a2550f1ed143f7f32c6e45cb1d3a4.jpg saved to cache
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 382db325-3222-5c2d-914a-654d37707f1c
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee6fd0>
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_0b721d8253d302d3fb7741394d57924e.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_0b721d8253d302d3fb7741394d57924e.jpg saved to cache
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 382db325-3222-5c2d-914a-654d37707f1c
2026-03-30 10:38:51 [auto1.de] INFO: Found listing with ID: GC02244
2026-03-30 10:38:51 [auto1.de] INFO: Found listing with ID: ZE36706
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE36706%27 HTTP/1.1" 200 None
2026-03-30 10:38:51 [auto1.de] INFO: Scrape type for ZE36706: 1
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_70f862e4cebf870ac7807e9415b00542.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_70f862e4cebf870ac7807e9415b00542.jpg not downloaded yet
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_28b3fa61c06fcc8d6fa35564fc1ea4eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_28b3fa61c06fcc8d6fa35564fc1ea4eb.jpg not downloaded yet
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_3d738d91d207e9f70bb712382a827d67.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_3d738d91d207e9f70bb712382a827d67.jpg not downloaded yet
2026-03-30 10:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17b8e012-578d-5566-b6ac-73e0be127174 with identifier: JB14555
2026-03-30 10:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17b8e012-578d-5566-b6ac-73e0be127174 with identifier: JB14555
2026-03-30 10:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17b8e012-578d-5566-b6ac-73e0be127174 with identifier: JB14555 to the API
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JB14555>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:45:34Z',
 'fuel_type': 'petrol',
 'id': '17b8e012-578d-5566-b6ac-73e0be127174',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB14555',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 96300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_5b315f204c7e4f9b01b12baa8cf2e898.jpg',
                'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_950ba7247d740a7dbae54b65fe7cb2cf.jpg',
                'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_c18570b8ed36f6b0f01e13b9fdc3f4fe.jpg',
                'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_6181025a05b12647ec0d09e092033845.jpg',
                'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_3b872f89ea3a967b228cefd9d3895c49.jpg',
                'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_3b12c5024a5dec9bbfd4f8a3e60dde5e.jpg',
                'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_3e7a83d8a7ff2ad207a685aa80597757.jpg',
                'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_6ceade964402949040be31eb6302b51b.jpg',
                'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_f19379037586761e2f9e902ed2bec0a7.jpg',
                'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_2d258b417b6476367cc26d7c4e31917b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17b8e012-578d-5566-b6ac-73e0be127174/17b8e012-578d-5566-b6ac-73e0be127174_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2833537,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_5b315f204c7e4f9b01b12baa8cf2e898.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17b8e012-578d-5566-b6ac-73e0be127174/17b8e012-578d-5566-b6ac-73e0be127174_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2729853,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_950ba7247d740a7dbae54b65fe7cb2cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17b8e012-578d-5566-b6ac-73e0be127174/17b8e012-578d-5566-b6ac-73e0be127174_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2746749,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_c18570b8ed36f6b0f01e13b9fdc3f4fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17b8e012-578d-5566-b6ac-73e0be127174/17b8e012-578d-5566-b6ac-73e0be127174_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2549471,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_6181025a05b12647ec0d09e092033845.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17b8e012-578d-5566-b6ac-73e0be127174/17b8e012-578d-5566-b6ac-73e0be127174_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2568435,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_3b872f89ea3a967b228cefd9d3895c49.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17b8e012-578d-5566-b6ac-73e0be127174/17b8e012-578d-5566-b6ac-73e0be127174_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2777760,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_3b12c5024a5dec9bbfd4f8a3e60dde5e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17b8e012-578d-5566-b6ac-73e0be127174/17b8e012-578d-5566-b6ac-73e0be127174_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2499967,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_3e7a83d8a7ff2ad207a685aa80597757.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17b8e012-578d-5566-b6ac-73e0be127174/17b8e012-578d-5566-b6ac-73e0be127174_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2644026,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_6ceade964402949040be31eb6302b51b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17b8e012-578d-5566-b6ac-73e0be127174/17b8e012-578d-5566-b6ac-73e0be127174_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2740307,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_f19379037586761e2f9e902ed2bec0a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17b8e012-578d-5566-b6ac-73e0be127174/17b8e012-578d-5566-b6ac-73e0be127174_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2457203,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/25/eb2545ea372b1f1e7459127d5c671528/pa/JB14555_2d258b417b6476367cc26d7c4e31917b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'automatic',
 'trim': 'Stepway Prestige',
 'year': 2017}
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB14555%27 HTTP/1.1" 200 None
2026-03-30 10:38:51 [auto1.de] INFO: Saving data for JB14555: {'created_time': 1774867131.924306, 'last_price_update_time': 1774867131.924318, 'auction_closing_time': 1774971934.0}
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB14555') HTTP/1.1" 204 0
2026-03-30 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL84583/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_8fc42984ecc3233c68186aa003c67565.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:51 [auto1.de] INFO: Found listing with ID: HJ77178
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ77178%27 HTTP/1.1" 200 None
2026-03-30 10:38:51 [auto1.de] INFO: Scrape type for HJ77178: 2
2026-03-30 10:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 786a7332-6ab6-5b34-89f7-85b70a8c82a7 with identifier: HJ77178
2026-03-30 10:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 786a7332-6ab6-5b34-89f7-85b70a8c82a7 with scrape type 2
2026-03-30 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 786a7332-6ab6-5b34-89f7-85b70a8c82a7 with scrape type 2
2026-03-30 10:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 786a7332-6ab6-5b34-89f7-85b70a8c82a7, identifier: HJ77178
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_9e901be06b979642254519d1ef96b418.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_9e901be06b979642254519d1ef96b418.jpg not downloaded yet
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_0e02f20accfb7458edc0d15b0cf896ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_0e02f20accfb7458edc0d15b0cf896ba.jpg not downloaded yet
2026-03-30 10:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV98071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 786a7332-6ab6-5b34-89f7-85b70a8c82a7 with identifier: HJ77178
2026-03-30 10:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 786a7332-6ab6-5b34-89f7-85b70a8c82a7 with identifier: HJ77178
2026-03-30 10:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 786a7332-6ab6-5b34-89f7-85b70a8c82a7 with identifier: HJ77178 to the API
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:43:48Z',
 'fuel_type': 'petrol',
 'id': '786a7332-6ab6-5b34-89f7-85b70a8c82a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ77178',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 121130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-21',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ77178%27 HTTP/1.1" 200 None
2026-03-30 10:38:52 [auto1.de] INFO: Saving data for HJ77178: {'auction_closing_time': 1774971828.0, 'created_time': 1774637042.17783, 'last_price_update_time': 1774867132.501889}
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ77178') HTTP/1.1" 204 0
2026-03-30 10:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:52 [auto1.de] INFO: Found listing with ID: FS99477
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS99477%27 HTTP/1.1" 200 None
2026-03-30 10:38:52 [auto1.de] INFO: Scrape type for FS99477: 1
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_255f07e68a61dfa118d7a63ba2af2a10.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_255f07e68a61dfa118d7a63ba2af2a10.jpg not downloaded yet
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_8160344eaf200a4ca6c03b3afa63dcaa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_8160344eaf200a4ca6c03b3afa63dcaa.jpg not downloaded yet
2026-03-30 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_d3f760ec655098a9f39a116c3f4e3154.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_73038582ca2f87e15c75cfafa5468ebd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:52 [auto1.de] INFO: Found listing with ID: JX90545
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX90545%27 HTTP/1.1" 200 None
2026-03-30 10:38:52 [auto1.de] INFO: Scrape type for JX90545: 1
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_a0620643826b559f596265d9315cdd05.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_a0620643826b559f596265d9315cdd05.jpg not downloaded yet
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_cdf94a427c673abc5f1b3e1f53095ce0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_cdf94a427c673abc5f1b3e1f53095ce0.jpg not downloaded yet
2026-03-30 10:38:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a78a10>
2026-03-30 10:38:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_8fc42984ecc3233c68186aa003c67565.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_8fc42984ecc3233c68186aa003c67565.jpg saved to cache
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4529458b-3015-5e6e-a612-b45ba7ee8a2e
2026-03-30 10:38:52 [auto1.de] INFO: Found listing with ID: CM52893
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM52893%27 HTTP/1.1" 200 None
2026-03-30 10:38:52 [auto1.de] INFO: Scrape type for CM52893: 1
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_ca99408e4046199eca5fd7864706cf0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_ca99408e4046199eca5fd7864706cf0e.jpg not downloaded yet
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_f8d0374f62525fd732e61d5d62e865dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_f8d0374f62525fd732e61d5d62e865dc.jpg not downloaded yet
2026-03-30 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_3d738d91d207e9f70bb712382a827d67.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef593f050>
2026-03-30 10:38:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_d3f760ec655098a9f39a116c3f4e3154.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_d3f760ec655098a9f39a116c3f4e3154.jpg saved to cache
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 382db325-3222-5c2d-914a-654d37707f1c
2026-03-30 10:38:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a97790>
2026-03-30 10:38:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_73038582ca2f87e15c75cfafa5468ebd.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_73038582ca2f87e15c75cfafa5468ebd.jpg saved to cache
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9d9b3c6-7f0d-5c08-b4a3-aaad26659400
2026-03-30 10:38:52 [auto1.de] INFO: Found listing with ID: ZF52635
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF52635%27 HTTP/1.1" 200 None
2026-03-30 10:38:52 [auto1.de] INFO: Scrape type for ZF52635: 1
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_74f578ff33660f5f3aa09d17890f830c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_74f578ff33660f5f3aa09d17890f830c.jpg not downloaded yet
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_23b3350c2dc0e09d835bc451ce305f19.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_23b3350c2dc0e09d835bc451ce305f19.jpg not downloaded yet
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_6795cb1cf228c255035c23aa834983da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_8160344eaf200a4ca6c03b3afa63dcaa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:53 [auto1.de] INFO: Found listing with ID: CE73784
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE73784%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [auto1.de] INFO: Scrape type for CE73784: 1
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_c60fc8dbe69fb24523e2daae20ff41b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_c60fc8dbe69fb24523e2daae20ff41b6.jpg not downloaded yet
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7b150>
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_3d738d91d207e9f70bb712382a827d67.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_3d738d91d207e9f70bb712382a827d67.jpg saved to cache
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9d9b3c6-7f0d-5c08-b4a3-aaad26659400
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_a561ff9292cc056cf1c624dffccddbe8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_e16cc36a63daa3347f6eec471a234a59.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:53 [auto1.de] INFO: Found listing with ID: GB07030
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WR86170/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ52167/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e4b7d0>
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_6795cb1cf228c255035c23aa834983da.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_6795cb1cf228c255035c23aa834983da.jpg saved to cache
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9d9b3c6-7f0d-5c08-b4a3-aaad26659400
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_c60fc8dbe69fb24523e2daae20ff41b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a26510>
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_8160344eaf200a4ca6c03b3afa63dcaa.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_8160344eaf200a4ca6c03b3afa63dcaa.jpg saved to cache
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9d9b3c6-7f0d-5c08-b4a3-aaad26659400
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_70f862e4cebf870ac7807e9415b00542.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50519d0>
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_a561ff9292cc056cf1c624dffccddbe8.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_a561ff9292cc056cf1c624dffccddbe8.jpg saved to cache
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 382db325-3222-5c2d-914a-654d37707f1c
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7933810>
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_e16cc36a63daa3347f6eec471a234a59.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_e16cc36a63daa3347f6eec471a234a59.jpg saved to cache
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4529458b-3015-5e6e-a612-b45ba7ee8a2e
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_f8d0374f62525fd732e61d5d62e865dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_23b3350c2dc0e09d835bc451ce305f19.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef502bed0>
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_c60fc8dbe69fb24523e2daae20ff41b6.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_c60fc8dbe69fb24523e2daae20ff41b6.jpg saved to cache
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b9d9b3c6-7f0d-5c08-b4a3-aaad26659400
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd3a50>
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_70f862e4cebf870ac7807e9415b00542.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_70f862e4cebf870ac7807e9415b00542.jpg saved to cache
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 382db325-3222-5c2d-914a-654d37707f1c
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_ca99408e4046199eca5fd7864706cf0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fcb150>
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_f8d0374f62525fd732e61d5d62e865dc.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_f8d0374f62525fd732e61d5d62e865dc.jpg saved to cache
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b9d9b3c6-7f0d-5c08-b4a3-aaad26659400
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fffe50>
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_23b3350c2dc0e09d835bc451ce305f19.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_23b3350c2dc0e09d835bc451ce305f19.jpg saved to cache
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b9d9b3c6-7f0d-5c08-b4a3-aaad26659400
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY58747/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DW30618> (referer: https://www.auto1.com/v1/car-details-view/DW30618/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0b910>
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_ca99408e4046199eca5fd7864706cf0e.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_ca99408e4046199eca5fd7864706cf0e.jpg saved to cache
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4529458b-3015-5e6e-a612-b45ba7ee8a2e
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_255f07e68a61dfa118d7a63ba2af2a10.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_74f578ff33660f5f3aa09d17890f830c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_28b3fa61c06fcc8d6fa35564fc1ea4eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9398289-a86c-58e4-ba69-58aa63c06599 with identifier: DW30618
2026-03-30 10:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9398289-a86c-58e4-ba69-58aa63c06599 with scrape type 1
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e9398289-a86c-58e4-ba69-58aa63c06599
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F01%252F760183244c3287d6066bf911c4f5ed64%252Fpa%252FDW30618_9b6f86309cd7c319e5c8da8d68cc199e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_9b6f86309cd7c319e5c8da8d68cc199e.jpg not downloaded yet
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F01%252F760183244c3287d6066bf911c4f5ed64%252Fpa%252FDW30618_26e8f51718a87b19a052694842ecbd9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_26e8f51718a87b19a052694842ecbd9a.jpg not downloaded yet
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F01%252F760183244c3287d6066bf911c4f5ed64%252Fpa%252FDW30618_e53eb41f7e6a0bdae95e3bea514e63e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_e53eb41f7e6a0bdae95e3bea514e63e2.jpg not downloaded yet
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F01%252F760183244c3287d6066bf911c4f5ed64%252Fpa%252FDW30618_a980df925e78ef4f0de15f5e3361fb9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_a980df925e78ef4f0de15f5e3361fb9f.jpg not downloaded yet
2026-03-30 10:38:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b2f50>
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_255f07e68a61dfa118d7a63ba2af2a10.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_255f07e68a61dfa118d7a63ba2af2a10.jpg saved to cache
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4529458b-3015-5e6e-a612-b45ba7ee8a2e
2026-03-30 10:38:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b31d90>
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_74f578ff33660f5f3aa09d17890f830c.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_74f578ff33660f5f3aa09d17890f830c.jpg saved to cache
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4529458b-3015-5e6e-a612-b45ba7ee8a2e
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F01%252F760183244c3287d6066bf911c4f5ed64%252Fpa%252FDW30618_8f5513c8dd77e7ab6eeb92c6393970f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_8f5513c8dd77e7ab6eeb92c6393970f4.jpg not downloaded yet
2026-03-30 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN97004/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b304d0>
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_28b3fa61c06fcc8d6fa35564fc1ea4eb.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_28b3fa61c06fcc8d6fa35564fc1ea4eb.jpg saved to cache
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4529458b-3015-5e6e-a612-b45ba7ee8a2e
2026-03-30 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_a0620643826b559f596265d9315cdd05.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_cdf94a427c673abc5f1b3e1f53095ce0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC55242> (referer: https://www.auto1.com/v1/car-details-view/PC55242/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_9b6f86309cd7c319e5c8da8d68cc199e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_a980df925e78ef4f0de15f5e3361fb9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_26e8f51718a87b19a052694842ecbd9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_8f5513c8dd77e7ab6eeb92c6393970f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_e53eb41f7e6a0bdae95e3bea514e63e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV98071> (referer: https://www.auto1.com/v1/car-details-view/XV98071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b285d0>
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_a0620643826b559f596265d9315cdd05.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_a0620643826b559f596265d9315cdd05.jpg saved to cache
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4529458b-3015-5e6e-a612-b45ba7ee8a2e
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef501b190>
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_cdf94a427c673abc5f1b3e1f53095ce0.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_cdf94a427c673abc5f1b3e1f53095ce0.jpg saved to cache
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9d9b3c6-7f0d-5c08-b4a3-aaad26659400
2026-03-30 10:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2ee7596-b6e7-5715-b19a-dfd90b3485d3 with identifier: PC55242
2026-03-30 10:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2ee7596-b6e7-5715-b19a-dfd90b3485d3 with scrape type 1
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2ee7596-b6e7-5715-b19a-dfd90b3485d3
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F49%252F5249ef1908c771da429f3865ee90bba3%252Fpa%252FPC55242_0ae1603b675a0e14569c263e044ec8b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_0ae1603b675a0e14569c263e044ec8b2.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F49%252F5249ef1908c771da429f3865ee90bba3%252Fpa%252FPC55242_f1c1610675349a9945b360d3407736a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_f1c1610675349a9945b360d3407736a6.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F49%252F5249ef1908c771da429f3865ee90bba3%252Fpa%252FPC55242_dbd8e75021437d8880a99bb8a501cfa7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_dbd8e75021437d8880a99bb8a501cfa7.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F49%252F5249ef1908c771da429f3865ee90bba3%252Fpa%252FPC55242_924eebbdc34cad93b7fcf85d09cb3a7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_924eebbdc34cad93b7fcf85d09cb3a7b.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F49%252F5249ef1908c771da429f3865ee90bba3%252Fpa%252FPC55242_8bf199764f218193bda4df4a8850de56.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_8bf199764f218193bda4df4a8850de56.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F49%252F5249ef1908c771da429f3865ee90bba3%252Fpa%252FPC55242_53670c56c5e3500d1178c98aeeb48077.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_53670c56c5e3500d1178c98aeeb48077.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F49%252F5249ef1908c771da429f3865ee90bba3%252Fpa%252FPC55242_a1bac90509a3534ca31c22b38f56b635.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_a1bac90509a3534ca31c22b38f56b635.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F49%252F5249ef1908c771da429f3865ee90bba3%252Fpa%252FPC55242_18991cc4b53e2203ff41a6231ca94da0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_18991cc4b53e2203ff41a6231ca94da0.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F49%252F5249ef1908c771da429f3865ee90bba3%252Fpa%252FPC55242_64bc4d75c09f72ff3622919869dd0481.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_64bc4d75c09f72ff3622919869dd0481.jpg already downloaded
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F49%252F5249ef1908c771da429f3865ee90bba3%252Fpa%252FPC55242_3e678cf525cdaa13749fcf90c52c12e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_3e678cf525cdaa13749fcf90c52c12e4.jpg already downloaded
2026-03-30 10:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2ee7596-b6e7-5715-b19a-dfd90b3485d3, identifier: PC55242
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef852f390>
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9398289-a86c-58e4-ba69-58aa63c06599/e9398289-a86c-58e4-ba69-58aa63c06599_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F01%252F760183244c3287d6066bf911c4f5ed64%252Fpa%252FDW30618_9b6f86309cd7c319e5c8da8d68cc199e.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_9b6f86309cd7c319e5c8da8d68cc199e.jpg saved to cache
2026-03-30 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9398289-a86c-58e4-ba69-58aa63c06599
2026-03-30 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5962510>
2026-03-30 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9398289-a86c-58e4-ba69-58aa63c06599/e9398289-a86c-58e4-ba69-58aa63c06599_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F01%252F760183244c3287d6066bf911c4f5ed64%252Fpa%252FDW30618_a980df925e78ef4f0de15f5e3361fb9f.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_a980df925e78ef4f0de15f5e3361fb9f.jpg saved to cache
2026-03-30 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9398289-a86c-58e4-ba69-58aa63c06599
2026-03-30 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5029e10>
2026-03-30 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9398289-a86c-58e4-ba69-58aa63c06599/e9398289-a86c-58e4-ba69-58aa63c06599_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F01%252F760183244c3287d6066bf911c4f5ed64%252Fpa%252FDW30618_26e8f51718a87b19a052694842ecbd9a.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_26e8f51718a87b19a052694842ecbd9a.jpg saved to cache
2026-03-30 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9398289-a86c-58e4-ba69-58aa63c06599
2026-03-30 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef596ccd0>
2026-03-30 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9398289-a86c-58e4-ba69-58aa63c06599/e9398289-a86c-58e4-ba69-58aa63c06599_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F01%252F760183244c3287d6066bf911c4f5ed64%252Fpa%252FDW30618_8f5513c8dd77e7ab6eeb92c6393970f4.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_8f5513c8dd77e7ab6eeb92c6393970f4.jpg saved to cache
2026-03-30 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9398289-a86c-58e4-ba69-58aa63c06599
2026-03-30 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f82010>
2026-03-30 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9398289-a86c-58e4-ba69-58aa63c06599/e9398289-a86c-58e4-ba69-58aa63c06599_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F01%252F760183244c3287d6066bf911c4f5ed64%252Fpa%252FDW30618_e53eb41f7e6a0bdae95e3bea514e63e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_e53eb41f7e6a0bdae95e3bea514e63e2.jpg saved to cache
2026-03-30 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9398289-a86c-58e4-ba69-58aa63c06599
2026-03-30 10:38:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9398289-a86c-58e4-ba69-58aa63c06599, skipping ID generation
2026-03-30 10:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9398289-a86c-58e4-ba69-58aa63c06599 with scrape type 1
2026-03-30 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9398289-a86c-58e4-ba69-58aa63c06599 sending to next pipeline
2026-03-30 10:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9398289-a86c-58e4-ba69-58aa63c06599, identifier: DW30618
2026-03-30 10:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9a7a0c8-2563-54f4-961e-593b802f09f7 with identifier: XV98071
2026-03-30 10:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9a7a0c8-2563-54f4-961e-593b802f09f7 with scrape type 1
2026-03-30 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9a7a0c8-2563-54f4-961e-593b802f09f7
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_6e1e3a1d5e6096426cb89684702246e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_6e1e3a1d5e6096426cb89684702246e7.jpg not downloaded yet
2026-03-30 10:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2ee7596-b6e7-5715-b19a-dfd90b3485d3 with identifier: PC55242
2026-03-30 10:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2ee7596-b6e7-5715-b19a-dfd90b3485d3 with identifier: PC55242
2026-03-30 10:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2ee7596-b6e7-5715-b19a-dfd90b3485d3 with identifier: PC55242 to the API
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PC55242>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:00:36Z',
 'fuel_type': 'diesel',
 'id': 'd2ee7596-b6e7-5715-b19a-dfd90b3485d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC55242',
 'listing': 'auction',
 'location': 'DE, Saarlouis',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 170145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_0ae1603b675a0e14569c263e044ec8b2.jpg',
                'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_f1c1610675349a9945b360d3407736a6.jpg',
                'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_dbd8e75021437d8880a99bb8a501cfa7.jpg',
                'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_924eebbdc34cad93b7fcf85d09cb3a7b.jpg',
                'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_8bf199764f218193bda4df4a8850de56.jpg',
                'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_53670c56c5e3500d1178c98aeeb48077.jpg',
                'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_a1bac90509a3534ca31c22b38f56b635.jpg',
                'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_18991cc4b53e2203ff41a6231ca94da0.jpg',
                'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_64bc4d75c09f72ff3622919869dd0481.jpg',
                'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_3e678cf525cdaa13749fcf90c52c12e4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2ee7596-b6e7-5715-b19a-dfd90b3485d3/d2ee7596-b6e7-5715-b19a-dfd90b3485d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2759208,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_0ae1603b675a0e14569c263e044ec8b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2ee7596-b6e7-5715-b19a-dfd90b3485d3/d2ee7596-b6e7-5715-b19a-dfd90b3485d3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2760830,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_f1c1610675349a9945b360d3407736a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2ee7596-b6e7-5715-b19a-dfd90b3485d3/d2ee7596-b6e7-5715-b19a-dfd90b3485d3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_dbd8e75021437d8880a99bb8a501cfa7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2ee7596-b6e7-5715-b19a-dfd90b3485d3/d2ee7596-b6e7-5715-b19a-dfd90b3485d3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2108702,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_924eebbdc34cad93b7fcf85d09cb3a7b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2ee7596-b6e7-5715-b19a-dfd90b3485d3/d2ee7596-b6e7-5715-b19a-dfd90b3485d3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2479282,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_8bf199764f218193bda4df4a8850de56.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2ee7596-b6e7-5715-b19a-dfd90b3485d3/d2ee7596-b6e7-5715-b19a-dfd90b3485d3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_53670c56c5e3500d1178c98aeeb48077.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2ee7596-b6e7-5715-b19a-dfd90b3485d3/d2ee7596-b6e7-5715-b19a-dfd90b3485d3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_a1bac90509a3534ca31c22b38f56b635.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2ee7596-b6e7-5715-b19a-dfd90b3485d3/d2ee7596-b6e7-5715-b19a-dfd90b3485d3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2517578,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_18991cc4b53e2203ff41a6231ca94da0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2ee7596-b6e7-5715-b19a-dfd90b3485d3/d2ee7596-b6e7-5715-b19a-dfd90b3485d3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_64bc4d75c09f72ff3622919869dd0481.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2ee7596-b6e7-5715-b19a-dfd90b3485d3/d2ee7596-b6e7-5715-b19a-dfd90b3485d3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2741823,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/49/5249ef1908c771da429f3865ee90bba3/pa/PC55242_3e678cf525cdaa13749fcf90c52c12e4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC55242%27 HTTP/1.1" 200 None
2026-03-30 10:38:55 [auto1.de] INFO: Saving data for PC55242: {'created_time': 1774867135.721142, 'last_price_update_time': 1774867135.72115, 'auction_closing_time': 1774969236.0}
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC55242') HTTP/1.1" 204 0
2026-03-30 10:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9398289-a86c-58e4-ba69-58aa63c06599 with identifier: DW30618
2026-03-30 10:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9398289-a86c-58e4-ba69-58aa63c06599 with identifier: DW30618
2026-03-30 10:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9398289-a86c-58e4-ba69-58aa63c06599 with identifier: DW30618 to the API
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_e53eb41f7e6a0bdae95e3bea514e63e2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 88,
 'expiration_date': '2026-03-31T15:26:22Z',
 'fuel_type': 'petrol',
 'id': 'e9398289-a86c-58e4-ba69-58aa63c06599',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW30618',
 'listing': 'auction',
 'location': 'DE, Lutherstadt Wittenberg',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 68516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9398289-a86c-58e4-ba69-58aa63c06599/e9398289-a86c-58e4-ba69-58aa63c06599_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_9b6f86309cd7c319e5c8da8d68cc199e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9398289-a86c-58e4-ba69-58aa63c06599/e9398289-a86c-58e4-ba69-58aa63c06599_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_26e8f51718a87b19a052694842ecbd9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9398289-a86c-58e4-ba69-58aa63c06599/e9398289-a86c-58e4-ba69-58aa63c06599_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_e53eb41f7e6a0bdae95e3bea514e63e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9398289-a86c-58e4-ba69-58aa63c06599/e9398289-a86c-58e4-ba69-58aa63c06599_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_a980df925e78ef4f0de15f5e3361fb9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9398289-a86c-58e4-ba69-58aa63c06599/e9398289-a86c-58e4-ba69-58aa63c06599_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/01/760183244c3287d6066bf911c4f5ed64/pa/DW30618_8f5513c8dd77e7ab6eeb92c6393970f4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.4 SensoDrive VTR',
 'transmission': 'automatic',
 'trim': 'SensoDrive VTR',
 'year': 2006}
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW30618%27 HTTP/1.1" 200 None
2026-03-30 10:38:56 [auto1.de] INFO: Saving data for DW30618: {'created_time': 1774867136.097883, 'last_price_update_time': 1774867136.097893, 'auction_closing_time': 1774970782.0}
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW30618') HTTP/1.1" 204 0
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_caf10a1a97b61244cf48515eb5ebce0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_caf10a1a97b61244cf48515eb5ebce0b.jpg not downloaded yet
2026-03-30 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_9e901be06b979642254519d1ef96b418.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_0e02f20accfb7458edc0d15b0cf896ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE73784/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZF52635/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CM52893/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_661dec94ab94024fc0b84d2c3725fd93.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_661dec94ab94024fc0b84d2c3725fd93.jpg not downloaded yet
2026-03-30 10:38:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_2680fcb9dd7306e2a58df22c6ba646f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_2680fcb9dd7306e2a58df22c6ba646f4.jpg not downloaded yet
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_a463a43b7e77609ce071f9a1fd330e65.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_a463a43b7e77609ce071f9a1fd330e65.jpg not downloaded yet
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_d222ab005c52c3a6199cabb8222a99a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_d222ab005c52c3a6199cabb8222a99a6.jpg not downloaded yet
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_bfb7a3ce498ef042bb9821e046fe56a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_bfb7a3ce498ef042bb9821e046fe56a3.jpg not downloaded yet
2026-03-30 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_6e1e3a1d5e6096426cb89684702246e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_caf10a1a97b61244cf48515eb5ebce0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_10a09a97c91c308a14ac66a08ebae789.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_10a09a97c91c308a14ac66a08ebae789.jpg not downloaded yet
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7930e50>
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_9e901be06b979642254519d1ef96b418.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_9e901be06b979642254519d1ef96b418.jpg saved to cache
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4529458b-3015-5e6e-a612-b45ba7ee8a2e
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f10f50>
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_0e02f20accfb7458edc0d15b0cf896ba.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_0e02f20accfb7458edc0d15b0cf896ba.jpg saved to cache
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9d9b3c6-7f0d-5c08-b4a3-aaad26659400
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_4feda1994df14648a28027004c568cb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_4feda1994df14648a28027004c568cb3.jpg not downloaded yet
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_3210eb5f7f43113b0aa9e51e7311c1c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_3210eb5f7f43113b0aa9e51e7311c1c7.jpg not downloaded yet
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef86a6310>
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_6e1e3a1d5e6096426cb89684702246e7.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_6e1e3a1d5e6096426cb89684702246e7.jpg saved to cache
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9a7a0c8-2563-54f4-961e-593b802f09f7
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b23390>
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_caf10a1a97b61244cf48515eb5ebce0b.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_caf10a1a97b61244cf48515eb5ebce0b.jpg saved to cache
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9a7a0c8-2563-54f4-961e-593b802f09f7
2026-03-30 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_707f47a41f192a43844d9cad06f11652.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_bfb7a3ce498ef042bb9821e046fe56a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_f85da965ef60ca27965d41a10fedd4e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_d222ab005c52c3a6199cabb8222a99a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7c150>
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fab%252Fc3ab3982408a5d308e89102b54672d2b%252Fpa%252FZM82524_707f47a41f192a43844d9cad06f11652.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_707f47a41f192a43844d9cad06f11652.jpg saved to cache
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9d9b3c6-7f0d-5c08-b4a3-aaad26659400
2026-03-30 10:38:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9d9b3c6-7f0d-5c08-b4a3-aaad26659400, skipping ID generation
2026-03-30 10:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9d9b3c6-7f0d-5c08-b4a3-aaad26659400 with scrape type 1
2026-03-30 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9d9b3c6-7f0d-5c08-b4a3-aaad26659400 sending to next pipeline
2026-03-30 10:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9d9b3c6-7f0d-5c08-b4a3-aaad26659400, identifier: ZM82524
2026-03-30 10:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9d9b3c6-7f0d-5c08-b4a3-aaad26659400 with identifier: ZM82524
2026-03-30 10:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9d9b3c6-7f0d-5c08-b4a3-aaad26659400 with identifier: ZM82524
2026-03-30 10:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9d9b3c6-7f0d-5c08-b4a3-aaad26659400 with identifier: ZM82524 to the API
2026-03-30 10:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_707f47a41f192a43844d9cad06f11652.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:14:24Z',
 'fuel_type': 'diesel',
 'id': 'b9d9b3c6-7f0d-5c08-b4a3-aaad26659400',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM82524',
 'listing': 'auction',
 'location': 'DE, Leer',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 151747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 439718,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_73038582ca2f87e15c75cfafa5468ebd.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_6795cb1cf228c255035c23aa834983da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_707f47a41f192a43844d9cad06f11652.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_3d738d91d207e9f70bb712382a827d67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_0e02f20accfb7458edc0d15b0cf896ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_8160344eaf200a4ca6c03b3afa63dcaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_cdf94a427c673abc5f1b3e1f53095ce0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 426678,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_f8d0374f62525fd732e61d5d62e865dc.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_23b3350c2dc0e09d835bc451ce305f19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d9b3c6-7f0d-5c08-b4a3-aaad26659400/b9d9b3c6-7f0d-5c08-b4a3-aaad26659400_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ab/c3ab3982408a5d308e89102b54672d2b/pa/ZM82524_c60fc8dbe69fb24523e2daae20ff41b6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM82524%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [auto1.de] INFO: Saving data for ZM82524: {'created_time': 1774867137.212837, 'last_price_update_time': 1774867137.212848, 'auction_closing_time': 1774970064.0}
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM82524') HTTP/1.1" 204 0
2026-03-30 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_3210eb5f7f43113b0aa9e51e7311c1c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JX90545/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ52167> (referer: https://www.auto1.com/v1/car-details-view/XJ52167/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WR86170> (referer: https://www.auto1.com/v1/car-details-view/WR86170/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL84583> (referer: https://www.auto1.com/v1/car-details-view/RL84583/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef501b110>
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_bfb7a3ce498ef042bb9821e046fe56a3.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_bfb7a3ce498ef042bb9821e046fe56a3.jpg saved to cache
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9a7a0c8-2563-54f4-961e-593b802f09f7
2026-03-30 10:38:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a20d10>
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_f85da965ef60ca27965d41a10fedd4e6.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_f85da965ef60ca27965d41a10fedd4e6.jpg saved to cache
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4529458b-3015-5e6e-a612-b45ba7ee8a2e
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f13650>
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_d222ab005c52c3a6199cabb8222a99a6.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_d222ab005c52c3a6199cabb8222a99a6.jpg saved to cache
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9a7a0c8-2563-54f4-961e-593b802f09f7
2026-03-30 10:38:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN97004> (referer: https://www.auto1.com/v1/car-details-view/CN97004/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f73e10>
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_3210eb5f7f43113b0aa9e51e7311c1c7.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_3210eb5f7f43113b0aa9e51e7311c1c7.jpg saved to cache
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b9a7a0c8-2563-54f4-961e-593b802f09f7
2026-03-30 10:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a702df90-5f5d-5e44-94b3-42fdb0c4c86f with identifier: XJ52167
2026-03-30 10:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a702df90-5f5d-5e44-94b3-42fdb0c4c86f with scrape type 1
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a702df90-5f5d-5e44-94b3-42fdb0c4c86f
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fbc%252Fb1bcb655307f1aa2f00e4105a4db7be0%252Fpa%252FXJ52167_d654eee60f57a35ace6b5f6931bd66f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_d654eee60f57a35ace6b5f6931bd66f3.jpg not downloaded yet
2026-03-30 10:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: WR86170
2026-03-30 10:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 975e6ac5-250d-5bb6-8ecf-3308799273a7 with scrape type 1
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_6dfee0b9bb45cfc932f5b1f4ce587db9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_6dfee0b9bb45cfc932f5b1f4ce587db9.jpg not downloaded yet
2026-03-30 10:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab0f4314-5b6e-5522-90bb-ad206ecb1ea5 with identifier: RL84583
2026-03-30 10:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab0f4314-5b6e-5522-90bb-ad206ecb1ea5 with scrape type 1
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab0f4314-5b6e-5522-90bb-ad206ecb1ea5
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_857d9ebc72ac7960bfd25f47aafd4f1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_857d9ebc72ac7960bfd25f47aafd4f1c.jpg not downloaded yet
2026-03-30 10:38:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fbc%252Fb1bcb655307f1aa2f00e4105a4db7be0%252Fpa%252FXJ52167_b95f8483f2132cfd7651984eb91015c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_b95f8483f2132cfd7651984eb91015c2.jpg not downloaded yet
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_e696bf5cd2168b5fc5d12f5872f08607.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_e696bf5cd2168b5fc5d12f5872f08607.jpg not downloaded yet
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_23d4d19832b7bd449cae104af7112e3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_23d4d19832b7bd449cae104af7112e3f.jpg not downloaded yet
2026-03-30 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_2680fcb9dd7306e2a58df22c6ba646f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_4feda1994df14648a28027004c568cb3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_a463a43b7e77609ce071f9a1fd330e65.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_661dec94ab94024fc0b84d2c3725fd93.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_10a09a97c91c308a14ac66a08ebae789.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fbc%252Fb1bcb655307f1aa2f00e4105a4db7be0%252Fpa%252FXJ52167_5d0f383bfb95abedf5569005459343b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_5d0f383bfb95abedf5569005459343b9.jpg not downloaded yet
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_46100de731edc4451e20491bbd586d39.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_46100de731edc4451e20491bbd586d39.jpg not downloaded yet
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_0496f6fe469f578c39b94171c53e3bfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_0496f6fe469f578c39b94171c53e3bfe.jpg not downloaded yet
2026-03-30 10:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 309147b4-3534-5e02-9387-a17cf2d5194b with identifier: CN97004
2026-03-30 10:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 309147b4-3534-5e02-9387-a17cf2d5194b with scrape type 1
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 309147b4-3534-5e02-9387-a17cf2d5194b
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F70%252Fb4702100d6714a3a36934d98170f1414%252Fpa%252FCN97004_943a019c2f2c003670cb929274f13abb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_943a019c2f2c003670cb929274f13abb.jpg not downloaded yet
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fbc%252Fb1bcb655307f1aa2f00e4105a4db7be0%252Fpa%252FXJ52167_a2fafc419ef4b73cde859e8508cae0ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_a2fafc419ef4b73cde859e8508cae0ca.jpg not downloaded yet
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_7f4b2a862ea2445fd930dae36c2301d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_7f4b2a862ea2445fd930dae36c2301d5.jpg not downloaded yet
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_0420173d68051b5e0b97462c4679a970.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_0420173d68051b5e0b97462c4679a970.jpg not downloaded yet
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F70%252Fb4702100d6714a3a36934d98170f1414%252Fpa%252FCN97004_f0317ed3b6feb82dba796e783f063d22.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_f0317ed3b6feb82dba796e783f063d22.jpg not downloaded yet
2026-03-30 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_857d9ebc72ac7960bfd25f47aafd4f1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fbc%252Fb1bcb655307f1aa2f00e4105a4db7be0%252Fpa%252FXJ52167_ecbec9708527d8ad1314647661c4bd01.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_ecbec9708527d8ad1314647661c4bd01.jpg not downloaded yet
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_260f1c318c2f6efa8fc7c2733b36f290.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_260f1c318c2f6efa8fc7c2733b36f290.jpg not downloaded yet
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_1424a9bb11c6f0047269911bb707025d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_1424a9bb11c6f0047269911bb707025d.jpg not downloaded yet
2026-03-30 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F70%252Fb4702100d6714a3a36934d98170f1414%252Fpa%252FCN97004_61d76f7397ab942af4a2314e0105c809.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_61d76f7397ab942af4a2314e0105c809.jpg not downloaded yet
2026-03-30 10:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_6dfee0b9bb45cfc932f5b1f4ce587db9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_1a32e039e606f436d9a59d488b55200f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_d654eee60f57a35ace6b5f6931bd66f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e48f90>
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_2680fcb9dd7306e2a58df22c6ba646f4.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_2680fcb9dd7306e2a58df22c6ba646f4.jpg saved to cache
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9a7a0c8-2563-54f4-961e-593b802f09f7
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d6f710>
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_4feda1994df14648a28027004c568cb3.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_4feda1994df14648a28027004c568cb3.jpg saved to cache
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b9a7a0c8-2563-54f4-961e-593b802f09f7
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d79f10>
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_a463a43b7e77609ce071f9a1fd330e65.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_a463a43b7e77609ce071f9a1fd330e65.jpg saved to cache
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9a7a0c8-2563-54f4-961e-593b802f09f7
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d82890>
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_661dec94ab94024fc0b84d2c3725fd93.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_661dec94ab94024fc0b84d2c3725fd93.jpg saved to cache
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9a7a0c8-2563-54f4-961e-593b802f09f7
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d78c10>
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F69%252Fd66994a652199d649329128556c7e837%252Fpa%252FXV98071_10a09a97c91c308a14ac66a08ebae789.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_10a09a97c91c308a14ac66a08ebae789.jpg saved to cache
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b9a7a0c8-2563-54f4-961e-593b802f09f7
2026-03-30 10:38:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9a7a0c8-2563-54f4-961e-593b802f09f7, skipping ID generation
2026-03-30 10:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9a7a0c8-2563-54f4-961e-593b802f09f7 with scrape type 1
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9a7a0c8-2563-54f4-961e-593b802f09f7 sending to next pipeline
2026-03-30 10:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9a7a0c8-2563-54f4-961e-593b802f09f7, identifier: XV98071
2026-03-30 10:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_1687a128d04cbc2ec4257759b2f281fa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_65b5143f591a58e199e26d633ba2afc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_65b5143f591a58e199e26d633ba2afc4.jpg not downloaded yet
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_d47f5b9d283b0c7fe2eb4859b32a2dd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_d47f5b9d283b0c7fe2eb4859b32a2dd9.jpg not downloaded yet
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F70%252Fb4702100d6714a3a36934d98170f1414%252Fpa%252FCN97004_9c53f32853504e7fe261b105cf7efb7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_9c53f32853504e7fe261b105cf7efb7e.jpg not downloaded yet
2026-03-30 10:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9a7a0c8-2563-54f4-961e-593b802f09f7 with identifier: XV98071
2026-03-30 10:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9a7a0c8-2563-54f4-961e-593b802f09f7 with identifier: XV98071
2026-03-30 10:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9a7a0c8-2563-54f4-961e-593b802f09f7 with identifier: XV98071 to the API
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_10a09a97c91c308a14ac66a08ebae789.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:20:00Z',
 'fuel_type': 'petrol',
 'id': 'b9a7a0c8-2563-54f4-961e-593b802f09f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV98071',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 142781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_6e1e3a1d5e6096426cb89684702246e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_caf10a1a97b61244cf48515eb5ebce0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_661dec94ab94024fc0b84d2c3725fd93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_2680fcb9dd7306e2a58df22c6ba646f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_a463a43b7e77609ce071f9a1fd330e65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_d222ab005c52c3a6199cabb8222a99a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_bfb7a3ce498ef042bb9821e046fe56a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_10a09a97c91c308a14ac66a08ebae789.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_4feda1994df14648a28027004c568cb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9a7a0c8-2563-54f4-961e-593b802f09f7/b9a7a0c8-2563-54f4-961e-593b802f09f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/69/d66994a652199d649329128556c7e837/pa/XV98071_3210eb5f7f43113b0aa9e51e7311c1c7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI Performance BlueMotion',
 'year': 2019}
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV98071%27 HTTP/1.1" 200 None
2026-03-30 10:38:58 [auto1.de] INFO: Saving data for XV98071: {'created_time': 1774867138.829518, 'last_price_update_time': 1774867138.829532, 'auction_closing_time': 1774970400.0}
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV98071') HTTP/1.1" 204 0
2026-03-30 10:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY58747> (referer: https://www.auto1.com/v1/car-details-view/WY58747/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_22a8c6d06f9298eafbb184c832e7009f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_22a8c6d06f9298eafbb184c832e7009f.jpg not downloaded yet
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_5a923eb51379d17314b96c25c720fd63.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_5a923eb51379d17314b96c25c720fd63.jpg not downloaded yet
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F70%252Fb4702100d6714a3a36934d98170f1414%252Fpa%252FCN97004_b0961a3a648d0f2a1a8b12d37421dc79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_b0961a3a648d0f2a1a8b12d37421dc79.jpg not downloaded yet
2026-03-30 10:38:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE36706/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d84f50>
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_857d9ebc72ac7960bfd25f47aafd4f1c.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_857d9ebc72ac7960bfd25f47aafd4f1c.jpg saved to cache
2026-03-30 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab0f4314-5b6e-5522-90bb-ad206ecb1ea5
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508cc50>
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_6dfee0b9bb45cfc932f5b1f4ce587db9.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_6dfee0b9bb45cfc932f5b1f4ce587db9.jpg saved to cache
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5090310>
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_1a32e039e606f436d9a59d488b55200f.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_1a32e039e606f436d9a59d488b55200f.jpg saved to cache
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 382db325-3222-5c2d-914a-654d37707f1c
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508fd50>
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a702df90-5f5d-5e44-94b3-42fdb0c4c86f/a702df90-5f5d-5e44-94b3-42fdb0c4c86f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fbc%252Fb1bcb655307f1aa2f00e4105a4db7be0%252Fpa%252FXJ52167_d654eee60f57a35ace6b5f6931bd66f3.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_d654eee60f57a35ace6b5f6931bd66f3.jpg saved to cache
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a702df90-5f5d-5e44-94b3-42fdb0c4c86f
2026-03-30 10:38:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS99477/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD62787> (referer: https://www.auto1.com/v1/car-details-view/ZD62787/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d70510>
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:38:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_1687a128d04cbc2ec4257759b2f281fa.jpg') HTTP/1.1" 204 0
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_1687a128d04cbc2ec4257759b2f281fa.jpg saved to cache
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 382db325-3222-5c2d-914a-654d37707f1c
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_9f10be1d106328d2fb8c44ee7ce994dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_9f10be1d106328d2fb8c44ee7ce994dc.jpg not downloaded yet
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_c21bb3c83f85c4c6b4a475ab063aabaf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_c21bb3c83f85c4c6b4a475ab063aabaf.jpg not downloaded yet
2026-03-30 10:38:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_f0317ed3b6feb82dba796e783f063d22.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_a2fafc419ef4b73cde859e8508cae0ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_7f4b2a862ea2445fd930dae36c2301d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_0420173d68051b5e0b97462c4679a970.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_61d76f7397ab942af4a2314e0105c809.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b65765a-a484-5ecb-98ad-91f80b7c5faf with identifier: WY58747
2026-03-30 10:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b65765a-a484-5ecb-98ad-91f80b7c5faf with scrape type 1
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b65765a-a484-5ecb-98ad-91f80b7c5faf
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_8d7e07e6786050649bdfaefdb4af03c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_8d7e07e6786050649bdfaefdb4af03c8.jpg not downloaded yet
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_509b4f202c6c85a7fa77f3c4541d483a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_509b4f202c6c85a7fa77f3c4541d483a.jpg not downloaded yet
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_b4a37a3aa7728a1a4abb7f0cd019706c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_b4a37a3aa7728a1a4abb7f0cd019706c.jpg not downloaded yet
2026-03-30 10:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_9c53f32853504e7fe261b105cf7efb7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_76db4a92fe8e474fac5015ec9c9a1574.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_76db4a92fe8e474fac5015ec9c9a1574.jpg not downloaded yet
2026-03-30 10:38:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99795a5d-51ea-5290-872e-7c04e360074a with identifier: ZD62787
2026-03-30 10:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99795a5d-51ea-5290-872e-7c04e360074a with scrape type 1
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99795a5d-51ea-5290-872e-7c04e360074a
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fce%252Fefce2362ecc167ff5757c2b60a441ab5%252Fpa%252FZD62787_2f56b0051c1f2caa2529560ce764a0b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_2f56b0051c1f2caa2529560ce764a0b6.jpg already downloaded
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fce%252Fefce2362ecc167ff5757c2b60a441ab5%252Fpa%252FZD62787_11f383e6dc5a7bfa253e73f4c47e6858.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_11f383e6dc5a7bfa253e73f4c47e6858.jpg already downloaded
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fce%252Fefce2362ecc167ff5757c2b60a441ab5%252Fpa%252FZD62787_68f96123b04d2dc29c88c6e9c5f8f868.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_68f96123b04d2dc29c88c6e9c5f8f868.jpg already downloaded
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fce%252Fefce2362ecc167ff5757c2b60a441ab5%252Fpa%252FZD62787_1bb304621e88b729c689caf5a028fc22.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_1bb304621e88b729c689caf5a028fc22.jpg already downloaded
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fce%252Fefce2362ecc167ff5757c2b60a441ab5%252Fpa%252FZD62787_949748ad9ee6ffea8028cdf763e6c8c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_949748ad9ee6ffea8028cdf763e6c8c3.jpg already downloaded
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fce%252Fefce2362ecc167ff5757c2b60a441ab5%252Fpa%252FZD62787_cbd1df4369ea06169ea3ed27e75d2f6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_cbd1df4369ea06169ea3ed27e75d2f6a.jpg already downloaded
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fce%252Fefce2362ecc167ff5757c2b60a441ab5%252Fpa%252FZD62787_1c90a175909fb1b2aaf5f23ca40036e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_1c90a175909fb1b2aaf5f23ca40036e4.jpg already downloaded
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fce%252Fefce2362ecc167ff5757c2b60a441ab5%252Fpa%252FZD62787_c135d67ad3b550375bd364739f2c6c29.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_c135d67ad3b550375bd364739f2c6c29.jpg already downloaded
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fce%252Fefce2362ecc167ff5757c2b60a441ab5%252Fpa%252FZD62787_8a5582159c811311b006b46dcd81e32a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_8a5582159c811311b006b46dcd81e32a.jpg already downloaded
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fce%252Fefce2362ecc167ff5757c2b60a441ab5%252Fpa%252FZD62787_815484b9242c41486b4caeff9471111c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_815484b9242c41486b4caeff9471111c.jpg already downloaded
2026-03-30 10:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99795a5d-51ea-5290-872e-7c04e360074a, identifier: ZD62787
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_e6e401008be2e28727b3d78c66fd54ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_e6e401008be2e28727b3d78c66fd54ad.jpg not downloaded yet
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_90cbc73bd1d8db6350730bba86aff69d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_90cbc73bd1d8db6350730bba86aff69d.jpg not downloaded yet
2026-03-30 10:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99795a5d-51ea-5290-872e-7c04e360074a with identifier: ZD62787
2026-03-30 10:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99795a5d-51ea-5290-872e-7c04e360074a with identifier: ZD62787
2026-03-30 10:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99795a5d-51ea-5290-872e-7c04e360074a with identifier: ZD62787 to the API
2026-03-30 10:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZD62787>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:00:47Z',
 'fuel_type': 'petrol',
 'id': '99795a5d-51ea-5290-872e-7c04e360074a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD62787',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 102383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_2f56b0051c1f2caa2529560ce764a0b6.jpg',
                'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_11f383e6dc5a7bfa253e73f4c47e6858.jpg',
                'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_68f96123b04d2dc29c88c6e9c5f8f868.jpg',
                'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_1bb304621e88b729c689caf5a028fc22.jpg',
                'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_949748ad9ee6ffea8028cdf763e6c8c3.jpg',
                'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_cbd1df4369ea06169ea3ed27e75d2f6a.jpg',
                'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_1c90a175909fb1b2aaf5f23ca40036e4.jpg',
                'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_c135d67ad3b550375bd364739f2c6c29.jpg',
                'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_8a5582159c811311b006b46dcd81e32a.jpg',
                'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_815484b9242c41486b4caeff9471111c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99795a5d-51ea-5290-872e-7c04e360074a/99795a5d-51ea-5290-872e-7c04e360074a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3067331,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_2f56b0051c1f2caa2529560ce764a0b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99795a5d-51ea-5290-872e-7c04e360074a/99795a5d-51ea-5290-872e-7c04e360074a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3098462,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_11f383e6dc5a7bfa253e73f4c47e6858.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99795a5d-51ea-5290-872e-7c04e360074a/99795a5d-51ea-5290-872e-7c04e360074a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_68f96123b04d2dc29c88c6e9c5f8f868.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99795a5d-51ea-5290-872e-7c04e360074a/99795a5d-51ea-5290-872e-7c04e360074a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2441839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_1bb304621e88b729c689caf5a028fc22.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99795a5d-51ea-5290-872e-7c04e360074a/99795a5d-51ea-5290-872e-7c04e360074a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_949748ad9ee6ffea8028cdf763e6c8c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99795a5d-51ea-5290-872e-7c04e360074a/99795a5d-51ea-5290-872e-7c04e360074a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2595627,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_cbd1df4369ea06169ea3ed27e75d2f6a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99795a5d-51ea-5290-872e-7c04e360074a/99795a5d-51ea-5290-872e-7c04e360074a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_1c90a175909fb1b2aaf5f23ca40036e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99795a5d-51ea-5290-872e-7c04e360074a/99795a5d-51ea-5290-872e-7c04e360074a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_c135d67ad3b550375bd364739f2c6c29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99795a5d-51ea-5290-872e-7c04e360074a/99795a5d-51ea-5290-872e-7c04e360074a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3077526,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_8a5582159c811311b006b46dcd81e32a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99795a5d-51ea-5290-872e-7c04e360074a/99795a5d-51ea-5290-872e-7c04e360074a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2376473,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ce/efce2362ecc167ff5757c2b60a441ab5/pa/ZD62787_815484b9242c41486b4caeff9471111c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-17',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Sound up!',
 'transmission': 'manual',
 'trim': 'Sound',
 'year': 2017}
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD62787%27 HTTP/1.1" 200 None
2026-03-30 10:39:00 [auto1.de] INFO: Saving data for ZD62787: {'created_time': 1774867140.243091, 'last_price_update_time': 1774867140.243107, 'auction_closing_time': 1774969247.0}
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD62787') HTTP/1.1" 204 0
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_c6fb93b074d211fd82f44b000ef381cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_c6fb93b074d211fd82f44b000ef381cf.jpg not downloaded yet
2026-03-30 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_5a923eb51379d17314b96c25c720fd63.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_22a8c6d06f9298eafbb184c832e7009f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_d47f5b9d283b0c7fe2eb4859b32a2dd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_260f1c318c2f6efa8fc7c2733b36f290.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_65b5143f591a58e199e26d633ba2afc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_b0961a3a648d0f2a1a8b12d37421dc79.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_1424a9bb11c6f0047269911bb707025d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_ecbec9708527d8ad1314647661c4bd01.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_e3ffdefb062849fde176b6b059a710a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_e3ffdefb062849fde176b6b059a710a4.jpg not downloaded yet
2026-03-30 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CM52893> (referer: https://www.auto1.com/v1/car-details-view/CM52893/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8b250>
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309147b4-3534-5e02-9387-a17cf2d5194b/309147b4-3534-5e02-9387-a17cf2d5194b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F70%252Fb4702100d6714a3a36934d98170f1414%252Fpa%252FCN97004_f0317ed3b6feb82dba796e783f063d22.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_f0317ed3b6feb82dba796e783f063d22.jpg saved to cache
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 309147b4-3534-5e02-9387-a17cf2d5194b
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b00310>
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a702df90-5f5d-5e44-94b3-42fdb0c4c86f/a702df90-5f5d-5e44-94b3-42fdb0c4c86f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fbc%252Fb1bcb655307f1aa2f00e4105a4db7be0%252Fpa%252FXJ52167_a2fafc419ef4b73cde859e8508cae0ca.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_a2fafc419ef4b73cde859e8508cae0ca.jpg saved to cache
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a702df90-5f5d-5e44-94b3-42fdb0c4c86f
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f44350>
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_7f4b2a862ea2445fd930dae36c2301d5.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_7f4b2a862ea2445fd930dae36c2301d5.jpg saved to cache
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef599ba10>
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_0420173d68051b5e0b97462c4679a970.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_0420173d68051b5e0b97462c4679a970.jpg saved to cache
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab0f4314-5b6e-5522-90bb-ad206ecb1ea5
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c1e50>
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309147b4-3534-5e02-9387-a17cf2d5194b/309147b4-3534-5e02-9387-a17cf2d5194b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F70%252Fb4702100d6714a3a36934d98170f1414%252Fpa%252FCN97004_61d76f7397ab942af4a2314e0105c809.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_61d76f7397ab942af4a2314e0105c809.jpg saved to cache
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 309147b4-3534-5e02-9387-a17cf2d5194b
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5067e10>
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309147b4-3534-5e02-9387-a17cf2d5194b/309147b4-3534-5e02-9387-a17cf2d5194b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F70%252Fb4702100d6714a3a36934d98170f1414%252Fpa%252FCN97004_9c53f32853504e7fe261b105cf7efb7e.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_9c53f32853504e7fe261b105cf7efb7e.jpg saved to cache
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 309147b4-3534-5e02-9387-a17cf2d5194b
2026-03-30 10:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_dc098c340e2a32a7d1b55159441e7416.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_dc098c340e2a32a7d1b55159441e7416.jpg not downloaded yet
2026-03-30 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE92414> (referer: https://www.auto1.com/v1/car-details-view/KE92414/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a777d0>
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_5a923eb51379d17314b96c25c720fd63.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_5a923eb51379d17314b96c25c720fd63.jpg saved to cache
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab0f4314-5b6e-5522-90bb-ad206ecb1ea5
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d80810>
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_22a8c6d06f9298eafbb184c832e7009f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_22a8c6d06f9298eafbb184c832e7009f.jpg saved to cache
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef501eed0>
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_d47f5b9d283b0c7fe2eb4859b32a2dd9.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_d47f5b9d283b0c7fe2eb4859b32a2dd9.jpg saved to cache
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab0f4314-5b6e-5522-90bb-ad206ecb1ea5
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0bb50>
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_260f1c318c2f6efa8fc7c2733b36f290.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_260f1c318c2f6efa8fc7c2733b36f290.jpg saved to cache
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d9e0d0>
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_65b5143f591a58e199e26d633ba2afc4.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_65b5143f591a58e199e26d633ba2afc4.jpg saved to cache
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d7fd10>
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309147b4-3534-5e02-9387-a17cf2d5194b/309147b4-3534-5e02-9387-a17cf2d5194b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F70%252Fb4702100d6714a3a36934d98170f1414%252Fpa%252FCN97004_b0961a3a648d0f2a1a8b12d37421dc79.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_b0961a3a648d0f2a1a8b12d37421dc79.jpg saved to cache
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 309147b4-3534-5e02-9387-a17cf2d5194b
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef78b0b50>
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_1424a9bb11c6f0047269911bb707025d.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_1424a9bb11c6f0047269911bb707025d.jpg saved to cache
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab0f4314-5b6e-5522-90bb-ad206ecb1ea5
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0b4d0>
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a702df90-5f5d-5e44-94b3-42fdb0c4c86f/a702df90-5f5d-5e44-94b3-42fdb0c4c86f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fbc%252Fb1bcb655307f1aa2f00e4105a4db7be0%252Fpa%252FXJ52167_ecbec9708527d8ad1314647661c4bd01.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_ecbec9708527d8ad1314647661c4bd01.jpg saved to cache
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a702df90-5f5d-5e44-94b3-42fdb0c4c86f
2026-03-30 10:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc45f626-cdf6-56dd-89cd-f70aae21339a with identifier: CM52893
2026-03-30 10:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc45f626-cdf6-56dd-89cd-f70aae21339a with scrape type 1
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc45f626-cdf6-56dd-89cd-f70aae21339a
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_8eb3c796aed0483c306d44506979cf4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_8eb3c796aed0483c306d44506979cf4f.jpg not downloaded yet
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_c6fb0bc9cce4837d73f69507ef4acff0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_c6fb0bc9cce4837d73f69507ef4acff0.jpg not downloaded yet
2026-03-30 10:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_c6fb93b074d211fd82f44b000ef381cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_76db4a92fe8e474fac5015ec9c9a1574.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_e6e401008be2e28727b3d78c66fd54ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_16f05dfc8612d7a8453da7b6f23b6955.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_16f05dfc8612d7a8453da7b6f23b6955.jpg not downloaded yet
2026-03-30 10:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_90cbc73bd1d8db6350730bba86aff69d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_b4a37a3aa7728a1a4abb7f0cd019706c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_509b4f202c6c85a7fa77f3c4541d483a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_c21bb3c83f85c4c6b4a475ab063aabaf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_36a7072f7515b3a53f549a59ff6ab8be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_36a7072f7515b3a53f549a59ff6ab8be.jpg not downloaded yet
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_69619642e098b630cb62364a086a24aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_69619642e098b630cb62364a086a24aa.jpg not downloaded yet
2026-03-30 10:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20f34d32-8732-5ac7-bc19-fee7aa3e5a03 with identifier: KE92414
2026-03-30 10:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20f34d32-8732-5ac7-bc19-fee7aa3e5a03 with scrape type 1
2026-03-30 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 20f34d32-8732-5ac7-bc19-fee7aa3e5a03
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F1a%252F6c1a4dadff1210615a9d7cfab2476ab7%252Fpa%252FKE92414_91218418c5813dfa2f4ddaf1871c804c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_91218418c5813dfa2f4ddaf1871c804c.jpg already downloaded
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F1a%252F6c1a4dadff1210615a9d7cfab2476ab7%252Fpa%252FKE92414_4d5eb43be23502796f147e80b2407397.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_4d5eb43be23502796f147e80b2407397.jpg already downloaded
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F1a%252F6c1a4dadff1210615a9d7cfab2476ab7%252Fpa%252FKE92414_2df1ad1e705b5cc88c3c7e3cf7a4692e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_2df1ad1e705b5cc88c3c7e3cf7a4692e.jpg already downloaded
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F1a%252F6c1a4dadff1210615a9d7cfab2476ab7%252Fpa%252FKE92414_b073cc675a4319fd135023cb6d127a2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_b073cc675a4319fd135023cb6d127a2d.jpg already downloaded
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F1a%252F6c1a4dadff1210615a9d7cfab2476ab7%252Fpa%252FKE92414_87f88eaa544caa76b461b5f80c0232d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_87f88eaa544caa76b461b5f80c0232d0.jpg already downloaded
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F1a%252F6c1a4dadff1210615a9d7cfab2476ab7%252Fpa%252FKE92414_94c8aa6f093bf6eaa259fc76f9066e47.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_94c8aa6f093bf6eaa259fc76f9066e47.jpg already downloaded
2026-03-30 10:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20f34d32-8732-5ac7-bc19-fee7aa3e5a03, identifier: KE92414
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_e74d4cc3812a224e88f7d48bd0b60360.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_e74d4cc3812a224e88f7d48bd0b60360.jpg not downloaded yet
2026-03-30 10:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20f34d32-8732-5ac7-bc19-fee7aa3e5a03 with identifier: KE92414
2026-03-30 10:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20f34d32-8732-5ac7-bc19-fee7aa3e5a03 with identifier: KE92414
2026-03-30 10:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20f34d32-8732-5ac7-bc19-fee7aa3e5a03 with identifier: KE92414 to the API
2026-03-30 10:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KE92414>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:46:56Z',
 'fuel_type': 'petrol',
 'id': '20f34d32-8732-5ac7-bc19-fee7aa3e5a03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE92414',
 'listing': 'auction',
 'location': 'DE, Wolfsburg',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 176876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_91218418c5813dfa2f4ddaf1871c804c.jpg',
                'https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_4d5eb43be23502796f147e80b2407397.jpg',
                'https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_2df1ad1e705b5cc88c3c7e3cf7a4692e.jpg',
                'https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_b073cc675a4319fd135023cb6d127a2d.jpg',
                'https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_87f88eaa544caa76b461b5f80c0232d0.jpg',
                'https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_94c8aa6f093bf6eaa259fc76f9066e47.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20f34d32-8732-5ac7-bc19-fee7aa3e5a03/20f34d32-8732-5ac7-bc19-fee7aa3e5a03_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_91218418c5813dfa2f4ddaf1871c804c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20f34d32-8732-5ac7-bc19-fee7aa3e5a03/20f34d32-8732-5ac7-bc19-fee7aa3e5a03_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_4d5eb43be23502796f147e80b2407397.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20f34d32-8732-5ac7-bc19-fee7aa3e5a03/20f34d32-8732-5ac7-bc19-fee7aa3e5a03_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_2df1ad1e705b5cc88c3c7e3cf7a4692e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20f34d32-8732-5ac7-bc19-fee7aa3e5a03/20f34d32-8732-5ac7-bc19-fee7aa3e5a03_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_b073cc675a4319fd135023cb6d127a2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20f34d32-8732-5ac7-bc19-fee7aa3e5a03/20f34d32-8732-5ac7-bc19-fee7aa3e5a03_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_87f88eaa544caa76b461b5f80c0232d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20f34d32-8732-5ac7-bc19-fee7aa3e5a03/20f34d32-8732-5ac7-bc19-fee7aa3e5a03_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/1a/6c1a4dadff1210615a9d7cfab2476ab7/pa/KE92414_94c8aa6f093bf6eaa259fc76f9066e47.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE92414%27 HTTP/1.1" 200 None
2026-03-30 10:39:02 [auto1.de] INFO: Saving data for KE92414: {'created_time': 1774867142.460501, 'last_price_update_time': 1774867142.460514, 'auction_closing_time': 1774972016.0}
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE92414') HTTP/1.1" 204 0
2026-03-30 10:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_dc098c340e2a32a7d1b55159441e7416.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_673a260df91c374616a69234423eab57.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_673a260df91c374616a69234423eab57.jpg not downloaded yet
2026-03-30 10:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_c6fb0bc9cce4837d73f69507ef4acff0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_9f10be1d106328d2fb8c44ee7ce994dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_8eb3c796aed0483c306d44506979cf4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_466380d8636619d9868d2bb064584e94.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_466380d8636619d9868d2bb064584e94.jpg not downloaded yet
2026-03-30 10:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZF52635> (referer: https://www.auto1.com/v1/car-details-view/ZF52635/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE73784> (referer: https://www.auto1.com/v1/car-details-view/CE73784/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_943a019c2f2c003670cb929274f13abb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_0496f6fe469f578c39b94171c53e3bfe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_d9a53676bc658024545b95e1649bbed2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_d9a53676bc658024545b95e1649bbed2.jpg not downloaded yet
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d9f090>
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_c6fb93b074d211fd82f44b000ef381cf.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_c6fb93b074d211fd82f44b000ef381cf.jpg saved to cache
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b65765a-a484-5ecb-98ad-91f80b7c5faf
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5982e50>
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_76db4a92fe8e474fac5015ec9c9a1574.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_76db4a92fe8e474fac5015ec9c9a1574.jpg saved to cache
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b65765a-a484-5ecb-98ad-91f80b7c5faf
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0f810>
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_e6e401008be2e28727b3d78c66fd54ad.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_e6e401008be2e28727b3d78c66fd54ad.jpg saved to cache
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a95bd0>
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_90cbc73bd1d8db6350730bba86aff69d.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_90cbc73bd1d8db6350730bba86aff69d.jpg saved to cache
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab0f4314-5b6e-5522-90bb-ad206ecb1ea5
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d823d0>
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_b4a37a3aa7728a1a4abb7f0cd019706c.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_b4a37a3aa7728a1a4abb7f0cd019706c.jpg saved to cache
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab0f4314-5b6e-5522-90bb-ad206ecb1ea5
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5983490>
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_509b4f202c6c85a7fa77f3c4541d483a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_509b4f202c6c85a7fa77f3c4541d483a.jpg saved to cache
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e7da90>
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_c21bb3c83f85c4c6b4a475ab063aabaf.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_c21bb3c83f85c4c6b4a475ab063aabaf.jpg saved to cache
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab0f4314-5b6e-5522-90bb-ad206ecb1ea5
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_4cfa4d04e1bf743edb11401b745444ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_4cfa4d04e1bf743edb11401b745444ae.jpg not downloaded yet
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_d86fc3cceeb13e21598b049038667484.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_d86fc3cceeb13e21598b049038667484.jpg not downloaded yet
2026-03-30 10:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_46100de731edc4451e20491bbd586d39.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a8e050>
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_dc098c340e2a32a7d1b55159441e7416.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_dc098c340e2a32a7d1b55159441e7416.jpg saved to cache
2026-03-30 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b65765a-a484-5ecb-98ad-91f80b7c5faf
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50a43d0>
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_c6fb0bc9cce4837d73f69507ef4acff0.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_c6fb0bc9cce4837d73f69507ef4acff0.jpg saved to cache
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b65765a-a484-5ecb-98ad-91f80b7c5faf
2026-03-30 10:39:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50a5450>
2026-03-30 10:39:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_9f10be1d106328d2fb8c44ee7ce994dc.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_9f10be1d106328d2fb8c44ee7ce994dc.jpg saved to cache
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-30 10:39:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f15550>
2026-03-30 10:39:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_8eb3c796aed0483c306d44506979cf4f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_8eb3c796aed0483c306d44506979cf4f.jpg saved to cache
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc45f626-cdf6-56dd-89cd-f70aae21339a
2026-03-30 10:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b with identifier: ZF52635
2026-03-30 10:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b with scrape type 1
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_5d05431e3e6e947891f00b690161e26a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_5d05431e3e6e947891f00b690161e26a.jpg not downloaded yet
2026-03-30 10:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f30d8966-62bd-5c38-8461-0dcc146ce251 with identifier: CE73784
2026-03-30 10:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f30d8966-62bd-5c38-8461-0dcc146ce251 with scrape type 1
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f30d8966-62bd-5c38-8461-0dcc146ce251
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_accb86575d89a2757a6f817a07abd3ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_accb86575d89a2757a6f817a07abd3ef.jpg not downloaded yet
2026-03-30 10:39:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5995310>
2026-03-30 10:39:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309147b4-3534-5e02-9387-a17cf2d5194b/309147b4-3534-5e02-9387-a17cf2d5194b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F70%252Fb4702100d6714a3a36934d98170f1414%252Fpa%252FCN97004_943a019c2f2c003670cb929274f13abb.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_943a019c2f2c003670cb929274f13abb.jpg saved to cache
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 309147b4-3534-5e02-9387-a17cf2d5194b
2026-03-30 10:39:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 309147b4-3534-5e02-9387-a17cf2d5194b, skipping ID generation
2026-03-30 10:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 309147b4-3534-5e02-9387-a17cf2d5194b with scrape type 1
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 309147b4-3534-5e02-9387-a17cf2d5194b sending to next pipeline
2026-03-30 10:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 309147b4-3534-5e02-9387-a17cf2d5194b, identifier: CN97004
2026-03-30 10:39:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e60410>
2026-03-30 10:39:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_0496f6fe469f578c39b94171c53e3bfe.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_0496f6fe469f578c39b94171c53e3bfe.jpg saved to cache
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab0f4314-5b6e-5522-90bb-ad206ecb1ea5
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_20e0a910bebf80634acca5349dfdf8fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_20e0a910bebf80634acca5349dfdf8fe.jpg not downloaded yet
2026-03-30 10:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 309147b4-3534-5e02-9387-a17cf2d5194b with identifier: CN97004
2026-03-30 10:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 309147b4-3534-5e02-9387-a17cf2d5194b with identifier: CN97004
2026-03-30 10:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 309147b4-3534-5e02-9387-a17cf2d5194b with identifier: CN97004 to the API
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_943a019c2f2c003670cb929274f13abb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:33:57Z',
 'fuel_type': 'petrol',
 'id': '309147b4-3534-5e02-9387-a17cf2d5194b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN97004',
 'listing': 'auction',
 'location': 'DE, Rostock',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 151595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309147b4-3534-5e02-9387-a17cf2d5194b/309147b4-3534-5e02-9387-a17cf2d5194b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_943a019c2f2c003670cb929274f13abb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309147b4-3534-5e02-9387-a17cf2d5194b/309147b4-3534-5e02-9387-a17cf2d5194b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_f0317ed3b6feb82dba796e783f063d22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309147b4-3534-5e02-9387-a17cf2d5194b/309147b4-3534-5e02-9387-a17cf2d5194b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_61d76f7397ab942af4a2314e0105c809.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309147b4-3534-5e02-9387-a17cf2d5194b/309147b4-3534-5e02-9387-a17cf2d5194b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_9c53f32853504e7fe261b105cf7efb7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309147b4-3534-5e02-9387-a17cf2d5194b/309147b4-3534-5e02-9387-a17cf2d5194b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/70/b4702100d6714a3a36934d98170f1414/pa/CN97004_b0961a3a648d0f2a1a8b12d37421dc79.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2006}
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN97004%27 HTTP/1.1" 200 None
2026-03-30 10:39:03 [auto1.de] INFO: Saving data for CN97004: {'created_time': 1774867143.938472, 'last_price_update_time': 1774867143.938485, 'auction_closing_time': 1774971237.0}
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN97004') HTTP/1.1" 204 0
2026-03-30 10:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_36a7072f7515b3a53f549a59ff6ab8be.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_69619642e098b630cb62364a086a24aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_e74d4cc3812a224e88f7d48bd0b60360.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_9f0ff9714f6e492d5500e6e7762e00c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_9f0ff9714f6e492d5500e6e7762e00c7.jpg not downloaded yet
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_878f62c97a49ead79307843455073720.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_878f62c97a49ead79307843455073720.jpg not downloaded yet
2026-03-30 10:39:04 [scrapy.extensions.logstats] INFO: Crawled 168 pages (at 70 pages/min), scraped 122 items (at 49 items/min)
2026-03-30 10:39:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_5d540337f2f26ab86d05e211344afe63.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_5d540337f2f26ab86d05e211344afe63.jpg not downloaded yet
2026-03-30 10:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JX90545> (referer: https://www.auto1.com/v1/car-details-view/JX90545/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE36706> (referer: https://www.auto1.com/v1/car-details-view/ZE36706/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e4d190>
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_46100de731edc4451e20491bbd586d39.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_46100de731edc4451e20491bbd586d39.jpg saved to cache
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-30 10:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_5d0f383bfb95abedf5569005459343b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_201a868f373b5844ac443c09d5335195.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_201a868f373b5844ac443c09d5335195.jpg not downloaded yet
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_6228948af69074f0603e48426704e3c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_6228948af69074f0603e48426704e3c8.jpg not downloaded yet
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_55f55620d71c8978f956e721c0a7a5b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_55f55620d71c8978f956e721c0a7a5b1.jpg not downloaded yet
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_59cac047658e1307abd4ef4e94e6351a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_59cac047658e1307abd4ef4e94e6351a.jpg not downloaded yet
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_9a1ca051e68fc778c4473793185e88eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_9a1ca051e68fc778c4473793185e88eb.jpg not downloaded yet
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c54ed0>
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_36a7072f7515b3a53f549a59ff6ab8be.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_36a7072f7515b3a53f549a59ff6ab8be.jpg saved to cache
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b65765a-a484-5ecb-98ad-91f80b7c5faf
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508d350>
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_69619642e098b630cb62364a086a24aa.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_69619642e098b630cb62364a086a24aa.jpg saved to cache
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc45f626-cdf6-56dd-89cd-f70aae21339a
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508ddd0>
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_e74d4cc3812a224e88f7d48bd0b60360.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_e74d4cc3812a224e88f7d48bd0b60360.jpg saved to cache
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b65765a-a484-5ecb-98ad-91f80b7c5faf
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_ae59cf9cd58adb925671248a50a81977.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_ae59cf9cd58adb925671248a50a81977.jpg not downloaded yet
2026-03-30 10:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_4cfa4d04e1bf743edb11401b745444ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_7ee9f4eb120c26caf0108e79ff3d3796.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_7ee9f4eb120c26caf0108e79ff3d3796.jpg not downloaded yet
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_5b4dfd31701c488816a75551b93f4824.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_5b4dfd31701c488816a75551b93f4824.jpg not downloaded yet
2026-03-30 10:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e642998b-3b96-59b8-9627-ae1fb2293119 with identifier: JX90545
2026-03-30 10:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e642998b-3b96-59b8-9627-ae1fb2293119 with scrape type 1
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e642998b-3b96-59b8-9627-ae1fb2293119
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_f7ffa703969c98bad6c468cb83c1a44f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_f7ffa703969c98bad6c468cb83c1a44f.jpg not downloaded yet
2026-03-30 10:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 855449ff-f862-5943-bb66-e13e78152f49 with identifier: ZE36706
2026-03-30 10:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 855449ff-f862-5943-bb66-e13e78152f49 with scrape type 1
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 855449ff-f862-5943-bb66-e13e78152f49
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F38%252F35380940d7bebafff0945c1054921f58%252Fpa%252FZE36706_ed5cb68adaadda125c7dd7fd8a23d2f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_ed5cb68adaadda125c7dd7fd8a23d2f6.jpg already downloaded
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F38%252F35380940d7bebafff0945c1054921f58%252Fpa%252FZE36706_743127243d087c9a2f595956790a1c4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_743127243d087c9a2f595956790a1c4f.jpg already downloaded
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F38%252F35380940d7bebafff0945c1054921f58%252Fpa%252FZE36706_f955e57228c42ffbdce8f2ba6e82a8a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_f955e57228c42ffbdce8f2ba6e82a8a1.jpg already downloaded
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F38%252F35380940d7bebafff0945c1054921f58%252Fpa%252FZE36706_e3d79016c7eec8cdcd8e6397d38a63d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_e3d79016c7eec8cdcd8e6397d38a63d6.jpg already downloaded
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F38%252F35380940d7bebafff0945c1054921f58%252Fpa%252FZE36706_326d10bc428361b0638a0bb8e71721ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_326d10bc428361b0638a0bb8e71721ee.jpg already downloaded
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F38%252F35380940d7bebafff0945c1054921f58%252Fpa%252FZE36706_24a374c04aa817b95eb2b738725db180.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_24a374c04aa817b95eb2b738725db180.jpg already downloaded
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F38%252F35380940d7bebafff0945c1054921f58%252Fpa%252FZE36706_e453e9f8ec635a33b08090554f1f94ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_e453e9f8ec635a33b08090554f1f94ad.jpg already downloaded
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F38%252F35380940d7bebafff0945c1054921f58%252Fpa%252FZE36706_8c3a2625d95dbb029530db65776de94c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_8c3a2625d95dbb029530db65776de94c.jpg already downloaded
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F38%252F35380940d7bebafff0945c1054921f58%252Fpa%252FZE36706_a12b1d61460c111ad9aac66e73a686f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_a12b1d61460c111ad9aac66e73a686f1.jpg already downloaded
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F38%252F35380940d7bebafff0945c1054921f58%252Fpa%252FZE36706_b9adcbbf65c4cdd28dc16656753328da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_b9adcbbf65c4cdd28dc16656753328da.jpg already downloaded
2026-03-30 10:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 855449ff-f862-5943-bb66-e13e78152f49, identifier: ZE36706
2026-03-30 10:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_20e0a910bebf80634acca5349dfdf8fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_e696bf5cd2168b5fc5d12f5872f08607.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 855449ff-f862-5943-bb66-e13e78152f49 with identifier: ZE36706
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 10:39:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 855449ff-f862-5943-bb66-e13e78152f49 with identifier: ZE36706
2026-03-30 10:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 855449ff-f862-5943-bb66-e13e78152f49 with identifier: ZE36706 to the API
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZE36706>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:55:24Z',
 'fuel_type': 'petrol',
 'id': '855449ff-f862-5943-bb66-e13e78152f49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE36706',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 37724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_ed5cb68adaadda125c7dd7fd8a23d2f6.jpg',
                'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_743127243d087c9a2f595956790a1c4f.jpg',
                'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_f955e57228c42ffbdce8f2ba6e82a8a1.jpg',
                'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_e3d79016c7eec8cdcd8e6397d38a63d6.jpg',
                'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_326d10bc428361b0638a0bb8e71721ee.jpg',
                'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_24a374c04aa817b95eb2b738725db180.jpg',
                'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_e453e9f8ec635a33b08090554f1f94ad.jpg',
                'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_8c3a2625d95dbb029530db65776de94c.jpg',
                'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_a12b1d61460c111ad9aac66e73a686f1.jpg',
                'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_b9adcbbf65c4cdd28dc16656753328da.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_ed5cb68adaadda125c7dd7fd8a23d2f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_743127243d087c9a2f595956790a1c4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_f955e57228c42ffbdce8f2ba6e82a8a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2849812,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_e3d79016c7eec8cdcd8e6397d38a63d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2759608,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_326d10bc428361b0638a0bb8e71721ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2303049,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_24a374c04aa817b95eb2b738725db180.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_e453e9f8ec635a33b08090554f1f94ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2513919,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_8c3a2625d95dbb029530db65776de94c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_a12b1d61460c111ad9aac66e73a686f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855449ff-f862-5943-bb66-e13e78152f49/855449ff-f862-5943-bb66-e13e78152f49_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/38/35380940d7bebafff0945c1054921f58/pa/ZE36706_b9adcbbf65c4cdd28dc16656753328da.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2018}
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE36706%27 HTTP/1.1" 200 None
2026-03-30 10:39:05 [auto1.de] INFO: Saving data for ZE36706: {'created_time': 1774867145.316643, 'last_price_update_time': 1774867145.316652, 'auction_closing_time': 1774972524.0}
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE36706') HTTP/1.1" 204 0
2026-03-30 10:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_23d4d19832b7bd449cae104af7112e3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_bea1ce4cb116f197176daad8e590dc95.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_bea1ce4cb116f197176daad8e590dc95.jpg not downloaded yet
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_c6505c72f7e9b34f56dac62652640922.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_c6505c72f7e9b34f56dac62652640922.jpg not downloaded yet
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_a7290bd1d6ab10e7baeeb0ece5f27a15.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_a7290bd1d6ab10e7baeeb0ece5f27a15.jpg not downloaded yet
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb8450>
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a702df90-5f5d-5e44-94b3-42fdb0c4c86f/a702df90-5f5d-5e44-94b3-42fdb0c4c86f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fbc%252Fb1bcb655307f1aa2f00e4105a4db7be0%252Fpa%252FXJ52167_5d0f383bfb95abedf5569005459343b9.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_5d0f383bfb95abedf5569005459343b9.jpg saved to cache
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a702df90-5f5d-5e44-94b3-42fdb0c4c86f
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b36b90>
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_4cfa4d04e1bf743edb11401b745444ae.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_4cfa4d04e1bf743edb11401b745444ae.jpg saved to cache
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b65765a-a484-5ecb-98ad-91f80b7c5faf
2026-03-30 10:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_accb86575d89a2757a6f817a07abd3ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_015d8a83489586f624e0872f1dc7063c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_015d8a83489586f624e0872f1dc7063c.jpg not downloaded yet
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_4b4e52b74c980f6a38f3d0d8d6db0086.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_4b4e52b74c980f6a38f3d0d8d6db0086.jpg not downloaded yet
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_2106bbfe407f87ab34304fe8495f6552.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_2106bbfe407f87ab34304fe8495f6552.jpg not downloaded yet
2026-03-30 10:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_878f62c97a49ead79307843455073720.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_5d05431e3e6e947891f00b690161e26a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c445d0>
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_20e0a910bebf80634acca5349dfdf8fe.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_20e0a910bebf80634acca5349dfdf8fe.jpg saved to cache
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc45f626-cdf6-56dd-89cd-f70aae21339a
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f46c50>
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F30%252F0a301dd60f5ee3487c92770b38999002%252Fpa%252FWR86170_e696bf5cd2168b5fc5d12f5872f08607.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_e696bf5cd2168b5fc5d12f5872f08607.jpg saved to cache
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-30 10:39:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 975e6ac5-250d-5bb6-8ecf-3308799273a7, skipping ID generation
2026-03-30 10:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 975e6ac5-250d-5bb6-8ecf-3308799273a7 with scrape type 1
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 975e6ac5-250d-5bb6-8ecf-3308799273a7 sending to next pipeline
2026-03-30 10:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 975e6ac5-250d-5bb6-8ecf-3308799273a7, identifier: WR86170
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_74a934ed417d40bef497c34a203e96bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_74a934ed417d40bef497c34a203e96bb.jpg not downloaded yet
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_6f37827049a5636730d48cdb852244f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_6f37827049a5636730d48cdb852244f8.jpg not downloaded yet
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_228afec2cc85b09c7dcf7cd240d69038.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_228afec2cc85b09c7dcf7cd240d69038.jpg not downloaded yet
2026-03-30 10:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: WR86170
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:39:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 10:39:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: WR86170
2026-03-30 10:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: WR86170 to the API
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_e696bf5cd2168b5fc5d12f5872f08607.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:39:04Z',
 'fuel_type': 'electro',
 'id': '975e6ac5-250d-5bb6-8ecf-3308799273a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR86170',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 9,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_6dfee0b9bb45cfc932f5b1f4ce587db9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_e696bf5cd2168b5fc5d12f5872f08607.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_46100de731edc4451e20491bbd586d39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_7f4b2a862ea2445fd930dae36c2301d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_260f1c318c2f6efa8fc7c2733b36f290.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_65b5143f591a58e199e26d633ba2afc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_22a8c6d06f9298eafbb184c832e7009f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_9f10be1d106328d2fb8c44ee7ce994dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_509b4f202c6c85a7fa77f3c4541d483a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/30/0a301dd60f5ee3487c92770b38999002/pa/WR86170_e6e401008be2e28727b3d78c66fd54ad.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR86170%27 HTTP/1.1" 200 None
2026-03-30 10:39:06 [auto1.de] INFO: Saving data for WR86170: {'created_time': 1774867146.456382, 'last_price_update_time': 1774867146.456392, 'auction_closing_time': 1774971544.0}
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR86170') HTTP/1.1" 204 0
2026-03-30 10:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e27d50>
2026-03-30 10:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fdc%252Faedcb5a8ad4b6778c71a280558a8d033%252Fpa%252FRL84583_23d4d19832b7bd449cae104af7112e3f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_23d4d19832b7bd449cae104af7112e3f.jpg saved to cache
2026-03-30 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab0f4314-5b6e-5522-90bb-ad206ecb1ea5
2026-03-30 10:39:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab0f4314-5b6e-5522-90bb-ad206ecb1ea5, skipping ID generation
2026-03-30 10:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab0f4314-5b6e-5522-90bb-ad206ecb1ea5 with scrape type 1
2026-03-30 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab0f4314-5b6e-5522-90bb-ad206ecb1ea5 sending to next pipeline
2026-03-30 10:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab0f4314-5b6e-5522-90bb-ad206ecb1ea5, identifier: RL84583
2026-03-30 10:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_d86fc3cceeb13e21598b049038667484.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab0f4314-5b6e-5522-90bb-ad206ecb1ea5 with identifier: RL84583
2026-03-30 10:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab0f4314-5b6e-5522-90bb-ad206ecb1ea5 with identifier: RL84583
2026-03-30 10:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab0f4314-5b6e-5522-90bb-ad206ecb1ea5 with identifier: RL84583 to the API
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_23d4d19832b7bd449cae104af7112e3f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:06:23Z',
 'fuel_type': 'diesel',
 'id': 'ab0f4314-5b6e-5522-90bb-ad206ecb1ea5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL84583',
 'listing': 'auction',
 'location': 'DE, Mitterteich',
 'make': 'BMW',
 'model': '3er',
 'odometer': 262194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_857d9ebc72ac7960bfd25f47aafd4f1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_23d4d19832b7bd449cae104af7112e3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_0496f6fe469f578c39b94171c53e3bfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_0420173d68051b5e0b97462c4679a970.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_1424a9bb11c6f0047269911bb707025d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_d47f5b9d283b0c7fe2eb4859b32a2dd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_5a923eb51379d17314b96c25c720fd63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_c21bb3c83f85c4c6b4a475ab063aabaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_b4a37a3aa7728a1a4abb7f0cd019706c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0f4314-5b6e-5522-90bb-ad206ecb1ea5/ab0f4314-5b6e-5522-90bb-ad206ecb1ea5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/dc/aedcb5a8ad4b6778c71a280558a8d033/pa/RL84583_90cbc73bd1d8db6350730bba86aff69d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 330d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-30 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL84583%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [auto1.de] INFO: Saving data for RL84583: {'created_time': 1774867147.008427, 'last_price_update_time': 1774867147.008438, 'auction_closing_time': 1774969583.0}
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL84583') HTTP/1.1" 204 0
2026-03-30 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_ae59cf9cd58adb925671248a50a81977.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_9a1ca051e68fc778c4473793185e88eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_9f0ff9714f6e492d5500e6e7762e00c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_2595811f637ec48c66fda1de69c9a947.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_2595811f637ec48c66fda1de69c9a947.jpg not downloaded yet
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_8dd6350f92c015f1338cd83e221f05d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_8dd6350f92c015f1338cd83e221f05d2.jpg not downloaded yet
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_d8d801b2c6b00f3e2b6144b1702347ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_d8d801b2c6b00f3e2b6144b1702347ce.jpg not downloaded yet
2026-03-30 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS99477> (referer: https://www.auto1.com/v1/car-details-view/FS99477/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5127750>
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_accb86575d89a2757a6f817a07abd3ef.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_accb86575d89a2757a6f817a07abd3ef.jpg saved to cache
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f30d8966-62bd-5c38-8461-0dcc146ce251
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb6950>
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_878f62c97a49ead79307843455073720.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_878f62c97a49ead79307843455073720.jpg saved to cache
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f30d8966-62bd-5c38-8461-0dcc146ce251
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b20a10>
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_5d05431e3e6e947891f00b690161e26a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_5d05431e3e6e947891f00b690161e26a.jpg saved to cache
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_28f8bd05094a4458e096ab3086fbbffb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_28f8bd05094a4458e096ab3086fbbffb.jpg not downloaded yet
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_0f926976a01fbe793db79387dbdcb910.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_0f926976a01fbe793db79387dbdcb910.jpg not downloaded yet
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_724616b954f7eeba5216b5b0e88c11f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_724616b954f7eeba5216b5b0e88c11f2.jpg not downloaded yet
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50512d0>
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_d86fc3cceeb13e21598b049038667484.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_d86fc3cceeb13e21598b049038667484.jpg saved to cache
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc45f626-cdf6-56dd-89cd-f70aae21339a
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_35153ed78161fd10a3f74e6dadb5de05.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_35153ed78161fd10a3f74e6dadb5de05.jpg not downloaded yet
2026-03-30 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_f7ffa703969c98bad6c468cb83c1a44f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b30f10>
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_ae59cf9cd58adb925671248a50a81977.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_ae59cf9cd58adb925671248a50a81977.jpg saved to cache
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc45f626-cdf6-56dd-89cd-f70aae21339a
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a26a10>
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_9a1ca051e68fc778c4473793185e88eb.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_9a1ca051e68fc778c4473793185e88eb.jpg saved to cache
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f30d8966-62bd-5c38-8461-0dcc146ce251
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e9c210>
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_9f0ff9714f6e492d5500e6e7762e00c7.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_9f0ff9714f6e492d5500e6e7762e00c7.jpg saved to cache
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b
2026-03-30 10:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4443487d-cda1-5246-baad-f41927620895 with identifier: FS99477
2026-03-30 10:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4443487d-cda1-5246-baad-f41927620895 with scrape type 1
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4443487d-cda1-5246-baad-f41927620895
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_091e27c0583eeffb8c5d4038a36ff513.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_091e27c0583eeffb8c5d4038a36ff513.jpg not downloaded yet
2026-03-30 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_c6505c72f7e9b34f56dac62652640922.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_9ce07b96e1fde88ecce0894a486db453.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_9ce07b96e1fde88ecce0894a486db453.jpg not downloaded yet
2026-03-30 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_59cac047658e1307abd4ef4e94e6351a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_a7290bd1d6ab10e7baeeb0ece5f27a15.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_9eef29177ea30b57c36ecd40c2d55468.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_9eef29177ea30b57c36ecd40c2d55468.jpg not downloaded yet
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_cf400361c1adcef07034c3384def5cca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_cf400361c1adcef07034c3384def5cca.jpg not downloaded yet
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50a5710>
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_f7ffa703969c98bad6c468cb83c1a44f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_f7ffa703969c98bad6c468cb83c1a44f.jpg saved to cache
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e642998b-3b96-59b8-9627-ae1fb2293119
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_3f8c565e2684769a496c299804e231d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_3f8c565e2684769a496c299804e231d3.jpg not downloaded yet
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_545a36d4f98109f66553e115b0863d51.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_545a36d4f98109f66553e115b0863d51.jpg not downloaded yet
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_5e3a57d0f1df7565de1b5387430472a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_5e3a57d0f1df7565de1b5387430472a9.jpg not downloaded yet
2026-03-30 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_bea1ce4cb116f197176daad8e590dc95.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_6f37827049a5636730d48cdb852244f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_54a84e18d51d4aee78ae4b574a40d3c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_54a84e18d51d4aee78ae4b574a40d3c4.jpg not downloaded yet
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b23d0>
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_c6505c72f7e9b34f56dac62652640922.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_c6505c72f7e9b34f56dac62652640922.jpg saved to cache
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f30d8966-62bd-5c38-8461-0dcc146ce251
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e08a50>
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_59cac047658e1307abd4ef4e94e6351a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_59cac047658e1307abd4ef4e94e6351a.jpg saved to cache
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef503fdd0>
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_a7290bd1d6ab10e7baeeb0ece5f27a15.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_a7290bd1d6ab10e7baeeb0ece5f27a15.jpg saved to cache
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e642998b-3b96-59b8-9627-ae1fb2293119
2026-03-30 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_8d7e07e6786050649bdfaefdb4af03c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_f71990fc41c0c229a3b6cf5202ab45b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_f71990fc41c0c229a3b6cf5202ab45b3.jpg not downloaded yet
2026-03-30 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_74a934ed417d40bef497c34a203e96bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_228afec2cc85b09c7dcf7cd240d69038.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_7ddfefb876881c27cfd4cf2772e1e12d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_7ddfefb876881c27cfd4cf2772e1e12d.jpg not downloaded yet
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a24890>
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_bea1ce4cb116f197176daad8e590dc95.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_bea1ce4cb116f197176daad8e590dc95.jpg saved to cache
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef505ec50>
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_6f37827049a5636730d48cdb852244f8.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_6f37827049a5636730d48cdb852244f8.jpg saved to cache
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f30d8966-62bd-5c38-8461-0dcc146ce251
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_e3ffdefb062849fde176b6b059a710a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_4e2273ea80e11721a23824a018d6a2dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_4e2273ea80e11721a23824a018d6a2dd.jpg not downloaded yet
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_091e27c0583eeffb8c5d4038a36ff513.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_d8d801b2c6b00f3e2b6144b1702347ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_2106bbfe407f87ab34304fe8495f6552.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_c07142bf33879720ed01e3d2cdfda594.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_c07142bf33879720ed01e3d2cdfda594.jpg not downloaded yet
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_dd9a28aec4bc48a4f96413ce1cdd5a5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_dd9a28aec4bc48a4f96413ce1cdd5a5a.jpg not downloaded yet
2026-03-30 10:39:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e8abd0>
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_8d7e07e6786050649bdfaefdb4af03c8.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_8d7e07e6786050649bdfaefdb4af03c8.jpg saved to cache
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b65765a-a484-5ecb-98ad-91f80b7c5faf
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a95fd0>
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_74a934ed417d40bef497c34a203e96bb.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_74a934ed417d40bef497c34a203e96bb.jpg saved to cache
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e23c50>
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_228afec2cc85b09c7dcf7cd240d69038.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_228afec2cc85b09c7dcf7cd240d69038.jpg saved to cache
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e642998b-3b96-59b8-9627-ae1fb2293119
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_0f926976a01fbe793db79387dbdcb910.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_54a84e18d51d4aee78ae4b574a40d3c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_5e3a57d0f1df7565de1b5387430472a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_35153ed78161fd10a3f74e6dadb5de05.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_545a36d4f98109f66553e115b0863d51.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0af50>
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_e3ffdefb062849fde176b6b059a710a4.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_e3ffdefb062849fde176b6b059a710a4.jpg saved to cache
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b65765a-a484-5ecb-98ad-91f80b7c5faf
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a30110>
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_091e27c0583eeffb8c5d4038a36ff513.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_091e27c0583eeffb8c5d4038a36ff513.jpg saved to cache
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4443487d-cda1-5246-baad-f41927620895
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f0a10>
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_d8d801b2c6b00f3e2b6144b1702347ce.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_d8d801b2c6b00f3e2b6144b1702347ce.jpg saved to cache
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e642998b-3b96-59b8-9627-ae1fb2293119
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef500a610>
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_2106bbfe407f87ab34304fe8495f6552.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_2106bbfe407f87ab34304fe8495f6552.jpg saved to cache
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e642998b-3b96-59b8-9627-ae1fb2293119
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_3f8c565e2684769a496c299804e231d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_cf400361c1adcef07034c3384def5cca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5996790>
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_0f926976a01fbe793db79387dbdcb910.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_0f926976a01fbe793db79387dbdcb910.jpg saved to cache
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f30d8966-62bd-5c38-8461-0dcc146ce251
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee2310>
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_54a84e18d51d4aee78ae4b574a40d3c4.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_54a84e18d51d4aee78ae4b574a40d3c4.jpg saved to cache
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4443487d-cda1-5246-baad-f41927620895
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b29c90>
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_5e3a57d0f1df7565de1b5387430472a9.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_5e3a57d0f1df7565de1b5387430472a9.jpg saved to cache
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4443487d-cda1-5246-baad-f41927620895
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef599dfd0>
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_35153ed78161fd10a3f74e6dadb5de05.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_35153ed78161fd10a3f74e6dadb5de05.jpg saved to cache
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e642998b-3b96-59b8-9627-ae1fb2293119
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b2bcd0>
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_545a36d4f98109f66553e115b0863d51.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_545a36d4f98109f66553e115b0863d51.jpg saved to cache
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e642998b-3b96-59b8-9627-ae1fb2293119
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_16f05dfc8612d7a8453da7b6f23b6955.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_673a260df91c374616a69234423eab57.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_dd9a28aec4bc48a4f96413ce1cdd5a5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_4e2273ea80e11721a23824a018d6a2dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_c07142bf33879720ed01e3d2cdfda594.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db9790>
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_3f8c565e2684769a496c299804e231d3.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_3f8c565e2684769a496c299804e231d3.jpg saved to cache
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4443487d-cda1-5246-baad-f41927620895
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6fad0>
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_cf400361c1adcef07034c3384def5cca.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_cf400361c1adcef07034c3384def5cca.jpg saved to cache
2026-03-30 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e642998b-3b96-59b8-9627-ae1fb2293119
2026-03-30 10:39:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dba910>
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_16f05dfc8612d7a8453da7b6f23b6955.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_16f05dfc8612d7a8453da7b6f23b6955.jpg saved to cache
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc45f626-cdf6-56dd-89cd-f70aae21339a
2026-03-30 10:39:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e27790>
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_673a260df91c374616a69234423eab57.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_673a260df91c374616a69234423eab57.jpg saved to cache
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc45f626-cdf6-56dd-89cd-f70aae21339a
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8c3d0>
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_dd9a28aec4bc48a4f96413ce1cdd5a5a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_dd9a28aec4bc48a4f96413ce1cdd5a5a.jpg saved to cache
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4443487d-cda1-5246-baad-f41927620895
2026-03-30 10:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_7ddfefb876881c27cfd4cf2772e1e12d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_8dd6350f92c015f1338cd83e221f05d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_f71990fc41c0c229a3b6cf5202ab45b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_2595811f637ec48c66fda1de69c9a947.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_9eef29177ea30b57c36ecd40c2d55468.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_28f8bd05094a4458e096ab3086fbbffb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ddbed0>
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_4e2273ea80e11721a23824a018d6a2dd.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_4e2273ea80e11721a23824a018d6a2dd.jpg saved to cache
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4443487d-cda1-5246-baad-f41927620895
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a206d0>
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_c07142bf33879720ed01e3d2cdfda594.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_c07142bf33879720ed01e3d2cdfda594.jpg saved to cache
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4443487d-cda1-5246-baad-f41927620895
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dec350>
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_7ddfefb876881c27cfd4cf2772e1e12d.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_7ddfefb876881c27cfd4cf2772e1e12d.jpg saved to cache
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4443487d-cda1-5246-baad-f41927620895
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb7350>
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_8dd6350f92c015f1338cd83e221f05d2.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_8dd6350f92c015f1338cd83e221f05d2.jpg saved to cache
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f30d8966-62bd-5c38-8461-0dcc146ce251
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0aa10>
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_f71990fc41c0c229a3b6cf5202ab45b3.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_f71990fc41c0c229a3b6cf5202ab45b3.jpg saved to cache
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4443487d-cda1-5246-baad-f41927620895
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef505d610>
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_2595811f637ec48c66fda1de69c9a947.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_2595811f637ec48c66fda1de69c9a947.jpg saved to cache
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0bf50>
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fb6%252Fa8b6343df47ffe418db4be0c9e140ab7%252Fpa%252FFS99477_9eef29177ea30b57c36ecd40c2d55468.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_9eef29177ea30b57c36ecd40c2d55468.jpg saved to cache
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4443487d-cda1-5246-baad-f41927620895
2026-03-30 10:39:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4443487d-cda1-5246-baad-f41927620895, skipping ID generation
2026-03-30 10:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4443487d-cda1-5246-baad-f41927620895 with scrape type 1
2026-03-30 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4443487d-cda1-5246-baad-f41927620895 sending to next pipeline
2026-03-30 10:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4443487d-cda1-5246-baad-f41927620895, identifier: FS99477
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ddb590>
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_28f8bd05094a4458e096ab3086fbbffb.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_28f8bd05094a4458e096ab3086fbbffb.jpg saved to cache
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b
2026-03-30 10:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4443487d-cda1-5246-baad-f41927620895 with identifier: FS99477
2026-03-30 10:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4443487d-cda1-5246-baad-f41927620895 with identifier: FS99477
2026-03-30 10:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4443487d-cda1-5246-baad-f41927620895 with identifier: FS99477 to the API
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_9eef29177ea30b57c36ecd40c2d55468.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:48:03Z',
 'fuel_type': 'petrol',
 'id': '4443487d-cda1-5246-baad-f41927620895',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS99477',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 46890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_091e27c0583eeffb8c5d4038a36ff513.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_9eef29177ea30b57c36ecd40c2d55468.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_3f8c565e2684769a496c299804e231d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_5e3a57d0f1df7565de1b5387430472a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_54a84e18d51d4aee78ae4b574a40d3c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_f71990fc41c0c229a3b6cf5202ab45b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_7ddfefb876881c27cfd4cf2772e1e12d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_4e2273ea80e11721a23824a018d6a2dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_c07142bf33879720ed01e3d2cdfda594.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4443487d-cda1-5246-baad-f41927620895/4443487d-cda1-5246-baad-f41927620895_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/b6/a8b6343df47ffe418db4be0c9e140ab7/pa/FS99477_dd9a28aec4bc48a4f96413ce1cdd5a5a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS99477%27 HTTP/1.1" 200 None
2026-03-30 10:39:10 [auto1.de] INFO: Saving data for FS99477: {'created_time': 1774867150.431908, 'last_price_update_time': 1774867150.431921, 'auction_closing_time': 1774972083.0}
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS99477') HTTP/1.1" 204 0
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_6228948af69074f0603e48426704e3c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_5b4dfd31701c488816a75551b93f4824.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_015d8a83489586f624e0872f1dc7063c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_7ee9f4eb120c26caf0108e79ff3d3796.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_4b4e52b74c980f6a38f3d0d8d6db0086.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_724616b954f7eeba5216b5b0e88c11f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_9ce07b96e1fde88ecce0894a486db453.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_55f55620d71c8978f956e721c0a7a5b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_cd115c1146ea0341768627f973be0054.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_b95f8483f2132cfd7651984eb91015c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_4b0566f648650d44e4bb3bb44dc79c82.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4df9190>
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_6228948af69074f0603e48426704e3c8.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_6228948af69074f0603e48426704e3c8.jpg saved to cache
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f30d8966-62bd-5c38-8461-0dcc146ce251
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_d9a53676bc658024545b95e1649bbed2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4df21d0>
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_5b4dfd31701c488816a75551b93f4824.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_5b4dfd31701c488816a75551b93f4824.jpg saved to cache
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f30d8966-62bd-5c38-8461-0dcc146ce251
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_fe202b164e08a91626efb39eec77e591.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_5d540337f2f26ab86d05e211344afe63.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_466380d8636619d9868d2bb064584e94.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef596f650>
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_015d8a83489586f624e0872f1dc7063c.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_015d8a83489586f624e0872f1dc7063c.jpg saved to cache
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4df0f10>
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_7ee9f4eb120c26caf0108e79ff3d3796.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_7ee9f4eb120c26caf0108e79ff3d3796.jpg saved to cache
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4df0d10>
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4ad766e08076c07d89b07de8f456add%252Fpa%252FCE73784_4b4e52b74c980f6a38f3d0d8d6db0086.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_4b4e52b74c980f6a38f3d0d8d6db0086.jpg saved to cache
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f30d8966-62bd-5c38-8461-0dcc146ce251
2026-03-30 10:39:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f30d8966-62bd-5c38-8461-0dcc146ce251, skipping ID generation
2026-03-30 10:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f30d8966-62bd-5c38-8461-0dcc146ce251 with scrape type 1
2026-03-30 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f30d8966-62bd-5c38-8461-0dcc146ce251 sending to next pipeline
2026-03-30 10:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f30d8966-62bd-5c38-8461-0dcc146ce251, identifier: CE73784
2026-03-30 10:39:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7c01950>
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_724616b954f7eeba5216b5b0e88c11f2.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_724616b954f7eeba5216b5b0e88c11f2.jpg saved to cache
2026-03-30 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e642998b-3b96-59b8-9627-ae1fb2293119
2026-03-30 10:39:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59670d0>
2026-03-30 10:39:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F4c%252F584c583a50f7d1cdae15feaadd20dd42%252Fpa%252FJX90545_9ce07b96e1fde88ecce0894a486db453.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_9ce07b96e1fde88ecce0894a486db453.jpg saved to cache
2026-03-30 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e642998b-3b96-59b8-9627-ae1fb2293119
2026-03-30 10:39:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e642998b-3b96-59b8-9627-ae1fb2293119, skipping ID generation
2026-03-30 10:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e642998b-3b96-59b8-9627-ae1fb2293119 with scrape type 1
2026-03-30 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e642998b-3b96-59b8-9627-ae1fb2293119 sending to next pipeline
2026-03-30 10:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e642998b-3b96-59b8-9627-ae1fb2293119, identifier: JX90545
2026-03-30 10:39:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4df8390>
2026-03-30 10:39:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_55f55620d71c8978f956e721c0a7a5b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_55f55620d71c8978f956e721c0a7a5b1.jpg saved to cache
2026-03-30 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc45f626-cdf6-56dd-89cd-f70aae21339a
2026-03-30 10:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_201a868f373b5844ac443c09d5335195.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f30d8966-62bd-5c38-8461-0dcc146ce251 with identifier: CE73784
2026-03-30 10:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f30d8966-62bd-5c38-8461-0dcc146ce251 with identifier: CE73784
2026-03-30 10:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f30d8966-62bd-5c38-8461-0dcc146ce251 with identifier: CE73784 to the API
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_4b4e52b74c980f6a38f3d0d8d6db0086.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:57:08Z',
 'fuel_type': 'diesel',
 'id': 'f30d8966-62bd-5c38-8461-0dcc146ce251',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE73784',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 96536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_accb86575d89a2757a6f817a07abd3ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_878f62c97a49ead79307843455073720.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_6228948af69074f0603e48426704e3c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_9a1ca051e68fc778c4473793185e88eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_5b4dfd31701c488816a75551b93f4824.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_c6505c72f7e9b34f56dac62652640922.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_4b4e52b74c980f6a38f3d0d8d6db0086.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_6f37827049a5636730d48cdb852244f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_8dd6350f92c015f1338cd83e221f05d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f30d8966-62bd-5c38-8461-0dcc146ce251/f30d8966-62bd-5c38-8461-0dcc146ce251_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4ad766e08076c07d89b07de8f456add/pa/CE73784_0f926976a01fbe793db79387dbdcb910.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Kasten BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Kasten BlueMotion',
 'year': 2018}
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE73784%27 HTTP/1.1" 200 None
2026-03-30 10:39:11 [auto1.de] INFO: Saving data for CE73784: {'created_time': 1774867151.834946, 'last_price_update_time': 1774867151.834968, 'auction_closing_time': 1774972628.0}
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE73784') HTTP/1.1" 204 0
2026-03-30 10:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e642998b-3b96-59b8-9627-ae1fb2293119 with identifier: JX90545
2026-03-30 10:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e642998b-3b96-59b8-9627-ae1fb2293119 with identifier: JX90545
2026-03-30 10:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e642998b-3b96-59b8-9627-ae1fb2293119 with identifier: JX90545 to the API
2026-03-30 10:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_9ce07b96e1fde88ecce0894a486db453.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:18:02Z',
 'fuel_type': 'electro',
 'id': 'e642998b-3b96-59b8-9627-ae1fb2293119',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX90545',
 'listing': 'auction',
 'location': 'DE, Halle',
 'make': 'Smart',
 'model': '#1',
 'odometer': 5705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_f7ffa703969c98bad6c468cb83c1a44f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_a7290bd1d6ab10e7baeeb0ece5f27a15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_2106bbfe407f87ab34304fe8495f6552.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_228afec2cc85b09c7dcf7cd240d69038.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_d8d801b2c6b00f3e2b6144b1702347ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2572814,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_724616b954f7eeba5216b5b0e88c11f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_35153ed78161fd10a3f74e6dadb5de05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2680318,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_9ce07b96e1fde88ecce0894a486db453.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_cf400361c1adcef07034c3384def5cca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e642998b-3b96-59b8-9627-ae1fb2293119/e642998b-3b96-59b8-9627-ae1fb2293119_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/4c/584c583a50f7d1cdae15feaadd20dd42/pa/JX90545_545a36d4f98109f66553e115b0863d51.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Smart #1 electric drive 200 kW Pro+',
 'transmission': 'automatic',
 'trim': 'Pro+',
 'year': 2024}
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX90545%27 HTTP/1.1" 200 None
2026-03-30 10:39:12 [auto1.de] INFO: Saving data for JX90545: {'created_time': 1774867152.19455, 'last_price_update_time': 1774867152.19456, 'auction_closing_time': 1774970282.0}
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX90545') HTTP/1.1" 204 0
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50091d0>
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_cd115c1146ea0341768627f973be0054.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_cd115c1146ea0341768627f973be0054.jpg saved to cache
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 382db325-3222-5c2d-914a-654d37707f1c
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef505e8d0>
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a702df90-5f5d-5e44-94b3-42fdb0c4c86f/a702df90-5f5d-5e44-94b3-42fdb0c4c86f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fbc%252Fb1bcb655307f1aa2f00e4105a4db7be0%252Fpa%252FXJ52167_b95f8483f2132cfd7651984eb91015c2.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_b95f8483f2132cfd7651984eb91015c2.jpg saved to cache
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a702df90-5f5d-5e44-94b3-42fdb0c4c86f
2026-03-30 10:39:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a702df90-5f5d-5e44-94b3-42fdb0c4c86f, skipping ID generation
2026-03-30 10:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a702df90-5f5d-5e44-94b3-42fdb0c4c86f with scrape type 1
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a702df90-5f5d-5e44-94b3-42fdb0c4c86f sending to next pipeline
2026-03-30 10:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a702df90-5f5d-5e44-94b3-42fdb0c4c86f, identifier: XJ52167
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7ca50>
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_4b0566f648650d44e4bb3bb44dc79c82.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_4b0566f648650d44e4bb3bb44dc79c82.jpg saved to cache
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 382db325-3222-5c2d-914a-654d37707f1c
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ded950>
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_d9a53676bc658024545b95e1649bbed2.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_d9a53676bc658024545b95e1649bbed2.jpg saved to cache
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc45f626-cdf6-56dd-89cd-f70aae21339a
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e08f10>
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fd9%252Febd903308f031ec89963c8d0582748af%252Fpa%252FVP88886_fe202b164e08a91626efb39eec77e591.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_fe202b164e08a91626efb39eec77e591.jpg saved to cache
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 382db325-3222-5c2d-914a-654d37707f1c
2026-03-30 10:39:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 382db325-3222-5c2d-914a-654d37707f1c, skipping ID generation
2026-03-30 10:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 382db325-3222-5c2d-914a-654d37707f1c with scrape type 1
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 382db325-3222-5c2d-914a-654d37707f1c sending to next pipeline
2026-03-30 10:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 382db325-3222-5c2d-914a-654d37707f1c, identifier: VP88886
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e70190>
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb1%252F60b11bb1425951f8eb6b7bc5ff18de01%252Fpa%252FCM52893_5d540337f2f26ab86d05e211344afe63.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_5d540337f2f26ab86d05e211344afe63.jpg saved to cache
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc45f626-cdf6-56dd-89cd-f70aae21339a
2026-03-30 10:39:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc45f626-cdf6-56dd-89cd-f70aae21339a, skipping ID generation
2026-03-30 10:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc45f626-cdf6-56dd-89cd-f70aae21339a with scrape type 1
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc45f626-cdf6-56dd-89cd-f70aae21339a sending to next pipeline
2026-03-30 10:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc45f626-cdf6-56dd-89cd-f70aae21339a, identifier: CM52893
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7931190>
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F533705fa593b972498d1cb164f0ed2e8%252Fpa%252FWY58747_466380d8636619d9868d2bb064584e94.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_466380d8636619d9868d2bb064584e94.jpg saved to cache
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b65765a-a484-5ecb-98ad-91f80b7c5faf
2026-03-30 10:39:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b65765a-a484-5ecb-98ad-91f80b7c5faf, skipping ID generation
2026-03-30 10:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b65765a-a484-5ecb-98ad-91f80b7c5faf with scrape type 1
2026-03-30 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b65765a-a484-5ecb-98ad-91f80b7c5faf sending to next pipeline
2026-03-30 10:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b65765a-a484-5ecb-98ad-91f80b7c5faf, identifier: WY58747
2026-03-30 10:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a702df90-5f5d-5e44-94b3-42fdb0c4c86f with identifier: XJ52167
2026-03-30 10:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a702df90-5f5d-5e44-94b3-42fdb0c4c86f with identifier: XJ52167
2026-03-30 10:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a702df90-5f5d-5e44-94b3-42fdb0c4c86f with identifier: XJ52167 to the API
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_b95f8483f2132cfd7651984eb91015c2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 2',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:31:00Z',
 'fuel_type': 'petrol',
 'id': 'a702df90-5f5d-5e44-94b3-42fdb0c4c86f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ52167',
 'listing': 'auction',
 'location': 'DE, Ludwigshafen am Rhein',
 'make': 'Volkswagen',
 'model': 'Golf III',
 'odometer': 236605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a702df90-5f5d-5e44-94b3-42fdb0c4c86f/a702df90-5f5d-5e44-94b3-42fdb0c4c86f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_d654eee60f57a35ace6b5f6931bd66f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a702df90-5f5d-5e44-94b3-42fdb0c4c86f/a702df90-5f5d-5e44-94b3-42fdb0c4c86f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_b95f8483f2132cfd7651984eb91015c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a702df90-5f5d-5e44-94b3-42fdb0c4c86f/a702df90-5f5d-5e44-94b3-42fdb0c4c86f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_5d0f383bfb95abedf5569005459343b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a702df90-5f5d-5e44-94b3-42fdb0c4c86f/a702df90-5f5d-5e44-94b3-42fdb0c4c86f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_a2fafc419ef4b73cde859e8508cae0ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a702df90-5f5d-5e44-94b3-42fdb0c4c86f/a702df90-5f5d-5e44-94b3-42fdb0c4c86f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/bc/b1bcb655307f1aa2f00e4105a4db7be0/pa/XJ52167_ecbec9708527d8ad1314647661c4bd01.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1996-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf III 1.6 Europe',
 'transmission': 'automatic',
 'trim': 'Europe',
 'year': 1996}
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ52167%27 HTTP/1.1" 200 None
2026-03-30 10:39:13 [auto1.de] INFO: Saving data for XJ52167: {'created_time': 1774867153.448245, 'last_price_update_time': 1774867153.448257, 'auction_closing_time': 1774971060.0}
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ52167') HTTP/1.1" 204 0
2026-03-30 10:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 382db325-3222-5c2d-914a-654d37707f1c with identifier: VP88886
2026-03-30 10:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 382db325-3222-5c2d-914a-654d37707f1c with identifier: VP88886
2026-03-30 10:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 382db325-3222-5c2d-914a-654d37707f1c with identifier: VP88886 to the API
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_fe202b164e08a91626efb39eec77e591.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:40:02Z',
 'fuel_type': 'electro',
 'id': '382db325-3222-5c2d-914a-654d37707f1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP88886',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 43376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_fe202b164e08a91626efb39eec77e591.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_d3f760ec655098a9f39a116c3f4e3154.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_0b721d8253d302d3fb7741394d57924e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_4c3a2550f1ed143f7f32c6e45cb1d3a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_cd115c1146ea0341768627f973be0054.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_4b0566f648650d44e4bb3bb44dc79c82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_a561ff9292cc056cf1c624dffccddbe8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_1a32e039e606f436d9a59d488b55200f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_1687a128d04cbc2ec4257759b2f281fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_382db325-3222-5c2d-914a-654d37707f1c/382db325-3222-5c2d-914a-654d37707f1c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/d9/ebd903308f031ec89963c8d0582748af/pa/VP88886_70f862e4cebf870ac7807e9415b00542.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 electric drive 100 kW e-Shine',
 'transmission': 'automatic',
 'trim': 'e-Shine',
 'year': 2023}
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP88886%27 HTTP/1.1" 200 None
2026-03-30 10:39:13 [auto1.de] INFO: Saving data for VP88886: {'created_time': 1774867153.841658, 'last_price_update_time': 1774867153.841667, 'auction_closing_time': 1774971602.0}
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP88886') HTTP/1.1" 204 0
2026-03-30 10:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc45f626-cdf6-56dd-89cd-f70aae21339a with identifier: CM52893
2026-03-30 10:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc45f626-cdf6-56dd-89cd-f70aae21339a with identifier: CM52893
2026-03-30 10:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc45f626-cdf6-56dd-89cd-f70aae21339a with identifier: CM52893 to the API
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_5d540337f2f26ab86d05e211344afe63.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:27:34Z',
 'fuel_type': 'diesel',
 'id': 'bc45f626-cdf6-56dd-89cd-f70aae21339a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM52893',
 'listing': 'auction',
 'location': 'DE, Bernburg (Saale)',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 290401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_8eb3c796aed0483c306d44506979cf4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2970863,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_16f05dfc8612d7a8453da7b6f23b6955.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_69619642e098b630cb62364a086a24aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3038156,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_673a260df91c374616a69234423eab57.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_d9a53676bc658024545b95e1649bbed2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_d86fc3cceeb13e21598b049038667484.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_20e0a910bebf80634acca5349dfdf8fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_5d540337f2f26ab86d05e211344afe63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2823678,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_55f55620d71c8978f956e721c0a7a5b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc45f626-cdf6-56dd-89cd-f70aae21339a/bc45f626-cdf6-56dd-89cd-f70aae21339a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b1/60b11bb1425951f8eb6b7bc5ff18de01/pa/CM52893_ae59cf9cd58adb925671248a50a81977.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2015}
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM52893%27 HTTP/1.1" 200 None
2026-03-30 10:39:14 [auto1.de] INFO: Saving data for CM52893: {'created_time': 1774867154.307219, 'last_price_update_time': 1774867154.307228, 'auction_closing_time': 1774970854.0}
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM52893') HTTP/1.1" 204 0
2026-03-30 10:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b65765a-a484-5ecb-98ad-91f80b7c5faf with identifier: WY58747
2026-03-30 10:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b65765a-a484-5ecb-98ad-91f80b7c5faf with identifier: WY58747
2026-03-30 10:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b65765a-a484-5ecb-98ad-91f80b7c5faf with identifier: WY58747 to the API
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_466380d8636619d9868d2bb064584e94.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:01:56Z',
 'fuel_type': 'petrol',
 'id': '9b65765a-a484-5ecb-98ad-91f80b7c5faf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY58747',
 'listing': 'auction',
 'location': 'DE, Bonn',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 95553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2619762,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_8d7e07e6786050649bdfaefdb4af03c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_76db4a92fe8e474fac5015ec9c9a1574.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_c6fb93b074d211fd82f44b000ef381cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2658230,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_e3ffdefb062849fde176b6b059a710a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_dc098c340e2a32a7d1b55159441e7416.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_c6fb0bc9cce4837d73f69507ef4acff0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_36a7072f7515b3a53f549a59ff6ab8be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_e74d4cc3812a224e88f7d48bd0b60360.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_466380d8636619d9868d2bb064584e94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b65765a-a484-5ecb-98ad-91f80b7c5faf/9b65765a-a484-5ecb-98ad-91f80b7c5faf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/533705fa593b972498d1cb164f0ed2e8/pa/WY58747_4cfa4d04e1bf743edb11401b745444ae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A1 1.4 TFSI S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2012}
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY58747%27 HTTP/1.1" 200 None
2026-03-30 10:39:14 [auto1.de] INFO: Saving data for WY58747: {'created_time': 1774867154.918747, 'last_price_update_time': 1774867154.918756, 'auction_closing_time': 1774969316.0}
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY58747') HTTP/1.1" 204 0
2026-03-30 10:39:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7933250>
2026-03-30 10:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fb2%252F87b2b278f091c756b831f574ee718263%252Fpa%252FZF52635_201a868f373b5844ac443c09d5335195.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_201a868f373b5844ac443c09d5335195.jpg saved to cache
2026-03-30 10:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b
2026-03-30 10:39:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b, skipping ID generation
2026-03-30 10:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b with scrape type 1
2026-03-30 10:39:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b sending to next pipeline
2026-03-30 10:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b, identifier: ZF52635
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT80632/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b with identifier: ZF52635
2026-03-30 10:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b with identifier: ZF52635
2026-03-30 10:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b with identifier: ZF52635 to the API
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_201a868f373b5844ac443c09d5335195.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:58:20Z',
 'fuel_type': 'electro',
 'id': '9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF52635',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 15,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_5d05431e3e6e947891f00b690161e26a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_9f0ff9714f6e492d5500e6e7762e00c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_201a868f373b5844ac443c09d5335195.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_59cac047658e1307abd4ef4e94e6351a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_7ee9f4eb120c26caf0108e79ff3d3796.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_bea1ce4cb116f197176daad8e590dc95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_015d8a83489586f624e0872f1dc7063c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_74a934ed417d40bef497c34a203e96bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_2595811f637ec48c66fda1de69c9a947.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b/9dcc31e3-9e00-5d47-8830-f3ba7c31fd3b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/b2/87b2b278f091c756b831f574ee718263/pa/ZF52635_28f8bd05094a4458e096ab3086fbbffb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF52635%27 HTTP/1.1" 200 None
2026-03-30 10:39:15 [auto1.de] INFO: Saving data for ZF52635: {'created_time': 1774867155.458882, 'last_price_update_time': 1774867155.458892, 'auction_closing_time': 1774972700.0}
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF52635') HTTP/1.1" 204 0
2026-03-30 10:39:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_9ed4c6087d39692ccecada03a9521e71.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_dc946c03f00cff78ca7f5b55d8e622ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_a6078d9a5b185c44898320ee8a22df13.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_e665c5a7698a538a06f55b33fc1a5449.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_cc0f2aa79b279d4927c1c71ab2a4b01c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_4170f66c87e977e3910646f27ebfa72d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_d3998d4b2c5b32ccd8302bf4e121a4cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_248421bc62f3520d36e1cc43852bb288.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c68110>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_9ed4c6087d39692ccecada03a9521e71.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_9ed4c6087d39692ccecada03a9521e71.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f26356c4-2f8f-5c20-9ba0-409993a1b682
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5006b10>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_dc946c03f00cff78ca7f5b55d8e622ce.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_dc946c03f00cff78ca7f5b55d8e622ce.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f26356c4-2f8f-5c20-9ba0-409993a1b682
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e75890>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_a6078d9a5b185c44898320ee8a22df13.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_a6078d9a5b185c44898320ee8a22df13.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f26356c4-2f8f-5c20-9ba0-409993a1b682
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e74c50>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_e665c5a7698a538a06f55b33fc1a5449.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_e665c5a7698a538a06f55b33fc1a5449.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f26356c4-2f8f-5c20-9ba0-409993a1b682
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50042d0>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_cc0f2aa79b279d4927c1c71ab2a4b01c.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_cc0f2aa79b279d4927c1c71ab2a4b01c.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f26356c4-2f8f-5c20-9ba0-409993a1b682
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5982850>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_4170f66c87e977e3910646f27ebfa72d.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_4170f66c87e977e3910646f27ebfa72d.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f26356c4-2f8f-5c20-9ba0-409993a1b682
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f88650>
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F0d%252F320d3b448a093d62ef2d8be19f250990%252Fpa%252FYS62418_d3998d4b2c5b32ccd8302bf4e121a4cc.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_d3998d4b2c5b32ccd8302bf4e121a4cc.jpg saved to cache
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f26356c4-2f8f-5c20-9ba0-409993a1b682
2026-03-30 10:39:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f26356c4-2f8f-5c20-9ba0-409993a1b682, skipping ID generation
2026-03-30 10:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f26356c4-2f8f-5c20-9ba0-409993a1b682 with scrape type 1
2026-03-30 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f26356c4-2f8f-5c20-9ba0-409993a1b682 sending to next pipeline
2026-03-30 10:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f26356c4-2f8f-5c20-9ba0-409993a1b682, identifier: YS62418
2026-03-30 10:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_2d483b487a0a43bdc38c7694dbeecefc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE11859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f26356c4-2f8f-5c20-9ba0-409993a1b682 with identifier: YS62418
2026-03-30 10:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f26356c4-2f8f-5c20-9ba0-409993a1b682 with identifier: YS62418
2026-03-30 10:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f26356c4-2f8f-5c20-9ba0-409993a1b682 with identifier: YS62418 to the API
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_d3998d4b2c5b32ccd8302bf4e121a4cc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:56:36Z',
 'fuel_type': 'petrol',
 'id': 'f26356c4-2f8f-5c20-9ba0-409993a1b682',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS62418',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 22912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_9ed4c6087d39692ccecada03a9521e71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_d3998d4b2c5b32ccd8302bf4e121a4cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_4170f66c87e977e3910646f27ebfa72d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_e665c5a7698a538a06f55b33fc1a5449.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_cc0f2aa79b279d4927c1c71ab2a4b01c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_a6078d9a5b185c44898320ee8a22df13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_dc946c03f00cff78ca7f5b55d8e622ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_44483103682863bf3875698e10621b5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_6e94a712de9d5554e1d3f06c7e4032d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26356c4-2f8f-5c20-9ba0-409993a1b682/f26356c4-2f8f-5c20-9ba0-409993a1b682_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/0d/320d3b448a093d62ef2d8be19f250990/pa/YS62418_46d50aba3ff98fa9c8c874dd53760231.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.2 PureTech Max',
 'transmission': 'automatic',
 'trim': 'Max',
 'year': 2024}
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS62418%27 HTTP/1.1" 200 None
2026-03-30 10:39:16 [auto1.de] INFO: Saving data for YS62418: {'created_time': 1774867156.382925, 'last_price_update_time': 1774867156.382937, 'auction_closing_time': 1774972596.0}
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS62418') HTTP/1.1" 204 0
2026-03-30 10:39:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8a610>
2026-03-30 10:39:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F32%252F03322c2672a09c7cb6786222273018ce%252Fpa%252FSD14914_248421bc62f3520d36e1cc43852bb288.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_248421bc62f3520d36e1cc43852bb288.jpg saved to cache
2026-03-30 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4529458b-3015-5e6e-a612-b45ba7ee8a2e
2026-03-30 10:39:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4529458b-3015-5e6e-a612-b45ba7ee8a2e, skipping ID generation
2026-03-30 10:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4529458b-3015-5e6e-a612-b45ba7ee8a2e with scrape type 1
2026-03-30 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4529458b-3015-5e6e-a612-b45ba7ee8a2e sending to next pipeline
2026-03-30 10:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4529458b-3015-5e6e-a612-b45ba7ee8a2e, identifier: SD14914
2026-03-30 10:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4529458b-3015-5e6e-a612-b45ba7ee8a2e with identifier: SD14914
2026-03-30 10:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4529458b-3015-5e6e-a612-b45ba7ee8a2e with identifier: SD14914
2026-03-30 10:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4529458b-3015-5e6e-a612-b45ba7ee8a2e with identifier: SD14914 to the API
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_248421bc62f3520d36e1cc43852bb288.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:42:03Z',
 'fuel_type': 'petrol',
 'id': '4529458b-3015-5e6e-a612-b45ba7ee8a2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD14914',
 'listing': 'auction',
 'location': 'DE, Neufahrn',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 77674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2966803,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_248421bc62f3520d36e1cc43852bb288.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_8fc42984ecc3233c68186aa003c67565.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_e16cc36a63daa3347f6eec471a234a59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2925132,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_f85da965ef60ca27965d41a10fedd4e6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3109714,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_28b3fa61c06fcc8d6fa35564fc1ea4eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_9e901be06b979642254519d1ef96b418.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3131970,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_255f07e68a61dfa118d7a63ba2af2a10.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_a0620643826b559f596265d9315cdd05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_ca99408e4046199eca5fd7864706cf0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4529458b-3015-5e6e-a612-b45ba7ee8a2e/4529458b-3015-5e6e-a612-b45ba7ee8a2e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2897157,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/32/03322c2672a09c7cb6786222273018ce/pa/SD14914_74f578ff33660f5f3aa09d17890f830c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-12',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD14914%27 HTTP/1.1" 200 None
2026-03-30 10:39:17 [auto1.de] INFO: Saving data for SD14914: {'created_time': 1774867157.021078, 'last_price_update_time': 1774867157.021088, 'auction_closing_time': 1774971723.0}
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD14914') HTTP/1.1" 204 0
2026-03-30 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX78933/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d83b10>
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_2d483b487a0a43bdc38c7694dbeecefc.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_2d483b487a0a43bdc38c7694dbeecefc.jpg saved to cache
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1
2026-03-30 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN69770/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_7b89d67149341056675694d7f9828baf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_6f11f4e5f9b3a05b3d1e846354c210ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_c0588aaa672313e0f5b0c68856822e36.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_b72fd3cfe4897d0ee0744f51e359ae3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e76210>
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_7b89d67149341056675694d7f9828baf.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_7b89d67149341056675694d7f9828baf.jpg saved to cache
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1
2026-03-30 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_9f31ab84d4c135aa67e452c5a897b766.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6d3d0>
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_6f11f4e5f9b3a05b3d1e846354c210ad.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_6f11f4e5f9b3a05b3d1e846354c210ad.jpg saved to cache
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1
2026-03-30 10:39:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5118150>
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_c0588aaa672313e0f5b0c68856822e36.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_c0588aaa672313e0f5b0c68856822e36.jpg saved to cache
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f88050>
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_b72fd3cfe4897d0ee0744f51e359ae3f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_b72fd3cfe4897d0ee0744f51e359ae3f.jpg saved to cache
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1
2026-03-30 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_c8636cfeb351d242edb0372cb386664f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e44150>
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_9f31ab84d4c135aa67e452c5a897b766.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_9f31ab84d4c135aa67e452c5a897b766.jpg saved to cache
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1
2026-03-30 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_535c82d7412e35d3406ff1ab6b1e2c46.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e792d0>
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_c8636cfeb351d242edb0372cb386664f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_c8636cfeb351d242edb0372cb386664f.jpg saved to cache
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1
2026-03-30 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_67f7ffa6b3fbc28e02ac8650d99bcb9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50772d0>
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_535c82d7412e35d3406ff1ab6b1e2c46.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_535c82d7412e35d3406ff1ab6b1e2c46.jpg saved to cache
2026-03-30 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1
2026-03-30 10:39:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef511dcd0>
2026-03-30 10:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fe9%252Febe9206cd620e37fb3768be8b4dacce3%252Fpa%252FKN66141_67f7ffa6b3fbc28e02ac8650d99bcb9f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_67f7ffa6b3fbc28e02ac8650d99bcb9f.jpg saved to cache
2026-03-30 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1
2026-03-30 10:39:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1, skipping ID generation
2026-03-30 10:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1 with scrape type 1
2026-03-30 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1 sending to next pipeline
2026-03-30 10:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1, identifier: KN66141
2026-03-30 10:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1 with identifier: KN66141
2026-03-30 10:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1 with identifier: KN66141
2026-03-30 10:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1 with identifier: KN66141 to the API
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_67f7ffa6b3fbc28e02ac8650d99bcb9f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:02:33Z',
 'fuel_type': 'petrol',
 'id': '55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN66141',
 'listing': 'auction',
 'location': 'DE, Kamen',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 54862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_535c82d7412e35d3406ff1ab6b1e2c46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3092284,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_67f7ffa6b3fbc28e02ac8650d99bcb9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_c8636cfeb351d242edb0372cb386664f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_9f31ab84d4c135aa67e452c5a897b766.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_b72fd3cfe4897d0ee0744f51e359ae3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3095316,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_c0588aaa672313e0f5b0c68856822e36.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3228716,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_7b89d67149341056675694d7f9828baf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3147412,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_6f11f4e5f9b3a05b3d1e846354c210ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_2d483b487a0a43bdc38c7694dbeecefc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1/55f3549b-1d10-5bce-ae0d-0d36b3b8e9e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/e9/ebe9206cd620e37fb3768be8b4dacce3/pa/KN66141_1fb9a5db831522ce9283594f432f699e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 Edition 2021 AMG Line',
 'transmission': 'automatic',
 'trim': 'Edition 2021 AMG Line',
 'year': 2022}
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN66141%27 HTTP/1.1" 200 None
2026-03-30 10:39:18 [auto1.de] INFO: Saving data for KN66141: {'created_time': 1774867158.632241, 'last_price_update_time': 1774867158.632252, 'auction_closing_time': 1774969353.0}
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN66141') HTTP/1.1" 204 0
2026-03-30 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AE19872/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT86965/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.073(s), this was the 1st time calling it.
2026-03-30 10:39:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.837282159689397 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:39:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK56270/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:18 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 9431 | hits on page: 40
2026-03-30 10:39:18 [auto1.de] INFO: Found listing with ID: CE73784
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE73784%27 HTTP/1.1" 200 None
2026-03-30 10:39:18 [auto1.de] INFO: Scrape type for CE73784: 0
2026-03-30 10:39:18 [auto1.de] INFO: Found listing with ID: GB07030
2026-03-30 10:39:18 [auto1.de] INFO: Found listing with ID: HX91404
2026-03-30 10:39:18 [auto1.de] INFO: Found listing with ID: CY18097
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY18097%27 HTTP/1.1" 200 None
2026-03-30 10:39:18 [auto1.de] INFO: Scrape type for CY18097: 1
2026-03-30 10:39:18 [auto1.de] INFO: Found listing with ID: NJ28052
2026-03-30 10:39:18 [auto1.de] INFO: Found listing with ID: CP02770
2026-03-30 10:39:18 [auto1.de] INFO: Found listing with ID: US18230
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US18230%27 HTTP/1.1" 200 None
2026-03-30 10:39:18 [auto1.de] INFO: Scrape type for US18230: 2
2026-03-30 10:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06aab565-d53a-50a4-b57a-7d8c2e9e50d8 with identifier: US18230
2026-03-30 10:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06aab565-d53a-50a4-b57a-7d8c2e9e50d8 with scrape type 2
2026-03-30 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06aab565-d53a-50a4-b57a-7d8c2e9e50d8 with scrape type 2
2026-03-30 10:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06aab565-d53a-50a4-b57a-7d8c2e9e50d8, identifier: US18230
2026-03-30 10:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06aab565-d53a-50a4-b57a-7d8c2e9e50d8 with identifier: US18230
2026-03-30 10:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06aab565-d53a-50a4-b57a-7d8c2e9e50d8 with identifier: US18230
2026-03-30 10:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06aab565-d53a-50a4-b57a-7d8c2e9e50d8 with identifier: US18230 to the API
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:10:21Z',
 'fuel_type': 'diesel',
 'id': '06aab565-d53a-50a4-b57a-7d8c2e9e50d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US18230',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 180993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-30',
 'seller_name': None,
 'title': 'MINI Clubman Cooper D HAMPTON',
 'transmission': 'manual',
 'trim': 'HAMPTON',
 'year': 2012}
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US18230%27 HTTP/1.1" 200 None
2026-03-30 10:39:19 [auto1.de] INFO: Saving data for US18230: {'auction_closing_time': 1774969821.0, 'created_time': 1773772605.845115, 'last_price_update_time': 1774867159.243694}
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US18230') HTTP/1.1" 204 0
2026-03-30 10:39:19 [auto1.de] INFO: Found listing with ID: YG35577
2026-03-30 10:39:19 [auto1.de] INFO: Found listing with ID: HN97244
2026-03-30 10:39:19 [auto1.de] INFO: Found listing with ID: LC24532
2026-03-30 10:39:19 [auto1.de] INFO: Found listing with ID: VC21585
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC21585%27 HTTP/1.1" 200 None
2026-03-30 10:39:19 [auto1.de] INFO: Scrape type for VC21585: 1
2026-03-30 10:39:19 [auto1.de] INFO: Found listing with ID: UY84465
2026-03-30 10:39:19 [auto1.de] INFO: Found listing with ID: BM81671
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM81671%27 HTTP/1.1" 200 None
2026-03-30 10:39:19 [auto1.de] INFO: Scrape type for BM81671: 1
2026-03-30 10:39:19 [auto1.de] INFO: Found listing with ID: RS58437
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS58437%27 HTTP/1.1" 200 None
2026-03-30 10:39:19 [auto1.de] INFO: Scrape type for RS58437: 1
2026-03-30 10:39:19 [auto1.de] INFO: Found listing with ID: RD39449
2026-03-30 10:39:19 [auto1.de] INFO: Found listing with ID: KF94036
2026-03-30 10:39:19 [auto1.de] INFO: Found listing with ID: FF99965
2026-03-30 10:39:19 [auto1.de] INFO: Found listing with ID: JZ50172
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ50172%27 HTTP/1.1" 200 None
2026-03-30 10:39:19 [auto1.de] INFO: Scrape type for JZ50172: 2
2026-03-30 10:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20182751-a50c-50f7-97f9-88c17e843ddd with identifier: JZ50172
2026-03-30 10:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20182751-a50c-50f7-97f9-88c17e843ddd with scrape type 2
2026-03-30 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20182751-a50c-50f7-97f9-88c17e843ddd with scrape type 2
2026-03-30 10:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20182751-a50c-50f7-97f9-88c17e843ddd, identifier: JZ50172
2026-03-30 10:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20182751-a50c-50f7-97f9-88c17e843ddd with identifier: JZ50172
2026-03-30 10:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20182751-a50c-50f7-97f9-88c17e843ddd with identifier: JZ50172
2026-03-30 10:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20182751-a50c-50f7-97f9-88c17e843ddd with identifier: JZ50172 to the API
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:43:33Z',
 'fuel_type': 'diesel',
 'id': '20182751-a50c-50f7-97f9-88c17e843ddd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ50172',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 176239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2022}
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ50172%27 HTTP/1.1" 200 None
2026-03-30 10:39:19 [auto1.de] INFO: Saving data for JZ50172: {'auction_closing_time': 1774971813.0, 'created_time': 1774262657.157005, 'last_price_update_time': 1774867159.857396}
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ50172') HTTP/1.1" 204 0
2026-03-30 10:39:19 [auto1.de] INFO: Found listing with ID: HW82301
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW82301%27 HTTP/1.1" 200 None
2026-03-30 10:39:19 [auto1.de] INFO: Scrape type for HW82301: 1
2026-03-30 10:39:19 [auto1.de] INFO: Found listing with ID: AU89070
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU89070%27 HTTP/1.1" 200 None
2026-03-30 10:39:20 [auto1.de] INFO: Scrape type for AU89070: 1
2026-03-30 10:39:20 [auto1.de] INFO: Found listing with ID: FR29182
2026-03-30 10:39:20 [auto1.de] INFO: Found listing with ID: XB70310
2026-03-30 10:39:20 [auto1.de] INFO: Found listing with ID: EZ67237
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ67237%27 HTTP/1.1" 200 None
2026-03-30 10:39:20 [auto1.de] INFO: Scrape type for EZ67237: 1
2026-03-30 10:39:20 [auto1.de] INFO: Found listing with ID: EB31634
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB31634%27 HTTP/1.1" 200 None
2026-03-30 10:39:20 [auto1.de] INFO: Scrape type for EB31634: 2
2026-03-30 10:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e875bcd0-e1d5-5dab-b28c-2f5ce1837399 with identifier: EB31634
2026-03-30 10:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e875bcd0-e1d5-5dab-b28c-2f5ce1837399 with scrape type 2
2026-03-30 10:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e875bcd0-e1d5-5dab-b28c-2f5ce1837399 with scrape type 2
2026-03-30 10:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e875bcd0-e1d5-5dab-b28c-2f5ce1837399, identifier: EB31634
2026-03-30 10:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e875bcd0-e1d5-5dab-b28c-2f5ce1837399 with identifier: EB31634
2026-03-30 10:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e875bcd0-e1d5-5dab-b28c-2f5ce1837399 with identifier: EB31634
2026-03-30 10:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e875bcd0-e1d5-5dab-b28c-2f5ce1837399 with identifier: EB31634 to the API
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:59:35Z',
 'fuel_type': 'petrol',
 'id': 'e875bcd0-e1d5-5dab-b28c-2f5ce1837399',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB31634',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 68204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-03',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2014}
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB31634%27 HTTP/1.1" 200 None
2026-03-30 10:39:20 [auto1.de] INFO: Saving data for EB31634: {'auction_closing_time': 1774972775.0, 'created_time': 1774380563.674485, 'last_price_update_time': 1774867160.454012}
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB31634') HTTP/1.1" 204 0
2026-03-30 10:39:20 [auto1.de] INFO: Found listing with ID: CC86665
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC86665%27 HTTP/1.1" 200 None
2026-03-30 10:39:20 [auto1.de] INFO: Scrape type for CC86665: 1
2026-03-30 10:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK07148/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:20 [auto1.de] INFO: Found listing with ID: MY16405
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY16405%27 HTTP/1.1" 200 None
2026-03-30 10:39:20 [auto1.de] INFO: Scrape type for MY16405: 1
2026-03-30 10:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:20 [auto1.de] INFO: Found listing with ID: WJ46951
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ46951%27 HTTP/1.1" 200 None
2026-03-30 10:39:20 [auto1.de] INFO: Scrape type for WJ46951: 2
2026-03-30 10:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c69e5d57-e0b6-5072-9046-ea87143a53c9 with identifier: WJ46951
2026-03-30 10:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c69e5d57-e0b6-5072-9046-ea87143a53c9 with scrape type 2
2026-03-30 10:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c69e5d57-e0b6-5072-9046-ea87143a53c9 with scrape type 2
2026-03-30 10:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c69e5d57-e0b6-5072-9046-ea87143a53c9, identifier: WJ46951
2026-03-30 10:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c69e5d57-e0b6-5072-9046-ea87143a53c9 with identifier: WJ46951
2026-03-30 10:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c69e5d57-e0b6-5072-9046-ea87143a53c9 with identifier: WJ46951
2026-03-30 10:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c69e5d57-e0b6-5072-9046-ea87143a53c9 with identifier: WJ46951 to the API
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:26:54Z',
 'fuel_type': 'petrol',
 'id': 'c69e5d57-e0b6-5072-9046-ea87143a53c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ46951',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 89170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-08',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2019}
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ46951%27 HTTP/1.1" 200 None
2026-03-30 10:39:20 [auto1.de] INFO: Saving data for WJ46951: {'auction_closing_time': 1774970814.0, 'created_time': 1774293459.922598, 'last_price_update_time': 1774867160.969328}
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ46951') HTTP/1.1" 204 0
2026-03-30 10:39:20 [auto1.de] INFO: Found listing with ID: BR65337
2026-03-30 10:39:20 [auto1.de] INFO: Found listing with ID: LB33247
2026-03-30 10:39:20 [auto1.de] INFO: Found listing with ID: GP91908
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP91908%27 HTTP/1.1" 200 None
2026-03-30 10:39:21 [auto1.de] INFO: Scrape type for GP91908: 1
2026-03-30 10:39:21 [auto1.de] INFO: Found listing with ID: KL83940
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL83940%27 HTTP/1.1" 200 None
2026-03-30 10:39:21 [auto1.de] INFO: Scrape type for KL83940: 1
2026-03-30 10:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN69770> (referer: https://www.auto1.com/v1/car-details-view/AN69770/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:21 [auto1.de] INFO: Found listing with ID: BD87504
2026-03-30 10:39:21 [auto1.de] INFO: Found listing with ID: RC82112
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC82112%27 HTTP/1.1" 200 None
2026-03-30 10:39:21 [auto1.de] INFO: Scrape type for RC82112: 2
2026-03-30 10:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cd80a0b-16d7-5993-8bb7-75a8c283b868 with identifier: RC82112
2026-03-30 10:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd80a0b-16d7-5993-8bb7-75a8c283b868 with scrape type 2
2026-03-30 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cd80a0b-16d7-5993-8bb7-75a8c283b868 with scrape type 2
2026-03-30 10:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cd80a0b-16d7-5993-8bb7-75a8c283b868, identifier: RC82112
2026-03-30 10:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cd80a0b-16d7-5993-8bb7-75a8c283b868 with identifier: RC82112
2026-03-30 10:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cd80a0b-16d7-5993-8bb7-75a8c283b868 with identifier: RC82112
2026-03-30 10:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cd80a0b-16d7-5993-8bb7-75a8c283b868 with identifier: RC82112 to the API
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:40:06Z',
 'fuel_type': 'petrol',
 'id': '6cd80a0b-16d7-5993-8bb7-75a8c283b868',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC82112',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 210388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-16',
 'seller_name': None,
 'title': 'BMW 1er 114i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC82112%27 HTTP/1.1" 200 None
2026-03-30 10:39:21 [auto1.de] INFO: Saving data for RC82112: {'auction_closing_time': 1774971606.0, 'created_time': 1773773350.167648, 'last_price_update_time': 1774867161.45425}
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC82112') HTTP/1.1" 204 0
2026-03-30 10:39:21 [auto1.de] INFO: Found listing with ID: BS31363
2026-03-30 10:39:21 [auto1.de] INFO: Found listing with ID: YB65730
2026-03-30 10:39:21 [auto1.de] INFO: Found listing with ID: BE30085
2026-03-30 10:39:21 [auto1.de] INFO: Found listing with ID: BP48504
2026-03-30 10:39:21 [auto1.de] INFO: Found listing with ID: FY06899
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY06899%27 HTTP/1.1" 200 None
2026-03-30 10:39:21 [auto1.de] INFO: Scrape type for FY06899: 2
2026-03-30 10:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a3ad567-660d-58bc-a614-898fe553ef00 with identifier: FY06899
2026-03-30 10:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a3ad567-660d-58bc-a614-898fe553ef00 with scrape type 2
2026-03-30 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a3ad567-660d-58bc-a614-898fe553ef00 with scrape type 2
2026-03-30 10:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a3ad567-660d-58bc-a614-898fe553ef00, identifier: FY06899
2026-03-30 10:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a3ad567-660d-58bc-a614-898fe553ef00 with identifier: FY06899
2026-03-30 10:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a3ad567-660d-58bc-a614-898fe553ef00 with identifier: FY06899
2026-03-30 10:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a3ad567-660d-58bc-a614-898fe553ef00 with identifier: FY06899 to the API
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:21:30Z',
 'fuel_type': 'diesel',
 'id': '7a3ad567-660d-58bc-a614-898fe553ef00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY06899',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 226554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-28',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Comfortline BlueMotion Tech.',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech.',
 'year': 2015}
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY06899%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [auto1.de] INFO: Saving data for FY06899: {'auction_closing_time': 1774970490.0, 'created_time': 1773689077.38386, 'last_price_update_time': 1774867162.046146}
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY06899') HTTP/1.1" 204 0
2026-03-30 10:39:22 [auto1.de] INFO: Found listing with ID: UW88941
2026-03-30 10:39:22 [auto1.de] INFO: Found listing with ID: LZ79063
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ79063%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [auto1.de] INFO: Scrape type for LZ79063: 2
2026-03-30 10:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf45c24b-d645-5f4d-bc0b-a7df3eb28e41 with identifier: LZ79063
2026-03-30 10:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf45c24b-d645-5f4d-bc0b-a7df3eb28e41 with scrape type 2
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf45c24b-d645-5f4d-bc0b-a7df3eb28e41 with scrape type 2
2026-03-30 10:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf45c24b-d645-5f4d-bc0b-a7df3eb28e41, identifier: LZ79063
2026-03-30 10:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63436321-d5ce-5e54-a93c-19f071a52219 with identifier: AN69770
2026-03-30 10:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63436321-d5ce-5e54-a93c-19f071a52219 with scrape type 1
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63436321-d5ce-5e54-a93c-19f071a52219
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_088df8656877bd7f1c09bf55819b9e20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_088df8656877bd7f1c09bf55819b9e20.jpg not downloaded yet
2026-03-30 10:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf45c24b-d645-5f4d-bc0b-a7df3eb28e41 with identifier: LZ79063
2026-03-30 10:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf45c24b-d645-5f4d-bc0b-a7df3eb28e41 with identifier: LZ79063
2026-03-30 10:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf45c24b-d645-5f4d-bc0b-a7df3eb28e41 with identifier: LZ79063 to the API
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:00:19Z',
 'fuel_type': 'diesel',
 'id': 'cf45c24b-d645-5f4d-bc0b-a7df3eb28e41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ79063',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 93292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-09',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Standard',
 'transmission': 'automatic',
 'trim': 'Standard',
 'year': 2013}
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ79063%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [auto1.de] INFO: Saving data for LZ79063: {'auction_closing_time': 1774969219.0, 'created_time': 1773229167.637558, 'last_price_update_time': 1774867162.573579}
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ79063') HTTP/1.1" 204 0
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_3eb08e4739acf11f66b3a9a5421e878a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_3eb08e4739acf11f66b3a9a5421e878a.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_f4b1b9dd838375cc90ea351d48272236.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_f4b1b9dd838375cc90ea351d48272236.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_f510f964db0a5a3f06d80110323c333f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_f510f964db0a5a3f06d80110323c333f.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_93ba5d39886d03a3aca709676903c0dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_93ba5d39886d03a3aca709676903c0dd.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_837b17de2fa9cc94dabb30ede5606c32.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_837b17de2fa9cc94dabb30ede5606c32.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_7756617a166a6213e1e68b2750cd4e67.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_7756617a166a6213e1e68b2750cd4e67.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_d5af56d6bbd9494f59682c6a30a437ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_d5af56d6bbd9494f59682c6a30a437ea.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_314fe32bc9617d3a4eff652fd3018b37.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_314fe32bc9617d3a4eff652fd3018b37.jpg not downloaded yet
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_3ac80747ce67eb3b7d02e320fbd66553.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_3ac80747ce67eb3b7d02e320fbd66553.jpg not downloaded yet
2026-03-30 10:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX78933> (referer: https://www.auto1.com/v1/car-details-view/CX78933/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee68c991-4d11-5e37-8792-50097c2c3df5 with identifier: CX78933
2026-03-30 10:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee68c991-4d11-5e37-8792-50097c2c3df5 with scrape type 1
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee68c991-4d11-5e37-8792-50097c2c3df5
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_46857908826c3efb834e04aba0403533.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_46857908826c3efb834e04aba0403533.jpg not downloaded yet
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_eeaa1d030b6ef2946a704a90c3665375.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_eeaa1d030b6ef2946a704a90c3665375.jpg not downloaded yet
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM81802> (referer: https://www.auto1.com/v1/car-details-view/YM81802/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_8b56e96671c39e7d698b89f4d48b72e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_8b56e96671c39e7d698b89f4d48b72e9.jpg not downloaded yet
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_466d9901ca294b8700e7b1efc6bbac7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_466d9901ca294b8700e7b1efc6bbac7f.jpg not downloaded yet
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_a8ec4261281b5f94986bd46c93a53d08.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_a8ec4261281b5f94986bd46c93a53d08.jpg not downloaded yet
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_f860d2eccc621950118c964cad4c2d24.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_f860d2eccc621950118c964cad4c2d24.jpg not downloaded yet
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_6f80cd08ce977f257fe68443f04826a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_6f80cd08ce977f257fe68443f04826a4.jpg not downloaded yet
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_3ac80747ce67eb3b7d02e320fbd66553.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_899257ea2c058e0f53404d4ffc4aaf56.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_899257ea2c058e0f53404d4ffc4aaf56.jpg not downloaded yet
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_46857908826c3efb834e04aba0403533.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_5a2a4cb1bb34b971e28952e00ee6f74e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_5a2a4cb1bb34b971e28952e00ee6f74e.jpg not downloaded yet
2026-03-30 10:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27b3f4d4-2061-5336-87de-c64aa5514201 with identifier: YM81802
2026-03-30 10:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27b3f4d4-2061-5336-87de-c64aa5514201 with scrape type 1
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27b3f4d4-2061-5336-87de-c64aa5514201
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_69abbb913369f240028edcd30c3cf3db.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_69abbb913369f240028edcd30c3cf3db.jpg not downloaded yet
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_ea2596048ba2d0598667549712911970.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_ea2596048ba2d0598667549712911970.jpg not downloaded yet
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_5707897d4e1e108a5706e3d8ef9dcdc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_5707897d4e1e108a5706e3d8ef9dcdc3.jpg not downloaded yet
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_fef3c480c8d69f9c0a79d11ac5f96d5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_fef3c480c8d69f9c0a79d11ac5f96d5b.jpg not downloaded yet
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TD64392/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_acba1af98714e807d4026097cfdfad8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_acba1af98714e807d4026097cfdfad8a.jpg not downloaded yet
2026-03-30 10:39:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5124910>
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_3ac80747ce67eb3b7d02e320fbd66553.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_3ac80747ce67eb3b7d02e320fbd66553.jpg saved to cache
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63436321-d5ce-5e54-a93c-19f071a52219
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_6f80cd08ce977f257fe68443f04826a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_f3e16a546525a5c018cf3df5e612b802.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_f3e16a546525a5c018cf3df5e612b802.jpg not downloaded yet
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ae05d0>
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_46857908826c3efb834e04aba0403533.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_46857908826c3efb834e04aba0403533.jpg saved to cache
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee68c991-4d11-5e37-8792-50097c2c3df5
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_e16b6587c6864cb937f6a44404beb2a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_e16b6587c6864cb937f6a44404beb2a7.jpg not downloaded yet
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW16115/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_899257ea2c058e0f53404d4ffc4aaf56.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_00153d2ad05b02676d4b988b1b650dc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_00153d2ad05b02676d4b988b1b650dc0.jpg not downloaded yet
2026-03-30 10:39:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_7a9311358946c3a607529d588296819c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_7a9311358946c3a607529d588296819c.jpg not downloaded yet
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef501f710>
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_6f80cd08ce977f257fe68443f04826a4.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_6f80cd08ce977f257fe68443f04826a4.jpg saved to cache
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee68c991-4d11-5e37-8792-50097c2c3df5
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_43375e4b2e64f31b6e8d447156f43401.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_43375e4b2e64f31b6e8d447156f43401.jpg not downloaded yet
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_bc296953dd34cb122b8107ee9fd44866.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_bc296953dd34cb122b8107ee9fd44866.jpg not downloaded yet
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_fef3c480c8d69f9c0a79d11ac5f96d5b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8bd10>
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_899257ea2c058e0f53404d4ffc4aaf56.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_899257ea2c058e0f53404d4ffc4aaf56.jpg saved to cache
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee68c991-4d11-5e37-8792-50097c2c3df5
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_5707897d4e1e108a5706e3d8ef9dcdc3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c4de50>
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_fef3c480c8d69f9c0a79d11ac5f96d5b.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_fef3c480c8d69f9c0a79d11ac5f96d5b.jpg saved to cache
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27b3f4d4-2061-5336-87de-c64aa5514201
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_e16b6587c6864cb937f6a44404beb2a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE11859> (referer: https://www.auto1.com/v1/car-details-view/SE11859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_f3e16a546525a5c018cf3df5e612b802.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da2110>
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_5707897d4e1e108a5706e3d8ef9dcdc3.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_5707897d4e1e108a5706e3d8ef9dcdc3.jpg saved to cache
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27b3f4d4-2061-5336-87de-c64aa5514201
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef511bc50>
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_e16b6587c6864cb937f6a44404beb2a7.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_e16b6587c6864cb937f6a44404beb2a7.jpg saved to cache
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27b3f4d4-2061-5336-87de-c64aa5514201
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_bc296953dd34cb122b8107ee9fd44866.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with identifier: SE11859
2026-03-30 10:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with scrape type 1
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_d9dfe11fa22321d766ce45a1d2aff4ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_d9dfe11fa22321d766ce45a1d2aff4ac.jpg not downloaded yet
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef505ddd0>
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_f3e16a546525a5c018cf3df5e612b802.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_f3e16a546525a5c018cf3df5e612b802.jpg saved to cache
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27b3f4d4-2061-5336-87de-c64aa5514201
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_6225dc54bdc8627c5c579553c7c6e3bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_6225dc54bdc8627c5c579553c7c6e3bd.jpg not downloaded yet
2026-03-30 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_00153d2ad05b02676d4b988b1b650dc0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_95ea25a226c510d7fd5f8367d3e55a59.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_95ea25a226c510d7fd5f8367d3e55a59.jpg not downloaded yet
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_7a9311358946c3a607529d588296819c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_43375e4b2e64f31b6e8d447156f43401.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_f148d9be7bdb4aa4cdac880378009993.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_f148d9be7bdb4aa4cdac880378009993.jpg not downloaded yet
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_b8dcdba6eab1867d4b462aaedfe51767.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_b8dcdba6eab1867d4b462aaedfe51767.jpg not downloaded yet
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_82fb546571bf97041d8dff5e10fc04f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_82fb546571bf97041d8dff5e10fc04f5.jpg not downloaded yet
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ad6d90>
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_bc296953dd34cb122b8107ee9fd44866.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_bc296953dd34cb122b8107ee9fd44866.jpg saved to cache
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27b3f4d4-2061-5336-87de-c64aa5514201
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_23761f62a88c2732b82380be8d35218e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_23761f62a88c2732b82380be8d35218e.jpg not downloaded yet
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_d9dfe11fa22321d766ce45a1d2aff4ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_8961926748ce974254733747d9034458.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_8961926748ce974254733747d9034458.jpg not downloaded yet
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e73010>
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_00153d2ad05b02676d4b988b1b650dc0.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_00153d2ad05b02676d4b988b1b650dc0.jpg saved to cache
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27b3f4d4-2061-5336-87de-c64aa5514201
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b00190>
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_7a9311358946c3a607529d588296819c.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_7a9311358946c3a607529d588296819c.jpg saved to cache
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27b3f4d4-2061-5336-87de-c64aa5514201
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e52b10>
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_43375e4b2e64f31b6e8d447156f43401.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_43375e4b2e64f31b6e8d447156f43401.jpg saved to cache
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27b3f4d4-2061-5336-87de-c64aa5514201
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_01611d46a6657ca0b5a8de28b2ed06f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_01611d46a6657ca0b5a8de28b2ed06f2.jpg not downloaded yet
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_95ea25a226c510d7fd5f8367d3e55a59.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_6225dc54bdc8627c5c579553c7c6e3bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_501bfc7fce83d190c680b950161af5b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_501bfc7fce83d190c680b950161af5b1.jpg not downloaded yet
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dbb250>
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_d9dfe11fa22321d766ce45a1d2aff4ac.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_d9dfe11fa22321d766ce45a1d2aff4ac.jpg saved to cache
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_82fb546571bf97041d8dff5e10fc04f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c5b450>
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_95ea25a226c510d7fd5f8367d3e55a59.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_95ea25a226c510d7fd5f8367d3e55a59.jpg saved to cache
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c604d0>
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_6225dc54bdc8627c5c579553c7c6e3bd.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_6225dc54bdc8627c5c579553c7c6e3bd.jpg saved to cache
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_8961926748ce974254733747d9034458.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_501bfc7fce83d190c680b950161af5b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AE19872> (referer: https://www.auto1.com/v1/car-details-view/AE19872/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef599d090>
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_82fb546571bf97041d8dff5e10fc04f5.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_82fb546571bf97041d8dff5e10fc04f5.jpg saved to cache
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK56270> (referer: https://www.auto1.com/v1/car-details-view/ZK56270/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_01611d46a6657ca0b5a8de28b2ed06f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_23761f62a88c2732b82380be8d35218e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e45c90>
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_8961926748ce974254733747d9034458.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_8961926748ce974254733747d9034458.jpg saved to cache
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea8ad0>
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_501bfc7fce83d190c680b950161af5b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_501bfc7fce83d190c680b950161af5b1.jpg saved to cache
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_ea2596048ba2d0598667549712911970.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_69abbb913369f240028edcd30c3cf3db.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_b8dcdba6eab1867d4b462aaedfe51767.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_f148d9be7bdb4aa4cdac880378009993.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51198f96-d516-58ae-a7d6-0208066496db with identifier: AE19872
2026-03-30 10:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51198f96-d516-58ae-a7d6-0208066496db with scrape type 1
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51198f96-d516-58ae-a7d6-0208066496db
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_f4bfa91eef9f55439f34d82fa00cae9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_f4bfa91eef9f55439f34d82fa00cae9c.jpg not downloaded yet
2026-03-30 10:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85e78267-436f-5bf2-9eb1-2011e07dd4f3 with identifier: ZK56270
2026-03-30 10:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85e78267-436f-5bf2-9eb1-2011e07dd4f3 with scrape type 1
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85e78267-436f-5bf2-9eb1-2011e07dd4f3
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fc2%252F10c2e1b5316a0cb7d179798dc26cca1e%252Fpa%252FZK56270_74acc60594a631572f9fa0072c11da32.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_74acc60594a631572f9fa0072c11da32.jpg already downloaded
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fc2%252F10c2e1b5316a0cb7d179798dc26cca1e%252Fpa%252FZK56270_b135e119a27ddcd1f9b58e241c21b699.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_b135e119a27ddcd1f9b58e241c21b699.jpg already downloaded
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fc2%252F10c2e1b5316a0cb7d179798dc26cca1e%252Fpa%252FZK56270_1fdacde617ad6b9cf744d92c1ff9426b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_1fdacde617ad6b9cf744d92c1ff9426b.jpg already downloaded
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fc2%252F10c2e1b5316a0cb7d179798dc26cca1e%252Fpa%252FZK56270_26f2f8f0df43b980587c6430e4cbad3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_26f2f8f0df43b980587c6430e4cbad3a.jpg already downloaded
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fc2%252F10c2e1b5316a0cb7d179798dc26cca1e%252Fpa%252FZK56270_2570886cb8bee8cba5845cb25767439a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_2570886cb8bee8cba5845cb25767439a.jpg already downloaded
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fc2%252F10c2e1b5316a0cb7d179798dc26cca1e%252Fpa%252FZK56270_3be5e1ae4339bd8f289d9dfb3b246656.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_3be5e1ae4339bd8f289d9dfb3b246656.jpg already downloaded
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fc2%252F10c2e1b5316a0cb7d179798dc26cca1e%252Fpa%252FZK56270_0894a3041c87a44457e9a545eb5223c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_0894a3041c87a44457e9a545eb5223c1.jpg already downloaded
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fc2%252F10c2e1b5316a0cb7d179798dc26cca1e%252Fpa%252FZK56270_93ff64340ad23b76ae63399920529a6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_93ff64340ad23b76ae63399920529a6d.jpg already downloaded
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fc2%252F10c2e1b5316a0cb7d179798dc26cca1e%252Fpa%252FZK56270_2d9d3d187a93d82bd90e20e02dae5972.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_2d9d3d187a93d82bd90e20e02dae5972.jpg already downloaded
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fc2%252F10c2e1b5316a0cb7d179798dc26cca1e%252Fpa%252FZK56270_14535e4f702396673227f6a6e707b670.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_14535e4f702396673227f6a6e707b670.jpg already downloaded
2026-03-30 10:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85e78267-436f-5bf2-9eb1-2011e07dd4f3, identifier: ZK56270
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c63b90>
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_01611d46a6657ca0b5a8de28b2ed06f2.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_01611d46a6657ca0b5a8de28b2ed06f2.jpg saved to cache
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7906f10>
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_23761f62a88c2732b82380be8d35218e.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_23761f62a88c2732b82380be8d35218e.jpg saved to cache
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-30 10:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85e78267-436f-5bf2-9eb1-2011e07dd4f3 with identifier: ZK56270
2026-03-30 10:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85e78267-436f-5bf2-9eb1-2011e07dd4f3 with identifier: ZK56270
2026-03-30 10:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85e78267-436f-5bf2-9eb1-2011e07dd4f3 with identifier: ZK56270 to the API
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZK56270>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:45:17Z',
 'fuel_type': 'petrol',
 'id': '85e78267-436f-5bf2-9eb1-2011e07dd4f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK56270',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 167888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_74acc60594a631572f9fa0072c11da32.jpg',
                'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_b135e119a27ddcd1f9b58e241c21b699.jpg',
                'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_1fdacde617ad6b9cf744d92c1ff9426b.jpg',
                'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_26f2f8f0df43b980587c6430e4cbad3a.jpg',
                'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_2570886cb8bee8cba5845cb25767439a.jpg',
                'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_3be5e1ae4339bd8f289d9dfb3b246656.jpg',
                'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_0894a3041c87a44457e9a545eb5223c1.jpg',
                'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_93ff64340ad23b76ae63399920529a6d.jpg',
                'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_2d9d3d187a93d82bd90e20e02dae5972.jpg',
                'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_14535e4f702396673227f6a6e707b670.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85e78267-436f-5bf2-9eb1-2011e07dd4f3/85e78267-436f-5bf2-9eb1-2011e07dd4f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_74acc60594a631572f9fa0072c11da32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85e78267-436f-5bf2-9eb1-2011e07dd4f3/85e78267-436f-5bf2-9eb1-2011e07dd4f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_b135e119a27ddcd1f9b58e241c21b699.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85e78267-436f-5bf2-9eb1-2011e07dd4f3/85e78267-436f-5bf2-9eb1-2011e07dd4f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2873528,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_1fdacde617ad6b9cf744d92c1ff9426b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85e78267-436f-5bf2-9eb1-2011e07dd4f3/85e78267-436f-5bf2-9eb1-2011e07dd4f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2864541,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_26f2f8f0df43b980587c6430e4cbad3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85e78267-436f-5bf2-9eb1-2011e07dd4f3/85e78267-436f-5bf2-9eb1-2011e07dd4f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3007415,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_2570886cb8bee8cba5845cb25767439a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85e78267-436f-5bf2-9eb1-2011e07dd4f3/85e78267-436f-5bf2-9eb1-2011e07dd4f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_3be5e1ae4339bd8f289d9dfb3b246656.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85e78267-436f-5bf2-9eb1-2011e07dd4f3/85e78267-436f-5bf2-9eb1-2011e07dd4f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2773788,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_0894a3041c87a44457e9a545eb5223c1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85e78267-436f-5bf2-9eb1-2011e07dd4f3/85e78267-436f-5bf2-9eb1-2011e07dd4f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2934185,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_93ff64340ad23b76ae63399920529a6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85e78267-436f-5bf2-9eb1-2011e07dd4f3/85e78267-436f-5bf2-9eb1-2011e07dd4f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2889657,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_2d9d3d187a93d82bd90e20e02dae5972.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85e78267-436f-5bf2-9eb1-2011e07dd4f3/85e78267-436f-5bf2-9eb1-2011e07dd4f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3009531,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/c2/10c2e1b5316a0cb7d179798dc26cca1e/pa/ZK56270_14535e4f702396673227f6a6e707b670.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.4 TGDI Family +',
 'transmission': 'manual',
 'trim': 'Family +',
 'year': 2018}
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK56270%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [auto1.de] INFO: Saving data for ZK56270: {'created_time': 1774867165.597612, 'last_price_update_time': 1774867165.597623, 'auction_closing_time': 1774971917.0}
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK56270') HTTP/1.1" 204 0
2026-03-30 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_acba1af98714e807d4026097cfdfad8a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_57f1b766dfd16a8ff0bf7363c265d8d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_57f1b766dfd16a8ff0bf7363c265d8d2.jpg not downloaded yet
2026-03-30 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_5a2a4cb1bb34b971e28952e00ee6f74e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_466d9901ca294b8700e7b1efc6bbac7f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_a8ec4261281b5f94986bd46c93a53d08.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_d23990632d5b1db4c7e1998decf9d145.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_d23990632d5b1db4c7e1998decf9d145.jpg not downloaded yet
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e74650>
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_ea2596048ba2d0598667549712911970.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_ea2596048ba2d0598667549712911970.jpg saved to cache
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee68c991-4d11-5e37-8792-50097c2c3df5
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ac9410>
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_69abbb913369f240028edcd30c3cf3db.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_69abbb913369f240028edcd30c3cf3db.jpg saved to cache
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27b3f4d4-2061-5336-87de-c64aa5514201
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef500b850>
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_b8dcdba6eab1867d4b462aaedfe51767.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_b8dcdba6eab1867d4b462aaedfe51767.jpg saved to cache
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d818d0>
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F9803463435386113302055cda232672f%252Fpa%252FSE11859_f148d9be7bdb4aa4cdac880378009993.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_f148d9be7bdb4aa4cdac880378009993.jpg saved to cache
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-30 10:39:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf, skipping ID generation
2026-03-30 10:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with scrape type 1
2026-03-30 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf sending to next pipeline
2026-03-30 10:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf, identifier: SE11859
2026-03-30 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_f860d2eccc621950118c964cad4c2d24.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with identifier: SE11859
2026-03-30 10:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with identifier: SE11859
2026-03-30 10:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with identifier: SE11859 to the API
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_f148d9be7bdb4aa4cdac880378009993.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:38:22Z',
 'fuel_type': 'electro',
 'id': '39a73000-d2ce-5a52-b8f5-a36cdb240ebf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE11859',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 10,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_d9dfe11fa22321d766ce45a1d2aff4ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_6225dc54bdc8627c5c579553c7c6e3bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_95ea25a226c510d7fd5f8367d3e55a59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_f148d9be7bdb4aa4cdac880378009993.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_b8dcdba6eab1867d4b462aaedfe51767.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_82fb546571bf97041d8dff5e10fc04f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_23761f62a88c2732b82380be8d35218e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_8961926748ce974254733747d9034458.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_01611d46a6657ca0b5a8de28b2ed06f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/9803463435386113302055cda232672f/pa/SE11859_501bfc7fce83d190c680b950161af5b1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE11859%27 HTTP/1.1" 200 None
2026-03-30 10:39:26 [auto1.de] INFO: Saving data for SE11859: {'created_time': 1774867166.254121, 'last_price_update_time': 1774867166.254132, 'auction_closing_time': 1774971502.0}
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE11859') HTTP/1.1" 204 0
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_2f0e4ea5be094bf039485adb45ee7cc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_2f0e4ea5be094bf039485adb45ee7cc4.jpg not downloaded yet
2026-03-30 10:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC21585/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC86665/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dd8490>
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fe9%252Fa7e9b086aa0d6ef6364c1e20b61f6ccd%252Fpa%252FYM81802_acba1af98714e807d4026097cfdfad8a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_acba1af98714e807d4026097cfdfad8a.jpg saved to cache
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27b3f4d4-2061-5336-87de-c64aa5514201
2026-03-30 10:39:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27b3f4d4-2061-5336-87de-c64aa5514201, skipping ID generation
2026-03-30 10:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27b3f4d4-2061-5336-87de-c64aa5514201 with scrape type 1
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27b3f4d4-2061-5336-87de-c64aa5514201 sending to next pipeline
2026-03-30 10:39:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27b3f4d4-2061-5336-87de-c64aa5514201, identifier: YM81802
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fc9590>
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_5a2a4cb1bb34b971e28952e00ee6f74e.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_5a2a4cb1bb34b971e28952e00ee6f74e.jpg saved to cache
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee68c991-4d11-5e37-8792-50097c2c3df5
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8f090>
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_466d9901ca294b8700e7b1efc6bbac7f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_466d9901ca294b8700e7b1efc6bbac7f.jpg saved to cache
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee68c991-4d11-5e37-8792-50097c2c3df5
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50e50d0>
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_a8ec4261281b5f94986bd46c93a53d08.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_a8ec4261281b5f94986bd46c93a53d08.jpg saved to cache
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee68c991-4d11-5e37-8792-50097c2c3df5
2026-03-30 10:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_8b56e96671c39e7d698b89f4d48b72e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_bf74a558cf2e012b6f53f7793f989b7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_bf74a558cf2e012b6f53f7793f989b7d.jpg not downloaded yet
2026-03-30 10:39:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27b3f4d4-2061-5336-87de-c64aa5514201 with identifier: YM81802
2026-03-30 10:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27b3f4d4-2061-5336-87de-c64aa5514201 with identifier: YM81802
2026-03-30 10:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27b3f4d4-2061-5336-87de-c64aa5514201 with identifier: YM81802 to the API
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_acba1af98714e807d4026097cfdfad8a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': 'Rental',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:19:33Z',
 'fuel_type': 'petrol',
 'id': '27b3f4d4-2061-5336-87de-c64aa5514201',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM81802',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 59784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_69abbb913369f240028edcd30c3cf3db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_5707897d4e1e108a5706e3d8ef9dcdc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_fef3c480c8d69f9c0a79d11ac5f96d5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_acba1af98714e807d4026097cfdfad8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_f3e16a546525a5c018cf3df5e612b802.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_e16b6587c6864cb937f6a44404beb2a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_00153d2ad05b02676d4b988b1b650dc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_7a9311358946c3a607529d588296819c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_43375e4b2e64f31b6e8d447156f43401.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27b3f4d4-2061-5336-87de-c64aa5514201/27b3f4d4-2061-5336-87de-c64aa5514201_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/e9/a7e9b086aa0d6ef6364c1e20b61f6ccd/pa/YM81802_bc296953dd34cb122b8107ee9fd44866.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Grandland X 1.2 Turbo GS Line',
 'transmission': 'automatic',
 'trim': 'GS Line',
 'year': 2024}
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM81802%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [auto1.de] INFO: Saving data for YM81802: {'created_time': 1774867167.096659, 'last_price_update_time': 1774867167.09667, 'auction_closing_time': 1774970373.0}
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM81802') HTTP/1.1" 204 0
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ac9d90>
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_f860d2eccc621950118c964cad4c2d24.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_f860d2eccc621950118c964cad4c2d24.jpg saved to cache
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee68c991-4d11-5e37-8792-50097c2c3df5
2026-03-30 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_57f1b766dfd16a8ff0bf7363c265d8d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_eeaa1d030b6ef2946a704a90c3665375.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_314fe32bc9617d3a4eff652fd3018b37.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_70618a222a4356b391e4c64cfcf50c87.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_70618a222a4356b391e4c64cfcf50c87.jpg not downloaded yet
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d65290>
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_8b56e96671c39e7d698b89f4d48b72e9.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_8b56e96671c39e7d698b89f4d48b72e9.jpg saved to cache
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee68c991-4d11-5e37-8792-50097c2c3df5
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_9a7084522af5565dd3187130aaed9c33.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_9a7084522af5565dd3187130aaed9c33.jpg not downloaded yet
2026-03-30 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT86965> (referer: https://www.auto1.com/v1/car-details-view/XT86965/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_69ca08ecdacac2f205606b4e6414374d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_69ca08ecdacac2f205606b4e6414374d.jpg not downloaded yet
2026-03-30 10:39:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_588945f8d8041954ece88c30ee9696c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_588945f8d8041954ece88c30ee9696c2.jpg not downloaded yet
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c5a050>
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_57f1b766dfd16a8ff0bf7363c265d8d2.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_57f1b766dfd16a8ff0bf7363c265d8d2.jpg saved to cache
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51198f96-d516-58ae-a7d6-0208066496db
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db4610>
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa1%252F63a1df278b5fcae31f1ed5b5a49a7ab6%252Fpa%252FCX78933_eeaa1d030b6ef2946a704a90c3665375.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_eeaa1d030b6ef2946a704a90c3665375.jpg saved to cache
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee68c991-4d11-5e37-8792-50097c2c3df5
2026-03-30 10:39:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee68c991-4d11-5e37-8792-50097c2c3df5, skipping ID generation
2026-03-30 10:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee68c991-4d11-5e37-8792-50097c2c3df5 with scrape type 1
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee68c991-4d11-5e37-8792-50097c2c3df5 sending to next pipeline
2026-03-30 10:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee68c991-4d11-5e37-8792-50097c2c3df5, identifier: CX78933
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b2f250>
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_314fe32bc9617d3a4eff652fd3018b37.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_314fe32bc9617d3a4eff652fd3018b37.jpg saved to cache
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63436321-d5ce-5e54-a93c-19f071a52219
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_4b4109b0874eaa65e5d9c6cb1b12d6f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_4b4109b0874eaa65e5d9c6cb1b12d6f7.jpg not downloaded yet
2026-03-30 10:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee68c991-4d11-5e37-8792-50097c2c3df5 with identifier: CX78933
2026-03-30 10:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee68c991-4d11-5e37-8792-50097c2c3df5 with identifier: CX78933
2026-03-30 10:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee68c991-4d11-5e37-8792-50097c2c3df5 with identifier: CX78933 to the API
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_eeaa1d030b6ef2946a704a90c3665375.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:08:48Z',
 'fuel_type': 'electro',
 'id': 'ee68c991-4d11-5e37-8792-50097c2c3df5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX78933',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 26430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_46857908826c3efb834e04aba0403533.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_eeaa1d030b6ef2946a704a90c3665375.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_8b56e96671c39e7d698b89f4d48b72e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_466d9901ca294b8700e7b1efc6bbac7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_a8ec4261281b5f94986bd46c93a53d08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_f860d2eccc621950118c964cad4c2d24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_6f80cd08ce977f257fe68443f04826a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_899257ea2c058e0f53404d4ffc4aaf56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_5a2a4cb1bb34b971e28952e00ee6f74e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee68c991-4d11-5e37-8792-50097c2c3df5/ee68c991-4d11-5e37-8792-50097c2c3df5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/a1/63a1df278b5fcae31f1ed5b5a49a7ab6/pa/CX78933_ea2596048ba2d0598667549712911970.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 electric drive 100 kW e-Feel',
 'transmission': 'automatic',
 'trim': 'e-Feel',
 'year': 2022}
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX78933%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [auto1.de] INFO: Saving data for CX78933: {'created_time': 1774867167.916777, 'last_price_update_time': 1774867167.916788, 'auction_closing_time': 1774969728.0}
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX78933') HTTP/1.1" 204 0
2026-03-30 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_d23990632d5b1db4c7e1998decf9d145.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_d5af56d6bbd9494f59682c6a30a437ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_7756617a166a6213e1e68b2750cd4e67.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_bf74a558cf2e012b6f53f7793f989b7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_837b17de2fa9cc94dabb30ede5606c32.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1441d604-3191-57b8-9f8a-1002c517f29b with identifier: XT86965
2026-03-30 10:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1441d604-3191-57b8-9f8a-1002c517f29b with scrape type 1
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1441d604-3191-57b8-9f8a-1002c517f29b
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7b%252F027b3712987c619ffd69eb83587e8a84%252Fpa%252FXT86965_38209cc881ad08c387577a2d05a840ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_38209cc881ad08c387577a2d05a840ea.jpg not downloaded yet
2026-03-30 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7b%252F027b3712987c619ffd69eb83587e8a84%252Fpa%252FXT86965_98888dd175d9db33c25ba6b3a9ae46e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_98888dd175d9db33c25ba6b3a9ae46e1.jpg not downloaded yet
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7b%252F027b3712987c619ffd69eb83587e8a84%252Fpa%252FXT86965_032be02a8479cf2f2f1f7984dcb1307f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_032be02a8479cf2f2f1f7984dcb1307f.jpg not downloaded yet
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7b%252F027b3712987c619ffd69eb83587e8a84%252Fpa%252FXT86965_649dc611040003ee08c311037936c0ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_649dc611040003ee08c311037936c0ae.jpg not downloaded yet
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7b%252F027b3712987c619ffd69eb83587e8a84%252Fpa%252FXT86965_4a295e0d632ee47a8c86c3a80207d793.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_4a295e0d632ee47a8c86c3a80207d793.jpg not downloaded yet
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d64790>
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_d23990632d5b1db4c7e1998decf9d145.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_d23990632d5b1db4c7e1998decf9d145.jpg saved to cache
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51198f96-d516-58ae-a7d6-0208066496db
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7b%252F027b3712987c619ffd69eb83587e8a84%252Fpa%252FXT86965_b5b20db5b761d5f775af971e15d3004d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_b5b20db5b761d5f775af971e15d3004d.jpg not downloaded yet
2026-03-30 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_69ca08ecdacac2f205606b4e6414374d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7932a90>
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_d5af56d6bbd9494f59682c6a30a437ea.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_d5af56d6bbd9494f59682c6a30a437ea.jpg saved to cache
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63436321-d5ce-5e54-a93c-19f071a52219
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5084a10>
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_7756617a166a6213e1e68b2750cd4e67.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_7756617a166a6213e1e68b2750cd4e67.jpg saved to cache
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63436321-d5ce-5e54-a93c-19f071a52219
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6f110>
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_bf74a558cf2e012b6f53f7793f989b7d.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_bf74a558cf2e012b6f53f7793f989b7d.jpg saved to cache
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51198f96-d516-58ae-a7d6-0208066496db
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e4b9d0>
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_837b17de2fa9cc94dabb30ede5606c32.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_837b17de2fa9cc94dabb30ede5606c32.jpg saved to cache
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63436321-d5ce-5e54-a93c-19f071a52219
2026-03-30 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_588945f8d8041954ece88c30ee9696c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT80632> (referer: https://www.auto1.com/v1/car-details-view/ZT80632/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f45590>
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_69ca08ecdacac2f205606b4e6414374d.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_69ca08ecdacac2f205606b4e6414374d.jpg saved to cache
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51198f96-d516-58ae-a7d6-0208066496db
2026-03-30 10:39:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_f4bfa91eef9f55439f34d82fa00cae9c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_2f0e4ea5be094bf039485adb45ee7cc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_9a7084522af5565dd3187130aaed9c33.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_4b4109b0874eaa65e5d9c6cb1b12d6f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e778d0>
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_588945f8d8041954ece88c30ee9696c2.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_588945f8d8041954ece88c30ee9696c2.jpg saved to cache
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51198f96-d516-58ae-a7d6-0208066496db
2026-03-30 10:39:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64a4a8d2-cc19-53a2-982d-1079dd8a976b with identifier: ZT80632
2026-03-30 10:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64a4a8d2-cc19-53a2-982d-1079dd8a976b with scrape type 1
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64a4a8d2-cc19-53a2-982d-1079dd8a976b
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_9cbbd6e1115f83d8aec7bab2d80e9a5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_9cbbd6e1115f83d8aec7bab2d80e9a5e.jpg not downloaded yet
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_3711f874d51c66919dd90ab13d373a04.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_3711f874d51c66919dd90ab13d373a04.jpg not downloaded yet
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_1fdb7779f0bec3d0fe8d682d8f22eef0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_1fdb7779f0bec3d0fe8d682d8f22eef0.jpg not downloaded yet
2026-03-30 10:39:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b0a7d0>
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_f4bfa91eef9f55439f34d82fa00cae9c.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_f4bfa91eef9f55439f34d82fa00cae9c.jpg saved to cache
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51198f96-d516-58ae-a7d6-0208066496db
2026-03-30 10:39:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef503c0d0>
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_2f0e4ea5be094bf039485adb45ee7cc4.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_2f0e4ea5be094bf039485adb45ee7cc4.jpg saved to cache
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51198f96-d516-58ae-a7d6-0208066496db
2026-03-30 10:39:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e4b450>
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_9a7084522af5565dd3187130aaed9c33.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_9a7084522af5565dd3187130aaed9c33.jpg saved to cache
2026-03-30 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51198f96-d516-58ae-a7d6-0208066496db
2026-03-30 10:39:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e19110>
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_4b4109b0874eaa65e5d9c6cb1b12d6f7.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_4b4109b0874eaa65e5d9c6cb1b12d6f7.jpg saved to cache
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51198f96-d516-58ae-a7d6-0208066496db
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_36bc9a92b24621e4aea24eca8ba62387.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_36bc9a92b24621e4aea24eca8ba62387.jpg not downloaded yet
2026-03-30 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_b5b20db5b761d5f775af971e15d3004d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_4a295e0d632ee47a8c86c3a80207d793.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:29 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.645(s), this was the 1st time calling it.
2026-03-30 10:39:29 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.451024875115576 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_649dc611040003ee08c311037936c0ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_032be02a8479cf2f2f1f7984dcb1307f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_f944d1c930deb3665add5f641bc6a033.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_f944d1c930deb3665add5f641bc6a033.jpg not downloaded yet
2026-03-30 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK07148> (referer: https://www.auto1.com/v1/car-details-view/HK07148/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW16115> (referer: https://www.auto1.com/v1/car-details-view/GW16115/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_e4a0c38ba62a743aa68e264c8fdfb7cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_e4a0c38ba62a743aa68e264c8fdfb7cf.jpg not downloaded yet
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_54516adc91938aa9531b3c2a833020b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_54516adc91938aa9531b3c2a833020b7.jpg not downloaded yet
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_8dde97b6a5790699c4a031cdb30d0ac9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_8dde97b6a5790699c4a031cdb30d0ac9.jpg not downloaded yet
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_69c6df28a2487c348e3e638fdf492902.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_69c6df28a2487c348e3e638fdf492902.jpg not downloaded yet
2026-03-30 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_38209cc881ad08c387577a2d05a840ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_9cbbd6e1115f83d8aec7bab2d80e9a5e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_1fdb7779f0bec3d0fe8d682d8f22eef0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_3711f874d51c66919dd90ab13d373a04.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_36bc9a92b24621e4aea24eca8ba62387.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_bee1a4d1a511434474cc443f0327dfac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_bee1a4d1a511434474cc443f0327dfac.jpg not downloaded yet
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e7d210>
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1441d604-3191-57b8-9f8a-1002c517f29b/1441d604-3191-57b8-9f8a-1002c517f29b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7b%252F027b3712987c619ffd69eb83587e8a84%252Fpa%252FXT86965_b5b20db5b761d5f775af971e15d3004d.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_b5b20db5b761d5f775af971e15d3004d.jpg saved to cache
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1441d604-3191-57b8-9f8a-1002c517f29b
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508da10>
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1441d604-3191-57b8-9f8a-1002c517f29b/1441d604-3191-57b8-9f8a-1002c517f29b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7b%252F027b3712987c619ffd69eb83587e8a84%252Fpa%252FXT86965_4a295e0d632ee47a8c86c3a80207d793.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_4a295e0d632ee47a8c86c3a80207d793.jpg saved to cache
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1441d604-3191-57b8-9f8a-1002c517f29b
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c3fed0>
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1441d604-3191-57b8-9f8a-1002c517f29b/1441d604-3191-57b8-9f8a-1002c517f29b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7b%252F027b3712987c619ffd69eb83587e8a84%252Fpa%252FXT86965_649dc611040003ee08c311037936c0ae.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_649dc611040003ee08c311037936c0ae.jpg saved to cache
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1441d604-3191-57b8-9f8a-1002c517f29b
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd3950>
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1441d604-3191-57b8-9f8a-1002c517f29b/1441d604-3191-57b8-9f8a-1002c517f29b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7b%252F027b3712987c619ffd69eb83587e8a84%252Fpa%252FXT86965_032be02a8479cf2f2f1f7984dcb1307f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_032be02a8479cf2f2f1f7984dcb1307f.jpg saved to cache
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1441d604-3191-57b8-9f8a-1002c517f29b
2026-03-30 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_70618a222a4356b391e4c64cfcf50c87.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_98888dd175d9db33c25ba6b3a9ae46e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_93ba5d39886d03a3aca709676903c0dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_f510f964db0a5a3f06d80110323c333f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32597ede-11c0-54b0-86a3-01a15dfadc2c with identifier: HK07148
2026-03-30 10:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32597ede-11c0-54b0-86a3-01a15dfadc2c with scrape type 1
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 32597ede-11c0-54b0-86a3-01a15dfadc2c
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F86%252F2f86619233805d65f32d270490a5cfb2%252Fpa%252FHK07148_574e3c3765f491a3c40cd95dfb518118.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_574e3c3765f491a3c40cd95dfb518118.jpg not downloaded yet
2026-03-30 10:39:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f872290-9c59-5023-8915-726b7672e4a9 with identifier: GW16115
2026-03-30 10:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f872290-9c59-5023-8915-726b7672e4a9 with scrape type 1
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f872290-9c59-5023-8915-726b7672e4a9
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc3%252F85c3659d764001b66b2e709402432856%252Fpa%252FGW16115_abf81c29e386f4941e6d029fb4bf8d3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_abf81c29e386f4941e6d029fb4bf8d3d.jpg already downloaded
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc3%252F85c3659d764001b66b2e709402432856%252Fpa%252FGW16115_7eefa119aca3bb4c5ed10a33b6be4642.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_7eefa119aca3bb4c5ed10a33b6be4642.jpg already downloaded
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc3%252F85c3659d764001b66b2e709402432856%252Fpa%252FGW16115_a78eb0fab392e2b126eb9e04d9cba23d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_a78eb0fab392e2b126eb9e04d9cba23d.jpg already downloaded
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc3%252F85c3659d764001b66b2e709402432856%252Fpa%252FGW16115_513e0eb4a4509acca32eb8017cfddb2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_513e0eb4a4509acca32eb8017cfddb2c.jpg already downloaded
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc3%252F85c3659d764001b66b2e709402432856%252Fpa%252FGW16115_d7558eae2430c866b2601e8a963b5eb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_d7558eae2430c866b2601e8a963b5eb2.jpg already downloaded
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc3%252F85c3659d764001b66b2e709402432856%252Fpa%252FGW16115_e572309eac7d05f9431ebf1e82ab28c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_e572309eac7d05f9431ebf1e82ab28c1.jpg already downloaded
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc3%252F85c3659d764001b66b2e709402432856%252Fpa%252FGW16115_8ca320bc2972230368428c625f24a511.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_8ca320bc2972230368428c625f24a511.jpg already downloaded
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc3%252F85c3659d764001b66b2e709402432856%252Fpa%252FGW16115_d2f071d90fdb7c4f888ae27263c7dca2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_d2f071d90fdb7c4f888ae27263c7dca2.jpg already downloaded
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc3%252F85c3659d764001b66b2e709402432856%252Fpa%252FGW16115_486145cfa2f2a52a161c3683def0a59c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_486145cfa2f2a52a161c3683def0a59c.jpg already downloaded
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc3%252F85c3659d764001b66b2e709402432856%252Fpa%252FGW16115_2fe0a549073f87d7a6a1b73ab98158d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_2fe0a549073f87d7a6a1b73ab98158d7.jpg already downloaded
2026-03-30 10:39:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f872290-9c59-5023-8915-726b7672e4a9, identifier: GW16115
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c46c50>
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1441d604-3191-57b8-9f8a-1002c517f29b/1441d604-3191-57b8-9f8a-1002c517f29b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7b%252F027b3712987c619ffd69eb83587e8a84%252Fpa%252FXT86965_38209cc881ad08c387577a2d05a840ea.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_38209cc881ad08c387577a2d05a840ea.jpg saved to cache
2026-03-30 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1441d604-3191-57b8-9f8a-1002c517f29b
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f81450>
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_9cbbd6e1115f83d8aec7bab2d80e9a5e.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_9cbbd6e1115f83d8aec7bab2d80e9a5e.jpg saved to cache
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64a4a8d2-cc19-53a2-982d-1079dd8a976b
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ec14d0>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_1fdb7779f0bec3d0fe8d682d8f22eef0.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_1fdb7779f0bec3d0fe8d682d8f22eef0.jpg saved to cache
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64a4a8d2-cc19-53a2-982d-1079dd8a976b
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5aae0d0>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_3711f874d51c66919dd90ab13d373a04.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_3711f874d51c66919dd90ab13d373a04.jpg saved to cache
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64a4a8d2-cc19-53a2-982d-1079dd8a976b
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef509be90>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_36bc9a92b24621e4aea24eca8ba62387.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_36bc9a92b24621e4aea24eca8ba62387.jpg saved to cache
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64a4a8d2-cc19-53a2-982d-1079dd8a976b
2026-03-30 10:39:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f872290-9c59-5023-8915-726b7672e4a9 with identifier: GW16115
2026-03-30 10:39:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f872290-9c59-5023-8915-726b7672e4a9 with identifier: GW16115
2026-03-30 10:39:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f872290-9c59-5023-8915-726b7672e4a9 with identifier: GW16115 to the API
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GW16115>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:12:51Z',
 'fuel_type': 'diesel',
 'id': '0f872290-9c59-5023-8915-726b7672e4a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW16115',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'BMW',
 'model': '3er',
 'odometer': 330764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_abf81c29e386f4941e6d029fb4bf8d3d.jpg',
                'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_7eefa119aca3bb4c5ed10a33b6be4642.jpg',
                'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_a78eb0fab392e2b126eb9e04d9cba23d.jpg',
                'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_513e0eb4a4509acca32eb8017cfddb2c.jpg',
                'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_d7558eae2430c866b2601e8a963b5eb2.jpg',
                'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_e572309eac7d05f9431ebf1e82ab28c1.jpg',
                'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_8ca320bc2972230368428c625f24a511.jpg',
                'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_d2f071d90fdb7c4f888ae27263c7dca2.jpg',
                'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_486145cfa2f2a52a161c3683def0a59c.jpg',
                'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_2fe0a549073f87d7a6a1b73ab98158d7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f872290-9c59-5023-8915-726b7672e4a9/0f872290-9c59-5023-8915-726b7672e4a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2629431,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_abf81c29e386f4941e6d029fb4bf8d3d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f872290-9c59-5023-8915-726b7672e4a9/0f872290-9c59-5023-8915-726b7672e4a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2583224,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_7eefa119aca3bb4c5ed10a33b6be4642.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f872290-9c59-5023-8915-726b7672e4a9/0f872290-9c59-5023-8915-726b7672e4a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2370734,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_a78eb0fab392e2b126eb9e04d9cba23d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f872290-9c59-5023-8915-726b7672e4a9/0f872290-9c59-5023-8915-726b7672e4a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_513e0eb4a4509acca32eb8017cfddb2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f872290-9c59-5023-8915-726b7672e4a9/0f872290-9c59-5023-8915-726b7672e4a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2549853,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_d7558eae2430c866b2601e8a963b5eb2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f872290-9c59-5023-8915-726b7672e4a9/0f872290-9c59-5023-8915-726b7672e4a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_e572309eac7d05f9431ebf1e82ab28c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f872290-9c59-5023-8915-726b7672e4a9/0f872290-9c59-5023-8915-726b7672e4a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2581179,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_8ca320bc2972230368428c625f24a511.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f872290-9c59-5023-8915-726b7672e4a9/0f872290-9c59-5023-8915-726b7672e4a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2622241,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_d2f071d90fdb7c4f888ae27263c7dca2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f872290-9c59-5023-8915-726b7672e4a9/0f872290-9c59-5023-8915-726b7672e4a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2619239,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_486145cfa2f2a52a161c3683def0a59c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f872290-9c59-5023-8915-726b7672e4a9/0f872290-9c59-5023-8915-726b7672e4a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3111975,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/c3/85c3659d764001b66b2e709402432856/pa/GW16115_2fe0a549073f87d7a6a1b73ab98158d7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW16115%27 HTTP/1.1" 200 None
2026-03-30 10:39:30 [auto1.de] INFO: Saving data for GW16115: {'created_time': 1774867170.611196, 'last_price_update_time': 1774867170.611206, 'auction_closing_time': 1774969971.0}
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW16115') HTTP/1.1" 204 0
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_f944d1c930deb3665add5f641bc6a033.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_54516adc91938aa9531b3c2a833020b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F86%252F2f86619233805d65f32d270490a5cfb2%252Fpa%252FHK07148_46b0a3dd90186e9658948c09a41f40a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_46b0a3dd90186e9658948c09a41f40a4.jpg not downloaded yet
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_69c6df28a2487c348e3e638fdf492902.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_e4a0c38ba62a743aa68e264c8fdfb7cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_8dde97b6a5790699c4a031cdb30d0ac9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TD64392> (referer: https://www.auto1.com/v1/car-details-view/TD64392/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef599f6d0>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fd0%252F9ed0a6d4fcaa0266a7d1dd1c440be18f%252Fpa%252FAE19872_70618a222a4356b391e4c64cfcf50c87.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_70618a222a4356b391e4c64cfcf50c87.jpg saved to cache
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51198f96-d516-58ae-a7d6-0208066496db
2026-03-30 10:39:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51198f96-d516-58ae-a7d6-0208066496db, skipping ID generation
2026-03-30 10:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51198f96-d516-58ae-a7d6-0208066496db with scrape type 1
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51198f96-d516-58ae-a7d6-0208066496db sending to next pipeline
2026-03-30 10:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51198f96-d516-58ae-a7d6-0208066496db, identifier: AE19872
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dfe150>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1441d604-3191-57b8-9f8a-1002c517f29b/1441d604-3191-57b8-9f8a-1002c517f29b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F7b%252F027b3712987c619ffd69eb83587e8a84%252Fpa%252FXT86965_98888dd175d9db33c25ba6b3a9ae46e1.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_98888dd175d9db33c25ba6b3a9ae46e1.jpg saved to cache
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1441d604-3191-57b8-9f8a-1002c517f29b
2026-03-30 10:39:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1441d604-3191-57b8-9f8a-1002c517f29b, skipping ID generation
2026-03-30 10:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1441d604-3191-57b8-9f8a-1002c517f29b with scrape type 1
2026-03-30 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1441d604-3191-57b8-9f8a-1002c517f29b sending to next pipeline
2026-03-30 10:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1441d604-3191-57b8-9f8a-1002c517f29b, identifier: XT86965
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c415d0>
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_93ba5d39886d03a3aca709676903c0dd.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_93ba5d39886d03a3aca709676903c0dd.jpg saved to cache
2026-03-30 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63436321-d5ce-5e54-a93c-19f071a52219
2026-03-30 10:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4df7ad0>
2026-03-30 10:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_f510f964db0a5a3f06d80110323c333f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_f510f964db0a5a3f06d80110323c333f.jpg saved to cache
2026-03-30 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63436321-d5ce-5e54-a93c-19f071a52219
2026-03-30 10:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_bee1a4d1a511434474cc443f0327dfac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F86%252F2f86619233805d65f32d270490a5cfb2%252Fpa%252FHK07148_045a21c01cffc63974b99813fa303eca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_045a21c01cffc63974b99813fa303eca.jpg not downloaded yet
2026-03-30 10:39:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51198f96-d516-58ae-a7d6-0208066496db with identifier: AE19872
2026-03-30 10:39:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51198f96-d516-58ae-a7d6-0208066496db with identifier: AE19872
2026-03-30 10:39:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51198f96-d516-58ae-a7d6-0208066496db with identifier: AE19872 to the API
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_70618a222a4356b391e4c64cfcf50c87.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:02:45Z',
 'fuel_type': 'petrol',
 'id': '51198f96-d516-58ae-a7d6-0208066496db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE19872',
 'listing': 'auction',
 'location': 'DE, Krefeld',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 77002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2812614,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_f4bfa91eef9f55439f34d82fa00cae9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_57f1b766dfd16a8ff0bf7363c265d8d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_d23990632d5b1db4c7e1998decf9d145.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2768594,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_2f0e4ea5be094bf039485adb45ee7cc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_bf74a558cf2e012b6f53f7793f989b7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_70618a222a4356b391e4c64cfcf50c87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2585062,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_9a7084522af5565dd3187130aaed9c33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_69ca08ecdacac2f205606b4e6414374d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_588945f8d8041954ece88c30ee9696c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51198f96-d516-58ae-a7d6-0208066496db/51198f96-d516-58ae-a7d6-0208066496db_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3010400,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/d0/9ed0a6d4fcaa0266a7d1dd1c440be18f/pa/AE19872_4b4109b0874eaa65e5d9c6cb1b12d6f7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2018}
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE19872%27 HTTP/1.1" 200 None
2026-03-30 10:39:31 [auto1.de] INFO: Saving data for AE19872: {'created_time': 1774867171.710842, 'last_price_update_time': 1774867171.710854, 'auction_closing_time': 1774969365.0}
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE19872') HTTP/1.1" 204 0
2026-03-30 10:39:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1441d604-3191-57b8-9f8a-1002c517f29b with identifier: XT86965
2026-03-30 10:39:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1441d604-3191-57b8-9f8a-1002c517f29b with identifier: XT86965
2026-03-30 10:39:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1441d604-3191-57b8-9f8a-1002c517f29b with identifier: XT86965 to the API
2026-03-30 10:39:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_98888dd175d9db33c25ba6b3a9ae46e1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:10:02Z',
 'fuel_type': 'petrol',
 'id': '1441d604-3191-57b8-9f8a-1002c517f29b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT86965',
 'listing': 'auction',
 'location': 'DE, Jena',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 127036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1441d604-3191-57b8-9f8a-1002c517f29b/1441d604-3191-57b8-9f8a-1002c517f29b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_38209cc881ad08c387577a2d05a840ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1441d604-3191-57b8-9f8a-1002c517f29b/1441d604-3191-57b8-9f8a-1002c517f29b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_98888dd175d9db33c25ba6b3a9ae46e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1441d604-3191-57b8-9f8a-1002c517f29b/1441d604-3191-57b8-9f8a-1002c517f29b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_032be02a8479cf2f2f1f7984dcb1307f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1441d604-3191-57b8-9f8a-1002c517f29b/1441d604-3191-57b8-9f8a-1002c517f29b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_649dc611040003ee08c311037936c0ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1441d604-3191-57b8-9f8a-1002c517f29b/1441d604-3191-57b8-9f8a-1002c517f29b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_4a295e0d632ee47a8c86c3a80207d793.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1441d604-3191-57b8-9f8a-1002c517f29b/1441d604-3191-57b8-9f8a-1002c517f29b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/7b/027b3712987c619ffd69eb83587e8a84/pa/XT86965_b5b20db5b761d5f775af971e15d3004d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-09-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2008}
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT86965%27 HTTP/1.1" 200 None
2026-03-30 10:39:32 [auto1.de] INFO: Saving data for XT86965: {'created_time': 1774867172.409491, 'last_price_update_time': 1774867172.409501, 'auction_closing_time': 1774969802.0}
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT86965') HTTP/1.1" 204 0
2026-03-30 10:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_3eb08e4739acf11f66b3a9a5421e878a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_f4b1b9dd838375cc90ea351d48272236.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F86%252F2f86619233805d65f32d270490a5cfb2%252Fpa%252FHK07148_b5a9e33b2ba747a35d239037ca77c1b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_b5a9e33b2ba747a35d239037ca77c1b9.jpg not downloaded yet
2026-03-30 10:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC21585> (referer: https://www.auto1.com/v1/car-details-view/VC21585/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee40d0>
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_f944d1c930deb3665add5f641bc6a033.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_f944d1c930deb3665add5f641bc6a033.jpg saved to cache
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64a4a8d2-cc19-53a2-982d-1079dd8a976b
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a8f250>
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_54516adc91938aa9531b3c2a833020b7.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_54516adc91938aa9531b3c2a833020b7.jpg saved to cache
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64a4a8d2-cc19-53a2-982d-1079dd8a976b
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e22410>
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_69c6df28a2487c348e3e638fdf492902.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_69c6df28a2487c348e3e638fdf492902.jpg saved to cache
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 64a4a8d2-cc19-53a2-982d-1079dd8a976b
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef505dc50>
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_e4a0c38ba62a743aa68e264c8fdfb7cf.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_e4a0c38ba62a743aa68e264c8fdfb7cf.jpg saved to cache
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64a4a8d2-cc19-53a2-982d-1079dd8a976b
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e9c3d0>
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_8dde97b6a5790699c4a031cdb30d0ac9.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_8dde97b6a5790699c4a031cdb30d0ac9.jpg saved to cache
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64a4a8d2-cc19-53a2-982d-1079dd8a976b
2026-03-30 10:39:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08bfede8-da23-5e5f-bb44-1332f5105aad with identifier: TD64392
2026-03-30 10:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08bfede8-da23-5e5f-bb44-1332f5105aad with scrape type 1
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 08bfede8-da23-5e5f-bb44-1332f5105aad
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fab%252Fb6ab4d6f894d932a41ad66dad7c351ac%252Fpa%252FTD64392_166a327f4e5e5a4064085ba545726cfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_166a327f4e5e5a4064085ba545726cfe.jpg not downloaded yet
2026-03-30 10:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_088df8656877bd7f1c09bf55819b9e20.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d64e50>
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fab%252F1fabdbdc53646b240bdfcad75307cdcf%252Fpa%252FZT80632_bee1a4d1a511434474cc443f0327dfac.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_bee1a4d1a511434474cc443f0327dfac.jpg saved to cache
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 64a4a8d2-cc19-53a2-982d-1079dd8a976b
2026-03-30 10:39:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64a4a8d2-cc19-53a2-982d-1079dd8a976b, skipping ID generation
2026-03-30 10:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64a4a8d2-cc19-53a2-982d-1079dd8a976b with scrape type 1
2026-03-30 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64a4a8d2-cc19-53a2-982d-1079dd8a976b sending to next pipeline
2026-03-30 10:39:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64a4a8d2-cc19-53a2-982d-1079dd8a976b, identifier: ZT80632
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F86%252F2f86619233805d65f32d270490a5cfb2%252Fpa%252FHK07148_58838e80066f76997595a79ffccfd12f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_58838e80066f76997595a79ffccfd12f.jpg not downloaded yet
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fab%252Fb6ab4d6f894d932a41ad66dad7c351ac%252Fpa%252FTD64392_6621af3432187c6ca45ee675c8b87d03.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_6621af3432187c6ca45ee675c8b87d03.jpg not downloaded yet
2026-03-30 10:39:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64a4a8d2-cc19-53a2-982d-1079dd8a976b with identifier: ZT80632
2026-03-30 10:39:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64a4a8d2-cc19-53a2-982d-1079dd8a976b with identifier: ZT80632
2026-03-30 10:39:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64a4a8d2-cc19-53a2-982d-1079dd8a976b with identifier: ZT80632 to the API
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_bee1a4d1a511434474cc443f0327dfac.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:39:15Z',
 'fuel_type': 'petrol',
 'id': '64a4a8d2-cc19-53a2-982d-1079dd8a976b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT80632',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 54603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_9cbbd6e1115f83d8aec7bab2d80e9a5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_3711f874d51c66919dd90ab13d373a04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_1fdb7779f0bec3d0fe8d682d8f22eef0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_36bc9a92b24621e4aea24eca8ba62387.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_f944d1c930deb3665add5f641bc6a033.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_e4a0c38ba62a743aa68e264c8fdfb7cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_54516adc91938aa9531b3c2a833020b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_8dde97b6a5790699c4a031cdb30d0ac9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_69c6df28a2487c348e3e638fdf492902.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64a4a8d2-cc19-53a2-982d-1079dd8a976b/64a4a8d2-cc19-53a2-982d-1079dd8a976b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/ab/1fabdbdc53646b240bdfcad75307cdcf/pa/ZT80632_bee1a4d1a511434474cc443f0327dfac.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI R-Line',
 'transmission': 'manual',
 'trim': 'R-Line',
 'year': 2023}
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT80632%27 HTTP/1.1" 200 None
2026-03-30 10:39:33 [auto1.de] INFO: Saving data for ZT80632: {'created_time': 1774867173.380748, 'last_price_update_time': 1774867173.380759, 'auction_closing_time': 1774971555.0}
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT80632') HTTP/1.1" 204 0
2026-03-30 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_574e3c3765f491a3c40cd95dfb518118.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_46b0a3dd90186e9658948c09a41f40a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c2e10>
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_3eb08e4739acf11f66b3a9a5421e878a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_3eb08e4739acf11f66b3a9a5421e878a.jpg saved to cache
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63436321-d5ce-5e54-a93c-19f071a52219
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0dfd0>
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_f4b1b9dd838375cc90ea351d48272236.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_f4b1b9dd838375cc90ea351d48272236.jpg saved to cache
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63436321-d5ce-5e54-a93c-19f071a52219
2026-03-30 10:39:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08865125-5435-54f8-9e5a-3c9855c2b82b with identifier: VC21585
2026-03-30 10:39:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08865125-5435-54f8-9e5a-3c9855c2b82b with scrape type 1
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08865125-5435-54f8-9e5a-3c9855c2b82b
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_380229a355044a995b07ff2300fade03.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_380229a355044a995b07ff2300fade03.jpg not downloaded yet
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fab%252Fb6ab4d6f894d932a41ad66dad7c351ac%252Fpa%252FTD64392_a519cbaa40d82248079bbc4e6ebab700.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_a519cbaa40d82248079bbc4e6ebab700.jpg not downloaded yet
2026-03-30 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_045a21c01cffc63974b99813fa303eca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_871450bb0d12ff9098cb74df503c99e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_871450bb0d12ff9098cb74df503c99e6.jpg not downloaded yet
2026-03-30 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN85536/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fab%252Fb6ab4d6f894d932a41ad66dad7c351ac%252Fpa%252FTD64392_2d9e542c06316a64c809f13d0b6460ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_2d9e542c06316a64c809f13d0b6460ca.jpg not downloaded yet
2026-03-30 10:39:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508f110>
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc2%252F62c28cf3a3326ceed1e01307b0658573%252Fpa%252FAN69770_088df8656877bd7f1c09bf55819b9e20.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_088df8656877bd7f1c09bf55819b9e20.jpg saved to cache
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63436321-d5ce-5e54-a93c-19f071a52219
2026-03-30 10:39:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63436321-d5ce-5e54-a93c-19f071a52219, skipping ID generation
2026-03-30 10:39:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63436321-d5ce-5e54-a93c-19f071a52219 with scrape type 1
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63436321-d5ce-5e54-a93c-19f071a52219 sending to next pipeline
2026-03-30 10:39:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63436321-d5ce-5e54-a93c-19f071a52219, identifier: AN69770
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef789f690>
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32597ede-11c0-54b0-86a3-01a15dfadc2c/32597ede-11c0-54b0-86a3-01a15dfadc2c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F86%252F2f86619233805d65f32d270490a5cfb2%252Fpa%252FHK07148_574e3c3765f491a3c40cd95dfb518118.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_574e3c3765f491a3c40cd95dfb518118.jpg saved to cache
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32597ede-11c0-54b0-86a3-01a15dfadc2c
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5028650>
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32597ede-11c0-54b0-86a3-01a15dfadc2c/32597ede-11c0-54b0-86a3-01a15dfadc2c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F86%252F2f86619233805d65f32d270490a5cfb2%252Fpa%252FHK07148_46b0a3dd90186e9658948c09a41f40a4.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_46b0a3dd90186e9658948c09a41f40a4.jpg saved to cache
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 32597ede-11c0-54b0-86a3-01a15dfadc2c
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_d1718f318678a625084def2581485afb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_d1718f318678a625084def2581485afb.jpg not downloaded yet
2026-03-30 10:39:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63436321-d5ce-5e54-a93c-19f071a52219 with identifier: AN69770
2026-03-30 10:39:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63436321-d5ce-5e54-a93c-19f071a52219 with identifier: AN69770
2026-03-30 10:39:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63436321-d5ce-5e54-a93c-19f071a52219 with identifier: AN69770 to the API
2026-03-30 10:39:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_088df8656877bd7f1c09bf55819b9e20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 341,
 'expiration_date': '2026-03-31T15:07:32Z',
 'fuel_type': 'hybrid',
 'id': '63436321-d5ce-5e54-a93c-19f071a52219',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN69770',
 'listing': 'auction',
 'location': 'DE, Aschaffenburg',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 135704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_088df8656877bd7f1c09bf55819b9e20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_3eb08e4739acf11f66b3a9a5421e878a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_f4b1b9dd838375cc90ea351d48272236.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_f510f964db0a5a3f06d80110323c333f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_93ba5d39886d03a3aca709676903c0dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_837b17de2fa9cc94dabb30ede5606c32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_7756617a166a6213e1e68b2750cd4e67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_d5af56d6bbd9494f59682c6a30a437ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_314fe32bc9617d3a4eff652fd3018b37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63436321-d5ce-5e54-a93c-19f071a52219/63436321-d5ce-5e54-a93c-19f071a52219_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c2/62c28cf3a3326ceed1e01307b0658573/pa/AN69770_3ac80747ce67eb3b7d02e320fbd66553.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 T6 Plug-in Hybrid R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2021}
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN69770%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [auto1.de] INFO: Saving data for AN69770: {'created_time': 1774867174.266954, 'last_price_update_time': 1774867174.266964, 'auction_closing_time': 1774969652.0}
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN69770') HTTP/1.1" 204 0
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_166a327f4e5e5a4064085ba545726cfe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fab%252Fb6ab4d6f894d932a41ad66dad7c351ac%252Fpa%252FTD64392_5488583c138b7f7229e72abcb96153b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_5488583c138b7f7229e72abcb96153b1.jpg not downloaded yet
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_b5a9e33b2ba747a35d239037ca77c1b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_e4cdb549583912b9a16a7f5b574b73ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_e4cdb549583912b9a16a7f5b574b73ed.jpg not downloaded yet
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5995b90>
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32597ede-11c0-54b0-86a3-01a15dfadc2c/32597ede-11c0-54b0-86a3-01a15dfadc2c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F86%252F2f86619233805d65f32d270490a5cfb2%252Fpa%252FHK07148_045a21c01cffc63974b99813fa303eca.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_045a21c01cffc63974b99813fa303eca.jpg saved to cache
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 32597ede-11c0-54b0-86a3-01a15dfadc2c
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fab%252Fb6ab4d6f894d932a41ad66dad7c351ac%252Fpa%252FTD64392_fcb09084947348604b57c12766d3f28f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_fcb09084947348604b57c12766d3f28f.jpg not downloaded yet
2026-03-30 10:39:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL83940/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY18097/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_1ccf9616217659d26e700a49fb61ffe4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_1ccf9616217659d26e700a49fb61ffe4.jpg not downloaded yet
2026-03-30 10:39:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_380229a355044a995b07ff2300fade03.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_ebbcf6c4166d75eb93bc3c27dc29c267.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_ebbcf6c4166d75eb93bc3c27dc29c267.jpg not downloaded yet
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ec06d0>
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bfede8-da23-5e5f-bb44-1332f5105aad/08bfede8-da23-5e5f-bb44-1332f5105aad_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fab%252Fb6ab4d6f894d932a41ad66dad7c351ac%252Fpa%252FTD64392_166a327f4e5e5a4064085ba545726cfe.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_166a327f4e5e5a4064085ba545726cfe.jpg saved to cache
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08bfede8-da23-5e5f-bb44-1332f5105aad
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef596fe10>
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32597ede-11c0-54b0-86a3-01a15dfadc2c/32597ede-11c0-54b0-86a3-01a15dfadc2c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F86%252F2f86619233805d65f32d270490a5cfb2%252Fpa%252FHK07148_b5a9e33b2ba747a35d239037ca77c1b9.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_b5a9e33b2ba747a35d239037ca77c1b9.jpg saved to cache
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 32597ede-11c0-54b0-86a3-01a15dfadc2c
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_a519cbaa40d82248079bbc4e6ebab700.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_e4cdb549583912b9a16a7f5b574b73ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_1bb7f675d4f0381563a4484bbcc0b8c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_1bb7f675d4f0381563a4484bbcc0b8c5.jpg not downloaded yet
2026-03-30 10:39:34 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 9432 | hits on page: 40
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_d1718f318678a625084def2581485afb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_d4e7bbcde48ed68a42451567fca5da19.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_d4e7bbcde48ed68a42451567fca5da19.jpg not downloaded yet
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5071e50>
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_380229a355044a995b07ff2300fade03.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_380229a355044a995b07ff2300fade03.jpg saved to cache
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08865125-5435-54f8-9e5a-3c9855c2b82b
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_2d9e542c06316a64c809f13d0b6460ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:34 [auto1.de] INFO: Found listing with ID: LZ79063
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ79063%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [auto1.de] INFO: Scrape type for LZ79063: 0
2026-03-30 10:39:34 [auto1.de] INFO: Found listing with ID: JA98582
2026-03-30 10:39:34 [auto1.de] INFO: Found listing with ID: HT26975
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT26975%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [auto1.de] INFO: Scrape type for HT26975: 1
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_b731629dd7fc5b4c70668b83c40486e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_b731629dd7fc5b4c70668b83c40486e2.jpg not downloaded yet
2026-03-30 10:39:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_5488583c138b7f7229e72abcb96153b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_fcb09084947348604b57c12766d3f28f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:34 [auto1.de] INFO: Found listing with ID: SM57605
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM57605%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [auto1.de] INFO: Scrape type for SM57605: 2
2026-03-30 10:39:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8149d089-0eaf-5f16-9848-cfa3b115f894 with identifier: SM57605
2026-03-30 10:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8149d089-0eaf-5f16-9848-cfa3b115f894 with scrape type 2
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8149d089-0eaf-5f16-9848-cfa3b115f894 with scrape type 2
2026-03-30 10:39:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8149d089-0eaf-5f16-9848-cfa3b115f894, identifier: SM57605
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_d2c93888eda5c42c5b23a824d4a0b90e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_d2c93888eda5c42c5b23a824d4a0b90e.jpg not downloaded yet
2026-03-30 10:39:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8149d089-0eaf-5f16-9848-cfa3b115f894 with identifier: SM57605
2026-03-30 10:39:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8149d089-0eaf-5f16-9848-cfa3b115f894 with identifier: SM57605
2026-03-30 10:39:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8149d089-0eaf-5f16-9848-cfa3b115f894 with identifier: SM57605 to the API
2026-03-30 10:39:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:43:06Z',
 'fuel_type': 'petrol',
 'id': '8149d089-0eaf-5f16-9848-cfa3b115f894',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM57605',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 81796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-07',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Spirit 2WD',
 'transmission': 'manual',
 'trim': 'Spirit 2WD',
 'year': 2013}
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM57605%27 HTTP/1.1" 200 None
2026-03-30 10:39:35 [auto1.de] INFO: Saving data for SM57605: {'auction_closing_time': 1774971786.0, 'created_time': 1773308022.508721, 'last_price_update_time': 1774867175.172702}
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM57605') HTTP/1.1" 204 0
2026-03-30 10:39:35 [auto1.de] INFO: Found listing with ID: UC67043
2026-03-30 10:39:35 [auto1.de] INFO: Found listing with ID: MH55571
2026-03-30 10:39:35 [auto1.de] INFO: Found listing with ID: HM13526
2026-03-30 10:39:35 [auto1.de] INFO: Found listing with ID: MN78455
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN78455%27 HTTP/1.1" 200 None
2026-03-30 10:39:35 [auto1.de] INFO: Scrape type for MN78455: 1
2026-03-30 10:39:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_1ccf9616217659d26e700a49fb61ffe4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_1bb7f675d4f0381563a4484bbcc0b8c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_ebbcf6c4166d75eb93bc3c27dc29c267.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db6b10>
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bfede8-da23-5e5f-bb44-1332f5105aad/08bfede8-da23-5e5f-bb44-1332f5105aad_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fab%252Fb6ab4d6f894d932a41ad66dad7c351ac%252Fpa%252FTD64392_a519cbaa40d82248079bbc4e6ebab700.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_a519cbaa40d82248079bbc4e6ebab700.jpg saved to cache
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08bfede8-da23-5e5f-bb44-1332f5105aad
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7884b50>
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_e4cdb549583912b9a16a7f5b574b73ed.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_e4cdb549583912b9a16a7f5b574b73ed.jpg saved to cache
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08865125-5435-54f8-9e5a-3c9855c2b82b
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5125f50>
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_d1718f318678a625084def2581485afb.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_d1718f318678a625084def2581485afb.jpg saved to cache
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08865125-5435-54f8-9e5a-3c9855c2b82b
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5aaf010>
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bfede8-da23-5e5f-bb44-1332f5105aad/08bfede8-da23-5e5f-bb44-1332f5105aad_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fab%252Fb6ab4d6f894d932a41ad66dad7c351ac%252Fpa%252FTD64392_2d9e542c06316a64c809f13d0b6460ca.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_2d9e542c06316a64c809f13d0b6460ca.jpg saved to cache
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08bfede8-da23-5e5f-bb44-1332f5105aad
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e79690>
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bfede8-da23-5e5f-bb44-1332f5105aad/08bfede8-da23-5e5f-bb44-1332f5105aad_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fab%252Fb6ab4d6f894d932a41ad66dad7c351ac%252Fpa%252FTD64392_5488583c138b7f7229e72abcb96153b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_5488583c138b7f7229e72abcb96153b1.jpg saved to cache
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08bfede8-da23-5e5f-bb44-1332f5105aad
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5126090>
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bfede8-da23-5e5f-bb44-1332f5105aad/08bfede8-da23-5e5f-bb44-1332f5105aad_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fab%252Fb6ab4d6f894d932a41ad66dad7c351ac%252Fpa%252FTD64392_fcb09084947348604b57c12766d3f28f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_fcb09084947348604b57c12766d3f28f.jpg saved to cache
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08bfede8-da23-5e5f-bb44-1332f5105aad
2026-03-30 10:39:35 [auto1.de] INFO: Found listing with ID: PZ62631
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ62631%27 HTTP/1.1" 200 None
2026-03-30 10:39:35 [auto1.de] INFO: Scrape type for PZ62631: 1
2026-03-30 10:39:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_d4e7bbcde48ed68a42451567fca5da19.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:35 [auto1.de] INFO: Found listing with ID: HH83846
2026-03-30 10:39:35 [auto1.de] INFO: Found listing with ID: LH15693
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH15693%27 HTTP/1.1" 200 None
2026-03-30 10:39:35 [auto1.de] INFO: Scrape type for LH15693: 2
2026-03-30 10:39:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bfd3ecb-885c-5501-a593-cf21a1a6708b with identifier: LH15693
2026-03-30 10:39:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bfd3ecb-885c-5501-a593-cf21a1a6708b with scrape type 2
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bfd3ecb-885c-5501-a593-cf21a1a6708b with scrape type 2
2026-03-30 10:39:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bfd3ecb-885c-5501-a593-cf21a1a6708b, identifier: LH15693
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee7a10>
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_1ccf9616217659d26e700a49fb61ffe4.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_1ccf9616217659d26e700a49fb61ffe4.jpg saved to cache
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08865125-5435-54f8-9e5a-3c9855c2b82b
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef8846a90>
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_1bb7f675d4f0381563a4484bbcc0b8c5.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_1bb7f675d4f0381563a4484bbcc0b8c5.jpg saved to cache
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08865125-5435-54f8-9e5a-3c9855c2b82b
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50841d0>
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_ebbcf6c4166d75eb93bc3c27dc29c267.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_ebbcf6c4166d75eb93bc3c27dc29c267.jpg saved to cache
2026-03-30 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08865125-5435-54f8-9e5a-3c9855c2b82b
2026-03-30 10:39:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bfd3ecb-885c-5501-a593-cf21a1a6708b with identifier: LH15693
2026-03-30 10:39:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bfd3ecb-885c-5501-a593-cf21a1a6708b with identifier: LH15693
2026-03-30 10:39:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bfd3ecb-885c-5501-a593-cf21a1a6708b with identifier: LH15693 to the API
2026-03-30 10:39:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:41:38Z',
 'fuel_type': 'petrol',
 'id': '5bfd3ecb-885c-5501-a593-cf21a1a6708b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH15693',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 106137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2020}
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH15693%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [auto1.de] INFO: Saving data for LH15693: {'auction_closing_time': 1774971698.0, 'created_time': 1773861383.949512, 'last_price_update_time': 1774867176.135798}
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH15693') HTTP/1.1" 204 0
2026-03-30 10:39:36 [auto1.de] INFO: Found listing with ID: ZM57551
2026-03-30 10:39:36 [auto1.de] INFO: Found listing with ID: VZ64850
2026-03-30 10:39:36 [auto1.de] INFO: Found listing with ID: BM75742
2026-03-30 10:39:36 [auto1.de] INFO: Found listing with ID: SS17636
2026-03-30 10:39:36 [auto1.de] INFO: Found listing with ID: KC19039
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC19039%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [auto1.de] INFO: Scrape type for KC19039: 1
2026-03-30 10:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_b731629dd7fc5b4c70668b83c40486e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_d2c93888eda5c42c5b23a824d4a0b90e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:36 [auto1.de] INFO: Found listing with ID: HJ87007
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ87007%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [auto1.de] INFO: Scrape type for HJ87007: 2
2026-03-30 10:39:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cf5d191-b7aa-5594-b3e2-5412f6cf9924 with identifier: HJ87007
2026-03-30 10:39:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cf5d191-b7aa-5594-b3e2-5412f6cf9924 with scrape type 2
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cf5d191-b7aa-5594-b3e2-5412f6cf9924 with scrape type 2
2026-03-30 10:39:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cf5d191-b7aa-5594-b3e2-5412f6cf9924, identifier: HJ87007
2026-03-30 10:39:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cf5d191-b7aa-5594-b3e2-5412f6cf9924 with identifier: HJ87007
2026-03-30 10:39:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cf5d191-b7aa-5594-b3e2-5412f6cf9924 with identifier: HJ87007
2026-03-30 10:39:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cf5d191-b7aa-5594-b3e2-5412f6cf9924 with identifier: HJ87007 to the API
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:00:23Z',
 'fuel_type': 'petrol',
 'id': '5cf5d191-b7aa-5594-b3e2-5412f6cf9924',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ87007',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 172812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-19',
 'seller_name': None,
 'title': 'Audi A3 1.8 TFSI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2011}
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ87007%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [auto1.de] INFO: Saving data for HJ87007: {'auction_closing_time': 1774969223.0, 'created_time': 1773345208.573039, 'last_price_update_time': 1774867176.609094}
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ87007') HTTP/1.1" 204 0
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50878d0>
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_d4e7bbcde48ed68a42451567fca5da19.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_d4e7bbcde48ed68a42451567fca5da19.jpg saved to cache
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08865125-5435-54f8-9e5a-3c9855c2b82b
2026-03-30 10:39:36 [auto1.de] INFO: Found listing with ID: EG45632
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG45632%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [auto1.de] INFO: Scrape type for EG45632: 1
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee7a10>
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_b731629dd7fc5b4c70668b83c40486e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_b731629dd7fc5b4c70668b83c40486e2.jpg saved to cache
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08865125-5435-54f8-9e5a-3c9855c2b82b
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da1d90>
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_d2c93888eda5c42c5b23a824d4a0b90e.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_d2c93888eda5c42c5b23a824d4a0b90e.jpg saved to cache
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08865125-5435-54f8-9e5a-3c9855c2b82b
2026-03-30 10:39:36 [auto1.de] INFO: Found listing with ID: NZ38096
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ38096%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [auto1.de] INFO: Scrape type for NZ38096: 1
2026-03-30 10:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC86665> (referer: https://www.auto1.com/v1/car-details-view/CC86665/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU89070/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:36 [auto1.de] INFO: Found listing with ID: PG06800
2026-03-30 10:39:36 [auto1.de] INFO: Found listing with ID: TS54833
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS54833%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [auto1.de] INFO: Scrape type for TS54833: 1
2026-03-30 10:39:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:36 [auto1.de] INFO: Found listing with ID: UP86151
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP86151%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [auto1.de] INFO: Scrape type for UP86151: 1
2026-03-30 10:39:36 [auto1.de] INFO: Found listing with ID: JV73978
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV73978%27 HTTP/1.1" 200 None
2026-03-30 10:39:36 [auto1.de] INFO: Scrape type for JV73978: 2
2026-03-30 10:39:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 049d1263-4af0-552e-8a8b-00cac330fcc5 with identifier: JV73978
2026-03-30 10:39:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 049d1263-4af0-552e-8a8b-00cac330fcc5 with scrape type 2
2026-03-30 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 049d1263-4af0-552e-8a8b-00cac330fcc5 with scrape type 2
2026-03-30 10:39:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 049d1263-4af0-552e-8a8b-00cac330fcc5, identifier: JV73978
2026-03-30 10:39:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 049d1263-4af0-552e-8a8b-00cac330fcc5 with identifier: JV73978
2026-03-30 10:39:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 049d1263-4af0-552e-8a8b-00cac330fcc5 with identifier: JV73978
2026-03-30 10:39:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 049d1263-4af0-552e-8a8b-00cac330fcc5 with identifier: JV73978 to the API
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:23:39Z',
 'fuel_type': 'petrol',
 'id': '049d1263-4af0-552e-8a8b-00cac330fcc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV73978',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 74077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-25',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Edition ecoFlex',
 'year': 2015}
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV73978%27 HTTP/1.1" 200 None
2026-03-30 10:39:37 [auto1.de] INFO: Saving data for JV73978: {'auction_closing_time': 1774970619.0, 'created_time': 1773726045.695635, 'last_price_update_time': 1774867177.338413}
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV73978') HTTP/1.1" 204 0
2026-03-30 10:39:37 [auto1.de] INFO: Found listing with ID: PM17860
2026-03-30 10:39:37 [auto1.de] INFO: Found listing with ID: VV52010
2026-03-30 10:39:37 [auto1.de] INFO: Found listing with ID: RT19134
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT19134%27 HTTP/1.1" 200 None
2026-03-30 10:39:37 [auto1.de] INFO: Scrape type for RT19134: 2
2026-03-30 10:39:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d570a34-6c95-514e-b8e7-ebb9230a8568 with identifier: RT19134
2026-03-30 10:39:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d570a34-6c95-514e-b8e7-ebb9230a8568 with scrape type 2
2026-03-30 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d570a34-6c95-514e-b8e7-ebb9230a8568 with scrape type 2
2026-03-30 10:39:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d570a34-6c95-514e-b8e7-ebb9230a8568, identifier: RT19134
2026-03-30 10:39:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d570a34-6c95-514e-b8e7-ebb9230a8568 with identifier: RT19134
2026-03-30 10:39:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d570a34-6c95-514e-b8e7-ebb9230a8568 with identifier: RT19134
2026-03-30 10:39:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d570a34-6c95-514e-b8e7-ebb9230a8568 with identifier: RT19134 to the API
2026-03-30 10:39:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:02:22Z',
 'fuel_type': 'petrol',
 'id': '9d570a34-6c95-514e-b8e7-ebb9230a8568',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT19134',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 96013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'GTI BlueMotion Tech',
 'year': 2014}
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT19134%27 HTTP/1.1" 200 None
2026-03-30 10:39:38 [auto1.de] INFO: Saving data for RT19134: {'auction_closing_time': 1774969342.0, 'created_time': 1773305745.58849, 'last_price_update_time': 1774867178.445612}
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT19134') HTTP/1.1" 204 0
2026-03-30 10:39:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9507fb7d-6763-560b-98e8-c6d13b90ddeb with identifier: CC86665
2026-03-30 10:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9507fb7d-6763-560b-98e8-c6d13b90ddeb with scrape type 1
2026-03-30 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9507fb7d-6763-560b-98e8-c6d13b90ddeb
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F76%252Ffa76df893059d18857729c9f26e956bf%252Fpa%252FCC86665_ab3fff137d0c0440cc335f1af2a1f6b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/76/fa76df893059d18857729c9f26e956bf/pa/CC86665_ab3fff137d0c0440cc335f1af2a1f6b1.jpg already downloaded
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F76%252Ffa76df893059d18857729c9f26e956bf%252Fpa%252FCC86665_05eda2ea8740e45cdf3b9a46629e89ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/76/fa76df893059d18857729c9f26e956bf/pa/CC86665_05eda2ea8740e45cdf3b9a46629e89ac.jpg already downloaded
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F76%252Ffa76df893059d18857729c9f26e956bf%252Fpa%252FCC86665_b824ce9c308af799f7d576ef928b7414.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/76/fa76df893059d18857729c9f26e956bf/pa/CC86665_b824ce9c308af799f7d576ef928b7414.jpg already downloaded
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F76%252Ffa76df893059d18857729c9f26e956bf%252Fpa%252FCC86665_c087941b2490f868fadb7c9cb28d66f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/76/fa76df893059d18857729c9f26e956bf/pa/CC86665_c087941b2490f868fadb7c9cb28d66f0.jpg already downloaded
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F76%252Ffa76df893059d18857729c9f26e956bf%252Fpa%252FCC86665_d74e7fcfec1e9f6885a3b008b446584b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/76/fa76df893059d18857729c9f26e956bf/pa/CC86665_d74e7fcfec1e9f6885a3b008b446584b.jpg already downloaded
2026-03-30 10:39:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9507fb7d-6763-560b-98e8-c6d13b90ddeb, identifier: CC86665
2026-03-30 10:39:38 [auto1.de] INFO: Found listing with ID: KV63005
2026-03-30 10:39:38 [auto1.de] INFO: Found listing with ID: SF81844
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF81844%27 HTTP/1.1" 200 None
2026-03-30 10:39:38 [auto1.de] INFO: Scrape type for SF81844: 1
2026-03-30 10:39:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9507fb7d-6763-560b-98e8-c6d13b90ddeb with identifier: CC86665
2026-03-30 10:39:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9507fb7d-6763-560b-98e8-c6d13b90ddeb with identifier: CC86665
2026-03-30 10:39:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9507fb7d-6763-560b-98e8-c6d13b90ddeb with identifier: CC86665 to the API
2026-03-30 10:39:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CC86665>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:01:27Z',
 'fuel_type': 'diesel',
 'id': '9507fb7d-6763-560b-98e8-c6d13b90ddeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC86665',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 311155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgfa/76/fa76df893059d18857729c9f26e956bf/pa/CC86665_ab3fff137d0c0440cc335f1af2a1f6b1.jpg',
                'https://img-pa.auto1.com/imgfa/76/fa76df893059d18857729c9f26e956bf/pa/CC86665_05eda2ea8740e45cdf3b9a46629e89ac.jpg',
                'https://img-pa.auto1.com/imgfa/76/fa76df893059d18857729c9f26e956bf/pa/CC86665_b824ce9c308af799f7d576ef928b7414.jpg',
                'https://img-pa.auto1.com/imgfa/76/fa76df893059d18857729c9f26e956bf/pa/CC86665_c087941b2490f868fadb7c9cb28d66f0.jpg',
                'https://img-pa.auto1.com/imgfa/76/fa76df893059d18857729c9f26e956bf/pa/CC86665_d74e7fcfec1e9f6885a3b008b446584b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9507fb7d-6763-560b-98e8-c6d13b90ddeb/9507fb7d-6763-560b-98e8-c6d13b90ddeb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/76/fa76df893059d18857729c9f26e956bf/pa/CC86665_ab3fff137d0c0440cc335f1af2a1f6b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9507fb7d-6763-560b-98e8-c6d13b90ddeb/9507fb7d-6763-560b-98e8-c6d13b90ddeb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/76/fa76df893059d18857729c9f26e956bf/pa/CC86665_05eda2ea8740e45cdf3b9a46629e89ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9507fb7d-6763-560b-98e8-c6d13b90ddeb/9507fb7d-6763-560b-98e8-c6d13b90ddeb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/76/fa76df893059d18857729c9f26e956bf/pa/CC86665_b824ce9c308af799f7d576ef928b7414.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9507fb7d-6763-560b-98e8-c6d13b90ddeb/9507fb7d-6763-560b-98e8-c6d13b90ddeb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/76/fa76df893059d18857729c9f26e956bf/pa/CC86665_c087941b2490f868fadb7c9cb28d66f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9507fb7d-6763-560b-98e8-c6d13b90ddeb/9507fb7d-6763-560b-98e8-c6d13b90ddeb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/76/fa76df893059d18857729c9f26e956bf/pa/CC86665_d74e7fcfec1e9f6885a3b008b446584b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC86665%27 HTTP/1.1" 200 None
2026-03-30 10:39:39 [auto1.de] INFO: Saving data for CC86665: {'created_time': 1774867179.17905, 'last_price_update_time': 1774867179.179061, 'auction_closing_time': 1774969287.0}
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC86665') HTTP/1.1" 204 0
2026-03-30 10:39:39 [auto1.de] INFO: Found listing with ID: AZ64163
2026-03-30 10:39:39 [auto1.de] INFO: Found listing with ID: LS25004
2026-03-30 10:39:39 [auto1.de] INFO: Found listing with ID: SE58467
2026-03-30 10:39:39 [auto1.de] INFO: Found listing with ID: LV13893
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV13893%27 HTTP/1.1" 200 None
2026-03-30 10:39:39 [auto1.de] INFO: Scrape type for LV13893: 2
2026-03-30 10:39:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2be6a903-2ce2-5df9-828a-c382920240f2 with identifier: LV13893
2026-03-30 10:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2be6a903-2ce2-5df9-828a-c382920240f2 with scrape type 2
2026-03-30 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2be6a903-2ce2-5df9-828a-c382920240f2 with scrape type 2
2026-03-30 10:39:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2be6a903-2ce2-5df9-828a-c382920240f2, identifier: LV13893
2026-03-30 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MY16405/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2be6a903-2ce2-5df9-828a-c382920240f2 with identifier: LV13893
2026-03-30 10:39:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2be6a903-2ce2-5df9-828a-c382920240f2 with identifier: LV13893
2026-03-30 10:39:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2be6a903-2ce2-5df9-828a-c382920240f2 with identifier: LV13893 to the API
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-31T15:32:41Z',
 'fuel_type': 'diesel',
 'id': '2be6a903-2ce2-5df9-828a-c382920240f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV13893',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 88793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-23',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2021}
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV13893%27 HTTP/1.1" 200 None
2026-03-30 10:39:39 [auto1.de] INFO: Saving data for LV13893: {'auction_closing_time': 1774971161.0, 'created_time': 1773402815.996962, 'last_price_update_time': 1774867179.748463}
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV13893') HTTP/1.1" 204 0
2026-03-30 10:39:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:39 [auto1.de] INFO: Found listing with ID: AD08111
2026-03-30 10:39:39 [auto1.de] INFO: Found listing with ID: XF59760
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF59760%27 HTTP/1.1" 200 None
2026-03-30 10:39:39 [auto1.de] INFO: Scrape type for XF59760: 2
2026-03-30 10:39:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78280084-0aa5-56a9-bea8-7bc13c61fa06 with identifier: XF59760
2026-03-30 10:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78280084-0aa5-56a9-bea8-7bc13c61fa06 with scrape type 2
2026-03-30 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78280084-0aa5-56a9-bea8-7bc13c61fa06 with scrape type 2
2026-03-30 10:39:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78280084-0aa5-56a9-bea8-7bc13c61fa06, identifier: XF59760
2026-03-30 10:39:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78280084-0aa5-56a9-bea8-7bc13c61fa06 with identifier: XF59760
2026-03-30 10:39:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78280084-0aa5-56a9-bea8-7bc13c61fa06 with identifier: XF59760
2026-03-30 10:39:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78280084-0aa5-56a9-bea8-7bc13c61fa06 with identifier: XF59760 to the API
2026-03-30 10:39:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:27:17Z',
 'fuel_type': 'petrol',
 'id': '78280084-0aa5-56a9-bea8-7bc13c61fa06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF59760',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 139972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-13',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF59760%27 HTTP/1.1" 200 None
2026-03-30 10:39:40 [auto1.de] INFO: Saving data for XF59760: {'auction_closing_time': 1774970837.0, 'created_time': 1773303494.408995, 'last_price_update_time': 1774867180.324703}
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF59760') HTTP/1.1" 204 0
2026-03-30 10:39:40 [auto1.de] INFO: Found listing with ID: SE80616
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE80616%27 HTTP/1.1" 200 None
2026-03-30 10:39:40 [auto1.de] INFO: Scrape type for SE80616: 1
2026-03-30 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EZ67237/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:40 [auto1.de] INFO: Found listing with ID: BP47539
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP47539%27 HTTP/1.1" 200 None
2026-03-30 10:39:40 [auto1.de] INFO: Scrape type for BP47539: 1
2026-03-30 10:39:40 [auto1.de] INFO: Found listing with ID: KK79364
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK79364%27 HTTP/1.1" 200 None
2026-03-30 10:39:40 [auto1.de] INFO: Scrape type for KK79364: 2
2026-03-30 10:39:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b389141-7998-5706-9841-35022d4527be with identifier: KK79364
2026-03-30 10:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b389141-7998-5706-9841-35022d4527be with scrape type 2
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b389141-7998-5706-9841-35022d4527be with scrape type 2
2026-03-30 10:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b389141-7998-5706-9841-35022d4527be, identifier: KK79364
2026-03-30 10:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b389141-7998-5706-9841-35022d4527be with identifier: KK79364
2026-03-30 10:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b389141-7998-5706-9841-35022d4527be with identifier: KK79364
2026-03-30 10:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b389141-7998-5706-9841-35022d4527be with identifier: KK79364 to the API
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:14:28Z',
 'fuel_type': 'petrol',
 'id': '3b389141-7998-5706-9841-35022d4527be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK79364',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 109944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-24',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2014}
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK79364%27 HTTP/1.1" 200 None
2026-03-30 10:39:40 [auto1.de] INFO: Saving data for KK79364: {'auction_closing_time': 1774970068.0, 'created_time': 1774348818.288555, 'last_price_update_time': 1774867180.798735}
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK79364') HTTP/1.1" 204 0
2026-03-30 10:39:40 [auto1.de] INFO: Found listing with ID: WY46895
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY46895%27 HTTP/1.1" 200 None
2026-03-30 10:39:40 [auto1.de] INFO: Scrape type for WY46895: 1
2026-03-30 10:39:40 [auto1.de] INFO: Found listing with ID: DM03841
2026-03-30 10:39:40 [auto1.de] INFO: Found listing with ID: LF76097
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF76097%27 HTTP/1.1" 200 None
2026-03-30 10:39:40 [auto1.de] INFO: Scrape type for LF76097: 2
2026-03-30 10:39:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cca3cac-b566-5b72-88ed-50f7fe3beab0 with identifier: LF76097
2026-03-30 10:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cca3cac-b566-5b72-88ed-50f7fe3beab0 with scrape type 2
2026-03-30 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cca3cac-b566-5b72-88ed-50f7fe3beab0 with scrape type 2
2026-03-30 10:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cca3cac-b566-5b72-88ed-50f7fe3beab0, identifier: LF76097
2026-03-30 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW82301/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cca3cac-b566-5b72-88ed-50f7fe3beab0 with identifier: LF76097
2026-03-30 10:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cca3cac-b566-5b72-88ed-50f7fe3beab0 with identifier: LF76097
2026-03-30 10:39:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cca3cac-b566-5b72-88ed-50f7fe3beab0 with identifier: LF76097 to the API
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:51:27Z',
 'fuel_type': 'diesel',
 'id': '0cca3cac-b566-5b72-88ed-50f7fe3beab0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF76097',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 233506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-11',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF76097%27 HTTP/1.1" 200 None
2026-03-30 10:39:41 [auto1.de] INFO: Saving data for LF76097: {'auction_closing_time': 1774972287.0, 'created_time': 1773688843.001272, 'last_price_update_time': 1774867181.30689}
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF76097') HTTP/1.1" 204 0
2026-03-30 10:39:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN85536> (referer: https://www.auto1.com/v1/car-details-view/MN85536/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f with identifier: MN85536
2026-03-30 10:39:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f with scrape type 1
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_5949b8e4f5b4514934baa4fe623c9f9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_5949b8e4f5b4514934baa4fe623c9f9c.jpg not downloaded yet
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_1a27dbb2b749a0a8498128f36a247dc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_1a27dbb2b749a0a8498128f36a247dc3.jpg not downloaded yet
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_521cb7c1e0aaea1ff20c14fe1a63268d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_521cb7c1e0aaea1ff20c14fe1a63268d.jpg not downloaded yet
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_ee34a78950f979240e56a55095b4b8fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_ee34a78950f979240e56a55095b4b8fc.jpg not downloaded yet
2026-03-30 10:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RS58437/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_e7f10cb44aa1bc11546e6b72d2ec8a7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_e7f10cb44aa1bc11546e6b72d2ec8a7d.jpg not downloaded yet
2026-03-30 10:39:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_0ce62a73321391fce751c0397770bd8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_0ce62a73321391fce751c0397770bd8a.jpg not downloaded yet
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_e0d416baef45f5aba80641b2002895ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_e0d416baef45f5aba80641b2002895ad.jpg not downloaded yet
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_44d419bfe76976ce2aa7655ed245d601.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_44d419bfe76976ce2aa7655ed245d601.jpg not downloaded yet
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_3bbf838a715d377cca7864e06382e76f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_3bbf838a715d377cca7864e06382e76f.jpg not downloaded yet
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_e6048f93872fad79ea5cb83216e6ddd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_e6048f93872fad79ea5cb83216e6ddd7.jpg not downloaded yet
2026-03-30 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_ee34a78950f979240e56a55095b4b8fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59abbd0>
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_ee34a78950f979240e56a55095b4b8fc.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_ee34a78950f979240e56a55095b4b8fc.jpg saved to cache
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f
2026-03-30 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT26975/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL83940> (referer: https://www.auto1.com/v1/car-details-view/KL83940/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_3bbf838a715d377cca7864e06382e76f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 124bab74-3be3-599d-97f4-becd5035dfb1 with identifier: KL83940
2026-03-30 10:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 124bab74-3be3-599d-97f4-becd5035dfb1 with scrape type 1
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 124bab74-3be3-599d-97f4-becd5035dfb1
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Ff6%252F0df6a73aee9cb59a114b6e2f28d0d302%252Fpa%252FKL83940_ceb1318097c2d6c366e5474d8b39c6c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_ceb1318097c2d6c366e5474d8b39c6c9.jpg already downloaded
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Ff6%252F0df6a73aee9cb59a114b6e2f28d0d302%252Fpa%252FKL83940_b5932e31e0216e89d3b4ccd2c2eb566c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_b5932e31e0216e89d3b4ccd2c2eb566c.jpg already downloaded
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Ff6%252F0df6a73aee9cb59a114b6e2f28d0d302%252Fpa%252FKL83940_d21f6a8860917d2f25375b538e59bf70.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_d21f6a8860917d2f25375b538e59bf70.jpg already downloaded
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Ff6%252F0df6a73aee9cb59a114b6e2f28d0d302%252Fpa%252FKL83940_9f3940e3423fef4876fb3e0cbb8b18c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_9f3940e3423fef4876fb3e0cbb8b18c3.jpg already downloaded
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Ff6%252F0df6a73aee9cb59a114b6e2f28d0d302%252Fpa%252FKL83940_1b1a5ca1d19330ee280ba0ba23fe2c7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_1b1a5ca1d19330ee280ba0ba23fe2c7b.jpg already downloaded
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Ff6%252F0df6a73aee9cb59a114b6e2f28d0d302%252Fpa%252FKL83940_623670f2929ff262c8d1cc613654654e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_623670f2929ff262c8d1cc613654654e.jpg already downloaded
2026-03-30 10:39:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 124bab74-3be3-599d-97f4-becd5035dfb1, identifier: KL83940
2026-03-30 10:39:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 124bab74-3be3-599d-97f4-becd5035dfb1 with identifier: KL83940
2026-03-30 10:39:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 124bab74-3be3-599d-97f4-becd5035dfb1 with identifier: KL83940
2026-03-30 10:39:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 124bab74-3be3-599d-97f4-becd5035dfb1 with identifier: KL83940 to the API
2026-03-30 10:39:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KL83940>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:18:24Z',
 'fuel_type': 'petrol',
 'id': '124bab74-3be3-599d-97f4-becd5035dfb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL83940',
 'listing': 'auction',
 'location': 'DE, Saarlouis',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 234815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_ceb1318097c2d6c366e5474d8b39c6c9.jpg',
                'https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_b5932e31e0216e89d3b4ccd2c2eb566c.jpg',
                'https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_d21f6a8860917d2f25375b538e59bf70.jpg',
                'https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_9f3940e3423fef4876fb3e0cbb8b18c3.jpg',
                'https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_1b1a5ca1d19330ee280ba0ba23fe2c7b.jpg',
                'https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_623670f2929ff262c8d1cc613654654e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124bab74-3be3-599d-97f4-becd5035dfb1/124bab74-3be3-599d-97f4-becd5035dfb1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_ceb1318097c2d6c366e5474d8b39c6c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124bab74-3be3-599d-97f4-becd5035dfb1/124bab74-3be3-599d-97f4-becd5035dfb1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_b5932e31e0216e89d3b4ccd2c2eb566c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124bab74-3be3-599d-97f4-becd5035dfb1/124bab74-3be3-599d-97f4-becd5035dfb1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_d21f6a8860917d2f25375b538e59bf70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124bab74-3be3-599d-97f4-becd5035dfb1/124bab74-3be3-599d-97f4-becd5035dfb1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_9f3940e3423fef4876fb3e0cbb8b18c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124bab74-3be3-599d-97f4-becd5035dfb1/124bab74-3be3-599d-97f4-becd5035dfb1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_1b1a5ca1d19330ee280ba0ba23fe2c7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124bab74-3be3-599d-97f4-becd5035dfb1/124bab74-3be3-599d-97f4-becd5035dfb1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/f6/0df6a73aee9cb59a114b6e2f28d0d302/pa/KL83940_623670f2929ff262c8d1cc613654654e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Team BlueMotion',
 'transmission': 'manual',
 'trim': 'Team BlueMotion',
 'year': 2011}
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL83940%27 HTTP/1.1" 200 None
2026-03-30 10:39:43 [auto1.de] INFO: Saving data for KL83940: {'created_time': 1774867183.161233, 'last_price_update_time': 1774867183.161243, 'auction_closing_time': 1774970304.0}
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL83940') HTTP/1.1" 204 0
2026-03-30 10:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN78455/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0b9d0>
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_3bbf838a715d377cca7864e06382e76f.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_3bbf838a715d377cca7864e06382e76f.jpg saved to cache
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f
2026-03-30 10:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_e6048f93872fad79ea5cb83216e6ddd7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50ff510>
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_e6048f93872fad79ea5cb83216e6ddd7.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_e6048f93872fad79ea5cb83216e6ddd7.jpg saved to cache
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f
2026-03-30 10:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_e0d416baef45f5aba80641b2002895ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_44d419bfe76976ce2aa7655ed245d601.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb7d50>
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_e0d416baef45f5aba80641b2002895ad.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_e0d416baef45f5aba80641b2002895ad.jpg saved to cache
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e031d0>
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_44d419bfe76976ce2aa7655ed245d601.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_44d419bfe76976ce2aa7655ed245d601.jpg saved to cache
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f
2026-03-30 10:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_0ce62a73321391fce751c0397770bd8a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef789cb50>
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_0ce62a73321391fce751c0397770bd8a.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_0ce62a73321391fce751c0397770bd8a.jpg saved to cache
2026-03-30 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f
2026-03-30 10:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_e7f10cb44aa1bc11546e6b72d2ec8a7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ38096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e89510>
2026-03-30 10:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_e7f10cb44aa1bc11546e6b72d2ec8a7d.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_e7f10cb44aa1bc11546e6b72d2ec8a7d.jpg saved to cache
2026-03-30 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f
2026-03-30 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_521cb7c1e0aaea1ff20c14fe1a63268d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_5949b8e4f5b4514934baa4fe623c9f9c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e63450>
2026-03-30 10:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_521cb7c1e0aaea1ff20c14fe1a63268d.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_521cb7c1e0aaea1ff20c14fe1a63268d.jpg saved to cache
2026-03-30 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f
2026-03-30 10:39:44 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 9435 | hits on page: 40
2026-03-30 10:39:44 [auto1.de] INFO: Found listing with ID: WY46895
2026-03-30 10:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee4e10>
2026-03-30 10:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_5949b8e4f5b4514934baa4fe623c9f9c.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_5949b8e4f5b4514934baa4fe623c9f9c.jpg saved to cache
2026-03-30 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f
2026-03-30 10:39:44 [auto1.de] INFO: Found listing with ID: DM03841
2026-03-30 10:39:44 [auto1.de] INFO: Found listing with ID: LF76097
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF76097%27 HTTP/1.1" 200 None
2026-03-30 10:39:44 [auto1.de] INFO: Scrape type for LF76097: 0
2026-03-30 10:39:44 [auto1.de] INFO: Found listing with ID: FG13318
2026-03-30 10:39:44 [auto1.de] INFO: Found listing with ID: NE24637
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE24637%27 HTTP/1.1" 200 None
2026-03-30 10:39:44 [auto1.de] INFO: Scrape type for NE24637: 1
2026-03-30 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_1a27dbb2b749a0a8498128f36a247dc3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:44 [auto1.de] INFO: Found listing with ID: NW01824
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01824%27 HTTP/1.1" 200 None
2026-03-30 10:39:44 [auto1.de] INFO: Scrape type for NW01824: 2
2026-03-30 10:39:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 147e7b11-a18f-5f93-902d-d45f8a8dfade with identifier: NW01824
2026-03-30 10:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 147e7b11-a18f-5f93-902d-d45f8a8dfade with scrape type 2
2026-03-30 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 147e7b11-a18f-5f93-902d-d45f8a8dfade with scrape type 2
2026-03-30 10:39:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 147e7b11-a18f-5f93-902d-d45f8a8dfade, identifier: NW01824
2026-03-30 10:39:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 147e7b11-a18f-5f93-902d-d45f8a8dfade with identifier: NW01824
2026-03-30 10:39:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 147e7b11-a18f-5f93-902d-d45f8a8dfade with identifier: NW01824
2026-03-30 10:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 147e7b11-a18f-5f93-902d-d45f8a8dfade with identifier: NW01824 to the API
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:11:49Z',
 'fuel_type': 'diesel',
 'id': '147e7b11-a18f-5f93-902d-d45f8a8dfade',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW01824',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 111369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-02',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 350 d 4Matic BlueTEC',
 'transmission': 'automatic',
 'trim': '4Matic BlueTEC',
 'year': 2017}
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01824%27 HTTP/1.1" 200 None
2026-03-30 10:39:45 [auto1.de] INFO: Saving data for NW01824: {'auction_closing_time': 1774969909.0, 'created_time': 1774640132.220991, 'last_price_update_time': 1774867185.096169}
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW01824') HTTP/1.1" 204 0
2026-03-30 10:39:45 [auto1.de] INFO: Found listing with ID: NX53505
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX53505%27 HTTP/1.1" 200 None
2026-03-30 10:39:45 [auto1.de] INFO: Scrape type for NX53505: 1
2026-03-30 10:39:45 [auto1.de] INFO: Found listing with ID: HH32152
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH32152%27 HTTP/1.1" 200 None
2026-03-30 10:39:45 [auto1.de] INFO: Scrape type for HH32152: 2
2026-03-30 10:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1d46d94-25bd-50e5-8c3c-f06150baa96e with identifier: HH32152
2026-03-30 10:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1d46d94-25bd-50e5-8c3c-f06150baa96e with scrape type 2
2026-03-30 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1d46d94-25bd-50e5-8c3c-f06150baa96e with scrape type 2
2026-03-30 10:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1d46d94-25bd-50e5-8c3c-f06150baa96e, identifier: HH32152
2026-03-30 10:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1d46d94-25bd-50e5-8c3c-f06150baa96e with identifier: HH32152
2026-03-30 10:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1d46d94-25bd-50e5-8c3c-f06150baa96e with identifier: HH32152
2026-03-30 10:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1d46d94-25bd-50e5-8c3c-f06150baa96e with identifier: HH32152 to the API
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:16:16Z',
 'fuel_type': 'diesel',
 'id': 'a1d46d94-25bd-50e5-8c3c-f06150baa96e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH32152',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 138458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-14',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.6 TDI Cup',
 'transmission': 'manual',
 'trim': 'Cup',
 'year': 2014}
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH32152%27 HTTP/1.1" 200 None
2026-03-30 10:39:45 [auto1.de] INFO: Saving data for HH32152: {'auction_closing_time': 1774970176.0, 'created_time': 1774377773.097315, 'last_price_update_time': 1774867185.595423}
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH32152') HTTP/1.1" 204 0
2026-03-30 10:39:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea2410>
2026-03-30 10:39:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fc1%252F4ac1dbea15344d6a64661704d8a4a1c8%252Fpa%252FMN85536_1a27dbb2b749a0a8498128f36a247dc3.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_1a27dbb2b749a0a8498128f36a247dc3.jpg saved to cache
2026-03-30 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f
2026-03-30 10:39:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f, skipping ID generation
2026-03-30 10:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f with scrape type 1
2026-03-30 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f sending to next pipeline
2026-03-30 10:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f, identifier: MN85536
2026-03-30 10:39:45 [auto1.de] INFO: Found listing with ID: AT25404
2026-03-30 10:39:45 [auto1.de] INFO: Found listing with ID: WW29948
2026-03-30 10:39:45 [auto1.de] INFO: Found listing with ID: BJ85670
2026-03-30 10:39:45 [auto1.de] INFO: Found listing with ID: XW43246
2026-03-30 10:39:45 [auto1.de] INFO: Found listing with ID: HK17634
2026-03-30 10:39:45 [auto1.de] INFO: Found listing with ID: ZW86653
2026-03-30 10:39:45 [auto1.de] INFO: Found listing with ID: CF13358
2026-03-30 10:39:45 [auto1.de] INFO: Found listing with ID: FD73568
2026-03-30 10:39:45 [auto1.de] INFO: Found listing with ID: SU59543
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU59543%27 HTTP/1.1" 200 None
2026-03-30 10:39:45 [auto1.de] INFO: Scrape type for SU59543: 1
2026-03-30 10:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f with identifier: MN85536
2026-03-30 10:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f with identifier: MN85536
2026-03-30 10:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f with identifier: MN85536 to the API
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_1a27dbb2b749a0a8498128f36a247dc3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:04:52Z',
 'fuel_type': 'diesel',
 'id': 'a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN85536',
 'listing': 'auction',
 'location': 'DE, Gummersbach',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 193885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_5949b8e4f5b4514934baa4fe623c9f9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2460749,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_1a27dbb2b749a0a8498128f36a247dc3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_521cb7c1e0aaea1ff20c14fe1a63268d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2599903,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_ee34a78950f979240e56a55095b4b8fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2440292,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_e7f10cb44aa1bc11546e6b72d2ec8a7d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1993630,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_0ce62a73321391fce751c0397770bd8a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_e0d416baef45f5aba80641b2002895ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_44d419bfe76976ce2aa7655ed245d601.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_3bbf838a715d377cca7864e06382e76f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f/a13703a7-7f14-5a5c-9d0e-fc1cbd68e90f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2961240,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/c1/4ac1dbea15344d6a64661704d8a4a1c8/pa/MN85536_e6048f93872fad79ea5cb83216e6ddd7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-09',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 220 d lang BlueTEC Edition',
 'transmission': 'automatic',
 'trim': 'lang BlueTEC Edition',
 'year': 2014}
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN85536%27 HTTP/1.1" 200 None
2026-03-30 10:39:46 [auto1.de] INFO: Saving data for MN85536: {'created_time': 1774867186.287482, 'last_price_update_time': 1774867186.287493, 'auction_closing_time': 1774969492.0}
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN85536') HTTP/1.1" 204 0
2026-03-30 10:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX61235/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:46 [auto1.de] INFO: Found listing with ID: FV99442
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV99442%27 HTTP/1.1" 200 None
2026-03-30 10:39:46 [auto1.de] INFO: Scrape type for FV99442: 1
2026-03-30 10:39:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG45632/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:46 [auto1.de] INFO: Found listing with ID: YC82095
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC82095%27 HTTP/1.1" 200 None
2026-03-30 10:39:46 [auto1.de] INFO: Scrape type for YC82095: 1
2026-03-30 10:39:46 [auto1.de] INFO: Found listing with ID: SK17684
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK17684%27 HTTP/1.1" 200 None
2026-03-30 10:39:46 [auto1.de] INFO: Scrape type for SK17684: 2
2026-03-30 10:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2928051b-cf5e-5808-9019-bdaa214b1497 with identifier: SK17684
2026-03-30 10:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2928051b-cf5e-5808-9019-bdaa214b1497 with scrape type 2
2026-03-30 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2928051b-cf5e-5808-9019-bdaa214b1497 with scrape type 2
2026-03-30 10:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2928051b-cf5e-5808-9019-bdaa214b1497, identifier: SK17684
2026-03-30 10:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2928051b-cf5e-5808-9019-bdaa214b1497 with identifier: SK17684
2026-03-30 10:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2928051b-cf5e-5808-9019-bdaa214b1497 with identifier: SK17684
2026-03-30 10:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2928051b-cf5e-5808-9019-bdaa214b1497 with identifier: SK17684 to the API
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:30:25Z',
 'fuel_type': 'petrol',
 'id': '2928051b-cf5e-5808-9019-bdaa214b1497',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK17684',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TTS',
 'odometer': 172931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-16',
 'seller_name': None,
 'title': 'Audi TTS 2.0 TFSI quattro Roadster',
 'transmission': 'manual',
 'trim': 'quattro Roadster',
 'year': 2009}
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK17684%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [auto1.de] INFO: Saving data for SK17684: {'auction_closing_time': 1774971025.0, 'created_time': 1773229708.463916, 'last_price_update_time': 1774867187.101163}
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK17684') HTTP/1.1" 204 0
2026-03-30 10:39:47 [auto1.de] INFO: Found listing with ID: EK25155
2026-03-30 10:39:47 [auto1.de] INFO: Found listing with ID: UD42563
2026-03-30 10:39:47 [auto1.de] INFO: Found listing with ID: FC77029
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC77029%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [auto1.de] INFO: Scrape type for FC77029: 2
2026-03-30 10:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72ebf101-3352-566a-9972-e25fed840f4c with identifier: FC77029
2026-03-30 10:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72ebf101-3352-566a-9972-e25fed840f4c with scrape type 2
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72ebf101-3352-566a-9972-e25fed840f4c with scrape type 2
2026-03-30 10:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72ebf101-3352-566a-9972-e25fed840f4c, identifier: FC77029
2026-03-30 10:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72ebf101-3352-566a-9972-e25fed840f4c with identifier: FC77029
2026-03-30 10:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72ebf101-3352-566a-9972-e25fed840f4c with identifier: FC77029
2026-03-30 10:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72ebf101-3352-566a-9972-e25fed840f4c with identifier: FC77029 to the API
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:28:32Z',
 'fuel_type': 'petrol',
 'id': '72ebf101-3352-566a-9972-e25fed840f4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC77029',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 131410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'GTI BlueMotion Tech',
 'year': 2015}
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC77029%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [auto1.de] INFO: Saving data for FC77029: {'auction_closing_time': 1774970912.0, 'created_time': 1774293690.46039, 'last_price_update_time': 1774867187.600677}
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC77029') HTTP/1.1" 204 0
2026-03-30 10:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ62631/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:47 [auto1.de] INFO: Found listing with ID: LK62819
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK62819%27 HTTP/1.1" 200 None
2026-03-30 10:39:47 [auto1.de] INFO: Scrape type for LK62819: 2
2026-03-30 10:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e801ccc6-af23-596c-8625-d3fee01aff5a with identifier: LK62819
2026-03-30 10:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e801ccc6-af23-596c-8625-d3fee01aff5a with scrape type 2
2026-03-30 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e801ccc6-af23-596c-8625-d3fee01aff5a with scrape type 2
2026-03-30 10:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e801ccc6-af23-596c-8625-d3fee01aff5a, identifier: LK62819
2026-03-30 10:39:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e801ccc6-af23-596c-8625-d3fee01aff5a with identifier: LK62819
2026-03-30 10:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e801ccc6-af23-596c-8625-d3fee01aff5a with identifier: LK62819
2026-03-30 10:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e801ccc6-af23-596c-8625-d3fee01aff5a with identifier: LK62819 to the API
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:00:20Z',
 'fuel_type': 'diesel',
 'id': 'e801ccc6-af23-596c-8625-d3fee01aff5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK62819',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 118411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-07',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi EcoBlue Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2023}
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK62819%27 HTTP/1.1" 200 None
2026-03-30 10:39:48 [auto1.de] INFO: Saving data for LK62819: {'auction_closing_time': 1774969220.0, 'created_time': 1774553020.40844, 'last_price_update_time': 1774867188.046114}
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK62819') HTTP/1.1" 204 0
2026-03-30 10:39:48 [auto1.de] INFO: Found listing with ID: RH77590
2026-03-30 10:39:48 [auto1.de] INFO: Found listing with ID: BE37921
2026-03-30 10:39:48 [auto1.de] INFO: Found listing with ID: HA59022
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA59022%27 HTTP/1.1" 200 None
2026-03-30 10:39:48 [auto1.de] INFO: Scrape type for HA59022: 1
2026-03-30 10:39:48 [auto1.de] INFO: Found listing with ID: GL86487
2026-03-30 10:39:48 [auto1.de] INFO: Found listing with ID: BA43176
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA43176%27 HTTP/1.1" 200 None
2026-03-30 10:39:48 [auto1.de] INFO: Scrape type for BA43176: 1
2026-03-30 10:39:48 [auto1.de] INFO: Found listing with ID: XA33716
2026-03-30 10:39:48 [auto1.de] INFO: Found listing with ID: UE99004
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE99004%27 HTTP/1.1" 200 None
2026-03-30 10:39:48 [auto1.de] INFO: Scrape type for UE99004: 2
2026-03-30 10:39:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2321a5d-aa14-5e8f-9cc0-5bcdc3bf2013 with identifier: UE99004
2026-03-30 10:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2321a5d-aa14-5e8f-9cc0-5bcdc3bf2013 with scrape type 2
2026-03-30 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2321a5d-aa14-5e8f-9cc0-5bcdc3bf2013 with scrape type 2
2026-03-30 10:39:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2321a5d-aa14-5e8f-9cc0-5bcdc3bf2013, identifier: UE99004
2026-03-30 10:39:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2321a5d-aa14-5e8f-9cc0-5bcdc3bf2013 with identifier: UE99004
2026-03-30 10:39:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2321a5d-aa14-5e8f-9cc0-5bcdc3bf2013 with identifier: UE99004
2026-03-30 10:39:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2321a5d-aa14-5e8f-9cc0-5bcdc3bf2013 with identifier: UE99004 to the API
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:04:08Z',
 'fuel_type': 'petrol',
 'id': 'b2321a5d-aa14-5e8f-9cc0-5bcdc3bf2013',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE99004',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 104814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-25',
 'seller_name': None,
 'title': 'Renault Clio 1.2 YAHOO!',
 'transmission': 'manual',
 'trim': 'YAHOO!',
 'year': 2012}
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE99004%27 HTTP/1.1" 200 None
2026-03-30 10:39:48 [auto1.de] INFO: Saving data for UE99004: {'auction_closing_time': 1774969448.0, 'created_time': 1774378069.51885, 'last_price_update_time': 1774867188.591521}
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE99004') HTTP/1.1" 204 0
2026-03-30 10:39:48 [auto1.de] INFO: Found listing with ID: SD73357
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD73357%27 HTTP/1.1" 200 None
2026-03-30 10:39:48 [auto1.de] INFO: Scrape type for SD73357: 1
2026-03-30 10:39:48 [auto1.de] INFO: Found listing with ID: CH19368
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH19368%27 HTTP/1.1" 200 None
2026-03-30 10:39:48 [auto1.de] INFO: Scrape type for CH19368: 1
2026-03-30 10:39:48 [auto1.de] INFO: Found listing with ID: YG04546
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG04546%27 HTTP/1.1" 200 None
2026-03-30 10:39:48 [auto1.de] INFO: Scrape type for YG04546: 2
2026-03-30 10:39:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 206ad905-84b7-58c7-a2a7-3ee5a41aa02e with identifier: YG04546
2026-03-30 10:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 206ad905-84b7-58c7-a2a7-3ee5a41aa02e with scrape type 2
2026-03-30 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 206ad905-84b7-58c7-a2a7-3ee5a41aa02e with scrape type 2
2026-03-30 10:39:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 206ad905-84b7-58c7-a2a7-3ee5a41aa02e, identifier: YG04546
2026-03-30 10:39:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 206ad905-84b7-58c7-a2a7-3ee5a41aa02e with identifier: YG04546
2026-03-30 10:39:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 206ad905-84b7-58c7-a2a7-3ee5a41aa02e with identifier: YG04546
2026-03-30 10:39:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 206ad905-84b7-58c7-a2a7-3ee5a41aa02e with identifier: YG04546 to the API
2026-03-30 10:39:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:07:19Z',
 'fuel_type': 'petrol',
 'id': '206ad905-84b7-58c7-a2a7-3ee5a41aa02e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG04546',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 61191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-27',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2017}
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG04546%27 HTTP/1.1" 200 None
2026-03-30 10:39:49 [auto1.de] INFO: Saving data for YG04546: {'auction_closing_time': 1774969639.0, 'created_time': 1774263456.98086, 'last_price_update_time': 1774867189.15621}
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YG04546') HTTP/1.1" 204 0
2026-03-30 10:39:49 [auto1.de] INFO: Found listing with ID: CL70294
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL70294%27 HTTP/1.1" 200 None
2026-03-30 10:39:49 [auto1.de] INFO: Scrape type for CL70294: 1
2026-03-30 10:39:49 [auto1.de] INFO: Found listing with ID: MN62141
2026-03-30 10:39:49 [auto1.de] INFO: Found listing with ID: BN03804
2026-03-30 10:39:49 [auto1.de] INFO: Found listing with ID: KM94418
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM94418%27 HTTP/1.1" 200 None
2026-03-30 10:39:49 [auto1.de] INFO: Scrape type for KM94418: 1
2026-03-30 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM81671/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:49 [auto1.de] INFO: Found listing with ID: ZS80574
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS80574%27 HTTP/1.1" 200 None
2026-03-30 10:39:49 [auto1.de] INFO: Scrape type for ZS80574: 2
2026-03-30 10:39:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 004b03b9-4b3d-5bb8-abfe-09114bd5e21e with identifier: ZS80574
2026-03-30 10:39:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 004b03b9-4b3d-5bb8-abfe-09114bd5e21e with scrape type 2
2026-03-30 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 004b03b9-4b3d-5bb8-abfe-09114bd5e21e with scrape type 2
2026-03-30 10:39:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 004b03b9-4b3d-5bb8-abfe-09114bd5e21e, identifier: ZS80574
2026-03-30 10:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 004b03b9-4b3d-5bb8-abfe-09114bd5e21e with identifier: ZS80574
2026-03-30 10:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 004b03b9-4b3d-5bb8-abfe-09114bd5e21e with identifier: ZS80574
2026-03-30 10:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 004b03b9-4b3d-5bb8-abfe-09114bd5e21e with identifier: ZS80574 to the API
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:42:04Z',
 'fuel_type': 'diesel',
 'id': '004b03b9-4b3d-5bb8-abfe-09114bd5e21e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS80574',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 237909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-10',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 113 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2013}
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS80574%27 HTTP/1.1" 200 None
2026-03-30 10:39:49 [auto1.de] INFO: Saving data for ZS80574: {'auction_closing_time': 1774971724.0, 'created_time': 1774294496.195637, 'last_price_update_time': 1774867189.654309}
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS80574') HTTP/1.1" 204 0
2026-03-30 10:39:49 [auto1.de] INFO: Found listing with ID: DL81432
2026-03-30 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SF81844/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EZ67237> (referer: https://www.auto1.com/v1/car-details-view/EZ67237/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN78455> (referer: https://www.auto1.com/v1/car-details-view/MN78455/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW82301> (referer: https://www.auto1.com/v1/car-details-view/HW82301/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: feba79ed-2d8b-5ba3-818a-a2490d3c3945 with identifier: EZ67237
2026-03-30 10:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item feba79ed-2d8b-5ba3-818a-a2490d3c3945 with scrape type 1
2026-03-30 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item feba79ed-2d8b-5ba3-818a-a2490d3c3945
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F36%252Fe1360a60a9bd98d989c7dad71bf20f58%252Fpa%252FEZ67237_380f08aa1189348556a4a7c725fdc6a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_380f08aa1189348556a4a7c725fdc6a5.jpg already downloaded
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F36%252Fe1360a60a9bd98d989c7dad71bf20f58%252Fpa%252FEZ67237_ba4db90ae7f944fe3148fff918f97cb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_ba4db90ae7f944fe3148fff918f97cb1.jpg already downloaded
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F36%252Fe1360a60a9bd98d989c7dad71bf20f58%252Fpa%252FEZ67237_614308fe0195e219ae4fd288d942d3f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_614308fe0195e219ae4fd288d942d3f3.jpg already downloaded
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F36%252Fe1360a60a9bd98d989c7dad71bf20f58%252Fpa%252FEZ67237_205aaf34583235b48f30617b9223a74c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_205aaf34583235b48f30617b9223a74c.jpg already downloaded
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F36%252Fe1360a60a9bd98d989c7dad71bf20f58%252Fpa%252FEZ67237_0c9901de00f2dab53d8d2ea15f3bc058.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_0c9901de00f2dab53d8d2ea15f3bc058.jpg already downloaded
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F36%252Fe1360a60a9bd98d989c7dad71bf20f58%252Fpa%252FEZ67237_81c2cb7255cd14d06368fd8e2f1e079a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_81c2cb7255cd14d06368fd8e2f1e079a.jpg already downloaded
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F36%252Fe1360a60a9bd98d989c7dad71bf20f58%252Fpa%252FEZ67237_063a15e6f036d4b1a5274d062a229ddd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_063a15e6f036d4b1a5274d062a229ddd.jpg already downloaded
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F36%252Fe1360a60a9bd98d989c7dad71bf20f58%252Fpa%252FEZ67237_58cf36ee306aca7d16269f1d6f0ae7a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_58cf36ee306aca7d16269f1d6f0ae7a0.jpg already downloaded
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F36%252Fe1360a60a9bd98d989c7dad71bf20f58%252Fpa%252FEZ67237_a90a55a494261a4b2dcc5ae5d576ba9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_a90a55a494261a4b2dcc5ae5d576ba9c.jpg already downloaded
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F36%252Fe1360a60a9bd98d989c7dad71bf20f58%252Fpa%252FEZ67237_f23dbfc16557a4f3d9f99761a6e544a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_f23dbfc16557a4f3d9f99761a6e544a3.jpg already downloaded
2026-03-30 10:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: feba79ed-2d8b-5ba3-818a-a2490d3c3945, identifier: EZ67237
2026-03-30 10:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: feba79ed-2d8b-5ba3-818a-a2490d3c3945 with identifier: EZ67237
2026-03-30 10:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: feba79ed-2d8b-5ba3-818a-a2490d3c3945 with identifier: EZ67237
2026-03-30 10:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: feba79ed-2d8b-5ba3-818a-a2490d3c3945 with identifier: EZ67237 to the API
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EZ67237>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:46:04Z',
 'fuel_type': 'diesel',
 'id': 'feba79ed-2d8b-5ba3-818a-a2490d3c3945',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ67237',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 134817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_380f08aa1189348556a4a7c725fdc6a5.jpg',
                'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_ba4db90ae7f944fe3148fff918f97cb1.jpg',
                'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_614308fe0195e219ae4fd288d942d3f3.jpg',
                'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_205aaf34583235b48f30617b9223a74c.jpg',
                'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_0c9901de00f2dab53d8d2ea15f3bc058.jpg',
                'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_81c2cb7255cd14d06368fd8e2f1e079a.jpg',
                'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_063a15e6f036d4b1a5274d062a229ddd.jpg',
                'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_58cf36ee306aca7d16269f1d6f0ae7a0.jpg',
                'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_a90a55a494261a4b2dcc5ae5d576ba9c.jpg',
                'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_f23dbfc16557a4f3d9f99761a6e544a3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feba79ed-2d8b-5ba3-818a-a2490d3c3945/feba79ed-2d8b-5ba3-818a-a2490d3c3945_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_380f08aa1189348556a4a7c725fdc6a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feba79ed-2d8b-5ba3-818a-a2490d3c3945/feba79ed-2d8b-5ba3-818a-a2490d3c3945_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_ba4db90ae7f944fe3148fff918f97cb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feba79ed-2d8b-5ba3-818a-a2490d3c3945/feba79ed-2d8b-5ba3-818a-a2490d3c3945_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_614308fe0195e219ae4fd288d942d3f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feba79ed-2d8b-5ba3-818a-a2490d3c3945/feba79ed-2d8b-5ba3-818a-a2490d3c3945_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_205aaf34583235b48f30617b9223a74c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feba79ed-2d8b-5ba3-818a-a2490d3c3945/feba79ed-2d8b-5ba3-818a-a2490d3c3945_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_0c9901de00f2dab53d8d2ea15f3bc058.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feba79ed-2d8b-5ba3-818a-a2490d3c3945/feba79ed-2d8b-5ba3-818a-a2490d3c3945_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_81c2cb7255cd14d06368fd8e2f1e079a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feba79ed-2d8b-5ba3-818a-a2490d3c3945/feba79ed-2d8b-5ba3-818a-a2490d3c3945_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_063a15e6f036d4b1a5274d062a229ddd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feba79ed-2d8b-5ba3-818a-a2490d3c3945/feba79ed-2d8b-5ba3-818a-a2490d3c3945_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_58cf36ee306aca7d16269f1d6f0ae7a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feba79ed-2d8b-5ba3-818a-a2490d3c3945/feba79ed-2d8b-5ba3-818a-a2490d3c3945_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_a90a55a494261a4b2dcc5ae5d576ba9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feba79ed-2d8b-5ba3-818a-a2490d3c3945/feba79ed-2d8b-5ba3-818a-a2490d3c3945_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/36/e1360a60a9bd98d989c7dad71bf20f58/pa/EZ67237_f23dbfc16557a4f3d9f99761a6e544a3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ67237%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [auto1.de] INFO: Saving data for EZ67237: {'created_time': 1774867191.433511, 'last_price_update_time': 1774867191.433522, 'auction_closing_time': 1774971964.0}
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ67237') HTTP/1.1" 204 0
2026-03-30 10:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34b1c613-da5f-5893-ad09-2a7113835dfa with identifier: MN78455
2026-03-30 10:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34b1c613-da5f-5893-ad09-2a7113835dfa with scrape type 1
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34b1c613-da5f-5893-ad09-2a7113835dfa
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F68%252Ffc68750a6a2c924561e49a3550a65cb6%252Fpa%252FMN78455_11ff074afad858cb98ac335af1c75489.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_11ff074afad858cb98ac335af1c75489.jpg already downloaded
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F68%252Ffc68750a6a2c924561e49a3550a65cb6%252Fpa%252FMN78455_7e455651f8bd0049509cce457ca2acd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_7e455651f8bd0049509cce457ca2acd1.jpg already downloaded
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F68%252Ffc68750a6a2c924561e49a3550a65cb6%252Fpa%252FMN78455_f69b91f3cb0079fb8d3a08aaf09c45b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_f69b91f3cb0079fb8d3a08aaf09c45b9.jpg already downloaded
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F68%252Ffc68750a6a2c924561e49a3550a65cb6%252Fpa%252FMN78455_5c5b8ca27097c879943fd7428336db33.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_5c5b8ca27097c879943fd7428336db33.jpg already downloaded
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F68%252Ffc68750a6a2c924561e49a3550a65cb6%252Fpa%252FMN78455_292afd47a07c4e0c8ea32b3163e7c657.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_292afd47a07c4e0c8ea32b3163e7c657.jpg already downloaded
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F68%252Ffc68750a6a2c924561e49a3550a65cb6%252Fpa%252FMN78455_4deeb0d30c921ec92b288761a5c5cfa5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_4deeb0d30c921ec92b288761a5c5cfa5.jpg already downloaded
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F68%252Ffc68750a6a2c924561e49a3550a65cb6%252Fpa%252FMN78455_b7486319e307a85f29133deaecc14354.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_b7486319e307a85f29133deaecc14354.jpg already downloaded
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F68%252Ffc68750a6a2c924561e49a3550a65cb6%252Fpa%252FMN78455_b4c90e43dac724869299438fd295b26f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_b4c90e43dac724869299438fd295b26f.jpg already downloaded
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F68%252Ffc68750a6a2c924561e49a3550a65cb6%252Fpa%252FMN78455_5db80e120cb24ccfe4b4db6f778adb64.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_5db80e120cb24ccfe4b4db6f778adb64.jpg already downloaded
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F68%252Ffc68750a6a2c924561e49a3550a65cb6%252Fpa%252FMN78455_143146d4ab075cd042a24ac12bc2c2b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_143146d4ab075cd042a24ac12bc2c2b8.jpg already downloaded
2026-03-30 10:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34b1c613-da5f-5893-ad09-2a7113835dfa, identifier: MN78455
2026-03-30 10:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68308b3e-fd23-58b0-b3d6-0e9df665e153 with identifier: HW82301
2026-03-30 10:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68308b3e-fd23-58b0-b3d6-0e9df665e153 with scrape type 1
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68308b3e-fd23-58b0-b3d6-0e9df665e153
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_e6fd1d3bc8729180bb792a468a6efbb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_e6fd1d3bc8729180bb792a468a6efbb0.jpg not downloaded yet
2026-03-30 10:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34b1c613-da5f-5893-ad09-2a7113835dfa with identifier: MN78455
2026-03-30 10:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34b1c613-da5f-5893-ad09-2a7113835dfa with identifier: MN78455
2026-03-30 10:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34b1c613-da5f-5893-ad09-2a7113835dfa with identifier: MN78455 to the API
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MN78455>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.1L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:15:19Z',
 'fuel_type': 'diesel',
 'id': '34b1c613-da5f-5893-ad09-2a7113835dfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN78455',
 'listing': 'auction',
 'location': 'DE, Sulz am Neckar',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 109832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_11ff074afad858cb98ac335af1c75489.jpg',
                'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_7e455651f8bd0049509cce457ca2acd1.jpg',
                'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_f69b91f3cb0079fb8d3a08aaf09c45b9.jpg',
                'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_5c5b8ca27097c879943fd7428336db33.jpg',
                'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_292afd47a07c4e0c8ea32b3163e7c657.jpg',
                'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_4deeb0d30c921ec92b288761a5c5cfa5.jpg',
                'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_b7486319e307a85f29133deaecc14354.jpg',
                'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_b4c90e43dac724869299438fd295b26f.jpg',
                'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_5db80e120cb24ccfe4b4db6f778adb64.jpg',
                'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_143146d4ab075cd042a24ac12bc2c2b8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b1c613-da5f-5893-ad09-2a7113835dfa/34b1c613-da5f-5893-ad09-2a7113835dfa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2624139,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_11ff074afad858cb98ac335af1c75489.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b1c613-da5f-5893-ad09-2a7113835dfa/34b1c613-da5f-5893-ad09-2a7113835dfa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2596116,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_7e455651f8bd0049509cce457ca2acd1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b1c613-da5f-5893-ad09-2a7113835dfa/34b1c613-da5f-5893-ad09-2a7113835dfa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2686541,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_f69b91f3cb0079fb8d3a08aaf09c45b9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b1c613-da5f-5893-ad09-2a7113835dfa/34b1c613-da5f-5893-ad09-2a7113835dfa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2696210,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_5c5b8ca27097c879943fd7428336db33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b1c613-da5f-5893-ad09-2a7113835dfa/34b1c613-da5f-5893-ad09-2a7113835dfa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_292afd47a07c4e0c8ea32b3163e7c657.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b1c613-da5f-5893-ad09-2a7113835dfa/34b1c613-da5f-5893-ad09-2a7113835dfa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_4deeb0d30c921ec92b288761a5c5cfa5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b1c613-da5f-5893-ad09-2a7113835dfa/34b1c613-da5f-5893-ad09-2a7113835dfa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2606419,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_b7486319e307a85f29133deaecc14354.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b1c613-da5f-5893-ad09-2a7113835dfa/34b1c613-da5f-5893-ad09-2a7113835dfa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_b4c90e43dac724869299438fd295b26f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b1c613-da5f-5893-ad09-2a7113835dfa/34b1c613-da5f-5893-ad09-2a7113835dfa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2627058,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_5db80e120cb24ccfe4b4db6f778adb64.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b1c613-da5f-5893-ad09-2a7113835dfa/34b1c613-da5f-5893-ad09-2a7113835dfa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/68/fc68750a6a2c924561e49a3550a65cb6/pa/MN78455_143146d4ab075cd042a24ac12bc2c2b8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2003}
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN78455%27 HTTP/1.1" 200 None
2026-03-30 10:39:52 [auto1.de] INFO: Saving data for MN78455: {'created_time': 1774867192.087764, 'last_price_update_time': 1774867192.087777, 'auction_closing_time': 1774970119.0}
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN78455') HTTP/1.1" 204 0
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_0331ef576ebdf9942246db7187a436f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_0331ef576ebdf9942246db7187a436f6.jpg not downloaded yet
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_6b5336c516f3aa0fa41d1795053ca815.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_6b5336c516f3aa0fa41d1795053ca815.jpg not downloaded yet
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_dec19c485395b46d18ed9e51ced5debd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_dec19c485395b46d18ed9e51ced5debd.jpg not downloaded yet
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_be79afc0042933170d99aa205d607a33.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_be79afc0042933170d99aa205d607a33.jpg not downloaded yet
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_d7a9c4495015165150e146a64c0a3b4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_d7a9c4495015165150e146a64c0a3b4e.jpg not downloaded yet
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_eb314d77a4c42cf6d0a5c116ede4984c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_eb314d77a4c42cf6d0a5c116ede4984c.jpg not downloaded yet
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_08dd7f6a7cae906a6b0d0be019902cc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_08dd7f6a7cae906a6b0d0be019902cc0.jpg not downloaded yet
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_0c6b1f199dc6e95f92e4bebbf9af6ff2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_0c6b1f199dc6e95f92e4bebbf9af6ff2.jpg not downloaded yet
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_8f6e6961049378197fb0f9594afed599.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_8f6e6961049378197fb0f9594afed599.jpg not downloaded yet
2026-03-30 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_8f6e6961049378197fb0f9594afed599.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:53 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 9437 | hits on page: 40
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: ZS80574
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS80574%27 HTTP/1.1" 200 None
2026-03-30 10:39:53 [auto1.de] INFO: Scrape type for ZS80574: 0
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: DL81432
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: SE21529
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE21529%27 HTTP/1.1" 200 None
2026-03-30 10:39:53 [auto1.de] INFO: Scrape type for SE21529: 1
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: FF53328
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF53328%27 HTTP/1.1" 200 None
2026-03-30 10:39:53 [auto1.de] INFO: Scrape type for FF53328: 1
2026-03-30 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_0c6b1f199dc6e95f92e4bebbf9af6ff2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: KD18794
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: PE68373
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: EW16881
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: FL29012
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL29012%27 HTTP/1.1" 200 None
2026-03-30 10:39:53 [auto1.de] INFO: Scrape type for FL29012: 1
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: DZ14257
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: MR66589
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR66589%27 HTTP/1.1" 200 None
2026-03-30 10:39:53 [auto1.de] INFO: Scrape type for MR66589: 1
2026-03-30 10:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef673c550>
2026-03-30 10:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_8f6e6961049378197fb0f9594afed599.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_8f6e6961049378197fb0f9594afed599.jpg saved to cache
2026-03-30 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 68308b3e-fd23-58b0-b3d6-0e9df665e153
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: RA69083
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: SB38553
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: HB76846
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB76846%27 HTTP/1.1" 200 None
2026-03-30 10:39:53 [auto1.de] INFO: Scrape type for HB76846: 1
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: KP41876
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: WV73920
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV73920%27 HTTP/1.1" 200 None
2026-03-30 10:39:53 [auto1.de] INFO: Scrape type for WV73920: 1
2026-03-30 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RS58437> (referer: https://www.auto1.com/v1/car-details-view/RS58437/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:53 [auto1.de] INFO: Found listing with ID: NS06519
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS06519%27 HTTP/1.1" 200 None
2026-03-30 10:39:53 [auto1.de] INFO: Scrape type for NS06519: 2
2026-03-30 10:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 295782d7-c881-5252-b335-641022560c95 with identifier: NS06519
2026-03-30 10:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 295782d7-c881-5252-b335-641022560c95 with scrape type 2
2026-03-30 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 295782d7-c881-5252-b335-641022560c95 with scrape type 2
2026-03-30 10:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 295782d7-c881-5252-b335-641022560c95, identifier: NS06519
2026-03-30 10:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b01a50>
2026-03-30 10:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_0c6b1f199dc6e95f92e4bebbf9af6ff2.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_0c6b1f199dc6e95f92e4bebbf9af6ff2.jpg saved to cache
2026-03-30 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 68308b3e-fd23-58b0-b3d6-0e9df665e153
2026-03-30 10:39:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 295782d7-c881-5252-b335-641022560c95 with identifier: NS06519
2026-03-30 10:39:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 295782d7-c881-5252-b335-641022560c95 with identifier: NS06519
2026-03-30 10:39:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 295782d7-c881-5252-b335-641022560c95 with identifier: NS06519 to the API
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:12:49Z',
 'fuel_type': 'diesel',
 'id': '295782d7-c881-5252-b335-641022560c95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS06519',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 383465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-28',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2014}
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS06519%27 HTTP/1.1" 200 None
2026-03-30 10:39:54 [auto1.de] INFO: Saving data for NS06519: {'auction_closing_time': 1774969969.0, 'created_time': 1773380525.352398, 'last_price_update_time': 1774867194.098408}
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS06519') HTTP/1.1" 204 0
2026-03-30 10:39:54 [auto1.de] INFO: Found listing with ID: RW87494
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW87494%27 HTTP/1.1" 200 None
2026-03-30 10:39:54 [auto1.de] INFO: Scrape type for RW87494: 2
2026-03-30 10:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c8fa28f-4b71-5404-b4c9-e4ca8c6a5ad9 with identifier: RW87494
2026-03-30 10:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c8fa28f-4b71-5404-b4c9-e4ca8c6a5ad9 with scrape type 2
2026-03-30 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c8fa28f-4b71-5404-b4c9-e4ca8c6a5ad9 with scrape type 2
2026-03-30 10:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c8fa28f-4b71-5404-b4c9-e4ca8c6a5ad9, identifier: RW87494
2026-03-30 10:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c8fa28f-4b71-5404-b4c9-e4ca8c6a5ad9 with identifier: RW87494
2026-03-30 10:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c8fa28f-4b71-5404-b4c9-e4ca8c6a5ad9 with identifier: RW87494
2026-03-30 10:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c8fa28f-4b71-5404-b4c9-e4ca8c6a5ad9 with identifier: RW87494 to the API
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:43:12Z',
 'fuel_type': 'petrol',
 'id': '0c8fa28f-4b71-5404-b4c9-e4ca8c6a5ad9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW87494',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 153786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW87494%27 HTTP/1.1" 200 None
2026-03-30 10:39:54 [auto1.de] INFO: Saving data for RW87494: {'auction_closing_time': 1774971792.0, 'created_time': 1774262915.058929, 'last_price_update_time': 1774867194.68928}
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW87494') HTTP/1.1" 204 0
2026-03-30 10:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT26975> (referer: https://www.auto1.com/v1/car-details-view/HT26975/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:54 [auto1.de] INFO: Found listing with ID: YF04765
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF04765%27 HTTP/1.1" 200 None
2026-03-30 10:39:54 [auto1.de] INFO: Scrape type for YF04765: 1
2026-03-30 10:39:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8f2995a-f3c3-524b-97dd-b62edafb9c3f with identifier: RS58437
2026-03-30 10:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8f2995a-f3c3-524b-97dd-b62edafb9c3f with scrape type 1
2026-03-30 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b8f2995a-f3c3-524b-97dd-b62edafb9c3f
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fb8%252F41b80da84a04360711234529ed743fb6%252Fpa%252FRS58437_29de316ec50c3b798f2814e44f398ad7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/b8/41b80da84a04360711234529ed743fb6/pa/RS58437_29de316ec50c3b798f2814e44f398ad7.jpg already downloaded
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fb8%252F41b80da84a04360711234529ed743fb6%252Fpa%252FRS58437_ed04688929b25dd25ab21252a9562c9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/b8/41b80da84a04360711234529ed743fb6/pa/RS58437_ed04688929b25dd25ab21252a9562c9d.jpg already downloaded
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fb8%252F41b80da84a04360711234529ed743fb6%252Fpa%252FRS58437_4ae53ea4358cd701fca6b33f7d98547c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/b8/41b80da84a04360711234529ed743fb6/pa/RS58437_4ae53ea4358cd701fca6b33f7d98547c.jpg already downloaded
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fb8%252F41b80da84a04360711234529ed743fb6%252Fpa%252FRS58437_d0c112985de47ab5aa10dc7377fd936e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/b8/41b80da84a04360711234529ed743fb6/pa/RS58437_d0c112985de47ab5aa10dc7377fd936e.jpg already downloaded
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fb8%252F41b80da84a04360711234529ed743fb6%252Fpa%252FRS58437_89317b0cfebf60d361ad03b6b57de63a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/b8/41b80da84a04360711234529ed743fb6/pa/RS58437_89317b0cfebf60d361ad03b6b57de63a.jpg already downloaded
2026-03-30 10:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8f2995a-f3c3-524b-97dd-b62edafb9c3f, identifier: RS58437
2026-03-30 10:39:54 [auto1.de] INFO: Found listing with ID: CV02833
2026-03-30 10:39:54 [auto1.de] INFO: Found listing with ID: BB05879
2026-03-30 10:39:54 [auto1.de] INFO: Found listing with ID: UA15697
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA15697%27 HTTP/1.1" 200 None
2026-03-30 10:39:54 [auto1.de] INFO: Scrape type for UA15697: 2
2026-03-30 10:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ab6fe2a-0697-5afc-a5ec-e07f1f6a8f86 with identifier: UA15697
2026-03-30 10:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ab6fe2a-0697-5afc-a5ec-e07f1f6a8f86 with scrape type 2
2026-03-30 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ab6fe2a-0697-5afc-a5ec-e07f1f6a8f86 with scrape type 2
2026-03-30 10:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ab6fe2a-0697-5afc-a5ec-e07f1f6a8f86, identifier: UA15697
2026-03-30 10:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8f2995a-f3c3-524b-97dd-b62edafb9c3f with identifier: RS58437
2026-03-30 10:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8f2995a-f3c3-524b-97dd-b62edafb9c3f with identifier: RS58437
2026-03-30 10:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8f2995a-f3c3-524b-97dd-b62edafb9c3f with identifier: RS58437 to the API
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RS58437>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:09:32Z',
 'fuel_type': 'diesel',
 'id': 'b8f2995a-f3c3-524b-97dd-b62edafb9c3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS58437',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 274528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img41/b8/41b80da84a04360711234529ed743fb6/pa/RS58437_29de316ec50c3b798f2814e44f398ad7.jpg',
                'https://img-pa.auto1.com/img41/b8/41b80da84a04360711234529ed743fb6/pa/RS58437_ed04688929b25dd25ab21252a9562c9d.jpg',
                'https://img-pa.auto1.com/img41/b8/41b80da84a04360711234529ed743fb6/pa/RS58437_4ae53ea4358cd701fca6b33f7d98547c.jpg',
                'https://img-pa.auto1.com/img41/b8/41b80da84a04360711234529ed743fb6/pa/RS58437_d0c112985de47ab5aa10dc7377fd936e.jpg',
                'https://img-pa.auto1.com/img41/b8/41b80da84a04360711234529ed743fb6/pa/RS58437_89317b0cfebf60d361ad03b6b57de63a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f2995a-f3c3-524b-97dd-b62edafb9c3f/b8f2995a-f3c3-524b-97dd-b62edafb9c3f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/b8/41b80da84a04360711234529ed743fb6/pa/RS58437_29de316ec50c3b798f2814e44f398ad7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f2995a-f3c3-524b-97dd-b62edafb9c3f/b8f2995a-f3c3-524b-97dd-b62edafb9c3f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/b8/41b80da84a04360711234529ed743fb6/pa/RS58437_ed04688929b25dd25ab21252a9562c9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f2995a-f3c3-524b-97dd-b62edafb9c3f/b8f2995a-f3c3-524b-97dd-b62edafb9c3f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/b8/41b80da84a04360711234529ed743fb6/pa/RS58437_4ae53ea4358cd701fca6b33f7d98547c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f2995a-f3c3-524b-97dd-b62edafb9c3f/b8f2995a-f3c3-524b-97dd-b62edafb9c3f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/b8/41b80da84a04360711234529ed743fb6/pa/RS58437_d0c112985de47ab5aa10dc7377fd936e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8f2995a-f3c3-524b-97dd-b62edafb9c3f/b8f2995a-f3c3-524b-97dd-b62edafb9c3f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/b8/41b80da84a04360711234529ed743fb6/pa/RS58437_89317b0cfebf60d361ad03b6b57de63a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS58437%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [auto1.de] INFO: Saving data for RS58437: {'created_time': 1774867195.38723, 'last_price_update_time': 1774867195.387241, 'auction_closing_time': 1774969772.0}
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS58437') HTTP/1.1" 204 0
2026-03-30 10:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ab6fe2a-0697-5afc-a5ec-e07f1f6a8f86 with identifier: UA15697
2026-03-30 10:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ab6fe2a-0697-5afc-a5ec-e07f1f6a8f86 with identifier: UA15697
2026-03-30 10:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ab6fe2a-0697-5afc-a5ec-e07f1f6a8f86 with identifier: UA15697 to the API
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:22:49Z',
 'fuel_type': 'diesel',
 'id': '5ab6fe2a-0697-5afc-a5ec-e07f1f6a8f86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA15697',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 184760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-10',
 'seller_name': None,
 'title': 'BMW 3er 320d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA15697%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [auto1.de] INFO: Saving data for UA15697: {'auction_closing_time': 1774970569.0, 'created_time': 1774263075.449551, 'last_price_update_time': 1774867195.777444}
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA15697') HTTP/1.1" 204 0
2026-03-30 10:39:55 [auto1.de] INFO: Found listing with ID: AN11349
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN11349%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [auto1.de] INFO: Scrape type for AN11349: 1
2026-03-30 10:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aabb9d2c-70d5-510a-95a5-6b7e8da5e29c with identifier: HT26975
2026-03-30 10:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aabb9d2c-70d5-510a-95a5-6b7e8da5e29c with scrape type 1
2026-03-30 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aabb9d2c-70d5-510a-95a5-6b7e8da5e29c
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F80%252Ffd808972591a143883f4dfb05ab2a936%252Fpa%252FHT26975_1fc7ef4f1f696f19b2974391e2845d90.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_1fc7ef4f1f696f19b2974391e2845d90.jpg already downloaded
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F80%252Ffd808972591a143883f4dfb05ab2a936%252Fpa%252FHT26975_a7e11c0f8c270381da197344f80823e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_a7e11c0f8c270381da197344f80823e9.jpg already downloaded
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F80%252Ffd808972591a143883f4dfb05ab2a936%252Fpa%252FHT26975_e5e413918d5b42cc5894deb423fa77b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_e5e413918d5b42cc5894deb423fa77b3.jpg already downloaded
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F80%252Ffd808972591a143883f4dfb05ab2a936%252Fpa%252FHT26975_a2b87dd7c737bd57704c6ad0e1aedae6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_a2b87dd7c737bd57704c6ad0e1aedae6.jpg already downloaded
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F80%252Ffd808972591a143883f4dfb05ab2a936%252Fpa%252FHT26975_55c5b5aff22f7f66be6433292145b03a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_55c5b5aff22f7f66be6433292145b03a.jpg already downloaded
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F80%252Ffd808972591a143883f4dfb05ab2a936%252Fpa%252FHT26975_f244ab7fe83102efd716e124e804d886.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_f244ab7fe83102efd716e124e804d886.jpg already downloaded
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F80%252Ffd808972591a143883f4dfb05ab2a936%252Fpa%252FHT26975_82dcf6615e406f661cb629d8e5d98728.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_82dcf6615e406f661cb629d8e5d98728.jpg already downloaded
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F80%252Ffd808972591a143883f4dfb05ab2a936%252Fpa%252FHT26975_5918d3ac6b0f617e81cfc823876e6f78.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_5918d3ac6b0f617e81cfc823876e6f78.jpg already downloaded
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F80%252Ffd808972591a143883f4dfb05ab2a936%252Fpa%252FHT26975_d507e7e62a8a547b7a0b0390ffd05a76.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_d507e7e62a8a547b7a0b0390ffd05a76.jpg already downloaded
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F80%252Ffd808972591a143883f4dfb05ab2a936%252Fpa%252FHT26975_cec0ce1257abce39b711923dcecf108e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_cec0ce1257abce39b711923dcecf108e.jpg already downloaded
2026-03-30 10:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aabb9d2c-70d5-510a-95a5-6b7e8da5e29c, identifier: HT26975
2026-03-30 10:39:56 [auto1.de] INFO: Found listing with ID: GG08526
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG08526%27 HTTP/1.1" 200 None
2026-03-30 10:39:56 [auto1.de] INFO: Scrape type for GG08526: 2
2026-03-30 10:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77cc4c00-eacf-5f6b-9e65-ca2fc3ab4b4c with identifier: GG08526
2026-03-30 10:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77cc4c00-eacf-5f6b-9e65-ca2fc3ab4b4c with scrape type 2
2026-03-30 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77cc4c00-eacf-5f6b-9e65-ca2fc3ab4b4c with scrape type 2
2026-03-30 10:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77cc4c00-eacf-5f6b-9e65-ca2fc3ab4b4c, identifier: GG08526
2026-03-30 10:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aabb9d2c-70d5-510a-95a5-6b7e8da5e29c with identifier: HT26975
2026-03-30 10:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aabb9d2c-70d5-510a-95a5-6b7e8da5e29c with identifier: HT26975
2026-03-30 10:39:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aabb9d2c-70d5-510a-95a5-6b7e8da5e29c with identifier: HT26975 to the API
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HT26975>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 462,
 'expiration_date': '2026-03-31T15:00:11Z',
 'fuel_type': 'hybrid',
 'id': 'aabb9d2c-70d5-510a-95a5-6b7e8da5e29c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT26975',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 109257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_1fc7ef4f1f696f19b2974391e2845d90.jpg',
                'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_a7e11c0f8c270381da197344f80823e9.jpg',
                'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_e5e413918d5b42cc5894deb423fa77b3.jpg',
                'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_a2b87dd7c737bd57704c6ad0e1aedae6.jpg',
                'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_55c5b5aff22f7f66be6433292145b03a.jpg',
                'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_f244ab7fe83102efd716e124e804d886.jpg',
                'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_82dcf6615e406f661cb629d8e5d98728.jpg',
                'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_5918d3ac6b0f617e81cfc823876e6f78.jpg',
                'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_d507e7e62a8a547b7a0b0390ffd05a76.jpg',
                'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_cec0ce1257abce39b711923dcecf108e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabb9d2c-70d5-510a-95a5-6b7e8da5e29c/aabb9d2c-70d5-510a-95a5-6b7e8da5e29c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_1fc7ef4f1f696f19b2974391e2845d90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabb9d2c-70d5-510a-95a5-6b7e8da5e29c/aabb9d2c-70d5-510a-95a5-6b7e8da5e29c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_a7e11c0f8c270381da197344f80823e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabb9d2c-70d5-510a-95a5-6b7e8da5e29c/aabb9d2c-70d5-510a-95a5-6b7e8da5e29c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_e5e413918d5b42cc5894deb423fa77b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabb9d2c-70d5-510a-95a5-6b7e8da5e29c/aabb9d2c-70d5-510a-95a5-6b7e8da5e29c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_a2b87dd7c737bd57704c6ad0e1aedae6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabb9d2c-70d5-510a-95a5-6b7e8da5e29c/aabb9d2c-70d5-510a-95a5-6b7e8da5e29c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_55c5b5aff22f7f66be6433292145b03a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabb9d2c-70d5-510a-95a5-6b7e8da5e29c/aabb9d2c-70d5-510a-95a5-6b7e8da5e29c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_f244ab7fe83102efd716e124e804d886.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabb9d2c-70d5-510a-95a5-6b7e8da5e29c/aabb9d2c-70d5-510a-95a5-6b7e8da5e29c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_82dcf6615e406f661cb629d8e5d98728.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabb9d2c-70d5-510a-95a5-6b7e8da5e29c/aabb9d2c-70d5-510a-95a5-6b7e8da5e29c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_5918d3ac6b0f617e81cfc823876e6f78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabb9d2c-70d5-510a-95a5-6b7e8da5e29c/aabb9d2c-70d5-510a-95a5-6b7e8da5e29c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_d507e7e62a8a547b7a0b0390ffd05a76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aabb9d2c-70d5-510a-95a5-6b7e8da5e29c/aabb9d2c-70d5-510a-95a5-6b7e8da5e29c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/80/fd808972591a143883f4dfb05ab2a936/pa/HT26975_cec0ce1257abce39b711923dcecf108e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Cayenne E-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT26975%27 HTTP/1.1" 200 None
2026-03-30 10:39:56 [auto1.de] INFO: Saving data for HT26975: {'created_time': 1774867196.535208, 'last_price_update_time': 1774867196.53522, 'auction_closing_time': 1774969211.0}
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT26975') HTTP/1.1" 204 0
2026-03-30 10:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77cc4c00-eacf-5f6b-9e65-ca2fc3ab4b4c with identifier: GG08526
2026-03-30 10:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77cc4c00-eacf-5f6b-9e65-ca2fc3ab4b4c with identifier: GG08526
2026-03-30 10:39:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77cc4c00-eacf-5f6b-9e65-ca2fc3ab4b4c with identifier: GG08526 to the API
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:40:41Z',
 'fuel_type': 'petrol',
 'id': '77cc4c00-eacf-5f6b-9e65-ca2fc3ab4b4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG08526',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 21603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-22',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Mild-Hybrid GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2022}
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG08526%27 HTTP/1.1" 200 None
2026-03-30 10:39:56 [auto1.de] INFO: Saving data for GG08526: {'auction_closing_time': 1774971641.0, 'created_time': 1773341849.074904, 'last_price_update_time': 1774867196.863525}
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG08526') HTTP/1.1" 204 0
2026-03-30 10:39:56 [auto1.de] INFO: Found listing with ID: YN03957
2026-03-30 10:39:56 [auto1.de] INFO: Found listing with ID: FK59829
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK59829%27 HTTP/1.1" 200 None
2026-03-30 10:39:56 [auto1.de] INFO: Scrape type for FK59829: 2
2026-03-30 10:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40f2c75b-ba35-570e-8684-4ab7d07c6a88 with identifier: FK59829
2026-03-30 10:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40f2c75b-ba35-570e-8684-4ab7d07c6a88 with scrape type 2
2026-03-30 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40f2c75b-ba35-570e-8684-4ab7d07c6a88 with scrape type 2
2026-03-30 10:39:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40f2c75b-ba35-570e-8684-4ab7d07c6a88, identifier: FK59829
2026-03-30 10:39:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40f2c75b-ba35-570e-8684-4ab7d07c6a88 with identifier: FK59829
2026-03-30 10:39:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40f2c75b-ba35-570e-8684-4ab7d07c6a88 with identifier: FK59829
2026-03-30 10:39:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40f2c75b-ba35-570e-8684-4ab7d07c6a88 with identifier: FK59829 to the API
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:44:10Z',
 'fuel_type': 'petrol',
 'id': '40f2c75b-ba35-570e-8684-4ab7d07c6a88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK59829',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 180013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-18',
 'seller_name': None,
 'title': 'Audi A4 3.2 V6 FSI quattro S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'quattro S line Sportpaket plus',
 'year': 2009}
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK59829%27 HTTP/1.1" 200 None
2026-03-30 10:39:57 [auto1.de] INFO: Saving data for FK59829: {'auction_closing_time': 1774971850.0, 'created_time': 1774293958.531468, 'last_price_update_time': 1774867197.338214}
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK59829') HTTP/1.1" 204 0
2026-03-30 10:39:57 [auto1.de] INFO: Found listing with ID: HA20586
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA20586%27 HTTP/1.1" 200 None
2026-03-30 10:39:57 [auto1.de] INFO: Scrape type for HA20586: 1
2026-03-30 10:39:57 [auto1.de] INFO: Found listing with ID: RB42350
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB42350%27 HTTP/1.1" 200 None
2026-03-30 10:39:57 [auto1.de] INFO: Scrape type for RB42350: 1
2026-03-30 10:39:57 [auto1.de] INFO: Found listing with ID: WL33179
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL33179%27 HTTP/1.1" 200 None
2026-03-30 10:39:57 [auto1.de] INFO: Scrape type for WL33179: 1
2026-03-30 10:39:57 [auto1.de] INFO: Found listing with ID: KX41187
2026-03-30 10:39:57 [auto1.de] INFO: Found listing with ID: YB72682
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB72682%27 HTTP/1.1" 200 None
2026-03-30 10:39:57 [auto1.de] INFO: Scrape type for YB72682: 1
2026-03-30 10:39:57 [auto1.de] INFO: Found listing with ID: VP46996
2026-03-30 10:39:57 [auto1.de] INFO: Found listing with ID: TB89261
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB89261%27 HTTP/1.1" 200 None
2026-03-30 10:39:57 [auto1.de] INFO: Scrape type for TB89261: 1
2026-03-30 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU59543/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:57 [auto1.de] INFO: Found listing with ID: XT31239
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT31239%27 HTTP/1.1" 200 None
2026-03-30 10:39:57 [auto1.de] INFO: Scrape type for XT31239: 1
2026-03-30 10:39:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:57 [auto1.de] INFO: Found listing with ID: XB84962
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB84962%27 HTTP/1.1" 200 None
2026-03-30 10:39:57 [auto1.de] INFO: Scrape type for XB84962: 1
2026-03-30 10:39:57 [auto1.de] INFO: Found listing with ID: YT13051
2026-03-30 10:39:57 [auto1.de] INFO: Found listing with ID: RE55796
2026-03-30 10:39:57 [auto1.de] INFO: Found listing with ID: FE09717
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE09717%27 HTTP/1.1" 200 None
2026-03-30 10:39:57 [auto1.de] INFO: Scrape type for FE09717: 2
2026-03-30 10:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0539f695-6056-56f5-975b-36885054791f with identifier: FE09717
2026-03-30 10:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0539f695-6056-56f5-975b-36885054791f with scrape type 2
2026-03-30 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0539f695-6056-56f5-975b-36885054791f with scrape type 2
2026-03-30 10:39:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0539f695-6056-56f5-975b-36885054791f, identifier: FE09717
2026-03-30 10:39:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0539f695-6056-56f5-975b-36885054791f with identifier: FE09717
2026-03-30 10:39:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0539f695-6056-56f5-975b-36885054791f with identifier: FE09717
2026-03-30 10:39:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0539f695-6056-56f5-975b-36885054791f with identifier: FE09717 to the API
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:03:07Z',
 'fuel_type': 'diesel',
 'id': '0539f695-6056-56f5-975b-36885054791f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE09717',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 175185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-08',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium S',
 'transmission': 'manual',
 'trim': 'Titanium S',
 'year': 2012}
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE09717%27 HTTP/1.1" 200 None
2026-03-30 10:39:57 [auto1.de] INFO: Saving data for FE09717: {'auction_closing_time': 1774969387.0, 'created_time': 1774378281.458204, 'last_price_update_time': 1774867197.96566}
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE09717') HTTP/1.1" 204 0
2026-03-30 10:39:58 [auto1.de] INFO: Found listing with ID: HR51580
2026-03-30 10:39:58 [auto1.de] INFO: Found listing with ID: JS21761
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS21761%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [auto1.de] INFO: Scrape type for JS21761: 1
2026-03-30 10:39:58 [auto1.de] INFO: Found listing with ID: LU37241
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU37241%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [auto1.de] INFO: Scrape type for LU37241: 1
2026-03-30 10:39:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG45632> (referer: https://www.auto1.com/v1/car-details-view/EG45632/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b03a723a-1587-5755-87b7-7158ba97995b with identifier: EG45632
2026-03-30 10:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03a723a-1587-5755-87b7-7158ba97995b with scrape type 1
2026-03-30 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b03a723a-1587-5755-87b7-7158ba97995b
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_fc4f092107dce4c986d729b440a2a1f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_fc4f092107dce4c986d729b440a2a1f9.jpg not downloaded yet
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_911b82576cf8b2e1cf4921645bfe4309.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_911b82576cf8b2e1cf4921645bfe4309.jpg not downloaded yet
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_30c8f840df7fb3e88d5cf1279c7cac05.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_30c8f840df7fb3e88d5cf1279c7cac05.jpg not downloaded yet
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_74d381a0883f39b5baf89dc58c06696e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_74d381a0883f39b5baf89dc58c06696e.jpg not downloaded yet
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_079f13ff0d5970817846985524ee8042.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_079f13ff0d5970817846985524ee8042.jpg not downloaded yet
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_906f35b2e775a8248b9767f89cd61be6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_906f35b2e775a8248b9767f89cd61be6.jpg not downloaded yet
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_2eee1b986b02cc8c5bb23e66ecb73b6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_2eee1b986b02cc8c5bb23e66ecb73b6d.jpg not downloaded yet
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_07602523407617c296cb3145685c845e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_07602523407617c296cb3145685c845e.jpg not downloaded yet
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_4713b7a2e43ff436a5d878e68a05e3d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_4713b7a2e43ff436a5d878e68a05e3d3.jpg not downloaded yet
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_e7017a4409afca99f1916bc128b71843.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_e7017a4409afca99f1916bc128b71843.jpg not downloaded yet
2026-03-30 10:39:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KM94418/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY46895/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_e7017a4409afca99f1916bc128b71843.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5087550>
2026-03-30 10:39:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_e7017a4409afca99f1916bc128b71843.jpg') HTTP/1.1" 204 0
2026-03-30 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_e7017a4409afca99f1916bc128b71843.jpg saved to cache
2026-03-30 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b03a723a-1587-5755-87b7-7158ba97995b
2026-03-30 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ38096> (referer: https://www.auto1.com/v1/car-details-view/NZ38096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_4713b7a2e43ff436a5d878e68a05e3d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:39:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 219c1d9c-996a-516a-afc4-0eec9b6ede7c with identifier: NZ38096
2026-03-30 10:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 219c1d9c-996a-516a-afc4-0eec9b6ede7c with scrape type 1
2026-03-30 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 219c1d9c-996a-516a-afc4-0eec9b6ede7c
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fcb%252F67cb1d100221ce3587b02283b1757866%252Fpa%252FNZ38096_de679d8164a35626a3e09ebbc8b41ff0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_de679d8164a35626a3e09ebbc8b41ff0.jpg already downloaded
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fcb%252F67cb1d100221ce3587b02283b1757866%252Fpa%252FNZ38096_70c98c554bec278cd028ddbc4fefb345.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_70c98c554bec278cd028ddbc4fefb345.jpg already downloaded
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fcb%252F67cb1d100221ce3587b02283b1757866%252Fpa%252FNZ38096_3684733a71164ea3c5a9622518987aaa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_3684733a71164ea3c5a9622518987aaa.jpg already downloaded
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fcb%252F67cb1d100221ce3587b02283b1757866%252Fpa%252FNZ38096_e0d35309b090320c448ced2e4a2ca6dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_e0d35309b090320c448ced2e4a2ca6dc.jpg already downloaded
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fcb%252F67cb1d100221ce3587b02283b1757866%252Fpa%252FNZ38096_9049372a755768be7a90adb200f9f0d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_9049372a755768be7a90adb200f9f0d8.jpg already downloaded
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fcb%252F67cb1d100221ce3587b02283b1757866%252Fpa%252FNZ38096_ca058001e7740ab9aa5031dd8c3e8d89.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_ca058001e7740ab9aa5031dd8c3e8d89.jpg already downloaded
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fcb%252F67cb1d100221ce3587b02283b1757866%252Fpa%252FNZ38096_317dcb0ab487cf09cca6d3049fa555ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_317dcb0ab487cf09cca6d3049fa555ab.jpg already downloaded
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fcb%252F67cb1d100221ce3587b02283b1757866%252Fpa%252FNZ38096_0c5fa32470fb7f668858ffd0e21d27fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_0c5fa32470fb7f668858ffd0e21d27fb.jpg already downloaded
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fcb%252F67cb1d100221ce3587b02283b1757866%252Fpa%252FNZ38096_fa4b1d201546c80fe02925ee1d738e61.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_fa4b1d201546c80fe02925ee1d738e61.jpg already downloaded
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fcb%252F67cb1d100221ce3587b02283b1757866%252Fpa%252FNZ38096_a9d004bc73c4657dcc759f6599e5125b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_a9d004bc73c4657dcc759f6599e5125b.jpg already downloaded
2026-03-30 10:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 219c1d9c-996a-516a-afc4-0eec9b6ede7c, identifier: NZ38096
2026-03-30 10:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 219c1d9c-996a-516a-afc4-0eec9b6ede7c with identifier: NZ38096
2026-03-30 10:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 219c1d9c-996a-516a-afc4-0eec9b6ede7c with identifier: NZ38096
2026-03-30 10:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 219c1d9c-996a-516a-afc4-0eec9b6ede7c with identifier: NZ38096 to the API
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NZ38096>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:41:50Z',
 'fuel_type': 'diesel',
 'id': '219c1d9c-996a-516a-afc4-0eec9b6ede7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ38096',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 126846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_de679d8164a35626a3e09ebbc8b41ff0.jpg',
                'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_70c98c554bec278cd028ddbc4fefb345.jpg',
                'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_3684733a71164ea3c5a9622518987aaa.jpg',
                'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_e0d35309b090320c448ced2e4a2ca6dc.jpg',
                'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_9049372a755768be7a90adb200f9f0d8.jpg',
                'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_ca058001e7740ab9aa5031dd8c3e8d89.jpg',
                'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_317dcb0ab487cf09cca6d3049fa555ab.jpg',
                'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_0c5fa32470fb7f668858ffd0e21d27fb.jpg',
                'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_fa4b1d201546c80fe02925ee1d738e61.jpg',
                'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_a9d004bc73c4657dcc759f6599e5125b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219c1d9c-996a-516a-afc4-0eec9b6ede7c/219c1d9c-996a-516a-afc4-0eec9b6ede7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_de679d8164a35626a3e09ebbc8b41ff0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219c1d9c-996a-516a-afc4-0eec9b6ede7c/219c1d9c-996a-516a-afc4-0eec9b6ede7c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_70c98c554bec278cd028ddbc4fefb345.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219c1d9c-996a-516a-afc4-0eec9b6ede7c/219c1d9c-996a-516a-afc4-0eec9b6ede7c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_3684733a71164ea3c5a9622518987aaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219c1d9c-996a-516a-afc4-0eec9b6ede7c/219c1d9c-996a-516a-afc4-0eec9b6ede7c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_e0d35309b090320c448ced2e4a2ca6dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219c1d9c-996a-516a-afc4-0eec9b6ede7c/219c1d9c-996a-516a-afc4-0eec9b6ede7c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_9049372a755768be7a90adb200f9f0d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219c1d9c-996a-516a-afc4-0eec9b6ede7c/219c1d9c-996a-516a-afc4-0eec9b6ede7c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_ca058001e7740ab9aa5031dd8c3e8d89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219c1d9c-996a-516a-afc4-0eec9b6ede7c/219c1d9c-996a-516a-afc4-0eec9b6ede7c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_317dcb0ab487cf09cca6d3049fa555ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219c1d9c-996a-516a-afc4-0eec9b6ede7c/219c1d9c-996a-516a-afc4-0eec9b6ede7c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_0c5fa32470fb7f668858ffd0e21d27fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219c1d9c-996a-516a-afc4-0eec9b6ede7c/219c1d9c-996a-516a-afc4-0eec9b6ede7c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_fa4b1d201546c80fe02925ee1d738e61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219c1d9c-996a-516a-afc4-0eec9b6ede7c/219c1d9c-996a-516a-afc4-0eec9b6ede7c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/cb/67cb1d100221ce3587b02283b1757866/pa/NZ38096_a9d004bc73c4657dcc759f6599e5125b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2019}
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ38096%27 HTTP/1.1" 200 None
2026-03-30 10:39:59 [auto1.de] INFO: Saving data for NZ38096: {'created_time': 1774867199.925607, 'last_price_update_time': 1774867199.925618, 'auction_closing_time': 1774971710.0}
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ38096') HTTP/1.1" 204 0
2026-03-30 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX53505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:39:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:39:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:39:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:39:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e78d10>
2026-03-30 10:39:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:39:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_4713b7a2e43ff436a5d878e68a05e3d3.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_4713b7a2e43ff436a5d878e68a05e3d3.jpg saved to cache
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b03a723a-1587-5755-87b7-7158ba97995b
2026-03-30 10:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_07602523407617c296cb3145685c845e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c42a90>
2026-03-30 10:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_07602523407617c296cb3145685c845e.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_07602523407617c296cb3145685c845e.jpg saved to cache
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b03a723a-1587-5755-87b7-7158ba97995b
2026-03-30 10:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_2eee1b986b02cc8c5bb23e66ecb73b6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da0490>
2026-03-30 10:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_2eee1b986b02cc8c5bb23e66ecb73b6d.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_2eee1b986b02cc8c5bb23e66ecb73b6d.jpg saved to cache
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b03a723a-1587-5755-87b7-7158ba97995b
2026-03-30 10:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_906f35b2e775a8248b9767f89cd61be6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f0410>
2026-03-30 10:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_906f35b2e775a8248b9767f89cd61be6.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_906f35b2e775a8248b9767f89cd61be6.jpg saved to cache
2026-03-30 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b03a723a-1587-5755-87b7-7158ba97995b
2026-03-30 10:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL70294/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_74d381a0883f39b5baf89dc58c06696e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM81671> (referer: https://www.auto1.com/v1/car-details-view/BM81671/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_079f13ff0d5970817846985524ee8042.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb24d0>
2026-03-30 10:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_74d381a0883f39b5baf89dc58c06696e.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_74d381a0883f39b5baf89dc58c06696e.jpg saved to cache
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b03a723a-1587-5755-87b7-7158ba97995b
2026-03-30 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_30c8f840df7fb3e88d5cf1279c7cac05.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY18097> (referer: https://www.auto1.com/v1/car-details-view/CY18097/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 471ba8b3-c8c8-5329-8edf-fd7f4718216b with identifier: BM81671
2026-03-30 10:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 471ba8b3-c8c8-5329-8edf-fd7f4718216b with scrape type 1
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 471ba8b3-c8c8-5329-8edf-fd7f4718216b
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_61b62350ee7f6511d041cf6838c51120.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_61b62350ee7f6511d041cf6838c51120.jpg not downloaded yet
2026-03-30 10:40:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e61290>
2026-03-30 10:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_079f13ff0d5970817846985524ee8042.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_079f13ff0d5970817846985524ee8042.jpg saved to cache
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b03a723a-1587-5755-87b7-7158ba97995b
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_f5e777170547c439c99ffd7ddab92b52.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_f5e777170547c439c99ffd7ddab92b52.jpg not downloaded yet
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_9e4e7d4bf2498b95c3a3164c85192fea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_9e4e7d4bf2498b95c3a3164c85192fea.jpg not downloaded yet
2026-03-30 10:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee5810>
2026-03-30 10:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_30c8f840df7fb3e88d5cf1279c7cac05.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_30c8f840df7fb3e88d5cf1279c7cac05.jpg saved to cache
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b03a723a-1587-5755-87b7-7158ba97995b
2026-03-30 10:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a5089c5-c525-5c27-825d-ed6985518cc5 with identifier: CY18097
2026-03-30 10:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a5089c5-c525-5c27-825d-ed6985518cc5 with scrape type 1
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a5089c5-c525-5c27-825d-ed6985518cc5
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_bfda74d741d59461ea76a04d9bbd40b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_bfda74d741d59461ea76a04d9bbd40b0.jpg not downloaded yet
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_154216af0d9149767c6c3f1df035ec2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_154216af0d9149767c6c3f1df035ec2d.jpg not downloaded yet
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_7c685cdbbbedb11ff8f053f6b7b4eb92.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_7c685cdbbbedb11ff8f053f6b7b4eb92.jpg not downloaded yet
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_811d39e350f88d34d719c9948584edcb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_811d39e350f88d34d719c9948584edcb.jpg not downloaded yet
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_a1712743459c75b38e5d52a34d7b985b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_a1712743459c75b38e5d52a34d7b985b.jpg not downloaded yet
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_8809ba95a7c4ede2ad8341ee39fd1a31.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_8809ba95a7c4ede2ad8341ee39fd1a31.jpg not downloaded yet
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_c565a251c57e750ae2da3f3c81ccf777.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_c565a251c57e750ae2da3f3c81ccf777.jpg not downloaded yet
2026-03-30 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_911b82576cf8b2e1cf4921645bfe4309.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_e1836a37f0c52f138121d66a5a053533.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_e1836a37f0c52f138121d66a5a053533.jpg not downloaded yet
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_b9e6f252c143bbd9f3d63a2ee02c4bcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_b9e6f252c143bbd9f3d63a2ee02c4bcd.jpg not downloaded yet
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_1ee43487edfe1311d896cab9d26e7dad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_1ee43487edfe1311d896cab9d26e7dad.jpg not downloaded yet
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_53e0fc306696b9c00486f9dab2476cd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_53e0fc306696b9c00486f9dab2476cd2.jpg not downloaded yet
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_e695c28d7d3f8a051873073251bd24e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_e695c28d7d3f8a051873073251bd24e8.jpg not downloaded yet
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_363fecaf233743ce0a71632e1ce1f17b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_363fecaf233743ce0a71632e1ce1f17b.jpg not downloaded yet
2026-03-30 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_8809ba95a7c4ede2ad8341ee39fd1a31.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_b107cdf2c0a8060cb73980452982e1b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_b107cdf2c0a8060cb73980452982e1b3.jpg not downloaded yet
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_786f74576c57c4f02a85367e5d289748.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_786f74576c57c4f02a85367e5d289748.jpg not downloaded yet
2026-03-30 10:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f11550>
2026-03-30 10:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_911b82576cf8b2e1cf4921645bfe4309.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_911b82576cf8b2e1cf4921645bfe4309.jpg saved to cache
2026-03-30 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b03a723a-1587-5755-87b7-7158ba97995b
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_8edb4f4f5e0406754e243903e8531304.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_8edb4f4f5e0406754e243903e8531304.jpg not downloaded yet
2026-03-30 10:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5052ed0>
2026-03-30 10:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_8809ba95a7c4ede2ad8341ee39fd1a31.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_8809ba95a7c4ede2ad8341ee39fd1a31.jpg saved to cache
2026-03-30 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 471ba8b3-c8c8-5329-8edf-fd7f4718216b
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_85cf5811184be21c25b864544f8343d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_85cf5811184be21c25b864544f8343d8.jpg not downloaded yet
2026-03-30 10:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_fc4f092107dce4c986d729b440a2a1f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_363fecaf233743ce0a71632e1ce1f17b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5982110>
2026-03-30 10:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F285480f34179928461735c88dc56c5d4%252Fpa%252FEG45632_fc4f092107dce4c986d729b440a2a1f9.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_fc4f092107dce4c986d729b440a2a1f9.jpg saved to cache
2026-03-30 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b03a723a-1587-5755-87b7-7158ba97995b
2026-03-30 10:40:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b03a723a-1587-5755-87b7-7158ba97995b, skipping ID generation
2026-03-30 10:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03a723a-1587-5755-87b7-7158ba97995b with scrape type 1
2026-03-30 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b03a723a-1587-5755-87b7-7158ba97995b sending to next pipeline
2026-03-30 10:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b03a723a-1587-5755-87b7-7158ba97995b, identifier: EG45632
2026-03-30 10:40:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b03a723a-1587-5755-87b7-7158ba97995b with identifier: EG45632
2026-03-30 10:40:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b03a723a-1587-5755-87b7-7158ba97995b with identifier: EG45632
2026-03-30 10:40:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b03a723a-1587-5755-87b7-7158ba97995b with identifier: EG45632 to the API
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_fc4f092107dce4c986d729b440a2a1f9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 67,
 'expiration_date': '2026-03-31T15:34:47Z',
 'fuel_type': 'petrol',
 'id': 'b03a723a-1587-5755-87b7-7158ba97995b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG45632',
 'listing': 'auction',
 'location': 'DE, Mannheim',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 25731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3089964,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_fc4f092107dce4c986d729b440a2a1f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_911b82576cf8b2e1cf4921645bfe4309.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_30c8f840df7fb3e88d5cf1279c7cac05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2506267,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_74d381a0883f39b5baf89dc58c06696e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3088972,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_079f13ff0d5970817846985524ee8042.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_906f35b2e775a8248b9767f89cd61be6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_2eee1b986b02cc8c5bb23e66ecb73b6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2934617,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_07602523407617c296cb3145685c845e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3178929,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_4713b7a2e43ff436a5d878e68a05e3d3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b03a723a-1587-5755-87b7-7158ba97995b/b03a723a-1587-5755-87b7-7158ba97995b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/285480f34179928461735c88dc56c5d4/pa/EG45632_e7017a4409afca99f1916bc128b71843.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2020}
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG45632%27 HTTP/1.1" 200 None
2026-03-30 10:40:02 [auto1.de] INFO: Saving data for EG45632: {'created_time': 1774867202.932638, 'last_price_update_time': 1774867202.932651, 'auction_closing_time': 1774971287.0}
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG45632') HTTP/1.1" 204 0
2026-03-30 10:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_85cf5811184be21c25b864544f8343d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_8edb4f4f5e0406754e243903e8531304.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB76846/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WV73920/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea0890>
2026-03-30 10:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_363fecaf233743ce0a71632e1ce1f17b.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_363fecaf233743ce0a71632e1ce1f17b.jpg saved to cache
2026-03-30 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a5089c5-c525-5c27-825d-ed6985518cc5
2026-03-30 10:40:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ae27d0>
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_85cf5811184be21c25b864544f8343d8.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_85cf5811184be21c25b864544f8343d8.jpg saved to cache
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a5089c5-c525-5c27-825d-ed6985518cc5
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a67c10>
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_8edb4f4f5e0406754e243903e8531304.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_8edb4f4f5e0406754e243903e8531304.jpg saved to cache
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a5089c5-c525-5c27-825d-ed6985518cc5
2026-03-30 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_e695c28d7d3f8a051873073251bd24e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_b107cdf2c0a8060cb73980452982e1b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_786f74576c57c4f02a85367e5d289748.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_53e0fc306696b9c00486f9dab2476cd2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_1ee43487edfe1311d896cab9d26e7dad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ffc1d0>
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_e695c28d7d3f8a051873073251bd24e8.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_e695c28d7d3f8a051873073251bd24e8.jpg saved to cache
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 471ba8b3-c8c8-5329-8edf-fd7f4718216b
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a8f3d0>
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_b107cdf2c0a8060cb73980452982e1b3.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_b107cdf2c0a8060cb73980452982e1b3.jpg saved to cache
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 471ba8b3-c8c8-5329-8edf-fd7f4718216b
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5051c50>
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_786f74576c57c4f02a85367e5d289748.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_786f74576c57c4f02a85367e5d289748.jpg saved to cache
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a5089c5-c525-5c27-825d-ed6985518cc5
2026-03-30 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_b9e6f252c143bbd9f3d63a2ee02c4bcd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50dc190>
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_53e0fc306696b9c00486f9dab2476cd2.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_53e0fc306696b9c00486f9dab2476cd2.jpg saved to cache
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a5089c5-c525-5c27-825d-ed6985518cc5
2026-03-30 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_e1836a37f0c52f138121d66a5a053533.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50df1d0>
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_1ee43487edfe1311d896cab9d26e7dad.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_1ee43487edfe1311d896cab9d26e7dad.jpg saved to cache
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 471ba8b3-c8c8-5329-8edf-fd7f4718216b
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595ca90>
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_b9e6f252c143bbd9f3d63a2ee02c4bcd.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_b9e6f252c143bbd9f3d63a2ee02c4bcd.jpg saved to cache
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a5089c5-c525-5c27-825d-ed6985518cc5
2026-03-30 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_c565a251c57e750ae2da3f3c81ccf777.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e61c90>
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_e1836a37f0c52f138121d66a5a053533.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_e1836a37f0c52f138121d66a5a053533.jpg saved to cache
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 471ba8b3-c8c8-5329-8edf-fd7f4718216b
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50915d0>
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_c565a251c57e750ae2da3f3c81ccf777.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_c565a251c57e750ae2da3f3c81ccf777.jpg saved to cache
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a5089c5-c525-5c27-825d-ed6985518cc5
2026-03-30 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_a1712743459c75b38e5d52a34d7b985b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_811d39e350f88d34d719c9948584edcb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_7c685cdbbbedb11ff8f053f6b7b4eb92.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_154216af0d9149767c6c3f1df035ec2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6fc10>
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_a1712743459c75b38e5d52a34d7b985b.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_a1712743459c75b38e5d52a34d7b985b.jpg saved to cache
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a5089c5-c525-5c27-825d-ed6985518cc5
2026-03-30 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_bfda74d741d59461ea76a04d9bbd40b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e78a90>
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_811d39e350f88d34d719c9948584edcb.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_811d39e350f88d34d719c9948584edcb.jpg saved to cache
2026-03-30 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 471ba8b3-c8c8-5329-8edf-fd7f4718216b
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee43d0>
2026-03-30 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_7c685cdbbbedb11ff8f053f6b7b4eb92.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_7c685cdbbbedb11ff8f053f6b7b4eb92.jpg saved to cache
2026-03-30 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a5089c5-c525-5c27-825d-ed6985518cc5
2026-03-30 10:40:04 [scrapy.extensions.logstats] INFO: Crawled 232 pages (at 64 pages/min), scraped 184 items (at 62 items/min)
2026-03-30 10:40:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-30 10:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB89261/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dba950>
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_154216af0d9149767c6c3f1df035ec2d.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_154216af0d9149767c6c3f1df035ec2d.jpg saved to cache
2026-03-30 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 471ba8b3-c8c8-5329-8edf-fd7f4718216b
2026-03-30 10:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_9e4e7d4bf2498b95c3a3164c85192fea.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd06d0>
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F0f%252F950f1d38cb03699e42c749056d5286f8%252Fpa%252FCY18097_bfda74d741d59461ea76a04d9bbd40b0.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_bfda74d741d59461ea76a04d9bbd40b0.jpg saved to cache
2026-03-30 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a5089c5-c525-5c27-825d-ed6985518cc5
2026-03-30 10:40:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a5089c5-c525-5c27-825d-ed6985518cc5, skipping ID generation
2026-03-30 10:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a5089c5-c525-5c27-825d-ed6985518cc5 with scrape type 1
2026-03-30 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a5089c5-c525-5c27-825d-ed6985518cc5 sending to next pipeline
2026-03-30 10:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a5089c5-c525-5c27-825d-ed6985518cc5, identifier: CY18097
2026-03-30 10:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a5089c5-c525-5c27-825d-ed6985518cc5 with identifier: CY18097
2026-03-30 10:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a5089c5-c525-5c27-825d-ed6985518cc5 with identifier: CY18097
2026-03-30 10:40:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a5089c5-c525-5c27-825d-ed6985518cc5 with identifier: CY18097 to the API
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_bfda74d741d59461ea76a04d9bbd40b0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:25:48Z',
 'fuel_type': 'petrol',
 'id': '9a5089c5-c525-5c27-825d-ed6985518cc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY18097',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 49109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_bfda74d741d59461ea76a04d9bbd40b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_7c685cdbbbedb11ff8f053f6b7b4eb92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_a1712743459c75b38e5d52a34d7b985b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_c565a251c57e750ae2da3f3c81ccf777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_b9e6f252c143bbd9f3d63a2ee02c4bcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_53e0fc306696b9c00486f9dab2476cd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_363fecaf233743ce0a71632e1ce1f17b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_786f74576c57c4f02a85367e5d289748.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_8edb4f4f5e0406754e243903e8531304.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a5089c5-c525-5c27-825d-ed6985518cc5/9a5089c5-c525-5c27-825d-ed6985518cc5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/0f/950f1d38cb03699e42c749056d5286f8/pa/CY18097_85cf5811184be21c25b864544f8343d8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2022}
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY18097%27 HTTP/1.1" 200 None
2026-03-30 10:40:04 [auto1.de] INFO: Saving data for CY18097: {'created_time': 1774867204.725348, 'last_price_update_time': 1774867204.725359, 'auction_closing_time': 1774970748.0}
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY18097') HTTP/1.1" 204 0
2026-03-30 10:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_f5e777170547c439c99ffd7ddab92b52.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_61b62350ee7f6511d041cf6838c51120.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0f350>
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_9e4e7d4bf2498b95c3a3164c85192fea.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_9e4e7d4bf2498b95c3a3164c85192fea.jpg saved to cache
2026-03-30 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 471ba8b3-c8c8-5329-8edf-fd7f4718216b
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f2690>
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_f5e777170547c439c99ffd7ddab92b52.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_f5e777170547c439c99ffd7ddab92b52.jpg saved to cache
2026-03-30 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 471ba8b3-c8c8-5329-8edf-fd7f4718216b
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5037fd0>
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc0%252F48c0211e43c0938fa9882ce7aa793592%252Fpa%252FBM81671_61b62350ee7f6511d041cf6838c51120.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_61b62350ee7f6511d041cf6838c51120.jpg saved to cache
2026-03-30 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 471ba8b3-c8c8-5329-8edf-fd7f4718216b
2026-03-30 10:40:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 471ba8b3-c8c8-5329-8edf-fd7f4718216b, skipping ID generation
2026-03-30 10:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 471ba8b3-c8c8-5329-8edf-fd7f4718216b with scrape type 1
2026-03-30 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 471ba8b3-c8c8-5329-8edf-fd7f4718216b sending to next pipeline
2026-03-30 10:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 471ba8b3-c8c8-5329-8edf-fd7f4718216b, identifier: BM81671
2026-03-30 10:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 471ba8b3-c8c8-5329-8edf-fd7f4718216b with identifier: BM81671
2026-03-30 10:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 471ba8b3-c8c8-5329-8edf-fd7f4718216b with identifier: BM81671
2026-03-30 10:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 471ba8b3-c8c8-5329-8edf-fd7f4718216b with identifier: BM81671 to the API
2026-03-30 10:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_61b62350ee7f6511d041cf6838c51120.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:17:36Z',
 'fuel_type': 'diesel',
 'id': '471ba8b3-c8c8-5329-8edf-fd7f4718216b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM81671',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 226812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_61b62350ee7f6511d041cf6838c51120.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_f5e777170547c439c99ffd7ddab92b52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_9e4e7d4bf2498b95c3a3164c85192fea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_154216af0d9149767c6c3f1df035ec2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_811d39e350f88d34d719c9948584edcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_8809ba95a7c4ede2ad8341ee39fd1a31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_e1836a37f0c52f138121d66a5a053533.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_1ee43487edfe1311d896cab9d26e7dad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_e695c28d7d3f8a051873073251bd24e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_471ba8b3-c8c8-5329-8edf-fd7f4718216b/471ba8b3-c8c8-5329-8edf-fd7f4718216b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c0/48c0211e43c0938fa9882ce7aa793592/pa/BM81671_b107cdf2c0a8060cb73980452982e1b3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang BlueTEC Avantgarde Edition',
 'transmission': 'automatic',
 'trim': 'lang BlueTEC Avantgarde Edition',
 'year': 2016}
2026-03-30 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM81671%27 HTTP/1.1" 200 None
2026-03-30 10:40:05 [auto1.de] INFO: Saving data for BM81671: {'created_time': 1774867205.403348, 'last_price_update_time': 1774867205.403359, 'auction_closing_time': 1774970256.0}
2026-03-30 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM81671') HTTP/1.1" 204 0
2026-03-30 10:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU37241/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KM94418> (referer: https://www.auto1.com/v1/car-details-view/KM94418/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b69ca83c-9f7b-56cf-ae4f-8ded15077e0d with identifier: KM94418
2026-03-30 10:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69ca83c-9f7b-56cf-ae4f-8ded15077e0d with scrape type 1
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b69ca83c-9f7b-56cf-ae4f-8ded15077e0d
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fb9%252F55b90ce07171e7d57cb77c30dcdc7c0e%252Fpa%252FKM94418_786eee9a4be3d5c4a9d06b97d84ae773.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_786eee9a4be3d5c4a9d06b97d84ae773.jpg not downloaded yet
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fb9%252F55b90ce07171e7d57cb77c30dcdc7c0e%252Fpa%252FKM94418_8c439a738fbe0992f5795ebed3a07a00.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_8c439a738fbe0992f5795ebed3a07a00.jpg not downloaded yet
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fb9%252F55b90ce07171e7d57cb77c30dcdc7c0e%252Fpa%252FKM94418_b84a00975b5d3950e62fb6d1799ccdd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_b84a00975b5d3950e62fb6d1799ccdd3.jpg not downloaded yet
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fb9%252F55b90ce07171e7d57cb77c30dcdc7c0e%252Fpa%252FKM94418_7544573c2c5395a55412e8942322e66b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_7544573c2c5395a55412e8942322e66b.jpg not downloaded yet
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fb9%252F55b90ce07171e7d57cb77c30dcdc7c0e%252Fpa%252FKM94418_1959a5480754cb5448c5ce55b127d359.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_1959a5480754cb5448c5ce55b127d359.jpg not downloaded yet
2026-03-30 10:40:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE21529/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_1959a5480754cb5448c5ce55b127d359.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_7544573c2c5395a55412e8942322e66b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0c8d0>
2026-03-30 10:40:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b69ca83c-9f7b-56cf-ae4f-8ded15077e0d/b69ca83c-9f7b-56cf-ae4f-8ded15077e0d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fb9%252F55b90ce07171e7d57cb77c30dcdc7c0e%252Fpa%252FKM94418_1959a5480754cb5448c5ce55b127d359.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_1959a5480754cb5448c5ce55b127d359.jpg saved to cache
2026-03-30 10:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b69ca83c-9f7b-56cf-ae4f-8ded15077e0d
2026-03-30 10:40:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b32490>
2026-03-30 10:40:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b69ca83c-9f7b-56cf-ae4f-8ded15077e0d/b69ca83c-9f7b-56cf-ae4f-8ded15077e0d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fb9%252F55b90ce07171e7d57cb77c30dcdc7c0e%252Fpa%252FKM94418_7544573c2c5395a55412e8942322e66b.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_7544573c2c5395a55412e8942322e66b.jpg saved to cache
2026-03-30 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b69ca83c-9f7b-56cf-ae4f-8ded15077e0d
2026-03-30 10:40:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU59543> (referer: https://www.auto1.com/v1/car-details-view/SU59543/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfe48ea5-ca1f-5426-84d6-5d0ae53995f9 with identifier: SU59543
2026-03-30 10:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfe48ea5-ca1f-5426-84d6-5d0ae53995f9 with scrape type 1
2026-03-30 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bfe48ea5-ca1f-5426-84d6-5d0ae53995f9
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_ecc5f3b7cb58132720e4d91059633803.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_ecc5f3b7cb58132720e4d91059633803.jpg not downloaded yet
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_8103f99f97698fed659abea434ca8edd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_8103f99f97698fed659abea434ca8edd.jpg not downloaded yet
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_0ed9bc2c05c384c8ba01f6f2b239b7b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_0ed9bc2c05c384c8ba01f6f2b239b7b4.jpg not downloaded yet
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_7d9e16f4c0b8dfba32af38fcec48e6b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_7d9e16f4c0b8dfba32af38fcec48e6b7.jpg not downloaded yet
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_051df38fd0ca07447c388653b3cdf277.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_051df38fd0ca07447c388653b3cdf277.jpg not downloaded yet
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_c07b0c7eb4e3bdad4422c44450e4b6fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_c07b0c7eb4e3bdad4422c44450e4b6fb.jpg not downloaded yet
2026-03-30 10:40:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_b84a00975b5d3950e62fb6d1799ccdd3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_8505a82e2e95d28b887ccbf02626867f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_8505a82e2e95d28b887ccbf02626867f.jpg not downloaded yet
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_b1e82938d8fc0b192d74bbe4309224fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_b1e82938d8fc0b192d74bbe4309224fe.jpg not downloaded yet
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_c29b8a6d42b24805a0c3929213014696.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_c29b8a6d42b24805a0c3929213014696.jpg not downloaded yet
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_59b4f1292465852484559cfeb28b3abf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_59b4f1292465852484559cfeb28b3abf.jpg not downloaded yet
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef593d410>
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b69ca83c-9f7b-56cf-ae4f-8ded15077e0d/b69ca83c-9f7b-56cf-ae4f-8ded15077e0d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fb9%252F55b90ce07171e7d57cb77c30dcdc7c0e%252Fpa%252FKM94418_b84a00975b5d3950e62fb6d1799ccdd3.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_b84a00975b5d3950e62fb6d1799ccdd3.jpg saved to cache
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b69ca83c-9f7b-56cf-ae4f-8ded15077e0d
2026-03-30 10:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_c07b0c7eb4e3bdad4422c44450e4b6fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da33d0>
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_c07b0c7eb4e3bdad4422c44450e4b6fb.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_c07b0c7eb4e3bdad4422c44450e4b6fb.jpg saved to cache
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bfe48ea5-ca1f-5426-84d6-5d0ae53995f9
2026-03-30 10:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_59b4f1292465852484559cfeb28b3abf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0bfd0>
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_59b4f1292465852484559cfeb28b3abf.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_59b4f1292465852484559cfeb28b3abf.jpg saved to cache
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bfe48ea5-ca1f-5426-84d6-5d0ae53995f9
2026-03-30 10:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_c29b8a6d42b24805a0c3929213014696.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL70294> (referer: https://www.auto1.com/v1/car-details-view/CL70294/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ffc690>
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_c29b8a6d42b24805a0c3929213014696.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_c29b8a6d42b24805a0c3929213014696.jpg saved to cache
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bfe48ea5-ca1f-5426-84d6-5d0ae53995f9
2026-03-30 10:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bda4e42-e293-5402-b819-26965dc67e77 with identifier: CL70294
2026-03-30 10:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bda4e42-e293-5402-b819-26965dc67e77 with scrape type 1
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3bda4e42-e293-5402-b819-26965dc67e77
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_1ca28cb751bcd1282752c4d4e3a06677.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_1ca28cb751bcd1282752c4d4e3a06677.jpg not downloaded yet
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_8ebcf9659fa84a92f33b81d02dd81498.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_8ebcf9659fa84a92f33b81d02dd81498.jpg not downloaded yet
2026-03-30 10:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_b1e82938d8fc0b192d74bbe4309224fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_9f4031a1dd190c535f46a867bbfdf5bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_9f4031a1dd190c535f46a867bbfdf5bf.jpg not downloaded yet
2026-03-30 10:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_8505a82e2e95d28b887ccbf02626867f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_2f44d7ae10a25a682843eeda9fedf77c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_2f44d7ae10a25a682843eeda9fedf77c.jpg not downloaded yet
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_b600e96b295d8ae20bcb6d0b1aa9875c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_b600e96b295d8ae20bcb6d0b1aa9875c.jpg not downloaded yet
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_aa78cf31c105200c33345a48025d9ad1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_aa78cf31c105200c33345a48025d9ad1.jpg not downloaded yet
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_94d888c4f54f7ade5810b06649fe5a5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_94d888c4f54f7ade5810b06649fe5a5d.jpg not downloaded yet
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_7b368459ae5ab0e6ae43c6c6e4375c21.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_7b368459ae5ab0e6ae43c6c6e4375c21.jpg not downloaded yet
2026-03-30 10:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_1ca28cb751bcd1282752c4d4e3a06677.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_561d1dd7964aebb64bdfda44d81a5c51.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_561d1dd7964aebb64bdfda44d81a5c51.jpg not downloaded yet
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c43710>
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_b1e82938d8fc0b192d74bbe4309224fe.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_b1e82938d8fc0b192d74bbe4309224fe.jpg saved to cache
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bfe48ea5-ca1f-5426-84d6-5d0ae53995f9
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_34aa3b52651e0d201d41807047dd02bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_34aa3b52651e0d201d41807047dd02bf.jpg not downloaded yet
2026-03-30 10:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX53505> (referer: https://www.auto1.com/v1/car-details-view/NX53505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50df010>
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_8505a82e2e95d28b887ccbf02626867f.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_8505a82e2e95d28b887ccbf02626867f.jpg saved to cache
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bfe48ea5-ca1f-5426-84d6-5d0ae53995f9
2026-03-30 10:40:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5051410>
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_1ca28cb751bcd1282752c4d4e3a06677.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_1ca28cb751bcd1282752c4d4e3a06677.jpg saved to cache
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3bda4e42-e293-5402-b819-26965dc67e77
2026-03-30 10:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_8ebcf9659fa84a92f33b81d02dd81498.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 769a302d-f98e-5e1c-8ede-e0cd2fcc3efa with identifier: NX53505
2026-03-30 10:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 769a302d-f98e-5e1c-8ede-e0cd2fcc3efa with scrape type 1
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 769a302d-f98e-5e1c-8ede-e0cd2fcc3efa
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ffd%252F45fd0da68432b6bf83b38737b00839c3%252Fpa%252FNX53505_8ea1dd1db48f842aee3479df7fbe4b2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_8ea1dd1db48f842aee3479df7fbe4b2a.jpg already downloaded
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ffd%252F45fd0da68432b6bf83b38737b00839c3%252Fpa%252FNX53505_d16e7c4b8bcfc5dc5cf59a7bec49da87.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_d16e7c4b8bcfc5dc5cf59a7bec49da87.jpg already downloaded
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ffd%252F45fd0da68432b6bf83b38737b00839c3%252Fpa%252FNX53505_3e35cfd1748ce3991699f2292ef3da8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_3e35cfd1748ce3991699f2292ef3da8a.jpg already downloaded
2026-03-30 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ffd%252F45fd0da68432b6bf83b38737b00839c3%252Fpa%252FNX53505_e4c1fabacc48d543fb5e3738862ba9f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_e4c1fabacc48d543fb5e3738862ba9f8.jpg already downloaded
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ffd%252F45fd0da68432b6bf83b38737b00839c3%252Fpa%252FNX53505_81baaeaa6df4f2cfe36a8ebc2d682ce1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_81baaeaa6df4f2cfe36a8ebc2d682ce1.jpg already downloaded
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ffd%252F45fd0da68432b6bf83b38737b00839c3%252Fpa%252FNX53505_6f012ad9719e8beddd120b2e5587a91d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_6f012ad9719e8beddd120b2e5587a91d.jpg already downloaded
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ffd%252F45fd0da68432b6bf83b38737b00839c3%252Fpa%252FNX53505_fca977abd65a04a16ba919fcb91a1847.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_fca977abd65a04a16ba919fcb91a1847.jpg already downloaded
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ffd%252F45fd0da68432b6bf83b38737b00839c3%252Fpa%252FNX53505_5074602ac939ad6e81c37525b4846ea8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_5074602ac939ad6e81c37525b4846ea8.jpg already downloaded
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ffd%252F45fd0da68432b6bf83b38737b00839c3%252Fpa%252FNX53505_5f2f1e1bce64849aee6a9b50582c2dd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_5f2f1e1bce64849aee6a9b50582c2dd4.jpg already downloaded
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ffd%252F45fd0da68432b6bf83b38737b00839c3%252Fpa%252FNX53505_f26ed2d48bcbeb4b169019942f412ffb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_f26ed2d48bcbeb4b169019942f412ffb.jpg already downloaded
2026-03-30 10:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 769a302d-f98e-5e1c-8ede-e0cd2fcc3efa, identifier: NX53505
2026-03-30 10:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 769a302d-f98e-5e1c-8ede-e0cd2fcc3efa with identifier: NX53505
2026-03-30 10:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 769a302d-f98e-5e1c-8ede-e0cd2fcc3efa with identifier: NX53505
2026-03-30 10:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 769a302d-f98e-5e1c-8ede-e0cd2fcc3efa with identifier: NX53505 to the API
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NX53505>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:15:34Z',
 'fuel_type': 'petrol',
 'id': '769a302d-f98e-5e1c-8ede-e0cd2fcc3efa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX53505',
 'listing': 'auction',
 'location': 'DE, Itzehoe',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 46523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_8ea1dd1db48f842aee3479df7fbe4b2a.jpg',
                'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_d16e7c4b8bcfc5dc5cf59a7bec49da87.jpg',
                'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_3e35cfd1748ce3991699f2292ef3da8a.jpg',
                'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_e4c1fabacc48d543fb5e3738862ba9f8.jpg',
                'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_81baaeaa6df4f2cfe36a8ebc2d682ce1.jpg',
                'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_6f012ad9719e8beddd120b2e5587a91d.jpg',
                'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_fca977abd65a04a16ba919fcb91a1847.jpg',
                'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_5074602ac939ad6e81c37525b4846ea8.jpg',
                'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_5f2f1e1bce64849aee6a9b50582c2dd4.jpg',
                'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_f26ed2d48bcbeb4b169019942f412ffb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_769a302d-f98e-5e1c-8ede-e0cd2fcc3efa/769a302d-f98e-5e1c-8ede-e0cd2fcc3efa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_8ea1dd1db48f842aee3479df7fbe4b2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_769a302d-f98e-5e1c-8ede-e0cd2fcc3efa/769a302d-f98e-5e1c-8ede-e0cd2fcc3efa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_d16e7c4b8bcfc5dc5cf59a7bec49da87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_769a302d-f98e-5e1c-8ede-e0cd2fcc3efa/769a302d-f98e-5e1c-8ede-e0cd2fcc3efa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_3e35cfd1748ce3991699f2292ef3da8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_769a302d-f98e-5e1c-8ede-e0cd2fcc3efa/769a302d-f98e-5e1c-8ede-e0cd2fcc3efa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_e4c1fabacc48d543fb5e3738862ba9f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_769a302d-f98e-5e1c-8ede-e0cd2fcc3efa/769a302d-f98e-5e1c-8ede-e0cd2fcc3efa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_81baaeaa6df4f2cfe36a8ebc2d682ce1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_769a302d-f98e-5e1c-8ede-e0cd2fcc3efa/769a302d-f98e-5e1c-8ede-e0cd2fcc3efa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_6f012ad9719e8beddd120b2e5587a91d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_769a302d-f98e-5e1c-8ede-e0cd2fcc3efa/769a302d-f98e-5e1c-8ede-e0cd2fcc3efa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_fca977abd65a04a16ba919fcb91a1847.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_769a302d-f98e-5e1c-8ede-e0cd2fcc3efa/769a302d-f98e-5e1c-8ede-e0cd2fcc3efa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_5074602ac939ad6e81c37525b4846ea8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_769a302d-f98e-5e1c-8ede-e0cd2fcc3efa/769a302d-f98e-5e1c-8ede-e0cd2fcc3efa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_5f2f1e1bce64849aee6a9b50582c2dd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_769a302d-f98e-5e1c-8ede-e0cd2fcc3efa/769a302d-f98e-5e1c-8ede-e0cd2fcc3efa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/fd/45fd0da68432b6bf83b38737b00839c3/pa/NX53505_f26ed2d48bcbeb4b169019942f412ffb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 Classic blue 2WD',
 'transmission': 'manual',
 'trim': 'Classic blue 2WD',
 'year': 2018}
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX53505%27 HTTP/1.1" 200 None
2026-03-30 10:40:10 [auto1.de] INFO: Saving data for NX53505: {'created_time': 1774867210.66513, 'last_price_update_time': 1774867210.665141, 'auction_closing_time': 1774970134.0}
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX53505') HTTP/1.1" 204 0
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7905410>
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_8ebcf9659fa84a92f33b81d02dd81498.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_8ebcf9659fa84a92f33b81d02dd81498.jpg saved to cache
2026-03-30 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3bda4e42-e293-5402-b819-26965dc67e77
2026-03-30 10:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_34aa3b52651e0d201d41807047dd02bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_561d1dd7964aebb64bdfda44d81a5c51.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_7b368459ae5ab0e6ae43c6c6e4375c21.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f46090>
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_34aa3b52651e0d201d41807047dd02bf.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_34aa3b52651e0d201d41807047dd02bf.jpg saved to cache
2026-03-30 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3bda4e42-e293-5402-b819-26965dc67e77
2026-03-30 10:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_94d888c4f54f7ade5810b06649fe5a5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ed0f50>
2026-03-30 10:40:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_561d1dd7964aebb64bdfda44d81a5c51.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_561d1dd7964aebb64bdfda44d81a5c51.jpg saved to cache
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3bda4e42-e293-5402-b819-26965dc67e77
2026-03-30 10:40:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50dd990>
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_7b368459ae5ab0e6ae43c6c6e4375c21.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_7b368459ae5ab0e6ae43c6c6e4375c21.jpg saved to cache
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3bda4e42-e293-5402-b819-26965dc67e77
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50352d0>
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_94d888c4f54f7ade5810b06649fe5a5d.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_94d888c4f54f7ade5810b06649fe5a5d.jpg saved to cache
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3bda4e42-e293-5402-b819-26965dc67e77
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS21761/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_aa78cf31c105200c33345a48025d9ad1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_2f44d7ae10a25a682843eeda9fedf77c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_051df38fd0ca07447c388653b3cdf277.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_9f4031a1dd190c535f46a867bbfdf5bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0c050>
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_aa78cf31c105200c33345a48025d9ad1.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_aa78cf31c105200c33345a48025d9ad1.jpg saved to cache
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3bda4e42-e293-5402-b819-26965dc67e77
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_7d9e16f4c0b8dfba32af38fcec48e6b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_0ed9bc2c05c384c8ba01f6f2b239b7b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd1250>
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_2f44d7ae10a25a682843eeda9fedf77c.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_2f44d7ae10a25a682843eeda9fedf77c.jpg saved to cache
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3bda4e42-e293-5402-b819-26965dc67e77
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_ecc5f3b7cb58132720e4d91059633803.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef593d9d0>
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_051df38fd0ca07447c388653b3cdf277.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_051df38fd0ca07447c388653b3cdf277.jpg saved to cache
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bfe48ea5-ca1f-5426-84d6-5d0ae53995f9
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b314d0>
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_9f4031a1dd190c535f46a867bbfdf5bf.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_9f4031a1dd190c535f46a867bbfdf5bf.jpg saved to cache
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3bda4e42-e293-5402-b819-26965dc67e77
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b288d0>
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_7d9e16f4c0b8dfba32af38fcec48e6b7.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_7d9e16f4c0b8dfba32af38fcec48e6b7.jpg saved to cache
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bfe48ea5-ca1f-5426-84d6-5d0ae53995f9
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50722d0>
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_0ed9bc2c05c384c8ba01f6f2b239b7b4.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_0ed9bc2c05c384c8ba01f6f2b239b7b4.jpg saved to cache
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bfe48ea5-ca1f-5426-84d6-5d0ae53995f9
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_8c439a738fbe0992f5795ebed3a07a00.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ed38d0>
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_ecc5f3b7cb58132720e4d91059633803.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_ecc5f3b7cb58132720e4d91059633803.jpg saved to cache
2026-03-30 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfe48ea5-ca1f-5426-84d6-5d0ae53995f9
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_8103f99f97698fed659abea434ca8edd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY46895> (referer: https://www.auto1.com/v1/car-details-view/WY46895/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_786eee9a4be3d5c4a9d06b97d84ae773.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b036d0>
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b69ca83c-9f7b-56cf-ae4f-8ded15077e0d/b69ca83c-9f7b-56cf-ae4f-8ded15077e0d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fb9%252F55b90ce07171e7d57cb77c30dcdc7c0e%252Fpa%252FKM94418_8c439a738fbe0992f5795ebed3a07a00.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_8c439a738fbe0992f5795ebed3a07a00.jpg saved to cache
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b69ca83c-9f7b-56cf-ae4f-8ded15077e0d
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b03c90>
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fc9%252F3cc969b0ed1e269e20f9da0a38eacb1f%252Fpa%252FSU59543_8103f99f97698fed659abea434ca8edd.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_8103f99f97698fed659abea434ca8edd.jpg saved to cache
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bfe48ea5-ca1f-5426-84d6-5d0ae53995f9
2026-03-30 10:40:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfe48ea5-ca1f-5426-84d6-5d0ae53995f9, skipping ID generation
2026-03-30 10:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfe48ea5-ca1f-5426-84d6-5d0ae53995f9 with scrape type 1
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfe48ea5-ca1f-5426-84d6-5d0ae53995f9 sending to next pipeline
2026-03-30 10:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bfe48ea5-ca1f-5426-84d6-5d0ae53995f9, identifier: SU59543
2026-03-30 10:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bfe48ea5-ca1f-5426-84d6-5d0ae53995f9 with identifier: SU59543
2026-03-30 10:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bfe48ea5-ca1f-5426-84d6-5d0ae53995f9 with identifier: SU59543
2026-03-30 10:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bfe48ea5-ca1f-5426-84d6-5d0ae53995f9 with identifier: SU59543 to the API
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_8103f99f97698fed659abea434ca8edd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 980,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:48:21Z',
 'fuel_type': 'petrol',
 'id': 'bfe48ea5-ca1f-5426-84d6-5d0ae53995f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU59543',
 'listing': 'auction',
 'location': 'DE, Schweitenkirchen',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 180530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_ecc5f3b7cb58132720e4d91059633803.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_8103f99f97698fed659abea434ca8edd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_0ed9bc2c05c384c8ba01f6f2b239b7b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_7d9e16f4c0b8dfba32af38fcec48e6b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_051df38fd0ca07447c388653b3cdf277.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_c07b0c7eb4e3bdad4422c44450e4b6fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_8505a82e2e95d28b887ccbf02626867f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_b1e82938d8fc0b192d74bbe4309224fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_c29b8a6d42b24805a0c3929213014696.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe48ea5-ca1f-5426-84d6-5d0ae53995f9/bfe48ea5-ca1f-5426-84d6-5d0ae53995f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/c9/3cc969b0ed1e269e20f9da0a38eacb1f/pa/SU59543_59b4f1292465852484559cfeb28b3abf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU59543%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [auto1.de] INFO: Saving data for SU59543: {'created_time': 1774867212.514881, 'last_price_update_time': 1774867212.514891, 'auction_closing_time': 1774972101.0}
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU59543') HTTP/1.1" 204 0
2026-03-30 10:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7c3af4b-d7bb-54b3-991b-bafcd928b1e2 with identifier: WY46895
2026-03-30 10:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7c3af4b-d7bb-54b3-991b-bafcd928b1e2 with scrape type 1
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7c3af4b-d7bb-54b3-991b-bafcd928b1e2
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_2b666001a9fad35ff80956e63f78ff25.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_2b666001a9fad35ff80956e63f78ff25.jpg not downloaded yet
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ae2b90>
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b69ca83c-9f7b-56cf-ae4f-8ded15077e0d/b69ca83c-9f7b-56cf-ae4f-8ded15077e0d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fb9%252F55b90ce07171e7d57cb77c30dcdc7c0e%252Fpa%252FKM94418_786eee9a4be3d5c4a9d06b97d84ae773.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_786eee9a4be3d5c4a9d06b97d84ae773.jpg saved to cache
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b69ca83c-9f7b-56cf-ae4f-8ded15077e0d
2026-03-30 10:40:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b69ca83c-9f7b-56cf-ae4f-8ded15077e0d, skipping ID generation
2026-03-30 10:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69ca83c-9f7b-56cf-ae4f-8ded15077e0d with scrape type 1
2026-03-30 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b69ca83c-9f7b-56cf-ae4f-8ded15077e0d sending to next pipeline
2026-03-30 10:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b69ca83c-9f7b-56cf-ae4f-8ded15077e0d, identifier: KM94418
2026-03-30 10:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b69ca83c-9f7b-56cf-ae4f-8ded15077e0d with identifier: KM94418
2026-03-30 10:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b69ca83c-9f7b-56cf-ae4f-8ded15077e0d with identifier: KM94418
2026-03-30 10:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b69ca83c-9f7b-56cf-ae4f-8ded15077e0d with identifier: KM94418 to the API
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_786eee9a4be3d5c4a9d06b97d84ae773.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:45:56Z',
 'fuel_type': 'diesel',
 'id': 'b69ca83c-9f7b-56cf-ae4f-8ded15077e0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM94418',
 'listing': 'auction',
 'location': 'DE, Kiel',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 166866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b69ca83c-9f7b-56cf-ae4f-8ded15077e0d/b69ca83c-9f7b-56cf-ae4f-8ded15077e0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_786eee9a4be3d5c4a9d06b97d84ae773.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b69ca83c-9f7b-56cf-ae4f-8ded15077e0d/b69ca83c-9f7b-56cf-ae4f-8ded15077e0d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_8c439a738fbe0992f5795ebed3a07a00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b69ca83c-9f7b-56cf-ae4f-8ded15077e0d/b69ca83c-9f7b-56cf-ae4f-8ded15077e0d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_b84a00975b5d3950e62fb6d1799ccdd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b69ca83c-9f7b-56cf-ae4f-8ded15077e0d/b69ca83c-9f7b-56cf-ae4f-8ded15077e0d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_7544573c2c5395a55412e8942322e66b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b69ca83c-9f7b-56cf-ae4f-8ded15077e0d/b69ca83c-9f7b-56cf-ae4f-8ded15077e0d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/b9/55b90ce07171e7d57cb77c30dcdc7c0e/pa/KM94418_1959a5480754cb5448c5ce55b127d359.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-06-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 207 1.6 HDi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2007}
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM94418%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [auto1.de] INFO: Saving data for KM94418: {'created_time': 1774867213.048509, 'last_price_update_time': 1774867213.048519, 'auction_closing_time': 1774971956.0}
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM94418') HTTP/1.1" 204 0
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_3a61fbab46d4935a5fbb0fe29f33f627.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_3a61fbab46d4935a5fbb0fe29f33f627.jpg not downloaded yet
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_e1c5a0f6a681db2bbbeb5f245bb610e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_e1c5a0f6a681db2bbbeb5f245bb610e2.jpg not downloaded yet
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_56c526cccf2a6bfcdda1b05c0d77ff24.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_56c526cccf2a6bfcdda1b05c0d77ff24.jpg not downloaded yet
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_3fbafcb95e187324f1b5eda30f6871ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_3fbafcb95e187324f1b5eda30f6871ae.jpg not downloaded yet
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_6139fbcdf80b5d9c5ae66257dea89f74.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_6139fbcdf80b5d9c5ae66257dea89f74.jpg not downloaded yet
2026-03-30 10:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_b600e96b295d8ae20bcb6d0b1aa9875c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_0c63226aa9cbe92f5d61cf3e13adac06.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_0c63226aa9cbe92f5d61cf3e13adac06.jpg not downloaded yet
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_4e0f4daf75ca451068cccf14cdd24a4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_4e0f4daf75ca451068cccf14cdd24a4b.jpg not downloaded yet
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_e9fbdfbc696acf02aad5cfeb09bcef7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_e9fbdfbc696acf02aad5cfeb09bcef7a.jpg not downloaded yet
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_fe05fafa6a71c3ef0f569ad6f6beaf1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_fe05fafa6a71c3ef0f569ad6f6beaf1f.jpg not downloaded yet
2026-03-30 10:40:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5084190>
2026-03-30 10:40:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef599dafd002b94e3faec24e703262a%252Fpa%252FCL70294_b600e96b295d8ae20bcb6d0b1aa9875c.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_b600e96b295d8ae20bcb6d0b1aa9875c.jpg saved to cache
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3bda4e42-e293-5402-b819-26965dc67e77
2026-03-30 10:40:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3bda4e42-e293-5402-b819-26965dc67e77, skipping ID generation
2026-03-30 10:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bda4e42-e293-5402-b819-26965dc67e77 with scrape type 1
2026-03-30 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3bda4e42-e293-5402-b819-26965dc67e77 sending to next pipeline
2026-03-30 10:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bda4e42-e293-5402-b819-26965dc67e77, identifier: CL70294
2026-03-30 10:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bda4e42-e293-5402-b819-26965dc67e77 with identifier: CL70294
2026-03-30 10:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bda4e42-e293-5402-b819-26965dc67e77 with identifier: CL70294
2026-03-30 10:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bda4e42-e293-5402-b819-26965dc67e77 with identifier: CL70294 to the API
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_b600e96b295d8ae20bcb6d0b1aa9875c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:47:41Z',
 'fuel_type': 'petrol',
 'id': '3bda4e42-e293-5402-b819-26965dc67e77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL70294',
 'listing': 'auction',
 'location': 'DE, Oberhausen',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 102250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_1ca28cb751bcd1282752c4d4e3a06677.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_8ebcf9659fa84a92f33b81d02dd81498.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_9f4031a1dd190c535f46a867bbfdf5bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_2f44d7ae10a25a682843eeda9fedf77c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2884247,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_b600e96b295d8ae20bcb6d0b1aa9875c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_aa78cf31c105200c33345a48025d9ad1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_94d888c4f54f7ade5810b06649fe5a5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2904405,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_7b368459ae5ab0e6ae43c6c6e4375c21.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2830593,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_561d1dd7964aebb64bdfda44d81a5c51.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda4e42-e293-5402-b819-26965dc67e77/3bda4e42-e293-5402-b819-26965dc67e77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2784278,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def599dafd002b94e3faec24e703262a/pa/CL70294_34aa3b52651e0d201d41807047dd02bf.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2017}
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL70294%27 HTTP/1.1" 200 None
2026-03-30 10:40:13 [auto1.de] INFO: Saving data for CL70294: {'created_time': 1774867213.900309, 'last_price_update_time': 1774867213.90032, 'auction_closing_time': 1774972061.0}
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL70294') HTTP/1.1" 204 0
2026-03-30 10:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_3fbafcb95e187324f1b5eda30f6871ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_fe05fafa6a71c3ef0f569ad6f6beaf1f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd3a90>
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_3fbafcb95e187324f1b5eda30f6871ae.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_3fbafcb95e187324f1b5eda30f6871ae.jpg saved to cache
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7c3af4b-d7bb-54b3-991b-bafcd928b1e2
2026-03-30 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_e9fbdfbc696acf02aad5cfeb09bcef7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ffce10>
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_fe05fafa6a71c3ef0f569ad6f6beaf1f.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_fe05fafa6a71c3ef0f569ad6f6beaf1f.jpg saved to cache
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7c3af4b-d7bb-54b3-991b-bafcd928b1e2
2026-03-30 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB84962/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dfb5d0>
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_e9fbdfbc696acf02aad5cfeb09bcef7a.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_e9fbdfbc696acf02aad5cfeb09bcef7a.jpg saved to cache
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7c3af4b-d7bb-54b3-991b-bafcd928b1e2
2026-03-30 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_4e0f4daf75ca451068cccf14cdd24a4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e02090>
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_4e0f4daf75ca451068cccf14cdd24a4b.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_4e0f4daf75ca451068cccf14cdd24a4b.jpg saved to cache
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7c3af4b-d7bb-54b3-991b-bafcd928b1e2
2026-03-30 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_0c63226aa9cbe92f5d61cf3e13adac06.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_6139fbcdf80b5d9c5ae66257dea89f74.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb4750>
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_0c63226aa9cbe92f5d61cf3e13adac06.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_0c63226aa9cbe92f5d61cf3e13adac06.jpg saved to cache
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7c3af4b-d7bb-54b3-991b-bafcd928b1e2
2026-03-30 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_56c526cccf2a6bfcdda1b05c0d77ff24.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e44b90>
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_6139fbcdf80b5d9c5ae66257dea89f74.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_6139fbcdf80b5d9c5ae66257dea89f74.jpg saved to cache
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7c3af4b-d7bb-54b3-991b-bafcd928b1e2
2026-03-30 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_e1c5a0f6a681db2bbbeb5f245bb610e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dbbfd0>
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_56c526cccf2a6bfcdda1b05c0d77ff24.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_56c526cccf2a6bfcdda1b05c0d77ff24.jpg saved to cache
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7c3af4b-d7bb-54b3-991b-bafcd928b1e2
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e08ed0>
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_e1c5a0f6a681db2bbbeb5f245bb610e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_e1c5a0f6a681db2bbbeb5f245bb610e2.jpg saved to cache
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7c3af4b-d7bb-54b3-991b-bafcd928b1e2
2026-03-30 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_3a61fbab46d4935a5fbb0fe29f33f627.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_2b666001a9fad35ff80956e63f78ff25.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a43850>
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_3a61fbab46d4935a5fbb0fe29f33f627.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_3a61fbab46d4935a5fbb0fe29f33f627.jpg saved to cache
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7c3af4b-d7bb-54b3-991b-bafcd928b1e2
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da03d0>
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fcf%252F3acfb22c1c8b00b92154e5a2e48ed51c%252Fpa%252FWY46895_2b666001a9fad35ff80956e63f78ff25.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_2b666001a9fad35ff80956e63f78ff25.jpg saved to cache
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7c3af4b-d7bb-54b3-991b-bafcd928b1e2
2026-03-30 10:40:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7c3af4b-d7bb-54b3-991b-bafcd928b1e2, skipping ID generation
2026-03-30 10:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7c3af4b-d7bb-54b3-991b-bafcd928b1e2 with scrape type 1
2026-03-30 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7c3af4b-d7bb-54b3-991b-bafcd928b1e2 sending to next pipeline
2026-03-30 10:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7c3af4b-d7bb-54b3-991b-bafcd928b1e2, identifier: WY46895
2026-03-30 10:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7c3af4b-d7bb-54b3-991b-bafcd928b1e2 with identifier: WY46895
2026-03-30 10:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7c3af4b-d7bb-54b3-991b-bafcd928b1e2 with identifier: WY46895
2026-03-30 10:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7c3af4b-d7bb-54b3-991b-bafcd928b1e2 with identifier: WY46895 to the API
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_2b666001a9fad35ff80956e63f78ff25.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:53:42Z',
 'fuel_type': 'petrol',
 'id': 'd7c3af4b-d7bb-54b3-991b-bafcd928b1e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY46895',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 57281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_2b666001a9fad35ff80956e63f78ff25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_3a61fbab46d4935a5fbb0fe29f33f627.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_e1c5a0f6a681db2bbbeb5f245bb610e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_56c526cccf2a6bfcdda1b05c0d77ff24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_3fbafcb95e187324f1b5eda30f6871ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_6139fbcdf80b5d9c5ae66257dea89f74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_0c63226aa9cbe92f5d61cf3e13adac06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_4e0f4daf75ca451068cccf14cdd24a4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_e9fbdfbc696acf02aad5cfeb09bcef7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7c3af4b-d7bb-54b3-991b-bafcd928b1e2/d7c3af4b-d7bb-54b3-991b-bafcd928b1e2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/cf/3acfb22c1c8b00b92154e5a2e48ed51c/pa/WY46895_fe05fafa6a71c3ef0f569ad6f6beaf1f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Subaru Forester 2.0 Mild-Hybrid Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2022}
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY46895%27 HTTP/1.1" 200 None
2026-03-30 10:40:15 [auto1.de] INFO: Saving data for WY46895: {'created_time': 1774867215.457389, 'last_price_update_time': 1774867215.4574, 'auction_closing_time': 1774972422.0}
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY46895') HTTP/1.1" 204 0
2026-03-30 10:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH19368/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU37241> (referer: https://www.auto1.com/v1/car-details-view/LU37241/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea1043f5-0f95-5cae-82c5-5e792df12239 with identifier: LU37241
2026-03-30 10:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea1043f5-0f95-5cae-82c5-5e792df12239 with scrape type 1
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea1043f5-0f95-5cae-82c5-5e792df12239
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_c65cfa153ad872e9641f035f96737955.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_c65cfa153ad872e9641f035f96737955.jpg not downloaded yet
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_caf1aad0ee2cdb4bbc80e6a3516742fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_caf1aad0ee2cdb4bbc80e6a3516742fa.jpg not downloaded yet
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_d6204cd178d6f16fca8ad20a8f036472.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_d6204cd178d6f16fca8ad20a8f036472.jpg not downloaded yet
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_e5ba136c4d124de6e03e8d4d2f6f687f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_e5ba136c4d124de6e03e8d4d2f6f687f.jpg not downloaded yet
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_9e07b4e84063467a4e039a18c247f1ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_9e07b4e84063467a4e039a18c247f1ff.jpg not downloaded yet
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_78751755ce1c19723b54ece9cc07d3e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_78751755ce1c19723b54ece9cc07d3e4.jpg not downloaded yet
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_b83e1ca54ca9bb5b3e4b9f5551f5eb91.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_b83e1ca54ca9bb5b3e4b9f5551f5eb91.jpg not downloaded yet
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_ab416610c5aec5b5f2a70e57d32abbed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_ab416610c5aec5b5f2a70e57d32abbed.jpg not downloaded yet
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_28a961392f9526aaff019470bc592974.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_28a961392f9526aaff019470bc592974.jpg not downloaded yet
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_3d2f4be19a4b500116b80df214d872ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_3d2f4be19a4b500116b80df214d872ae.jpg not downloaded yet
2026-03-30 10:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB76846> (referer: https://www.auto1.com/v1/car-details-view/HB76846/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_3d2f4be19a4b500116b80df214d872ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932e6c2e-79bb-58da-8112-a1c5e7ed7795 with identifier: HB76846
2026-03-30 10:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932e6c2e-79bb-58da-8112-a1c5e7ed7795 with scrape type 1
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 932e6c2e-79bb-58da-8112-a1c5e7ed7795
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9e%252F9e9e03f8008939d002cac1803986476d%252Fpa%252FHB76846_f2a14c7a0bc0b27c72b73e93e1c79301.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9e/9e9e03f8008939d002cac1803986476d/pa/HB76846_f2a14c7a0bc0b27c72b73e93e1c79301.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9e%252F9e9e03f8008939d002cac1803986476d%252Fpa%252FHB76846_82904e3bfc83ee620028478abd7603ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9e/9e9e03f8008939d002cac1803986476d/pa/HB76846_82904e3bfc83ee620028478abd7603ac.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9e%252F9e9e03f8008939d002cac1803986476d%252Fpa%252FHB76846_38c435b11978a567d2679a21079a4a72.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9e/9e9e03f8008939d002cac1803986476d/pa/HB76846_38c435b11978a567d2679a21079a4a72.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9e%252F9e9e03f8008939d002cac1803986476d%252Fpa%252FHB76846_781f503d99cfd107e9bc6db5c6bbe7e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9e/9e9e03f8008939d002cac1803986476d/pa/HB76846_781f503d99cfd107e9bc6db5c6bbe7e3.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9e%252F9e9e03f8008939d002cac1803986476d%252Fpa%252FHB76846_57f428b5664036abaa8bb7bd1e49c550.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9e/9e9e03f8008939d002cac1803986476d/pa/HB76846_57f428b5664036abaa8bb7bd1e49c550.jpg already downloaded
2026-03-30 10:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 932e6c2e-79bb-58da-8112-a1c5e7ed7795, identifier: HB76846
2026-03-30 10:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 932e6c2e-79bb-58da-8112-a1c5e7ed7795 with identifier: HB76846
2026-03-30 10:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 932e6c2e-79bb-58da-8112-a1c5e7ed7795 with identifier: HB76846
2026-03-30 10:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 932e6c2e-79bb-58da-8112-a1c5e7ed7795 with identifier: HB76846 to the API
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HB76846>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:54:04Z',
 'fuel_type': 'petrol',
 'id': '932e6c2e-79bb-58da-8112-a1c5e7ed7795',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB76846',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 185681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img9e/9e/9e9e03f8008939d002cac1803986476d/pa/HB76846_f2a14c7a0bc0b27c72b73e93e1c79301.jpg',
                'https://img-pa.auto1.com/img9e/9e/9e9e03f8008939d002cac1803986476d/pa/HB76846_82904e3bfc83ee620028478abd7603ac.jpg',
                'https://img-pa.auto1.com/img9e/9e/9e9e03f8008939d002cac1803986476d/pa/HB76846_38c435b11978a567d2679a21079a4a72.jpg',
                'https://img-pa.auto1.com/img9e/9e/9e9e03f8008939d002cac1803986476d/pa/HB76846_781f503d99cfd107e9bc6db5c6bbe7e3.jpg',
                'https://img-pa.auto1.com/img9e/9e/9e9e03f8008939d002cac1803986476d/pa/HB76846_57f428b5664036abaa8bb7bd1e49c550.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932e6c2e-79bb-58da-8112-a1c5e7ed7795/932e6c2e-79bb-58da-8112-a1c5e7ed7795_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/9e/9e9e03f8008939d002cac1803986476d/pa/HB76846_f2a14c7a0bc0b27c72b73e93e1c79301.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932e6c2e-79bb-58da-8112-a1c5e7ed7795/932e6c2e-79bb-58da-8112-a1c5e7ed7795_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/9e/9e9e03f8008939d002cac1803986476d/pa/HB76846_82904e3bfc83ee620028478abd7603ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932e6c2e-79bb-58da-8112-a1c5e7ed7795/932e6c2e-79bb-58da-8112-a1c5e7ed7795_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/9e/9e9e03f8008939d002cac1803986476d/pa/HB76846_38c435b11978a567d2679a21079a4a72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932e6c2e-79bb-58da-8112-a1c5e7ed7795/932e6c2e-79bb-58da-8112-a1c5e7ed7795_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/9e/9e9e03f8008939d002cac1803986476d/pa/HB76846_781f503d99cfd107e9bc6db5c6bbe7e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932e6c2e-79bb-58da-8112-a1c5e7ed7795/932e6c2e-79bb-58da-8112-a1c5e7ed7795_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/9e/9e9e03f8008939d002cac1803986476d/pa/HB76846_57f428b5664036abaa8bb7bd1e49c550.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-03-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2009}
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB76846%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [auto1.de] INFO: Saving data for HB76846: {'created_time': 1774867218.637155, 'last_price_update_time': 1774867218.637166, 'auction_closing_time': 1774972444.0}
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB76846') HTTP/1.1" 204 0
2026-03-30 10:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_28a961392f9526aaff019470bc592974.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB89261> (referer: https://www.auto1.com/v1/car-details-view/TB89261/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT31239/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b2a350>
2026-03-30 10:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_3d2f4be19a4b500116b80df214d872ae.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_3d2f4be19a4b500116b80df214d872ae.jpg saved to cache
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea1043f5-0f95-5cae-82c5-5e792df12239
2026-03-30 10:40:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e09d10>
2026-03-30 10:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_28a961392f9526aaff019470bc592974.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_28a961392f9526aaff019470bc592974.jpg saved to cache
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea1043f5-0f95-5cae-82c5-5e792df12239
2026-03-30 10:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_78751755ce1c19723b54ece9cc07d3e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d980567b-535e-5bf5-9210-3046238dbb70 with identifier: TB89261
2026-03-30 10:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d980567b-535e-5bf5-9210-3046238dbb70 with scrape type 1
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d980567b-535e-5bf5-9210-3046238dbb70
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8e%252F718ef8d96649e761693e78c819108237%252Fpa%252FTB89261_551e5cc06cb6f6fe76a33f528084e5d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_551e5cc06cb6f6fe76a33f528084e5d2.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8e%252F718ef8d96649e761693e78c819108237%252Fpa%252FTB89261_f9291495bde0a2cd4e8f994ad4d410e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_f9291495bde0a2cd4e8f994ad4d410e5.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8e%252F718ef8d96649e761693e78c819108237%252Fpa%252FTB89261_491295e06ddcf92ef0f83a7c704a0c34.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_491295e06ddcf92ef0f83a7c704a0c34.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8e%252F718ef8d96649e761693e78c819108237%252Fpa%252FTB89261_df86d4cf4d5016449c7a0e3a923e91b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_df86d4cf4d5016449c7a0e3a923e91b6.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8e%252F718ef8d96649e761693e78c819108237%252Fpa%252FTB89261_65d6ce1135424fdb588f5b337f69bdc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_65d6ce1135424fdb588f5b337f69bdc9.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8e%252F718ef8d96649e761693e78c819108237%252Fpa%252FTB89261_0fb5564884e85f72a209a13ed7cc8b18.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_0fb5564884e85f72a209a13ed7cc8b18.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8e%252F718ef8d96649e761693e78c819108237%252Fpa%252FTB89261_385a25f4823e1033b348b5ba0491c51c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_385a25f4823e1033b348b5ba0491c51c.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8e%252F718ef8d96649e761693e78c819108237%252Fpa%252FTB89261_d6de68faf8ce37e809ae17e5b98ed13a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_d6de68faf8ce37e809ae17e5b98ed13a.jpg already downloaded
2026-03-30 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8e%252F718ef8d96649e761693e78c819108237%252Fpa%252FTB89261_edfbcc75bdecc74a6351b69c310ffcbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_edfbcc75bdecc74a6351b69c310ffcbe.jpg already downloaded
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8e%252F718ef8d96649e761693e78c819108237%252Fpa%252FTB89261_d3d5b118991e13d45d1f280ddb2a00af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_d3d5b118991e13d45d1f280ddb2a00af.jpg already downloaded
2026-03-30 10:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d980567b-535e-5bf5-9210-3046238dbb70, identifier: TB89261
2026-03-30 10:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d980567b-535e-5bf5-9210-3046238dbb70 with identifier: TB89261
2026-03-30 10:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d980567b-535e-5bf5-9210-3046238dbb70 with identifier: TB89261
2026-03-30 10:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d980567b-535e-5bf5-9210-3046238dbb70 with identifier: TB89261 to the API
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TB89261>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:00:17Z',
 'fuel_type': 'petrol',
 'id': 'd980567b-535e-5bf5-9210-3046238dbb70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB89261',
 'listing': 'auction',
 'location': 'DE, Sulz am Neckar',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 74821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_551e5cc06cb6f6fe76a33f528084e5d2.jpg',
                'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_f9291495bde0a2cd4e8f994ad4d410e5.jpg',
                'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_491295e06ddcf92ef0f83a7c704a0c34.jpg',
                'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_df86d4cf4d5016449c7a0e3a923e91b6.jpg',
                'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_65d6ce1135424fdb588f5b337f69bdc9.jpg',
                'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_0fb5564884e85f72a209a13ed7cc8b18.jpg',
                'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_385a25f4823e1033b348b5ba0491c51c.jpg',
                'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_d6de68faf8ce37e809ae17e5b98ed13a.jpg',
                'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_edfbcc75bdecc74a6351b69c310ffcbe.jpg',
                'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_d3d5b118991e13d45d1f280ddb2a00af.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d980567b-535e-5bf5-9210-3046238dbb70/d980567b-535e-5bf5-9210-3046238dbb70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_551e5cc06cb6f6fe76a33f528084e5d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d980567b-535e-5bf5-9210-3046238dbb70/d980567b-535e-5bf5-9210-3046238dbb70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_f9291495bde0a2cd4e8f994ad4d410e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d980567b-535e-5bf5-9210-3046238dbb70/d980567b-535e-5bf5-9210-3046238dbb70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_491295e06ddcf92ef0f83a7c704a0c34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d980567b-535e-5bf5-9210-3046238dbb70/d980567b-535e-5bf5-9210-3046238dbb70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_df86d4cf4d5016449c7a0e3a923e91b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d980567b-535e-5bf5-9210-3046238dbb70/d980567b-535e-5bf5-9210-3046238dbb70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_65d6ce1135424fdb588f5b337f69bdc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d980567b-535e-5bf5-9210-3046238dbb70/d980567b-535e-5bf5-9210-3046238dbb70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_0fb5564884e85f72a209a13ed7cc8b18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d980567b-535e-5bf5-9210-3046238dbb70/d980567b-535e-5bf5-9210-3046238dbb70_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_385a25f4823e1033b348b5ba0491c51c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d980567b-535e-5bf5-9210-3046238dbb70/d980567b-535e-5bf5-9210-3046238dbb70_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_d6de68faf8ce37e809ae17e5b98ed13a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d980567b-535e-5bf5-9210-3046238dbb70/d980567b-535e-5bf5-9210-3046238dbb70_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_edfbcc75bdecc74a6351b69c310ffcbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d980567b-535e-5bf5-9210-3046238dbb70/d980567b-535e-5bf5-9210-3046238dbb70_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8e/718ef8d96649e761693e78c819108237/pa/TB89261_d3d5b118991e13d45d1f280ddb2a00af.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB89261%27 HTTP/1.1" 200 None
2026-03-30 10:40:19 [auto1.de] INFO: Saving data for TB89261: {'created_time': 1774867219.47533, 'last_price_update_time': 1774867219.47534, 'auction_closing_time': 1774969217.0}
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB89261') HTTP/1.1" 204 0
2026-03-30 10:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_b83e1ca54ca9bb5b3e4b9f5551f5eb91.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_ab416610c5aec5b5f2a70e57d32abbed.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef593de90>
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_78751755ce1c19723b54ece9cc07d3e4.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_78751755ce1c19723b54ece9cc07d3e4.jpg saved to cache
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea1043f5-0f95-5cae-82c5-5e792df12239
2026-03-30 10:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_9e07b4e84063467a4e039a18c247f1ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50deed0>
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_b83e1ca54ca9bb5b3e4b9f5551f5eb91.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_b83e1ca54ca9bb5b3e4b9f5551f5eb91.jpg saved to cache
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea1043f5-0f95-5cae-82c5-5e792df12239
2026-03-30 10:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_d6204cd178d6f16fca8ad20a8f036472.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0edd0>
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_ab416610c5aec5b5f2a70e57d32abbed.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_ab416610c5aec5b5f2a70e57d32abbed.jpg saved to cache
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea1043f5-0f95-5cae-82c5-5e792df12239
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb5c90>
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_9e07b4e84063467a4e039a18c247f1ff.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_9e07b4e84063467a4e039a18c247f1ff.jpg saved to cache
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea1043f5-0f95-5cae-82c5-5e792df12239
2026-03-30 10:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_e5ba136c4d124de6e03e8d4d2f6f687f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS21761> (referer: https://www.auto1.com/v1/car-details-view/JS21761/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f45550>
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_d6204cd178d6f16fca8ad20a8f036472.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_d6204cd178d6f16fca8ad20a8f036472.jpg saved to cache
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea1043f5-0f95-5cae-82c5-5e792df12239
2026-03-30 10:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_c65cfa153ad872e9641f035f96737955.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_caf1aad0ee2cdb4bbc80e6a3516742fa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e88090>
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_e5ba136c4d124de6e03e8d4d2f6f687f.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_e5ba136c4d124de6e03e8d4d2f6f687f.jpg saved to cache
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea1043f5-0f95-5cae-82c5-5e792df12239
2026-03-30 10:40:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f79451c8-474c-5324-b1c5-4631902cf434 with identifier: JS21761
2026-03-30 10:40:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f79451c8-474c-5324-b1c5-4631902cf434 with scrape type 1
2026-03-30 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f79451c8-474c-5324-b1c5-4631902cf434
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_690529368c50512633051ef9d50dac0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_690529368c50512633051ef9d50dac0c.jpg not downloaded yet
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_59daaff878c88bbd79a0c9355ddcbffc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_59daaff878c88bbd79a0c9355ddcbffc.jpg not downloaded yet
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_3ce62ae2528a441ffad6bb6cb455b42d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_3ce62ae2528a441ffad6bb6cb455b42d.jpg not downloaded yet
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0c310>
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_c65cfa153ad872e9641f035f96737955.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_c65cfa153ad872e9641f035f96737955.jpg saved to cache
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea1043f5-0f95-5cae-82c5-5e792df12239
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a66d50>
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F8f%252Fd98faece124ef38aff84ef1efd370c29%252Fpa%252FLU37241_caf1aad0ee2cdb4bbc80e6a3516742fa.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_caf1aad0ee2cdb4bbc80e6a3516742fa.jpg saved to cache
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea1043f5-0f95-5cae-82c5-5e792df12239
2026-03-30 10:40:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea1043f5-0f95-5cae-82c5-5e792df12239, skipping ID generation
2026-03-30 10:40:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea1043f5-0f95-5cae-82c5-5e792df12239 with scrape type 1
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea1043f5-0f95-5cae-82c5-5e792df12239 sending to next pipeline
2026-03-30 10:40:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea1043f5-0f95-5cae-82c5-5e792df12239, identifier: LU37241
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_34daa2d7b342611749a028786521e803.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_34daa2d7b342611749a028786521e803.jpg not downloaded yet
2026-03-30 10:40:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea1043f5-0f95-5cae-82c5-5e792df12239 with identifier: LU37241
2026-03-30 10:40:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea1043f5-0f95-5cae-82c5-5e792df12239 with identifier: LU37241
2026-03-30 10:40:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea1043f5-0f95-5cae-82c5-5e792df12239 with identifier: LU37241 to the API
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_caf1aad0ee2cdb4bbc80e6a3516742fa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:35:05Z',
 'fuel_type': 'diesel',
 'id': 'ea1043f5-0f95-5cae-82c5-5e792df12239',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU37241',
 'listing': 'auction',
 'location': 'DE, Kassel',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 237314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_c65cfa153ad872e9641f035f96737955.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_caf1aad0ee2cdb4bbc80e6a3516742fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_d6204cd178d6f16fca8ad20a8f036472.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_e5ba136c4d124de6e03e8d4d2f6f687f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_9e07b4e84063467a4e039a18c247f1ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_78751755ce1c19723b54ece9cc07d3e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_b83e1ca54ca9bb5b3e4b9f5551f5eb91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_ab416610c5aec5b5f2a70e57d32abbed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_28a961392f9526aaff019470bc592974.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea1043f5-0f95-5cae-82c5-5e792df12239/ea1043f5-0f95-5cae-82c5-5e792df12239_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/8f/d98faece124ef38aff84ef1efd370c29/pa/LU37241_3d2f4be19a4b500116b80df214d872ae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU37241%27 HTTP/1.1" 200 None
2026-03-30 10:40:20 [auto1.de] INFO: Saving data for LU37241: {'created_time': 1774867220.638325, 'last_price_update_time': 1774867220.638341, 'auction_closing_time': 1774971305.0}
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU37241') HTTP/1.1" 204 0
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_04d0a7d9b4f803abaaf7973fd171f7bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_04d0a7d9b4f803abaaf7973fd171f7bf.jpg not downloaded yet
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_a1c5cb5ef2d300307ac9621db219510c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_a1c5cb5ef2d300307ac9621db219510c.jpg not downloaded yet
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_9a0a10abc003c6c91239dd346facafc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_9a0a10abc003c6c91239dd346facafc5.jpg not downloaded yet
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_02aac8adee4c9539fed8a2b13a257ba8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_02aac8adee4c9539fed8a2b13a257ba8.jpg not downloaded yet
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_04339cbacf66050ba50ef2eb9615732a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_04339cbacf66050ba50ef2eb9615732a.jpg not downloaded yet
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_c73099b539e03f09535ef17d6b6c79d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_c73099b539e03f09535ef17d6b6c79d3.jpg not downloaded yet
2026-03-30 10:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB72682/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_c73099b539e03f09535ef17d6b6c79d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb8390>
2026-03-30 10:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_c73099b539e03f09535ef17d6b6c79d3.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_c73099b539e03f09535ef17d6b6c79d3.jpg saved to cache
2026-03-30 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f79451c8-474c-5324-b1c5-4631902cf434
2026-03-30 10:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_04339cbacf66050ba50ef2eb9615732a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da0d50>
2026-03-30 10:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_04339cbacf66050ba50ef2eb9615732a.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_04339cbacf66050ba50ef2eb9615732a.jpg saved to cache
2026-03-30 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f79451c8-474c-5324-b1c5-4631902cf434
2026-03-30 10:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RB42350/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB84962> (referer: https://www.auto1.com/v1/car-details-view/XB84962/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_02aac8adee4c9539fed8a2b13a257ba8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_9a0a10abc003c6c91239dd346facafc5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_a1c5cb5ef2d300307ac9621db219510c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b75a9096-e3ce-5007-9d2e-8e61556968b9 with identifier: XB84962
2026-03-30 10:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75a9096-e3ce-5007-9d2e-8e61556968b9 with scrape type 1
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b75a9096-e3ce-5007-9d2e-8e61556968b9
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_7a64e82e669c0e15df84d7c49a278887.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_7a64e82e669c0e15df84d7c49a278887.jpg not downloaded yet
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_644aeb12e699bf3484362300461d9c5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_644aeb12e699bf3484362300461d9c5b.jpg not downloaded yet
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_c8f5a273693da9cb5f411b2e9bc226b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_c8f5a273693da9cb5f411b2e9bc226b1.jpg not downloaded yet
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef51249d0>
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_02aac8adee4c9539fed8a2b13a257ba8.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_02aac8adee4c9539fed8a2b13a257ba8.jpg saved to cache
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f79451c8-474c-5324-b1c5-4631902cf434
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_874d6ad496bbfdac178458aefe2e34e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_874d6ad496bbfdac178458aefe2e34e2.jpg not downloaded yet
2026-03-30 10:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_04d0a7d9b4f803abaaf7973fd171f7bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b28e90>
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_9a0a10abc003c6c91239dd346facafc5.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_9a0a10abc003c6c91239dd346facafc5.jpg saved to cache
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f79451c8-474c-5324-b1c5-4631902cf434
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b2f3d0>
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_a1c5cb5ef2d300307ac9621db219510c.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_a1c5cb5ef2d300307ac9621db219510c.jpg saved to cache
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f79451c8-474c-5324-b1c5-4631902cf434
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_c0e572084477b50d10863613c2f3b9fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_c0e572084477b50d10863613c2f3b9fe.jpg not downloaded yet
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_4fa82db6d2951eaeaed7644460e5279c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_4fa82db6d2951eaeaed7644460e5279c.jpg not downloaded yet
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_3ede61646b8264b97cfc67e2b774c7b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_3ede61646b8264b97cfc67e2b774c7b9.jpg not downloaded yet
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5053ad0>
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_04d0a7d9b4f803abaaf7973fd171f7bf.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_04d0a7d9b4f803abaaf7973fd171f7bf.jpg saved to cache
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f79451c8-474c-5324-b1c5-4631902cf434
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_af016ca277cc1bed07fc545e0b57a907.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_af016ca277cc1bed07fc545e0b57a907.jpg not downloaded yet
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_2ab6c5bafc3a43faa6675d4ec3cdd2e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_2ab6c5bafc3a43faa6675d4ec3cdd2e6.jpg not downloaded yet
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_2e242ba03ef779a10b037831dd3cd92b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_2e242ba03ef779a10b037831dd3cd92b.jpg not downloaded yet
2026-03-30 10:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_c8f5a273693da9cb5f411b2e9bc226b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_2e242ba03ef779a10b037831dd3cd92b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e62d50>
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_c8f5a273693da9cb5f411b2e9bc226b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_c8f5a273693da9cb5f411b2e9bc226b1.jpg saved to cache
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b75a9096-e3ce-5007-9d2e-8e61556968b9
2026-03-30 10:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_2ab6c5bafc3a43faa6675d4ec3cdd2e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0e810>
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_2e242ba03ef779a10b037831dd3cd92b.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_2e242ba03ef779a10b037831dd3cd92b.jpg saved to cache
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b75a9096-e3ce-5007-9d2e-8e61556968b9
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4df3ad0>
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_2ab6c5bafc3a43faa6675d4ec3cdd2e6.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_2ab6c5bafc3a43faa6675d4ec3cdd2e6.jpg saved to cache
2026-03-30 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b75a9096-e3ce-5007-9d2e-8e61556968b9
2026-03-30 10:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_af016ca277cc1bed07fc545e0b57a907.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN11349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb7d50>
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_af016ca277cc1bed07fc545e0b57a907.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_af016ca277cc1bed07fc545e0b57a907.jpg saved to cache
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b75a9096-e3ce-5007-9d2e-8e61556968b9
2026-03-30 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_4fa82db6d2951eaeaed7644460e5279c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_3ede61646b8264b97cfc67e2b774c7b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_c0e572084477b50d10863613c2f3b9fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe0410>
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_4fa82db6d2951eaeaed7644460e5279c.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_4fa82db6d2951eaeaed7644460e5279c.jpg saved to cache
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b75a9096-e3ce-5007-9d2e-8e61556968b9
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da0fd0>
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_3ede61646b8264b97cfc67e2b774c7b9.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_3ede61646b8264b97cfc67e2b774c7b9.jpg saved to cache
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b75a9096-e3ce-5007-9d2e-8e61556968b9
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4df1950>
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_c0e572084477b50d10863613c2f3b9fe.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_c0e572084477b50d10863613c2f3b9fe.jpg saved to cache
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b75a9096-e3ce-5007-9d2e-8e61556968b9
2026-03-30 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_874d6ad496bbfdac178458aefe2e34e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7886450>
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_874d6ad496bbfdac178458aefe2e34e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_874d6ad496bbfdac178458aefe2e34e2.jpg saved to cache
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b75a9096-e3ce-5007-9d2e-8e61556968b9
2026-03-30 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_644aeb12e699bf3484362300461d9c5b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_7a64e82e669c0e15df84d7c49a278887.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6ce10>
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_644aeb12e699bf3484362300461d9c5b.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_644aeb12e699bf3484362300461d9c5b.jpg saved to cache
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b75a9096-e3ce-5007-9d2e-8e61556968b9
2026-03-30 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_34daa2d7b342611749a028786521e803.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ad7a10>
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F3d%252F603d04271c78cae6c78301949db95df0%252Fpa%252FXB84962_7a64e82e669c0e15df84d7c49a278887.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_7a64e82e669c0e15df84d7c49a278887.jpg saved to cache
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b75a9096-e3ce-5007-9d2e-8e61556968b9
2026-03-30 10:40:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b75a9096-e3ce-5007-9d2e-8e61556968b9, skipping ID generation
2026-03-30 10:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75a9096-e3ce-5007-9d2e-8e61556968b9 with scrape type 1
2026-03-30 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b75a9096-e3ce-5007-9d2e-8e61556968b9 sending to next pipeline
2026-03-30 10:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b75a9096-e3ce-5007-9d2e-8e61556968b9, identifier: XB84962
2026-03-30 10:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b75a9096-e3ce-5007-9d2e-8e61556968b9 with identifier: XB84962
2026-03-30 10:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b75a9096-e3ce-5007-9d2e-8e61556968b9 with identifier: XB84962
2026-03-30 10:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b75a9096-e3ce-5007-9d2e-8e61556968b9 with identifier: XB84962 to the API
2026-03-30 10:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_7a64e82e669c0e15df84d7c49a278887.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:35:24Z',
 'fuel_type': 'diesel',
 'id': 'b75a9096-e3ce-5007-9d2e-8e61556968b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB84962',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Ford',
 'model': 'Transit Connect',
 'odometer': 34170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_7a64e82e669c0e15df84d7c49a278887.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_644aeb12e699bf3484362300461d9c5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_c8f5a273693da9cb5f411b2e9bc226b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_874d6ad496bbfdac178458aefe2e34e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_c0e572084477b50d10863613c2f3b9fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_4fa82db6d2951eaeaed7644460e5279c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_3ede61646b8264b97cfc67e2b774c7b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_af016ca277cc1bed07fc545e0b57a907.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_2ab6c5bafc3a43faa6675d4ec3cdd2e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75a9096-e3ce-5007-9d2e-8e61556968b9/b75a9096-e3ce-5007-9d2e-8e61556968b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/3d/603d04271c78cae6c78301949db95df0/pa/XB84962_2e242ba03ef779a10b037831dd3cd92b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Connect 1.5 EcoBlue TDCi Kasten Trend lang',
 'transmission': 'manual',
 'trim': 'Kasten Trend lang',
 'year': 2023}
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB84962%27 HTTP/1.1" 200 None
2026-03-30 10:40:24 [auto1.de] INFO: Saving data for XB84962: {'created_time': 1774867224.199146, 'last_price_update_time': 1774867224.199155, 'auction_closing_time': 1774971324.0}
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB84962') HTTP/1.1" 204 0
2026-03-30 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_3ce62ae2528a441ffad6bb6cb455b42d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WL33179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5051650>
2026-03-30 10:40:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_34daa2d7b342611749a028786521e803.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_34daa2d7b342611749a028786521e803.jpg saved to cache
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f79451c8-474c-5324-b1c5-4631902cf434
2026-03-30 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_59daaff878c88bbd79a0c9355ddcbffc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea1650>
2026-03-30 10:40:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_3ce62ae2528a441ffad6bb6cb455b42d.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_3ce62ae2528a441ffad6bb6cb455b42d.jpg saved to cache
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f79451c8-474c-5324-b1c5-4631902cf434
2026-03-30 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_690529368c50512633051ef9d50dac0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5af1950>
2026-03-30 10:40:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_59daaff878c88bbd79a0c9355ddcbffc.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_59daaff878c88bbd79a0c9355ddcbffc.jpg saved to cache
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f79451c8-474c-5324-b1c5-4631902cf434
2026-03-30 10:40:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a43b10>
2026-03-30 10:40:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9c%252F379c02ac8eb53ab2801e4dbd328ebfbf%252Fpa%252FJS21761_690529368c50512633051ef9d50dac0c.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_690529368c50512633051ef9d50dac0c.jpg saved to cache
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f79451c8-474c-5324-b1c5-4631902cf434
2026-03-30 10:40:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f79451c8-474c-5324-b1c5-4631902cf434, skipping ID generation
2026-03-30 10:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f79451c8-474c-5324-b1c5-4631902cf434 with scrape type 1
2026-03-30 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f79451c8-474c-5324-b1c5-4631902cf434 sending to next pipeline
2026-03-30 10:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f79451c8-474c-5324-b1c5-4631902cf434, identifier: JS21761
2026-03-30 10:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f79451c8-474c-5324-b1c5-4631902cf434 with identifier: JS21761
2026-03-30 10:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f79451c8-474c-5324-b1c5-4631902cf434 with identifier: JS21761
2026-03-30 10:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f79451c8-474c-5324-b1c5-4631902cf434 with identifier: JS21761 to the API
2026-03-30 10:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_690529368c50512633051ef9d50dac0c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:58:02Z',
 'fuel_type': 'petrol',
 'id': 'f79451c8-474c-5324-b1c5-4631902cf434',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS21761',
 'listing': 'auction',
 'location': 'DE, Karlsruhe',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 66696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_690529368c50512633051ef9d50dac0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_59daaff878c88bbd79a0c9355ddcbffc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_3ce62ae2528a441ffad6bb6cb455b42d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_34daa2d7b342611749a028786521e803.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_04d0a7d9b4f803abaaf7973fd171f7bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_a1c5cb5ef2d300307ac9621db219510c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_9a0a10abc003c6c91239dd346facafc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_02aac8adee4c9539fed8a2b13a257ba8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_04339cbacf66050ba50ef2eb9615732a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79451c8-474c-5324-b1c5-4631902cf434/f79451c8-474c-5324-b1c5-4631902cf434_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/9c/379c02ac8eb53ab2801e4dbd328ebfbf/pa/JS21761_c73099b539e03f09535ef17d6b6c79d3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2020}
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS21761%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [auto1.de] INFO: Saving data for JS21761: {'created_time': 1774867225.295635, 'last_price_update_time': 1774867225.295645, 'auction_closing_time': 1774972682.0}
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS21761') HTTP/1.1" 204 0
2026-03-30 10:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA20586/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE21529> (referer: https://www.auto1.com/v1/car-details-view/SE21529/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH19368> (referer: https://www.auto1.com/v1/car-details-view/CH19368/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_08dd7f6a7cae906a6b0d0be019902cc0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0816d9a-6567-5b10-a0c1-679a86a87cdc with identifier: SE21529
2026-03-30 10:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0816d9a-6567-5b10-a0c1-679a86a87cdc with scrape type 1
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0816d9a-6567-5b10-a0c1-679a86a87cdc
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe1%252Fcfe12ac0a242e2ef9e8c35b8fc93058f%252Fpa%252FSE21529_0d94ea0c8e955235358819dd4439ab18.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_0d94ea0c8e955235358819dd4439ab18.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe1%252Fcfe12ac0a242e2ef9e8c35b8fc93058f%252Fpa%252FSE21529_cf6080e8a6cdc3282e87087f13ccc2e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_cf6080e8a6cdc3282e87087f13ccc2e1.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe1%252Fcfe12ac0a242e2ef9e8c35b8fc93058f%252Fpa%252FSE21529_f782407e6843e9445c1535279f796ea2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_f782407e6843e9445c1535279f796ea2.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe1%252Fcfe12ac0a242e2ef9e8c35b8fc93058f%252Fpa%252FSE21529_384e2e1930485eb2ea31cc08a92bfdca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_384e2e1930485eb2ea31cc08a92bfdca.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe1%252Fcfe12ac0a242e2ef9e8c35b8fc93058f%252Fpa%252FSE21529_0ca40506216585c1758f821a64851d7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_0ca40506216585c1758f821a64851d7e.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe1%252Fcfe12ac0a242e2ef9e8c35b8fc93058f%252Fpa%252FSE21529_59996725477e6ded7dd8342eca75d60e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_59996725477e6ded7dd8342eca75d60e.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe1%252Fcfe12ac0a242e2ef9e8c35b8fc93058f%252Fpa%252FSE21529_d2f977ff6370ec50abc74ee3be994537.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_d2f977ff6370ec50abc74ee3be994537.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe1%252Fcfe12ac0a242e2ef9e8c35b8fc93058f%252Fpa%252FSE21529_e0d28187af2278c6ac9cb99349459db9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_e0d28187af2278c6ac9cb99349459db9.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe1%252Fcfe12ac0a242e2ef9e8c35b8fc93058f%252Fpa%252FSE21529_1b7187cc677b982a2cd42f1f268dd42b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_1b7187cc677b982a2cd42f1f268dd42b.jpg already downloaded
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe1%252Fcfe12ac0a242e2ef9e8c35b8fc93058f%252Fpa%252FSE21529_6f45f9b5ab98a6fcc64667ff20f8d26a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_6f45f9b5ab98a6fcc64667ff20f8d26a.jpg already downloaded
2026-03-30 10:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0816d9a-6567-5b10-a0c1-679a86a87cdc, identifier: SE21529
2026-03-30 10:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0816d9a-6567-5b10-a0c1-679a86a87cdc with identifier: SE21529
2026-03-30 10:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0816d9a-6567-5b10-a0c1-679a86a87cdc with identifier: SE21529
2026-03-30 10:40:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0816d9a-6567-5b10-a0c1-679a86a87cdc with identifier: SE21529 to the API
2026-03-30 10:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SE21529>
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:55:31Z',
 'fuel_type': 'diesel',
 'id': 'd0816d9a-6567-5b10-a0c1-679a86a87cdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE21529',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 131106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_0d94ea0c8e955235358819dd4439ab18.jpg',
                'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_cf6080e8a6cdc3282e87087f13ccc2e1.jpg',
                'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_f782407e6843e9445c1535279f796ea2.jpg',
                'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_384e2e1930485eb2ea31cc08a92bfdca.jpg',
                'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_0ca40506216585c1758f821a64851d7e.jpg',
                'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_59996725477e6ded7dd8342eca75d60e.jpg',
                'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_d2f977ff6370ec50abc74ee3be994537.jpg',
                'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_e0d28187af2278c6ac9cb99349459db9.jpg',
                'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_1b7187cc677b982a2cd42f1f268dd42b.jpg',
                'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_6f45f9b5ab98a6fcc64667ff20f8d26a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0816d9a-6567-5b10-a0c1-679a86a87cdc/d0816d9a-6567-5b10-a0c1-679a86a87cdc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_0d94ea0c8e955235358819dd4439ab18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0816d9a-6567-5b10-a0c1-679a86a87cdc/d0816d9a-6567-5b10-a0c1-679a86a87cdc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_cf6080e8a6cdc3282e87087f13ccc2e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0816d9a-6567-5b10-a0c1-679a86a87cdc/d0816d9a-6567-5b10-a0c1-679a86a87cdc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_f782407e6843e9445c1535279f796ea2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0816d9a-6567-5b10-a0c1-679a86a87cdc/d0816d9a-6567-5b10-a0c1-679a86a87cdc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2919794,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_384e2e1930485eb2ea31cc08a92bfdca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0816d9a-6567-5b10-a0c1-679a86a87cdc/d0816d9a-6567-5b10-a0c1-679a86a87cdc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_0ca40506216585c1758f821a64851d7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0816d9a-6567-5b10-a0c1-679a86a87cdc/d0816d9a-6567-5b10-a0c1-679a86a87cdc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_59996725477e6ded7dd8342eca75d60e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0816d9a-6567-5b10-a0c1-679a86a87cdc/d0816d9a-6567-5b10-a0c1-679a86a87cdc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_d2f977ff6370ec50abc74ee3be994537.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0816d9a-6567-5b10-a0c1-679a86a87cdc/d0816d9a-6567-5b10-a0c1-679a86a87cdc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_e0d28187af2278c6ac9cb99349459db9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0816d9a-6567-5b10-a0c1-679a86a87cdc/d0816d9a-6567-5b10-a0c1-679a86a87cdc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_1b7187cc677b982a2cd42f1f268dd42b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0816d9a-6567-5b10-a0c1-679a86a87cdc/d0816d9a-6567-5b10-a0c1-679a86a87cdc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e1/cfe12ac0a242e2ef9e8c35b8fc93058f/pa/SE21529_6f45f9b5ab98a6fcc64667ff20f8d26a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TDI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2020}
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE21529%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [auto1.de] INFO: Saving data for SE21529: {'created_time': 1774867226.187839, 'last_price_update_time': 1774867226.18785, 'auction_closing_time': 1774972531.0}
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE21529') HTTP/1.1" 204 0
2026-03-30 10:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_eb314d77a4c42cf6d0a5c116ede4984c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e92cc75-074e-5fd4-a30d-95d191e0bf8c with identifier: CH19368
2026-03-30 10:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e92cc75-074e-5fd4-a30d-95d191e0bf8c with scrape type 1
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e92cc75-074e-5fd4-a30d-95d191e0bf8c
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_aac8b92e7ea362d8d2765faf47eee56e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_aac8b92e7ea362d8d2765faf47eee56e.jpg not downloaded yet
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e603d0>
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_08dd7f6a7cae906a6b0d0be019902cc0.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_08dd7f6a7cae906a6b0d0be019902cc0.jpg saved to cache
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68308b3e-fd23-58b0-b3d6-0e9df665e153
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_48b8524885fbfbfe9b0b06cf19465f70.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_48b8524885fbfbfe9b0b06cf19465f70.jpg not downloaded yet
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_e3fd57f8a5e9ecc80effb7fcdd6f67a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_e3fd57f8a5e9ecc80effb7fcdd6f67a1.jpg not downloaded yet
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_54d0535f96bb8d67be4333a905bda35b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_54d0535f96bb8d67be4333a905bda35b.jpg not downloaded yet
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_0f87207a11d07647487920db8aa575ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_0f87207a11d07647487920db8aa575ab.jpg not downloaded yet
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee4f10>
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_eb314d77a4c42cf6d0a5c116ede4984c.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_eb314d77a4c42cf6d0a5c116ede4984c.jpg saved to cache
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68308b3e-fd23-58b0-b3d6-0e9df665e153
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_32b0488139c5f5197945b46ec3bcb535.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_32b0488139c5f5197945b46ec3bcb535.jpg not downloaded yet
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_e78a3514968b7fd1452b986d871d9b02.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_e78a3514968b7fd1452b986d871d9b02.jpg not downloaded yet
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_5759cdd195bb19c98be73b92b1ee62ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_5759cdd195bb19c98be73b92b1ee62ac.jpg not downloaded yet
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_1203088a8defb6d2337bd2ce0066ece0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_1203088a8defb6d2337bd2ce0066ece0.jpg not downloaded yet
2026-03-30 10:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_d7a9c4495015165150e146a64c0a3b4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_be3c7dc59e568f2cc42d681516982e28.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_be3c7dc59e568f2cc42d681516982e28.jpg not downloaded yet
2026-03-30 10:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WV73920> (referer: https://www.auto1.com/v1/car-details-view/WV73920/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb9190>
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_d7a9c4495015165150e146a64c0a3b4e.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_d7a9c4495015165150e146a64c0a3b4e.jpg saved to cache
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68308b3e-fd23-58b0-b3d6-0e9df665e153
2026-03-30 10:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44e3a005-aa50-5d63-b63b-24acd4b7b14d with identifier: WV73920
2026-03-30 10:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44e3a005-aa50-5d63-b63b-24acd4b7b14d with scrape type 1
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44e3a005-aa50-5d63-b63b-24acd4b7b14d
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_9919be92e72d980cea6f312a6c8d9565.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_9919be92e72d980cea6f312a6c8d9565.jpg not downloaded yet
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_51e8f4a9fe130e4683cce6e638ab73e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_51e8f4a9fe130e4683cce6e638ab73e6.jpg not downloaded yet
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_5dbcc8d48827f14d01bc490726cefe91.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_5dbcc8d48827f14d01bc490726cefe91.jpg not downloaded yet
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_ea93aba385ef1287d3343952da83855e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_ea93aba385ef1287d3343952da83855e.jpg not downloaded yet
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_847cafd50f9d4ba340a22c0ee8ea51ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_847cafd50f9d4ba340a22c0ee8ea51ac.jpg not downloaded yet
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_1024715b7fb8a6746d92ef641f837955.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_1024715b7fb8a6746d92ef641f837955.jpg not downloaded yet
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_9bef721a25d6a57ade11e4d1e7e099ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_9bef721a25d6a57ade11e4d1e7e099ee.jpg not downloaded yet
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_6de38deb8e789771ca7d77990b5102bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_6de38deb8e789771ca7d77990b5102bf.jpg not downloaded yet
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_fa5c278cc869441a5ef75e141ef41d78.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_fa5c278cc869441a5ef75e141ef41d78.jpg not downloaded yet
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_f1d787761e845ae44175c153e5b50565.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_f1d787761e845ae44175c153e5b50565.jpg not downloaded yet
2026-03-30 10:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_be3c7dc59e568f2cc42d681516982e28.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_1203088a8defb6d2337bd2ce0066ece0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e09c10>
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_be3c7dc59e568f2cc42d681516982e28.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_be3c7dc59e568f2cc42d681516982e28.jpg saved to cache
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e92cc75-074e-5fd4-a30d-95d191e0bf8c
2026-03-30 10:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MR66589/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd3010>
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_1203088a8defb6d2337bd2ce0066ece0.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_1203088a8defb6d2337bd2ce0066ece0.jpg saved to cache
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e92cc75-074e-5fd4-a30d-95d191e0bf8c
2026-03-30 10:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_f1d787761e845ae44175c153e5b50565.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_fa5c278cc869441a5ef75e141ef41d78.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e46fd0>
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_f1d787761e845ae44175c153e5b50565.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_f1d787761e845ae44175c153e5b50565.jpg saved to cache
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44e3a005-aa50-5d63-b63b-24acd4b7b14d
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0f5d0>
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_fa5c278cc869441a5ef75e141ef41d78.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_fa5c278cc869441a5ef75e141ef41d78.jpg saved to cache
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44e3a005-aa50-5d63-b63b-24acd4b7b14d
2026-03-30 10:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_9bef721a25d6a57ade11e4d1e7e099ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_6de38deb8e789771ca7d77990b5102bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb1290>
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_9bef721a25d6a57ade11e4d1e7e099ee.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_9bef721a25d6a57ade11e4d1e7e099ee.jpg saved to cache
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44e3a005-aa50-5d63-b63b-24acd4b7b14d
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e09c50>
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_6de38deb8e789771ca7d77990b5102bf.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_6de38deb8e789771ca7d77990b5102bf.jpg saved to cache
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44e3a005-aa50-5d63-b63b-24acd4b7b14d
2026-03-30 10:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_1024715b7fb8a6746d92ef641f837955.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_847cafd50f9d4ba340a22c0ee8ea51ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_ea93aba385ef1287d3343952da83855e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fffd50>
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_1024715b7fb8a6746d92ef641f837955.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_1024715b7fb8a6746d92ef641f837955.jpg saved to cache
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44e3a005-aa50-5d63-b63b-24acd4b7b14d
2026-03-30 10:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_5dbcc8d48827f14d01bc490726cefe91.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee4450>
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_847cafd50f9d4ba340a22c0ee8ea51ac.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_847cafd50f9d4ba340a22c0ee8ea51ac.jpg saved to cache
2026-03-30 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44e3a005-aa50-5d63-b63b-24acd4b7b14d
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ae0a50>
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_ea93aba385ef1287d3343952da83855e.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_ea93aba385ef1287d3343952da83855e.jpg saved to cache
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44e3a005-aa50-5d63-b63b-24acd4b7b14d
2026-03-30 10:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_9919be92e72d980cea6f312a6c8d9565.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50dc510>
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_5dbcc8d48827f14d01bc490726cefe91.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_5dbcc8d48827f14d01bc490726cefe91.jpg saved to cache
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44e3a005-aa50-5d63-b63b-24acd4b7b14d
2026-03-30 10:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_51e8f4a9fe130e4683cce6e638ab73e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0bbd0>
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_9919be92e72d980cea6f312a6c8d9565.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_9919be92e72d980cea6f312a6c8d9565.jpg saved to cache
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44e3a005-aa50-5d63-b63b-24acd4b7b14d
2026-03-30 10:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RB42350> (referer: https://www.auto1.com/v1/car-details-view/RB42350/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb6f90>
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Faf%252F74af90a3bb2ce99a00d611f53823afa2%252Fpa%252FWV73920_51e8f4a9fe130e4683cce6e638ab73e6.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_51e8f4a9fe130e4683cce6e638ab73e6.jpg saved to cache
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44e3a005-aa50-5d63-b63b-24acd4b7b14d
2026-03-30 10:40:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44e3a005-aa50-5d63-b63b-24acd4b7b14d, skipping ID generation
2026-03-30 10:40:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44e3a005-aa50-5d63-b63b-24acd4b7b14d with scrape type 1
2026-03-30 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44e3a005-aa50-5d63-b63b-24acd4b7b14d sending to next pipeline
2026-03-30 10:40:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44e3a005-aa50-5d63-b63b-24acd4b7b14d, identifier: WV73920
2026-03-30 10:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_e78a3514968b7fd1452b986d871d9b02.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44e3a005-aa50-5d63-b63b-24acd4b7b14d with identifier: WV73920
2026-03-30 10:40:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44e3a005-aa50-5d63-b63b-24acd4b7b14d with identifier: WV73920
2026-03-30 10:40:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44e3a005-aa50-5d63-b63b-24acd4b7b14d with identifier: WV73920 to the API
2026-03-30 10:40:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_51e8f4a9fe130e4683cce6e638ab73e6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:35:56Z',
 'fuel_type': 'petrol',
 'id': '44e3a005-aa50-5d63-b63b-24acd4b7b14d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV73920',
 'listing': 'auction',
 'location': 'DE, Mönchengladbach',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 107670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_9919be92e72d980cea6f312a6c8d9565.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_51e8f4a9fe130e4683cce6e638ab73e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_5dbcc8d48827f14d01bc490726cefe91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_ea93aba385ef1287d3343952da83855e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_847cafd50f9d4ba340a22c0ee8ea51ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_1024715b7fb8a6746d92ef641f837955.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_9bef721a25d6a57ade11e4d1e7e099ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_6de38deb8e789771ca7d77990b5102bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_fa5c278cc869441a5ef75e141ef41d78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e3a005-aa50-5d63-b63b-24acd4b7b14d/44e3a005-aa50-5d63-b63b-24acd4b7b14d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/af/74af90a3bb2ce99a00d611f53823afa2/pa/WV73920_f1d787761e845ae44175c153e5b50565.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Exclusive-Line',
 'transmission': 'automatic',
 'trim': 'Exclusive-Line',
 'year': 2017}
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV73920%27 HTTP/1.1" 200 None
2026-03-30 10:40:29 [auto1.de] INFO: Saving data for WV73920: {'created_time': 1774867229.2205, 'last_price_update_time': 1774867229.220512, 'auction_closing_time': 1774971356.0}
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV73920') HTTP/1.1" 204 0
2026-03-30 10:40:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fe2f801-1543-516d-a26a-aeca40a3f455 with identifier: RB42350
2026-03-30 10:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fe2f801-1543-516d-a26a-aeca40a3f455 with scrape type 1
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6fe2f801-1543-516d-a26a-aeca40a3f455
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F21%252F29217ffa519ec6da4d7307b8bdb5ac41%252Fpa%252FRB42350_1c32b1e37961086985c4951651398710.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_1c32b1e37961086985c4951651398710.jpg already downloaded
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F21%252F29217ffa519ec6da4d7307b8bdb5ac41%252Fpa%252FRB42350_ab03923b449272edd209e462bfd0301c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_ab03923b449272edd209e462bfd0301c.jpg already downloaded
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F21%252F29217ffa519ec6da4d7307b8bdb5ac41%252Fpa%252FRB42350_e00373929bca9d5acd2b889bae0a2f63.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_e00373929bca9d5acd2b889bae0a2f63.jpg already downloaded
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F21%252F29217ffa519ec6da4d7307b8bdb5ac41%252Fpa%252FRB42350_0d6e6749615f254cc372d88f3a0b4e8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_0d6e6749615f254cc372d88f3a0b4e8e.jpg already downloaded
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F21%252F29217ffa519ec6da4d7307b8bdb5ac41%252Fpa%252FRB42350_c0788cccf74340b4bf0651490a561eca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_c0788cccf74340b4bf0651490a561eca.jpg already downloaded
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F21%252F29217ffa519ec6da4d7307b8bdb5ac41%252Fpa%252FRB42350_06b11b796bb0468b33acec5935ca054e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_06b11b796bb0468b33acec5935ca054e.jpg already downloaded
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F21%252F29217ffa519ec6da4d7307b8bdb5ac41%252Fpa%252FRB42350_0be8e69d7e79d7557b8514071b500e97.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_0be8e69d7e79d7557b8514071b500e97.jpg already downloaded
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F21%252F29217ffa519ec6da4d7307b8bdb5ac41%252Fpa%252FRB42350_612dafdbbdaf90e009280fe458da4d95.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_612dafdbbdaf90e009280fe458da4d95.jpg already downloaded
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F21%252F29217ffa519ec6da4d7307b8bdb5ac41%252Fpa%252FRB42350_a2eebd3b757ee0df03f2c6f64472506c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_a2eebd3b757ee0df03f2c6f64472506c.jpg already downloaded
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F21%252F29217ffa519ec6da4d7307b8bdb5ac41%252Fpa%252FRB42350_e055c793ccf3a16c8bc8cafc822ffae8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_e055c793ccf3a16c8bc8cafc822ffae8.jpg already downloaded
2026-03-30 10:40:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fe2f801-1543-516d-a26a-aeca40a3f455, identifier: RB42350
2026-03-30 10:40:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fe2f801-1543-516d-a26a-aeca40a3f455 with identifier: RB42350
2026-03-30 10:40:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fe2f801-1543-516d-a26a-aeca40a3f455 with identifier: RB42350
2026-03-30 10:40:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fe2f801-1543-516d-a26a-aeca40a3f455 with identifier: RB42350 to the API
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RB42350>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:05:54Z',
 'fuel_type': 'diesel',
 'id': '6fe2f801-1543-516d-a26a-aeca40a3f455',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB42350',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Ford',
 'model': 'Tourneo Connect',
 'odometer': 168675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_1c32b1e37961086985c4951651398710.jpg',
                'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_ab03923b449272edd209e462bfd0301c.jpg',
                'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_e00373929bca9d5acd2b889bae0a2f63.jpg',
                'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_0d6e6749615f254cc372d88f3a0b4e8e.jpg',
                'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_c0788cccf74340b4bf0651490a561eca.jpg',
                'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_06b11b796bb0468b33acec5935ca054e.jpg',
                'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_0be8e69d7e79d7557b8514071b500e97.jpg',
                'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_612dafdbbdaf90e009280fe458da4d95.jpg',
                'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_a2eebd3b757ee0df03f2c6f64472506c.jpg',
                'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_e055c793ccf3a16c8bc8cafc822ffae8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe2f801-1543-516d-a26a-aeca40a3f455/6fe2f801-1543-516d-a26a-aeca40a3f455_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_1c32b1e37961086985c4951651398710.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe2f801-1543-516d-a26a-aeca40a3f455/6fe2f801-1543-516d-a26a-aeca40a3f455_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_ab03923b449272edd209e462bfd0301c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe2f801-1543-516d-a26a-aeca40a3f455/6fe2f801-1543-516d-a26a-aeca40a3f455_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_e00373929bca9d5acd2b889bae0a2f63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe2f801-1543-516d-a26a-aeca40a3f455/6fe2f801-1543-516d-a26a-aeca40a3f455_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_0d6e6749615f254cc372d88f3a0b4e8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe2f801-1543-516d-a26a-aeca40a3f455/6fe2f801-1543-516d-a26a-aeca40a3f455_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_c0788cccf74340b4bf0651490a561eca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe2f801-1543-516d-a26a-aeca40a3f455/6fe2f801-1543-516d-a26a-aeca40a3f455_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_06b11b796bb0468b33acec5935ca054e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe2f801-1543-516d-a26a-aeca40a3f455/6fe2f801-1543-516d-a26a-aeca40a3f455_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_0be8e69d7e79d7557b8514071b500e97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe2f801-1543-516d-a26a-aeca40a3f455/6fe2f801-1543-516d-a26a-aeca40a3f455_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_612dafdbbdaf90e009280fe458da4d95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe2f801-1543-516d-a26a-aeca40a3f455/6fe2f801-1543-516d-a26a-aeca40a3f455_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_a2eebd3b757ee0df03f2c6f64472506c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe2f801-1543-516d-a26a-aeca40a3f455/6fe2f801-1543-516d-a26a-aeca40a3f455_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/21/29217ffa519ec6da4d7307b8bdb5ac41/pa/RB42350_e055c793ccf3a16c8bc8cafc822ffae8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Tourneo Connect 1.5 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB42350%27 HTTP/1.1" 200 None
2026-03-30 10:40:29 [auto1.de] INFO: Saving data for RB42350: {'created_time': 1774867229.921241, 'last_price_update_time': 1774867229.921251, 'auction_closing_time': 1774969554.0}
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB42350') HTTP/1.1" 204 0
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dee710>
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_e78a3514968b7fd1452b986d871d9b02.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_e78a3514968b7fd1452b986d871d9b02.jpg saved to cache
2026-03-30 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e92cc75-074e-5fd4-a30d-95d191e0bf8c
2026-03-30 10:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_0f87207a11d07647487920db8aa575ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_32b0488139c5f5197945b46ec3bcb535.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_5759cdd195bb19c98be73b92b1ee62ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5980a90>
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_0f87207a11d07647487920db8aa575ab.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_0f87207a11d07647487920db8aa575ab.jpg saved to cache
2026-03-30 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e92cc75-074e-5fd4-a30d-95d191e0bf8c
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e8ab10>
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_32b0488139c5f5197945b46ec3bcb535.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_32b0488139c5f5197945b46ec3bcb535.jpg saved to cache
2026-03-30 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e92cc75-074e-5fd4-a30d-95d191e0bf8c
2026-03-30 10:40:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6e410>
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_5759cdd195bb19c98be73b92b1ee62ac.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_5759cdd195bb19c98be73b92b1ee62ac.jpg saved to cache
2026-03-30 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e92cc75-074e-5fd4-a30d-95d191e0bf8c
2026-03-30 10:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_54d0535f96bb8d67be4333a905bda35b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_aac8b92e7ea362d8d2765faf47eee56e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee67d0>
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_54d0535f96bb8d67be4333a905bda35b.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_54d0535f96bb8d67be4333a905bda35b.jpg saved to cache
2026-03-30 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e92cc75-074e-5fd4-a30d-95d191e0bf8c
2026-03-30 10:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_e3fd57f8a5e9ecc80effb7fcdd6f67a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_be79afc0042933170d99aa205d607a33.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5090590>
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_aac8b92e7ea362d8d2765faf47eee56e.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_aac8b92e7ea362d8d2765faf47eee56e.jpg saved to cache
2026-03-30 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e92cc75-074e-5fd4-a30d-95d191e0bf8c
2026-03-30 10:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_48b8524885fbfbfe9b0b06cf19465f70.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL29012/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF04765/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_e6fd1d3bc8729180bb792a468a6efbb0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef596e8d0>
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_e3fd57f8a5e9ecc80effb7fcdd6f67a1.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_e3fd57f8a5e9ecc80effb7fcdd6f67a1.jpg saved to cache
2026-03-30 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e92cc75-074e-5fd4-a30d-95d191e0bf8c
2026-03-30 10:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_0331ef576ebdf9942246db7187a436f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_dec19c485395b46d18ed9e51ced5debd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_6b5336c516f3aa0fa41d1795053ca815.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ed1b10>
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_be79afc0042933170d99aa205d607a33.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_be79afc0042933170d99aa205d607a33.jpg saved to cache
2026-03-30 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68308b3e-fd23-58b0-b3d6-0e9df665e153
2026-03-30 10:40:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8d450>
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02a1a2790fd9b00103cc128071c89b8%252Fpa%252FCH19368_48b8524885fbfbfe9b0b06cf19465f70.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_48b8524885fbfbfe9b0b06cf19465f70.jpg saved to cache
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e92cc75-074e-5fd4-a30d-95d191e0bf8c
2026-03-30 10:40:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e92cc75-074e-5fd4-a30d-95d191e0bf8c, skipping ID generation
2026-03-30 10:40:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e92cc75-074e-5fd4-a30d-95d191e0bf8c with scrape type 1
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e92cc75-074e-5fd4-a30d-95d191e0bf8c sending to next pipeline
2026-03-30 10:40:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e92cc75-074e-5fd4-a30d-95d191e0bf8c, identifier: CH19368
2026-03-30 10:40:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4df7ad0>
2026-03-30 10:40:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_e6fd1d3bc8729180bb792a468a6efbb0.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_e6fd1d3bc8729180bb792a468a6efbb0.jpg saved to cache
2026-03-30 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68308b3e-fd23-58b0-b3d6-0e9df665e153
2026-03-30 10:40:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e92cc75-074e-5fd4-a30d-95d191e0bf8c with identifier: CH19368
2026-03-30 10:40:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e92cc75-074e-5fd4-a30d-95d191e0bf8c with identifier: CH19368
2026-03-30 10:40:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e92cc75-074e-5fd4-a30d-95d191e0bf8c with identifier: CH19368 to the API
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_48b8524885fbfbfe9b0b06cf19465f70.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:56:32Z',
 'fuel_type': 'diesel',
 'id': '8e92cc75-074e-5fd4-a30d-95d191e0bf8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH19368',
 'listing': 'auction',
 'location': 'DE, Leipzig',
 'make': 'BMW',
 'model': '1er',
 'odometer': 111691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_aac8b92e7ea362d8d2765faf47eee56e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2451267,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_48b8524885fbfbfe9b0b06cf19465f70.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2445629,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_e3fd57f8a5e9ecc80effb7fcdd6f67a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2248897,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_54d0535f96bb8d67be4333a905bda35b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_0f87207a11d07647487920db8aa575ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_32b0488139c5f5197945b46ec3bcb535.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_e78a3514968b7fd1452b986d871d9b02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2446499,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_5759cdd195bb19c98be73b92b1ee62ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2585551,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_1203088a8defb6d2337bd2ce0066ece0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e92cc75-074e-5fd4-a30d-95d191e0bf8c/8e92cc75-074e-5fd4-a30d-95d191e0bf8c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2582653,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02a1a2790fd9b00103cc128071c89b8/pa/CH19368_be3c7dc59e568f2cc42d681516982e28.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d xDrive Urban Line',
 'transmission': 'manual',
 'trim': 'xDrive Urban Line',
 'year': 2015}
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH19368%27 HTTP/1.1" 200 None
2026-03-30 10:40:31 [auto1.de] INFO: Saving data for CH19368: {'created_time': 1774867231.958788, 'last_price_update_time': 1774867231.9588, 'auction_closing_time': 1774972592.0}
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH19368') HTTP/1.1" 204 0
2026-03-30 10:40:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b2e8d0>
2026-03-30 10:40:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_0331ef576ebdf9942246db7187a436f6.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_0331ef576ebdf9942246db7187a436f6.jpg saved to cache
2026-03-30 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68308b3e-fd23-58b0-b3d6-0e9df665e153
2026-03-30 10:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508e6d0>
2026-03-30 10:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_dec19c485395b46d18ed9e51ced5debd.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_dec19c485395b46d18ed9e51ced5debd.jpg saved to cache
2026-03-30 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68308b3e-fd23-58b0-b3d6-0e9df665e153
2026-03-30 10:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef503e7d0>
2026-03-30 10:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F03%252F31030ef47494479707f1fd15f1b835a5%252Fpa%252FHW82301_6b5336c516f3aa0fa41d1795053ca815.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_6b5336c516f3aa0fa41d1795053ca815.jpg saved to cache
2026-03-30 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68308b3e-fd23-58b0-b3d6-0e9df665e153
2026-03-30 10:40:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68308b3e-fd23-58b0-b3d6-0e9df665e153, skipping ID generation
2026-03-30 10:40:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68308b3e-fd23-58b0-b3d6-0e9df665e153 with scrape type 1
2026-03-30 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68308b3e-fd23-58b0-b3d6-0e9df665e153 sending to next pipeline
2026-03-30 10:40:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68308b3e-fd23-58b0-b3d6-0e9df665e153, identifier: HW82301
2026-03-30 10:40:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68308b3e-fd23-58b0-b3d6-0e9df665e153 with identifier: HW82301
2026-03-30 10:40:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68308b3e-fd23-58b0-b3d6-0e9df665e153 with identifier: HW82301
2026-03-30 10:40:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68308b3e-fd23-58b0-b3d6-0e9df665e153 with identifier: HW82301 to the API
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_6b5336c516f3aa0fa41d1795053ca815.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:59:59Z',
 'fuel_type': 'petrol',
 'id': '68308b3e-fd23-58b0-b3d6-0e9df665e153',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW82301',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 103209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_e6fd1d3bc8729180bb792a468a6efbb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_0331ef576ebdf9942246db7187a436f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_6b5336c516f3aa0fa41d1795053ca815.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_dec19c485395b46d18ed9e51ced5debd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_be79afc0042933170d99aa205d607a33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_d7a9c4495015165150e146a64c0a3b4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_eb314d77a4c42cf6d0a5c116ede4984c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_08dd7f6a7cae906a6b0d0be019902cc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_0c6b1f199dc6e95f92e4bebbf9af6ff2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68308b3e-fd23-58b0-b3d6-0e9df665e153/68308b3e-fd23-58b0-b3d6-0e9df665e153_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/03/31030ef47494479707f1fd15f1b835a5/pa/HW82301_8f6e6961049378197fb0f9594afed599.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI John Cooper Works',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW82301%27 HTTP/1.1" 200 None
2026-03-30 10:40:32 [auto1.de] INFO: Saving data for HW82301: {'created_time': 1774867232.582262, 'last_price_update_time': 1774867232.582272, 'auction_closing_time': 1774972799.0}
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW82301') HTTP/1.1" 204 0
2026-03-30 10:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:32 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 9437 | hits on page: 40
2026-03-30 10:40:32 [auto1.de] INFO: Found listing with ID: FM54313
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM54313%27 HTTP/1.1" 200 None
2026-03-30 10:40:32 [auto1.de] INFO: Scrape type for FM54313: 1
2026-03-30 10:40:32 [auto1.de] INFO: Found listing with ID: HD00097
2026-03-30 10:40:32 [auto1.de] INFO: Found listing with ID: AA95512
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA95512%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [auto1.de] INFO: Scrape type for AA95512: 2
2026-03-30 10:40:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f72adb83-329c-5e8d-8112-34c644a6222f with identifier: AA95512
2026-03-30 10:40:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f72adb83-329c-5e8d-8112-34c644a6222f with scrape type 2
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f72adb83-329c-5e8d-8112-34c644a6222f with scrape type 2
2026-03-30 10:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f72adb83-329c-5e8d-8112-34c644a6222f, identifier: AA95512
2026-03-30 10:40:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f72adb83-329c-5e8d-8112-34c644a6222f with identifier: AA95512
2026-03-30 10:40:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f72adb83-329c-5e8d-8112-34c644a6222f with identifier: AA95512
2026-03-30 10:40:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f72adb83-329c-5e8d-8112-34c644a6222f with identifier: AA95512 to the API
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:38:53Z',
 'fuel_type': 'diesel',
 'id': 'f72adb83-329c-5e8d-8112-34c644a6222f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA95512',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 78709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-08',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA95512%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [auto1.de] INFO: Saving data for AA95512: {'auction_closing_time': 1774971533.0, 'created_time': 1774294149.238712, 'last_price_update_time': 1774867233.429243}
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA95512') HTTP/1.1" 204 0
2026-03-30 10:40:33 [auto1.de] INFO: Found listing with ID: GG34958
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG34958%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [auto1.de] INFO: Scrape type for GG34958: 2
2026-03-30 10:40:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22804a65-f6a0-5799-bf06-80dc2b92a70b with identifier: GG34958
2026-03-30 10:40:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22804a65-f6a0-5799-bf06-80dc2b92a70b with scrape type 2
2026-03-30 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22804a65-f6a0-5799-bf06-80dc2b92a70b with scrape type 2
2026-03-30 10:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22804a65-f6a0-5799-bf06-80dc2b92a70b, identifier: GG34958
2026-03-30 10:40:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22804a65-f6a0-5799-bf06-80dc2b92a70b with identifier: GG34958
2026-03-30 10:40:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22804a65-f6a0-5799-bf06-80dc2b92a70b with identifier: GG34958
2026-03-30 10:40:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22804a65-f6a0-5799-bf06-80dc2b92a70b with identifier: GG34958 to the API
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:22:44Z',
 'fuel_type': 'petrol',
 'id': '22804a65-f6a0-5799-bf06-80dc2b92a70b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG34958',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 82295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-25',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2020}
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG34958%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [auto1.de] INFO: Saving data for GG34958: {'auction_closing_time': 1774970564.0, 'created_time': 1773689090.097858, 'last_price_update_time': 1774867233.922537}
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG34958') HTTP/1.1" 204 0
2026-03-30 10:40:33 [auto1.de] INFO: Found listing with ID: ZM89950
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM89950%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [auto1.de] INFO: Scrape type for ZM89950: 1
2026-03-30 10:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT31239> (referer: https://www.auto1.com/v1/car-details-view/XT31239/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:33 [auto1.de] INFO: Found listing with ID: BL10422
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL10422%27 HTTP/1.1" 200 None
2026-03-30 10:40:33 [auto1.de] INFO: Scrape type for BL10422: 1
2026-03-30 10:40:33 [auto1.de] INFO: Found listing with ID: SK87421
2026-03-30 10:40:33 [auto1.de] INFO: Found listing with ID: HU92055
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU92055%27 HTTP/1.1" 200 None
2026-03-30 10:40:34 [auto1.de] INFO: Scrape type for HU92055: 2
2026-03-30 10:40:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfaeb360-969e-51b4-a135-b211ff933359 with identifier: HU92055
2026-03-30 10:40:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfaeb360-969e-51b4-a135-b211ff933359 with scrape type 2
2026-03-30 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfaeb360-969e-51b4-a135-b211ff933359 with scrape type 2
2026-03-30 10:40:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfaeb360-969e-51b4-a135-b211ff933359, identifier: HU92055
2026-03-30 10:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfaeb360-969e-51b4-a135-b211ff933359 with identifier: HU92055
2026-03-30 10:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfaeb360-969e-51b4-a135-b211ff933359 with identifier: HU92055
2026-03-30 10:40:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfaeb360-969e-51b4-a135-b211ff933359 with identifier: HU92055 to the API
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:17:49Z',
 'fuel_type': 'petrol',
 'id': 'dfaeb360-969e-51b4-a135-b211ff933359',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU92055',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 64912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2021}
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU92055%27 HTTP/1.1" 200 None
2026-03-30 10:40:34 [auto1.de] INFO: Saving data for HU92055: {'auction_closing_time': 1774970269.0, 'created_time': 1773689243.6667, 'last_price_update_time': 1774867234.767512}
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU92055') HTTP/1.1" 204 0
2026-03-30 10:40:34 [auto1.de] INFO: Found listing with ID: GE83879
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE83879%27 HTTP/1.1" 200 None
2026-03-30 10:40:34 [auto1.de] INFO: Scrape type for GE83879: 1
2026-03-30 10:40:34 [auto1.de] INFO: Found listing with ID: MT85534
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT85534%27 HTTP/1.1" 200 None
2026-03-30 10:40:34 [auto1.de] INFO: Scrape type for MT85534: 2
2026-03-30 10:40:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2b7b001-c0ff-5a7c-8d9b-8a4b5c5c01e3 with identifier: MT85534
2026-03-30 10:40:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2b7b001-c0ff-5a7c-8d9b-8a4b5c5c01e3 with scrape type 2
2026-03-30 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2b7b001-c0ff-5a7c-8d9b-8a4b5c5c01e3 with scrape type 2
2026-03-30 10:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2b7b001-c0ff-5a7c-8d9b-8a4b5c5c01e3, identifier: MT85534
2026-03-30 10:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2b7b001-c0ff-5a7c-8d9b-8a4b5c5c01e3 with identifier: MT85534
2026-03-30 10:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2b7b001-c0ff-5a7c-8d9b-8a4b5c5c01e3 with identifier: MT85534
2026-03-30 10:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2b7b001-c0ff-5a7c-8d9b-8a4b5c5c01e3 with identifier: MT85534 to the API
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:47:52Z',
 'fuel_type': 'diesel',
 'id': 'b2b7b001-c0ff-5a7c-8d9b-8a4b5c5c01e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT85534',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 249369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-31',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2010}
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT85534%27 HTTP/1.1" 200 None
2026-03-30 10:40:35 [auto1.de] INFO: Saving data for MT85534: {'auction_closing_time': 1774972072.0, 'created_time': 1774291172.73688, 'last_price_update_time': 1774867235.416552}
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT85534') HTTP/1.1" 204 0
2026-03-30 10:40:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4aa40bf-899b-5c97-8268-7e6c47ec4446 with identifier: XT31239
2026-03-30 10:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4aa40bf-899b-5c97-8268-7e6c47ec4446 with scrape type 1
2026-03-30 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b4aa40bf-899b-5c97-8268-7e6c47ec4446
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F5a%252F955aa5d66cf91292044eb08424302b53%252Fpa%252FXT31239_467f21066a8360dd4f39eac4ffa771d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_467f21066a8360dd4f39eac4ffa771d8.jpg not downloaded yet
2026-03-30 10:40:35 [auto1.de] INFO: Found listing with ID: RE68011
2026-03-30 10:40:35 [auto1.de] INFO: Found listing with ID: DH10613
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH10613%27 HTTP/1.1" 200 None
2026-03-30 10:40:35 [auto1.de] INFO: Scrape type for DH10613: 2
2026-03-30 10:40:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 227999ba-d881-5738-a269-b2f8db8244ca with identifier: DH10613
2026-03-30 10:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 227999ba-d881-5738-a269-b2f8db8244ca with scrape type 2
2026-03-30 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 227999ba-d881-5738-a269-b2f8db8244ca with scrape type 2
2026-03-30 10:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 227999ba-d881-5738-a269-b2f8db8244ca, identifier: DH10613
2026-03-30 10:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 227999ba-d881-5738-a269-b2f8db8244ca with identifier: DH10613
2026-03-30 10:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 227999ba-d881-5738-a269-b2f8db8244ca with identifier: DH10613
2026-03-30 10:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 227999ba-d881-5738-a269-b2f8db8244ca with identifier: DH10613 to the API
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:12:15Z',
 'fuel_type': 'diesel',
 'id': '227999ba-d881-5738-a269-b2f8db8244ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH10613',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 256203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-29',
 'seller_name': None,
 'title': 'Volvo V50 1.6 D2',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH10613%27 HTTP/1.1" 200 None
2026-03-30 10:40:35 [auto1.de] INFO: Saving data for DH10613: {'auction_closing_time': 1774969935.0, 'created_time': 1773775957.06467, 'last_price_update_time': 1774867235.959579}
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH10613') HTTP/1.1" 204 0
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F5a%252F955aa5d66cf91292044eb08424302b53%252Fpa%252FXT31239_bdcf0438ac97e8ba267cbc4371c6f14d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_bdcf0438ac97e8ba267cbc4371c6f14d.jpg not downloaded yet
2026-03-30 10:40:35 [auto1.de] INFO: Found listing with ID: KR19122
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR19122%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [auto1.de] INFO: Scrape type for KR19122: 1
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F5a%252F955aa5d66cf91292044eb08424302b53%252Fpa%252FXT31239_b44a8b992b3e7f6ced5ec7f9ad1f2578.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_b44a8b992b3e7f6ced5ec7f9ad1f2578.jpg not downloaded yet
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: AE02185
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: TB03254
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: LM89418
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89418%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [auto1.de] INFO: Scrape type for LM89418: 1
2026-03-30 10:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WL33179> (referer: https://www.auto1.com/v1/car-details-view/WL33179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F5a%252F955aa5d66cf91292044eb08424302b53%252Fpa%252FXT31239_3aab7f453036b04be97297206a9b60b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_3aab7f453036b04be97297206a9b60b1.jpg not downloaded yet
2026-03-30 10:40:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: WZ57217
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: BJ56368
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ56368%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [auto1.de] INFO: Scrape type for BJ56368: 1
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F5a%252F955aa5d66cf91292044eb08424302b53%252Fpa%252FXT31239_727e9e9f3baaeaa0a53431ff1dc8a05e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_727e9e9f3baaeaa0a53431ff1dc8a05e.jpg not downloaded yet
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: UU86547
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU86547%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [auto1.de] INFO: Scrape type for UU86547: 1
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: ZG67358
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG67358%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [auto1.de] INFO: Scrape type for ZG67358: 1
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: ZF87994
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: NT58972
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: UF92317
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: LP80912
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: YH22570
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: JB82984
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: FS39177
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: BF55628
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: RU80356
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: FR25339
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR25339%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [auto1.de] INFO: Scrape type for FR25339: 2
2026-03-30 10:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2c7e249-a51e-504d-bf3a-44ddb86591f8 with identifier: FR25339
2026-03-30 10:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2c7e249-a51e-504d-bf3a-44ddb86591f8 with scrape type 2
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2c7e249-a51e-504d-bf3a-44ddb86591f8 with scrape type 2
2026-03-30 10:40:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2c7e249-a51e-504d-bf3a-44ddb86591f8, identifier: FR25339
2026-03-30 10:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2c7e249-a51e-504d-bf3a-44ddb86591f8 with identifier: FR25339
2026-03-30 10:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2c7e249-a51e-504d-bf3a-44ddb86591f8 with identifier: FR25339
2026-03-30 10:40:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2c7e249-a51e-504d-bf3a-44ddb86591f8 with identifier: FR25339 to the API
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:14:24Z',
 'fuel_type': 'diesel',
 'id': 'a2c7e249-a51e-504d-bf3a-44ddb86591f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR25339',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 120544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-20',
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR25339%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [auto1.de] INFO: Saving data for FR25339: {'auction_closing_time': 1774970064.0, 'created_time': 1773688039.363876, 'last_price_update_time': 1774867236.735487}
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR25339') HTTP/1.1" 204 0
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: NE66153
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: MF98789
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: LF89175
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF89175%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [auto1.de] INFO: Scrape type for LF89175: 1
2026-03-30 10:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_b44a8b992b3e7f6ced5ec7f9ad1f2578.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: SE64605
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: BP66204
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP66204%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [auto1.de] INFO: Scrape type for BP66204: 1
2026-03-30 10:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4440915-bde6-5dcf-a7eb-58a28f26652c with identifier: WL33179
2026-03-30 10:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4440915-bde6-5dcf-a7eb-58a28f26652c with scrape type 1
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4440915-bde6-5dcf-a7eb-58a28f26652c
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_f4953484015e5a1f91074f541e2bc55f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_f4953484015e5a1f91074f541e2bc55f.jpg not downloaded yet
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: LT56720
2026-03-30 10:40:36 [auto1.de] INFO: Found listing with ID: CF26327
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF26327%27 HTTP/1.1" 200 None
2026-03-30 10:40:36 [auto1.de] INFO: Scrape type for CF26327: 2
2026-03-30 10:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88d2165-2ea5-5b5e-bc1d-bbf77c5e5a80 with identifier: CF26327
2026-03-30 10:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88d2165-2ea5-5b5e-bc1d-bbf77c5e5a80 with scrape type 2
2026-03-30 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e88d2165-2ea5-5b5e-bc1d-bbf77c5e5a80 with scrape type 2
2026-03-30 10:40:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e88d2165-2ea5-5b5e-bc1d-bbf77c5e5a80, identifier: CF26327
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_67f890a6ccbf3addc510be0cdbd3ec08.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_67f890a6ccbf3addc510be0cdbd3ec08.jpg not downloaded yet
2026-03-30 10:40:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA20586> (referer: https://www.auto1.com/v1/car-details-view/HA20586/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e88d2165-2ea5-5b5e-bc1d-bbf77c5e5a80 with identifier: CF26327
2026-03-30 10:40:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e88d2165-2ea5-5b5e-bc1d-bbf77c5e5a80 with identifier: CF26327
2026-03-30 10:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e88d2165-2ea5-5b5e-bc1d-bbf77c5e5a80 with identifier: CF26327 to the API
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:09:21Z',
 'fuel_type': 'petrol',
 'id': 'e88d2165-2ea5-5b5e-bc1d-bbf77c5e5a80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF26327',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 181444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-07',
 'seller_name': None,
 'title': 'Seat Ateca 1.4 TSI ACT Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2018}
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF26327%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [auto1.de] INFO: Saving data for CF26327: {'auction_closing_time': 1774969761.0, 'created_time': 1774264153.922882, 'last_price_update_time': 1774867237.379223}
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF26327') HTTP/1.1" 204 0
2026-03-30 10:40:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:37 [auto1.de] INFO: Found listing with ID: UT28191
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT28191%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [auto1.de] INFO: Scrape type for UT28191: 1
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_95b7740968302f028301bc0c18fcec12.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_95b7740968302f028301bc0c18fcec12.jpg not downloaded yet
2026-03-30 10:40:37 [auto1.de] INFO: Found listing with ID: VS83622
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS83622%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [auto1.de] INFO: Scrape type for VS83622: 1
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_d3bd117a9ae2f49e217e4f9eb4329b4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_d3bd117a9ae2f49e217e4f9eb4329b4e.jpg not downloaded yet
2026-03-30 10:40:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef503e850>
2026-03-30 10:40:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4aa40bf-899b-5c97-8268-7e6c47ec4446/b4aa40bf-899b-5c97-8268-7e6c47ec4446_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F5a%252F955aa5d66cf91292044eb08424302b53%252Fpa%252FXT31239_b44a8b992b3e7f6ced5ec7f9ad1f2578.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_b44a8b992b3e7f6ced5ec7f9ad1f2578.jpg saved to cache
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4aa40bf-899b-5c97-8268-7e6c47ec4446
2026-03-30 10:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d172f18-f381-5a6d-b295-cfe8729257cd with identifier: HA20586
2026-03-30 10:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d172f18-f381-5a6d-b295-cfe8729257cd with scrape type 1
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d172f18-f381-5a6d-b295-cfe8729257cd
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe5%252F3ae576b1f6b7c1639dd09d6534492137%252Fpa%252FHA20586_3b73247a9d69b1a1c45aa5a3b2a1d5e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_3b73247a9d69b1a1c45aa5a3b2a1d5e8.jpg already downloaded
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe5%252F3ae576b1f6b7c1639dd09d6534492137%252Fpa%252FHA20586_c7c4e3a8d71faf791bb91956c3225c9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_c7c4e3a8d71faf791bb91956c3225c9d.jpg already downloaded
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe5%252F3ae576b1f6b7c1639dd09d6534492137%252Fpa%252FHA20586_353ea2062167cb42d48524b9e5b9d9b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_353ea2062167cb42d48524b9e5b9d9b4.jpg already downloaded
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe5%252F3ae576b1f6b7c1639dd09d6534492137%252Fpa%252FHA20586_e0bb2df0363ec9d7df5e87453f921d82.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_e0bb2df0363ec9d7df5e87453f921d82.jpg already downloaded
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe5%252F3ae576b1f6b7c1639dd09d6534492137%252Fpa%252FHA20586_2e2422efbbd39c83cd84b9961221e22b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_2e2422efbbd39c83cd84b9961221e22b.jpg already downloaded
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe5%252F3ae576b1f6b7c1639dd09d6534492137%252Fpa%252FHA20586_1a75117e997f224eb786ce14b0316bb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_1a75117e997f224eb786ce14b0316bb7.jpg already downloaded
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe5%252F3ae576b1f6b7c1639dd09d6534492137%252Fpa%252FHA20586_ac317a3078d10d4e2990ae565e1ec9c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_ac317a3078d10d4e2990ae565e1ec9c3.jpg already downloaded
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe5%252F3ae576b1f6b7c1639dd09d6534492137%252Fpa%252FHA20586_64a0d6207b6c73741751dc45d156fd74.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_64a0d6207b6c73741751dc45d156fd74.jpg already downloaded
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe5%252F3ae576b1f6b7c1639dd09d6534492137%252Fpa%252FHA20586_b51a6248bfc2ce5b56188f056dca9384.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_b51a6248bfc2ce5b56188f056dca9384.jpg already downloaded
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe5%252F3ae576b1f6b7c1639dd09d6534492137%252Fpa%252FHA20586_c052b7787d1e05fc79c3cac108ec013d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_c052b7787d1e05fc79c3cac108ec013d.jpg already downloaded
2026-03-30 10:40:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d172f18-f381-5a6d-b295-cfe8729257cd, identifier: HA20586
2026-03-30 10:40:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d172f18-f381-5a6d-b295-cfe8729257cd with identifier: HA20586
2026-03-30 10:40:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d172f18-f381-5a6d-b295-cfe8729257cd with identifier: HA20586
2026-03-30 10:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d172f18-f381-5a6d-b295-cfe8729257cd with identifier: HA20586 to the API
2026-03-30 10:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HA20586>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:20:17Z',
 'fuel_type': 'petrol',
 'id': '9d172f18-f381-5a6d-b295-cfe8729257cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA20586',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 125470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_3b73247a9d69b1a1c45aa5a3b2a1d5e8.jpg',
                'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_c7c4e3a8d71faf791bb91956c3225c9d.jpg',
                'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_353ea2062167cb42d48524b9e5b9d9b4.jpg',
                'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_e0bb2df0363ec9d7df5e87453f921d82.jpg',
                'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_2e2422efbbd39c83cd84b9961221e22b.jpg',
                'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_1a75117e997f224eb786ce14b0316bb7.jpg',
                'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_ac317a3078d10d4e2990ae565e1ec9c3.jpg',
                'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_64a0d6207b6c73741751dc45d156fd74.jpg',
                'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_b51a6248bfc2ce5b56188f056dca9384.jpg',
                'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_c052b7787d1e05fc79c3cac108ec013d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d172f18-f381-5a6d-b295-cfe8729257cd/9d172f18-f381-5a6d-b295-cfe8729257cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2989017,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_3b73247a9d69b1a1c45aa5a3b2a1d5e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d172f18-f381-5a6d-b295-cfe8729257cd/9d172f18-f381-5a6d-b295-cfe8729257cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2985443,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_c7c4e3a8d71faf791bb91956c3225c9d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d172f18-f381-5a6d-b295-cfe8729257cd/9d172f18-f381-5a6d-b295-cfe8729257cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_353ea2062167cb42d48524b9e5b9d9b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d172f18-f381-5a6d-b295-cfe8729257cd/9d172f18-f381-5a6d-b295-cfe8729257cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_e0bb2df0363ec9d7df5e87453f921d82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d172f18-f381-5a6d-b295-cfe8729257cd/9d172f18-f381-5a6d-b295-cfe8729257cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3056205,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_2e2422efbbd39c83cd84b9961221e22b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d172f18-f381-5a6d-b295-cfe8729257cd/9d172f18-f381-5a6d-b295-cfe8729257cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_1a75117e997f224eb786ce14b0316bb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d172f18-f381-5a6d-b295-cfe8729257cd/9d172f18-f381-5a6d-b295-cfe8729257cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2908077,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_ac317a3078d10d4e2990ae565e1ec9c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d172f18-f381-5a6d-b295-cfe8729257cd/9d172f18-f381-5a6d-b295-cfe8729257cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2987360,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_64a0d6207b6c73741751dc45d156fd74.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d172f18-f381-5a6d-b295-cfe8729257cd/9d172f18-f381-5a6d-b295-cfe8729257cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_b51a6248bfc2ce5b56188f056dca9384.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d172f18-f381-5a6d-b295-cfe8729257cd/9d172f18-f381-5a6d-b295-cfe8729257cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e5/3ae576b1f6b7c1639dd09d6534492137/pa/HA20586_c052b7787d1e05fc79c3cac108ec013d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 I-Way',
 'transmission': 'manual',
 'trim': 'I-Way',
 'year': 2012}
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA20586%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [auto1.de] INFO: Saving data for HA20586: {'created_time': 1774867238.27848, 'last_price_update_time': 1774867238.27849, 'auction_closing_time': 1774970417.0}
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA20586') HTTP/1.1" 204 0
2026-03-30 10:40:38 [auto1.de] INFO: Found listing with ID: GJ55737
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_0cc7caefaa0774ae5cdaf1deee838e3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_0cc7caefaa0774ae5cdaf1deee838e3c.jpg not downloaded yet
2026-03-30 10:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_f4953484015e5a1f91074f541e2bc55f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MR66589> (referer: https://www.auto1.com/v1/car-details-view/MR66589/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_eca5096f74c59ad01bf44f7a21d9328d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_eca5096f74c59ad01bf44f7a21d9328d.jpg not downloaded yet
2026-03-30 10:40:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN11349> (referer: https://www.auto1.com/v1/car-details-view/AN11349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_b0dd92b7b674a92e53de1d1596147798.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_b0dd92b7b674a92e53de1d1596147798.jpg not downloaded yet
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_f79383c6a81198faf95761d7427f2a2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_f79383c6a81198faf95761d7427f2a2b.jpg not downloaded yet
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_d3de251fd0b1ea0b6303a2677f9e3101.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_d3de251fd0b1ea0b6303a2677f9e3101.jpg not downloaded yet
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_a59d09db8615ea5e6522959b494aa876.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_a59d09db8615ea5e6522959b494aa876.jpg not downloaded yet
2026-03-30 10:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_d3bd117a9ae2f49e217e4f9eb4329b4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da3b50>
2026-03-30 10:40:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_f4953484015e5a1f91074f541e2bc55f.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_f4953484015e5a1f91074f541e2bc55f.jpg saved to cache
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4440915-bde6-5dcf-a7eb-58a28f26652c
2026-03-30 10:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e1968c5-81c4-54e7-93a0-63aa06cb4b8f with identifier: MR66589
2026-03-30 10:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e1968c5-81c4-54e7-93a0-63aa06cb4b8f with scrape type 1
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e1968c5-81c4-54e7-93a0-63aa06cb4b8f
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F6d%252F6b6df76cb00dfc07f03fe936fa8dcc2b%252Fpa%252FMR66589_f821c364f2186e8f494ac8d20d2d924e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_f821c364f2186e8f494ac8d20d2d924e.jpg already downloaded
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F6d%252F6b6df76cb00dfc07f03fe936fa8dcc2b%252Fpa%252FMR66589_b5db928b646edbffe099f566cba0d786.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_b5db928b646edbffe099f566cba0d786.jpg already downloaded
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F6d%252F6b6df76cb00dfc07f03fe936fa8dcc2b%252Fpa%252FMR66589_5822c111b4073c8975a0d8ad0aae65b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_5822c111b4073c8975a0d8ad0aae65b6.jpg already downloaded
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F6d%252F6b6df76cb00dfc07f03fe936fa8dcc2b%252Fpa%252FMR66589_f981184776f1e626c82c14426e491ede.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_f981184776f1e626c82c14426e491ede.jpg already downloaded
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F6d%252F6b6df76cb00dfc07f03fe936fa8dcc2b%252Fpa%252FMR66589_8b6be331e20c2846dea7835ece58f7eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_8b6be331e20c2846dea7835ece58f7eb.jpg already downloaded
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F6d%252F6b6df76cb00dfc07f03fe936fa8dcc2b%252Fpa%252FMR66589_0fc7e0f11f0c13f021ec3e37d0b75d7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_0fc7e0f11f0c13f021ec3e37d0b75d7a.jpg already downloaded
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F6d%252F6b6df76cb00dfc07f03fe936fa8dcc2b%252Fpa%252FMR66589_660d21e3e4d92fe5f853658dbf6230fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_660d21e3e4d92fe5f853658dbf6230fd.jpg already downloaded
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F6d%252F6b6df76cb00dfc07f03fe936fa8dcc2b%252Fpa%252FMR66589_9bbd2e067af08027cf68e9b877405d52.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_9bbd2e067af08027cf68e9b877405d52.jpg already downloaded
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F6d%252F6b6df76cb00dfc07f03fe936fa8dcc2b%252Fpa%252FMR66589_18f2fca6622c2b047d9534b46a983841.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_18f2fca6622c2b047d9534b46a983841.jpg already downloaded
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F6d%252F6b6df76cb00dfc07f03fe936fa8dcc2b%252Fpa%252FMR66589_ae862801fc6d9879ffb2865e26ff7491.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_ae862801fc6d9879ffb2865e26ff7491.jpg already downloaded
2026-03-30 10:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e1968c5-81c4-54e7-93a0-63aa06cb4b8f, identifier: MR66589
2026-03-30 10:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e1968c5-81c4-54e7-93a0-63aa06cb4b8f with identifier: MR66589
2026-03-30 10:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e1968c5-81c4-54e7-93a0-63aa06cb4b8f with identifier: MR66589
2026-03-30 10:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e1968c5-81c4-54e7-93a0-63aa06cb4b8f with identifier: MR66589 to the API
2026-03-30 10:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MR66589>
{'auction_title': '',
 'c_o_2_emission_value': 232,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:43:37Z',
 'fuel_type': 'diesel',
 'id': '0e1968c5-81c4-54e7-93a0-63aa06cb4b8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR66589',
 'listing': 'auction',
 'location': 'Mülheim\xad-Kärlich',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 42572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_f821c364f2186e8f494ac8d20d2d924e.jpg',
                'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_b5db928b646edbffe099f566cba0d786.jpg',
                'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_5822c111b4073c8975a0d8ad0aae65b6.jpg',
                'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_f981184776f1e626c82c14426e491ede.jpg',
                'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_8b6be331e20c2846dea7835ece58f7eb.jpg',
                'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_0fc7e0f11f0c13f021ec3e37d0b75d7a.jpg',
                'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_660d21e3e4d92fe5f853658dbf6230fd.jpg',
                'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_9bbd2e067af08027cf68e9b877405d52.jpg',
                'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_18f2fca6622c2b047d9534b46a983841.jpg',
                'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_ae862801fc6d9879ffb2865e26ff7491.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1968c5-81c4-54e7-93a0-63aa06cb4b8f/0e1968c5-81c4-54e7-93a0-63aa06cb4b8f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_f821c364f2186e8f494ac8d20d2d924e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1968c5-81c4-54e7-93a0-63aa06cb4b8f/0e1968c5-81c4-54e7-93a0-63aa06cb4b8f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2675407,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_b5db928b646edbffe099f566cba0d786.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1968c5-81c4-54e7-93a0-63aa06cb4b8f/0e1968c5-81c4-54e7-93a0-63aa06cb4b8f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2552456,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_5822c111b4073c8975a0d8ad0aae65b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1968c5-81c4-54e7-93a0-63aa06cb4b8f/0e1968c5-81c4-54e7-93a0-63aa06cb4b8f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_f981184776f1e626c82c14426e491ede.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1968c5-81c4-54e7-93a0-63aa06cb4b8f/0e1968c5-81c4-54e7-93a0-63aa06cb4b8f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2405783,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_8b6be331e20c2846dea7835ece58f7eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1968c5-81c4-54e7-93a0-63aa06cb4b8f/0e1968c5-81c4-54e7-93a0-63aa06cb4b8f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2555350,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_0fc7e0f11f0c13f021ec3e37d0b75d7a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1968c5-81c4-54e7-93a0-63aa06cb4b8f/0e1968c5-81c4-54e7-93a0-63aa06cb4b8f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2813678,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_660d21e3e4d92fe5f853658dbf6230fd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1968c5-81c4-54e7-93a0-63aa06cb4b8f/0e1968c5-81c4-54e7-93a0-63aa06cb4b8f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_9bbd2e067af08027cf68e9b877405d52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1968c5-81c4-54e7-93a0-63aa06cb4b8f/0e1968c5-81c4-54e7-93a0-63aa06cb4b8f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_18f2fca6622c2b047d9534b46a983841.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1968c5-81c4-54e7-93a0-63aa06cb4b8f/0e1968c5-81c4-54e7-93a0-63aa06cb4b8f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/6d/6b6df76cb00dfc07f03fe936fa8dcc2b/pa/MR66589_ae862801fc6d9879ffb2865e26ff7491.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-09-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi EcoBlue Wildtrak e-4WD Doppelkabine',
 'transmission': 'automatic',
 'trim': 'Wildtrak e-4WD Doppelkabine',
 'year': 2023}
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR66589%27 HTTP/1.1" 200 None
2026-03-30 10:40:39 [auto1.de] INFO: Saving data for MR66589: {'created_time': 1774867239.485916, 'last_price_update_time': 1774867239.485926, 'auction_closing_time': 1774971817.0}
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR66589') HTTP/1.1" 204 0
2026-03-30 10:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_0cc7caefaa0774ae5cdaf1deee838e3c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b015fdc2-98de-5239-b8c1-61065bb35377 with identifier: AN11349
2026-03-30 10:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b015fdc2-98de-5239-b8c1-61065bb35377 with scrape type 1
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b015fdc2-98de-5239-b8c1-61065bb35377
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_804c28127dc94090670e090800dcd01d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_804c28127dc94090670e090800dcd01d.jpg not downloaded yet
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ecd510>
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_d3bd117a9ae2f49e217e4f9eb4329b4e.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_d3bd117a9ae2f49e217e4f9eb4329b4e.jpg saved to cache
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4440915-bde6-5dcf-a7eb-58a28f26652c
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_1a889f629b1695c99d996c47649fe02b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_1a889f629b1695c99d996c47649fe02b.jpg not downloaded yet
2026-03-30 10:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_a59d09db8615ea5e6522959b494aa876.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP91908/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_42510c8bc0f8630bcb9efe3e404168de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_42510c8bc0f8630bcb9efe3e404168de.jpg not downloaded yet
2026-03-30 10:40:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_9b370e3c01ff22383c23241d5301068e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_9b370e3c01ff22383c23241d5301068e.jpg not downloaded yet
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eb5c50>
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_0cc7caefaa0774ae5cdaf1deee838e3c.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_0cc7caefaa0774ae5cdaf1deee838e3c.jpg saved to cache
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4440915-bde6-5dcf-a7eb-58a28f26652c
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_486ee71bf0d10c558e0da304a6fc21fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_486ee71bf0d10c558e0da304a6fc21fe.jpg not downloaded yet
2026-03-30 10:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_d3de251fd0b1ea0b6303a2677f9e3101.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_804c28127dc94090670e090800dcd01d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_fa504d961809b8899e615ade3af5e487.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_fa504d961809b8899e615ade3af5e487.jpg not downloaded yet
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e63a50>
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_a59d09db8615ea5e6522959b494aa876.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_a59d09db8615ea5e6522959b494aa876.jpg saved to cache
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4440915-bde6-5dcf-a7eb-58a28f26652c
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_5db02a8ac3bb424c9120d3ad132416f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_5db02a8ac3bb424c9120d3ad132416f5.jpg not downloaded yet
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_3ccde7d9635e5d19de8806eb119d4c6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_3ccde7d9635e5d19de8806eb119d4c6f.jpg not downloaded yet
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_ea573476efd1bdb02f1b45465035ac68.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_ea573476efd1bdb02f1b45465035ac68.jpg not downloaded yet
2026-03-30 10:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_1a889f629b1695c99d996c47649fe02b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_486ee71bf0d10c558e0da304a6fc21fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_bbc3fa8f39e47c5ef8b75a6a616b29e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_bbc3fa8f39e47c5ef8b75a6a616b29e9.jpg not downloaded yet
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb6050>
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_d3de251fd0b1ea0b6303a2677f9e3101.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_d3de251fd0b1ea0b6303a2677f9e3101.jpg saved to cache
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4440915-bde6-5dcf-a7eb-58a28f26652c
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eab690>
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_804c28127dc94090670e090800dcd01d.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_804c28127dc94090670e090800dcd01d.jpg saved to cache
2026-03-30 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b015fdc2-98de-5239-b8c1-61065bb35377
2026-03-30 10:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_9b370e3c01ff22383c23241d5301068e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c40310>
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_1a889f629b1695c99d996c47649fe02b.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_1a889f629b1695c99d996c47649fe02b.jpg saved to cache
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b015fdc2-98de-5239-b8c1-61065bb35377
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b344d0>
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_486ee71bf0d10c558e0da304a6fc21fe.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_486ee71bf0d10c558e0da304a6fc21fe.jpg saved to cache
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b015fdc2-98de-5239-b8c1-61065bb35377
2026-03-30 10:40:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_3ccde7d9635e5d19de8806eb119d4c6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f46710>
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_9b370e3c01ff22383c23241d5301068e.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_9b370e3c01ff22383c23241d5301068e.jpg saved to cache
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b015fdc2-98de-5239-b8c1-61065bb35377
2026-03-30 10:40:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_bbc3fa8f39e47c5ef8b75a6a616b29e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_5db02a8ac3bb424c9120d3ad132416f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e79f10>
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_3ccde7d9635e5d19de8806eb119d4c6f.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_3ccde7d9635e5d19de8806eb119d4c6f.jpg saved to cache
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b015fdc2-98de-5239-b8c1-61065bb35377
2026-03-30 10:40:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_ea573476efd1bdb02f1b45465035ac68.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b01150>
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_bbc3fa8f39e47c5ef8b75a6a616b29e9.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_bbc3fa8f39e47c5ef8b75a6a616b29e9.jpg saved to cache
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b015fdc2-98de-5239-b8c1-61065bb35377
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db6f10>
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_5db02a8ac3bb424c9120d3ad132416f5.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_5db02a8ac3bb424c9120d3ad132416f5.jpg saved to cache
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b015fdc2-98de-5239-b8c1-61065bb35377
2026-03-30 10:40:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_fa504d961809b8899e615ade3af5e487.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50727d0>
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_ea573476efd1bdb02f1b45465035ac68.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_ea573476efd1bdb02f1b45465035ac68.jpg saved to cache
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b015fdc2-98de-5239-b8c1-61065bb35377
2026-03-30 10:40:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_f79383c6a81198faf95761d7427f2a2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dfad10>
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_fa504d961809b8899e615ade3af5e487.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_fa504d961809b8899e615ade3af5e487.jpg saved to cache
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b015fdc2-98de-5239-b8c1-61065bb35377
2026-03-30 10:40:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_42510c8bc0f8630bcb9efe3e404168de.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db43d0>
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_f79383c6a81198faf95761d7427f2a2b.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_f79383c6a81198faf95761d7427f2a2b.jpg saved to cache
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4440915-bde6-5dcf-a7eb-58a28f26652c
2026-03-30 10:40:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_eca5096f74c59ad01bf44f7a21d9328d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eabd50>
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619d480f60cffb950d03dbde7b2d9dc3%252Fpa%252FAN11349_42510c8bc0f8630bcb9efe3e404168de.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_42510c8bc0f8630bcb9efe3e404168de.jpg saved to cache
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b015fdc2-98de-5239-b8c1-61065bb35377
2026-03-30 10:40:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b015fdc2-98de-5239-b8c1-61065bb35377, skipping ID generation
2026-03-30 10:40:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b015fdc2-98de-5239-b8c1-61065bb35377 with scrape type 1
2026-03-30 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b015fdc2-98de-5239-b8c1-61065bb35377 sending to next pipeline
2026-03-30 10:40:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b015fdc2-98de-5239-b8c1-61065bb35377, identifier: AN11349
2026-03-30 10:40:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b015fdc2-98de-5239-b8c1-61065bb35377 with identifier: AN11349
2026-03-30 10:40:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b015fdc2-98de-5239-b8c1-61065bb35377 with identifier: AN11349
2026-03-30 10:40:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b015fdc2-98de-5239-b8c1-61065bb35377 with identifier: AN11349 to the API
2026-03-30 10:40:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_42510c8bc0f8630bcb9efe3e404168de.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 280,
 'expiration_date': '2026-03-31T15:17:38Z',
 'fuel_type': 'petrol',
 'id': 'b015fdc2-98de-5239-b8c1-61065bb35377',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN11349',
 'listing': 'auction',
 'location': 'DE, Nürnberg',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 45950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_804c28127dc94090670e090800dcd01d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_1a889f629b1695c99d996c47649fe02b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_42510c8bc0f8630bcb9efe3e404168de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_9b370e3c01ff22383c23241d5301068e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_486ee71bf0d10c558e0da304a6fc21fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_fa504d961809b8899e615ade3af5e487.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_5db02a8ac3bb424c9120d3ad132416f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_3ccde7d9635e5d19de8806eb119d4c6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_ea573476efd1bdb02f1b45465035ac68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b015fdc2-98de-5239-b8c1-61065bb35377/b015fdc2-98de-5239-b8c1-61065bb35377_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619d480f60cffb950d03dbde7b2d9dc3/pa/AN11349_bbc3fa8f39e47c5ef8b75a6a616b29e9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.0 Turbo Veloce',
 'transmission': 'automatic',
 'trim': 'Veloce',
 'year': 2021}
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN11349%27 HTTP/1.1" 200 None
2026-03-30 10:40:41 [auto1.de] INFO: Saving data for AN11349: {'created_time': 1774867241.440775, 'last_price_update_time': 1774867241.440789, 'auction_closing_time': 1774970258.0}
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN11349') HTTP/1.1" 204 0
2026-03-30 10:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_b0dd92b7b674a92e53de1d1596147798.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_95b7740968302f028301bc0c18fcec12.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA59022/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea8310>
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_eca5096f74c59ad01bf44f7a21d9328d.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_eca5096f74c59ad01bf44f7a21d9328d.jpg saved to cache
2026-03-30 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4440915-bde6-5dcf-a7eb-58a28f26652c
2026-03-30 10:40:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595ee10>
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_b0dd92b7b674a92e53de1d1596147798.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_b0dd92b7b674a92e53de1d1596147798.jpg saved to cache
2026-03-30 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4440915-bde6-5dcf-a7eb-58a28f26652c
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e78890>
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_95b7740968302f028301bc0c18fcec12.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_95b7740968302f028301bc0c18fcec12.jpg saved to cache
2026-03-30 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4440915-bde6-5dcf-a7eb-58a28f26652c
2026-03-30 10:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_67f890a6ccbf3addc510be0cdbd3ec08.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dfb1d0>
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F0d%252F160d0318ef74a5e3e5c3284553066cf7%252Fpa%252FWL33179_67f890a6ccbf3addc510be0cdbd3ec08.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_67f890a6ccbf3addc510be0cdbd3ec08.jpg saved to cache
2026-03-30 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4440915-bde6-5dcf-a7eb-58a28f26652c
2026-03-30 10:40:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4440915-bde6-5dcf-a7eb-58a28f26652c, skipping ID generation
2026-03-30 10:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4440915-bde6-5dcf-a7eb-58a28f26652c with scrape type 1
2026-03-30 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4440915-bde6-5dcf-a7eb-58a28f26652c sending to next pipeline
2026-03-30 10:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4440915-bde6-5dcf-a7eb-58a28f26652c, identifier: WL33179
2026-03-30 10:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4440915-bde6-5dcf-a7eb-58a28f26652c with identifier: WL33179
2026-03-30 10:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4440915-bde6-5dcf-a7eb-58a28f26652c with identifier: WL33179
2026-03-30 10:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4440915-bde6-5dcf-a7eb-58a28f26652c with identifier: WL33179 to the API
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_67f890a6ccbf3addc510be0cdbd3ec08.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:25:48Z',
 'fuel_type': 'diesel',
 'id': 'e4440915-bde6-5dcf-a7eb-58a28f26652c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL33179',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 121760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_f4953484015e5a1f91074f541e2bc55f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_67f890a6ccbf3addc510be0cdbd3ec08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_95b7740968302f028301bc0c18fcec12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_d3bd117a9ae2f49e217e4f9eb4329b4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_0cc7caefaa0774ae5cdaf1deee838e3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_eca5096f74c59ad01bf44f7a21d9328d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_b0dd92b7b674a92e53de1d1596147798.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_f79383c6a81198faf95761d7427f2a2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_d3de251fd0b1ea0b6303a2677f9e3101.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4440915-bde6-5dcf-a7eb-58a28f26652c/e4440915-bde6-5dcf-a7eb-58a28f26652c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/0d/160d0318ef74a5e3e5c3284553066cf7/pa/WL33179_a59d09db8615ea5e6522959b494aa876.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 Allroad 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL33179%27 HTTP/1.1" 200 None
2026-03-30 10:40:42 [auto1.de] INFO: Saving data for WL33179: {'created_time': 1774867242.254913, 'last_price_update_time': 1774867242.254923, 'auction_closing_time': 1774970748.0}
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL33179') HTTP/1.1" 204 0
2026-03-30 10:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ62631> (referer: https://www.auto1.com/v1/car-details-view/PZ62631/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d0cab07-ba13-5ba2-8cb4-cd920de26d2f with identifier: PZ62631
2026-03-30 10:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d0cab07-ba13-5ba2-8cb4-cd920de26d2f with scrape type 1
2026-03-30 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d0cab07-ba13-5ba2-8cb4-cd920de26d2f
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fc4%252F9bc42d2a981b0dad060fa0b95d601d2f%252Fpa%252FPZ62631_ad71e0019419b5992d11b0b23656df06.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_ad71e0019419b5992d11b0b23656df06.jpg already downloaded
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fc4%252F9bc42d2a981b0dad060fa0b95d601d2f%252Fpa%252FPZ62631_ef8e873970b74f7ad618688aafdd5a34.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_ef8e873970b74f7ad618688aafdd5a34.jpg already downloaded
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fc4%252F9bc42d2a981b0dad060fa0b95d601d2f%252Fpa%252FPZ62631_7568b26d5c5e69474c8773ea930ca200.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_7568b26d5c5e69474c8773ea930ca200.jpg already downloaded
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fc4%252F9bc42d2a981b0dad060fa0b95d601d2f%252Fpa%252FPZ62631_a5b959bdb66f2a7a1b2693053be62b85.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_a5b959bdb66f2a7a1b2693053be62b85.jpg already downloaded
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fc4%252F9bc42d2a981b0dad060fa0b95d601d2f%252Fpa%252FPZ62631_a33847ed0fa92204b11d01a35f93f710.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_a33847ed0fa92204b11d01a35f93f710.jpg already downloaded
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fc4%252F9bc42d2a981b0dad060fa0b95d601d2f%252Fpa%252FPZ62631_d82caec14c5fbf3fdecb683a76c25578.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_d82caec14c5fbf3fdecb683a76c25578.jpg already downloaded
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fc4%252F9bc42d2a981b0dad060fa0b95d601d2f%252Fpa%252FPZ62631_31a8b2e3f2ab612860d125be18775d79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_31a8b2e3f2ab612860d125be18775d79.jpg already downloaded
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fc4%252F9bc42d2a981b0dad060fa0b95d601d2f%252Fpa%252FPZ62631_5542cd04541bd39a9a48e8d0bbd70cf4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_5542cd04541bd39a9a48e8d0bbd70cf4.jpg already downloaded
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fc4%252F9bc42d2a981b0dad060fa0b95d601d2f%252Fpa%252FPZ62631_f0c10caa6813cd22b21f9fc49186126b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_f0c10caa6813cd22b21f9fc49186126b.jpg already downloaded
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fc4%252F9bc42d2a981b0dad060fa0b95d601d2f%252Fpa%252FPZ62631_e978c4231e81cd4aca4b61236d75baa3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_e978c4231e81cd4aca4b61236d75baa3.jpg already downloaded
2026-03-30 10:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d0cab07-ba13-5ba2-8cb4-cd920de26d2f, identifier: PZ62631
2026-03-30 10:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d0cab07-ba13-5ba2-8cb4-cd920de26d2f with identifier: PZ62631
2026-03-30 10:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d0cab07-ba13-5ba2-8cb4-cd920de26d2f with identifier: PZ62631
2026-03-30 10:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d0cab07-ba13-5ba2-8cb4-cd920de26d2f with identifier: PZ62631 to the API
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PZ62631>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:20:12Z',
 'fuel_type': 'petrol',
 'id': '4d0cab07-ba13-5ba2-8cb4-cd920de26d2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ62631',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 101009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_ad71e0019419b5992d11b0b23656df06.jpg',
                'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_ef8e873970b74f7ad618688aafdd5a34.jpg',
                'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_7568b26d5c5e69474c8773ea930ca200.jpg',
                'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_a5b959bdb66f2a7a1b2693053be62b85.jpg',
                'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_a33847ed0fa92204b11d01a35f93f710.jpg',
                'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_d82caec14c5fbf3fdecb683a76c25578.jpg',
                'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_31a8b2e3f2ab612860d125be18775d79.jpg',
                'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_5542cd04541bd39a9a48e8d0bbd70cf4.jpg',
                'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_f0c10caa6813cd22b21f9fc49186126b.jpg',
                'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_e978c4231e81cd4aca4b61236d75baa3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d0cab07-ba13-5ba2-8cb4-cd920de26d2f/4d0cab07-ba13-5ba2-8cb4-cd920de26d2f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2314683,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_ad71e0019419b5992d11b0b23656df06.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d0cab07-ba13-5ba2-8cb4-cd920de26d2f/4d0cab07-ba13-5ba2-8cb4-cd920de26d2f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2365150,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_ef8e873970b74f7ad618688aafdd5a34.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d0cab07-ba13-5ba2-8cb4-cd920de26d2f/4d0cab07-ba13-5ba2-8cb4-cd920de26d2f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2217485,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_7568b26d5c5e69474c8773ea930ca200.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d0cab07-ba13-5ba2-8cb4-cd920de26d2f/4d0cab07-ba13-5ba2-8cb4-cd920de26d2f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2202628,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_a5b959bdb66f2a7a1b2693053be62b85.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d0cab07-ba13-5ba2-8cb4-cd920de26d2f/4d0cab07-ba13-5ba2-8cb4-cd920de26d2f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2238863,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_a33847ed0fa92204b11d01a35f93f710.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d0cab07-ba13-5ba2-8cb4-cd920de26d2f/4d0cab07-ba13-5ba2-8cb4-cd920de26d2f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2224506,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_d82caec14c5fbf3fdecb683a76c25578.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d0cab07-ba13-5ba2-8cb4-cd920de26d2f/4d0cab07-ba13-5ba2-8cb4-cd920de26d2f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2249456,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_31a8b2e3f2ab612860d125be18775d79.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d0cab07-ba13-5ba2-8cb4-cd920de26d2f/4d0cab07-ba13-5ba2-8cb4-cd920de26d2f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2311574,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_5542cd04541bd39a9a48e8d0bbd70cf4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d0cab07-ba13-5ba2-8cb4-cd920de26d2f/4d0cab07-ba13-5ba2-8cb4-cd920de26d2f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2095651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_f0c10caa6813cd22b21f9fc49186126b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d0cab07-ba13-5ba2-8cb4-cd920de26d2f/4d0cab07-ba13-5ba2-8cb4-cd920de26d2f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2545908,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/c4/9bc42d2a981b0dad060fa0b95d601d2f/pa/PZ62631_e978c4231e81cd4aca4b61236d75baa3.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.4 TGDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2020}
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ62631%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [auto1.de] INFO: Saving data for PZ62631: {'created_time': 1774867243.246988, 'last_price_update_time': 1774867243.246999, 'auction_closing_time': 1774970412.0}
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ62631') HTTP/1.1" 204 0
2026-03-30 10:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX61235> (referer: https://www.auto1.com/v1/car-details-view/BX61235/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66cdbdc9-f2db-5f57-8322-a2591df29cf3 with identifier: BX61235
2026-03-30 10:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66cdbdc9-f2db-5f57-8322-a2591df29cf3 with scrape type 1
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66cdbdc9-f2db-5f57-8322-a2591df29cf3
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_4637a0e31af1df4e54f6725fb8d3fc9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_4637a0e31af1df4e54f6725fb8d3fc9c.jpg not downloaded yet
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_265e2e15854039b8cba181017942da7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_265e2e15854039b8cba181017942da7b.jpg not downloaded yet
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_ad61ace1834a7192cc981a0d0f577cb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_ad61ace1834a7192cc981a0d0f577cb8.jpg not downloaded yet
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_8a852f1e5cada3dfac7a9ae0e9462cd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_8a852f1e5cada3dfac7a9ae0e9462cd5.jpg not downloaded yet
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_1ece21e1795151b0f0ca562ff418e098.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_1ece21e1795151b0f0ca562ff418e098.jpg not downloaded yet
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_35cfaab75ac1a6e243ea98af93bd32f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_35cfaab75ac1a6e243ea98af93bd32f1.jpg not downloaded yet
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_f08532d43239218fa75904e2666c6af3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_f08532d43239218fa75904e2666c6af3.jpg not downloaded yet
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_1564e2a1562e3a5788209a512405edf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_1564e2a1562e3a5788209a512405edf6.jpg not downloaded yet
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_a560b420d1af7c4d3468a7ac474af28c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_a560b420d1af7c4d3468a7ac474af28c.jpg not downloaded yet
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_a43cc0f80840a3ecffa5c0743f2f618b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_a43cc0f80840a3ecffa5c0743f2f618b.jpg not downloaded yet
2026-03-30 10:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YF04765> (referer: https://www.auto1.com/v1/car-details-view/YF04765/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM54313/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b59828f-2ffd-5d51-a3a6-8f09f0056b68 with identifier: YF04765
2026-03-30 10:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b59828f-2ffd-5d51-a3a6-8f09f0056b68 with scrape type 1
2026-03-30 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b59828f-2ffd-5d51-a3a6-8f09f0056b68
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F8f%252Fd28f08b753782308d23f0b4c7583b3f9%252Fpa%252FYF04765_f281e0a230caddbeb733b4c7724972cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_f281e0a230caddbeb733b4c7724972cf.jpg already downloaded
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F8f%252Fd28f08b753782308d23f0b4c7583b3f9%252Fpa%252FYF04765_79d44fdd2e1285b885e72ce68f7c6197.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_79d44fdd2e1285b885e72ce68f7c6197.jpg already downloaded
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F8f%252Fd28f08b753782308d23f0b4c7583b3f9%252Fpa%252FYF04765_a89be53e3e69129f64e7934860ab7333.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_a89be53e3e69129f64e7934860ab7333.jpg already downloaded
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F8f%252Fd28f08b753782308d23f0b4c7583b3f9%252Fpa%252FYF04765_407c92b6639b7f5c5e41dc51fbcc9142.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_407c92b6639b7f5c5e41dc51fbcc9142.jpg already downloaded
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F8f%252Fd28f08b753782308d23f0b4c7583b3f9%252Fpa%252FYF04765_f6af6be5f3ba1ab57d3a740251fe6167.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_f6af6be5f3ba1ab57d3a740251fe6167.jpg already downloaded
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F8f%252Fd28f08b753782308d23f0b4c7583b3f9%252Fpa%252FYF04765_22509622322ce9ee8f38b3b9f8289d88.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_22509622322ce9ee8f38b3b9f8289d88.jpg already downloaded
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F8f%252Fd28f08b753782308d23f0b4c7583b3f9%252Fpa%252FYF04765_09c88f46e8043b7e2b55681f5990f23c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_09c88f46e8043b7e2b55681f5990f23c.jpg already downloaded
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F8f%252Fd28f08b753782308d23f0b4c7583b3f9%252Fpa%252FYF04765_e86b200d093b4b4ba155fb967a5a00a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_e86b200d093b4b4ba155fb967a5a00a5.jpg already downloaded
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F8f%252Fd28f08b753782308d23f0b4c7583b3f9%252Fpa%252FYF04765_3231fe9ddc0e79a005b6a29b2c6a6301.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_3231fe9ddc0e79a005b6a29b2c6a6301.jpg already downloaded
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F8f%252Fd28f08b753782308d23f0b4c7583b3f9%252Fpa%252FYF04765_bf76f966d2f2fdc7951ee7be7c0451bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_bf76f966d2f2fdc7951ee7be7c0451bc.jpg already downloaded
2026-03-30 10:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b59828f-2ffd-5d51-a3a6-8f09f0056b68, identifier: YF04765
2026-03-30 10:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b59828f-2ffd-5d51-a3a6-8f09f0056b68 with identifier: YF04765
2026-03-30 10:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b59828f-2ffd-5d51-a3a6-8f09f0056b68 with identifier: YF04765
2026-03-30 10:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b59828f-2ffd-5d51-a3a6-8f09f0056b68 with identifier: YF04765 to the API
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YF04765>
{'auction_title': '',
 'c_o_2_emission_value': 257,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '5.0L',
 'engine_horse_power': 450,
 'expiration_date': '2026-03-31T15:37:09Z',
 'fuel_type': 'petrol',
 'id': '6b59828f-2ffd-5d51-a3a6-8f09f0056b68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF04765',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Ford',
 'model': 'Mustang',
 'odometer': 14604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_f281e0a230caddbeb733b4c7724972cf.jpg',
                'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_79d44fdd2e1285b885e72ce68f7c6197.jpg',
                'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_a89be53e3e69129f64e7934860ab7333.jpg',
                'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_407c92b6639b7f5c5e41dc51fbcc9142.jpg',
                'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_f6af6be5f3ba1ab57d3a740251fe6167.jpg',
                'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_22509622322ce9ee8f38b3b9f8289d88.jpg',
                'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_09c88f46e8043b7e2b55681f5990f23c.jpg',
                'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_e86b200d093b4b4ba155fb967a5a00a5.jpg',
                'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_3231fe9ddc0e79a005b6a29b2c6a6301.jpg',
                'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_bf76f966d2f2fdc7951ee7be7c0451bc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b59828f-2ffd-5d51-a3a6-8f09f0056b68/6b59828f-2ffd-5d51-a3a6-8f09f0056b68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_f281e0a230caddbeb733b4c7724972cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b59828f-2ffd-5d51-a3a6-8f09f0056b68/6b59828f-2ffd-5d51-a3a6-8f09f0056b68_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2885558,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_79d44fdd2e1285b885e72ce68f7c6197.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b59828f-2ffd-5d51-a3a6-8f09f0056b68/6b59828f-2ffd-5d51-a3a6-8f09f0056b68_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2939929,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_a89be53e3e69129f64e7934860ab7333.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b59828f-2ffd-5d51-a3a6-8f09f0056b68/6b59828f-2ffd-5d51-a3a6-8f09f0056b68_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2659871,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_407c92b6639b7f5c5e41dc51fbcc9142.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b59828f-2ffd-5d51-a3a6-8f09f0056b68/6b59828f-2ffd-5d51-a3a6-8f09f0056b68_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_f6af6be5f3ba1ab57d3a740251fe6167.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b59828f-2ffd-5d51-a3a6-8f09f0056b68/6b59828f-2ffd-5d51-a3a6-8f09f0056b68_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2953143,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_22509622322ce9ee8f38b3b9f8289d88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b59828f-2ffd-5d51-a3a6-8f09f0056b68/6b59828f-2ffd-5d51-a3a6-8f09f0056b68_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2885585,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_09c88f46e8043b7e2b55681f5990f23c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b59828f-2ffd-5d51-a3a6-8f09f0056b68/6b59828f-2ffd-5d51-a3a6-8f09f0056b68_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_e86b200d093b4b4ba155fb967a5a00a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b59828f-2ffd-5d51-a3a6-8f09f0056b68/6b59828f-2ffd-5d51-a3a6-8f09f0056b68_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_3231fe9ddc0e79a005b6a29b2c6a6301.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b59828f-2ffd-5d51-a3a6-8f09f0056b68/6b59828f-2ffd-5d51-a3a6-8f09f0056b68_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2890086,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/8f/d28f08b753782308d23f0b4c7583b3f9/pa/YF04765_bf76f966d2f2fdc7951ee7be7c0451bc.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Mustang 5.0 Ti-VCT V8 GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2020}
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF04765%27 HTTP/1.1" 200 None
2026-03-30 10:40:45 [auto1.de] INFO: Saving data for YF04765: {'created_time': 1774867245.109193, 'last_price_update_time': 1774867245.109204, 'auction_closing_time': 1774971429.0}
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF04765') HTTP/1.1" 204 0
2026-03-30 10:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_a560b420d1af7c4d3468a7ac474af28c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_a43cc0f80840a3ecffa5c0743f2f618b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eaac10>
2026-03-30 10:40:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_a560b420d1af7c4d3468a7ac474af28c.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_a560b420d1af7c4d3468a7ac474af28c.jpg saved to cache
2026-03-30 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 66cdbdc9-f2db-5f57-8322-a2591df29cf3
2026-03-30 10:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_f08532d43239218fa75904e2666c6af3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a433d0>
2026-03-30 10:40:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_a43cc0f80840a3ecffa5c0743f2f618b.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_a43cc0f80840a3ecffa5c0743f2f618b.jpg saved to cache
2026-03-30 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66cdbdc9-f2db-5f57-8322-a2591df29cf3
2026-03-30 10:40:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b221d0>
2026-03-30 10:40:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_f08532d43239218fa75904e2666c6af3.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_f08532d43239218fa75904e2666c6af3.jpg saved to cache
2026-03-30 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66cdbdc9-f2db-5f57-8322-a2591df29cf3
2026-03-30 10:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_1564e2a1562e3a5788209a512405edf6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7e910>
2026-03-30 10:40:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_1564e2a1562e3a5788209a512405edf6.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_1564e2a1562e3a5788209a512405edf6.jpg saved to cache
2026-03-30 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66cdbdc9-f2db-5f57-8322-a2591df29cf3
2026-03-30 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_35cfaab75ac1a6e243ea98af93bd32f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS83622/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6be90>
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_35cfaab75ac1a6e243ea98af93bd32f1.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_35cfaab75ac1a6e243ea98af93bd32f1.jpg saved to cache
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66cdbdc9-f2db-5f57-8322-a2591df29cf3
2026-03-30 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_1ece21e1795151b0f0ca562ff418e098.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF89175/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_8a852f1e5cada3dfac7a9ae0e9462cd5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea9490>
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_1ece21e1795151b0f0ca562ff418e098.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_1ece21e1795151b0f0ca562ff418e098.jpg saved to cache
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66cdbdc9-f2db-5f57-8322-a2591df29cf3
2026-03-30 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_265e2e15854039b8cba181017942da7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b2ac10>
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_8a852f1e5cada3dfac7a9ae0e9462cd5.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_8a852f1e5cada3dfac7a9ae0e9462cd5.jpg saved to cache
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66cdbdc9-f2db-5f57-8322-a2591df29cf3
2026-03-30 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_4637a0e31af1df4e54f6725fb8d3fc9c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b36590>
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_265e2e15854039b8cba181017942da7b.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_265e2e15854039b8cba181017942da7b.jpg saved to cache
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66cdbdc9-f2db-5f57-8322-a2591df29cf3
2026-03-30 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_ad61ace1834a7192cc981a0d0f577cb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f44590>
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_4637a0e31af1df4e54f6725fb8d3fc9c.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_4637a0e31af1df4e54f6725fb8d3fc9c.jpg saved to cache
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66cdbdc9-f2db-5f57-8322-a2591df29cf3
2026-03-30 10:40:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f2590>
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F27%252F0f275cd3de5b610b99a956896b2c3653%252Fpa%252FBX61235_ad61ace1834a7192cc981a0d0f577cb8.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_ad61ace1834a7192cc981a0d0f577cb8.jpg saved to cache
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66cdbdc9-f2db-5f57-8322-a2591df29cf3
2026-03-30 10:40:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66cdbdc9-f2db-5f57-8322-a2591df29cf3, skipping ID generation
2026-03-30 10:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66cdbdc9-f2db-5f57-8322-a2591df29cf3 with scrape type 1
2026-03-30 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66cdbdc9-f2db-5f57-8322-a2591df29cf3 sending to next pipeline
2026-03-30 10:40:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66cdbdc9-f2db-5f57-8322-a2591df29cf3, identifier: BX61235
2026-03-30 10:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66cdbdc9-f2db-5f57-8322-a2591df29cf3 with identifier: BX61235
2026-03-30 10:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66cdbdc9-f2db-5f57-8322-a2591df29cf3 with identifier: BX61235
2026-03-30 10:40:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66cdbdc9-f2db-5f57-8322-a2591df29cf3 with identifier: BX61235 to the API
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_ad61ace1834a7192cc981a0d0f577cb8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:35:10Z',
 'fuel_type': 'petrol',
 'id': '66cdbdc9-f2db-5f57-8322-a2591df29cf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX61235',
 'listing': 'auction',
 'location': 'DE, Singen',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 168172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_4637a0e31af1df4e54f6725fb8d3fc9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_265e2e15854039b8cba181017942da7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2830061,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_ad61ace1834a7192cc981a0d0f577cb8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3026686,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_8a852f1e5cada3dfac7a9ae0e9462cd5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_1ece21e1795151b0f0ca562ff418e098.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2995630,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_35cfaab75ac1a6e243ea98af93bd32f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_f08532d43239218fa75904e2666c6af3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2866291,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_1564e2a1562e3a5788209a512405edf6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_a560b420d1af7c4d3468a7ac474af28c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66cdbdc9-f2db-5f57-8322-a2591df29cf3/66cdbdc9-f2db-5f57-8322-a2591df29cf3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/27/0f275cd3de5b610b99a956896b2c3653/pa/BX61235_a43cc0f80840a3ecffa5c0743f2f618b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Essential',
 'transmission': 'manual',
 'trim': 'Stepway Essential',
 'year': 2018}
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX61235%27 HTTP/1.1" 200 None
2026-03-30 10:40:47 [auto1.de] INFO: Saving data for BX61235: {'created_time': 1774867247.675969, 'last_price_update_time': 1774867247.675982, 'auction_closing_time': 1774971310.0}
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX61235') HTTP/1.1" 204 0
2026-03-30 10:40:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_727e9e9f3baaeaa0a53431ff1dc8a05e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5034ad0>
2026-03-30 10:40:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4aa40bf-899b-5c97-8268-7e6c47ec4446/b4aa40bf-899b-5c97-8268-7e6c47ec4446_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F5a%252F955aa5d66cf91292044eb08424302b53%252Fpa%252FXT31239_727e9e9f3baaeaa0a53431ff1dc8a05e.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_727e9e9f3baaeaa0a53431ff1dc8a05e.jpg saved to cache
2026-03-30 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4aa40bf-899b-5c97-8268-7e6c47ec4446
2026-03-30 10:40:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT28191/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_3aab7f453036b04be97297206a9b60b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:40:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:40:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0bfd0>
2026-03-30 10:40:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:40:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4aa40bf-899b-5c97-8268-7e6c47ec4446/b4aa40bf-899b-5c97-8268-7e6c47ec4446_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F5a%252F955aa5d66cf91292044eb08424302b53%252Fpa%252FXT31239_3aab7f453036b04be97297206a9b60b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_3aab7f453036b04be97297206a9b60b1.jpg saved to cache
2026-03-30 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4aa40bf-899b-5c97-8268-7e6c47ec4446
2026-03-30 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP66204/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BA43176/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA59022> (referer: https://www.auto1.com/v1/car-details-view/HA59022/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2287c6b4-71bf-5611-a0fd-035cf53d91d7 with identifier: HA59022
2026-03-30 10:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2287c6b4-71bf-5611-a0fd-035cf53d91d7 with scrape type 1
2026-03-30 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2287c6b4-71bf-5611-a0fd-035cf53d91d7
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa0%252Fd8a0b86c71aadbce963a3d7e6275f1ca%252Fpa%252FHA59022_e7f23476b08f58e5d140ceedfb967d12.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_e7f23476b08f58e5d140ceedfb967d12.jpg already downloaded
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa0%252Fd8a0b86c71aadbce963a3d7e6275f1ca%252Fpa%252FHA59022_b6bb6e1184eff22d281e6f635c197dad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_b6bb6e1184eff22d281e6f635c197dad.jpg already downloaded
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa0%252Fd8a0b86c71aadbce963a3d7e6275f1ca%252Fpa%252FHA59022_dae67cc360ca62321d8449d5e3daf225.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_dae67cc360ca62321d8449d5e3daf225.jpg already downloaded
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa0%252Fd8a0b86c71aadbce963a3d7e6275f1ca%252Fpa%252FHA59022_1ef107c564e7178043cb71001fcc31aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_1ef107c564e7178043cb71001fcc31aa.jpg already downloaded
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa0%252Fd8a0b86c71aadbce963a3d7e6275f1ca%252Fpa%252FHA59022_c2de4f22051af128313647a09262db49.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_c2de4f22051af128313647a09262db49.jpg already downloaded
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa0%252Fd8a0b86c71aadbce963a3d7e6275f1ca%252Fpa%252FHA59022_9f63657e45106fd6884bada5eb98dfc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_9f63657e45106fd6884bada5eb98dfc3.jpg already downloaded
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa0%252Fd8a0b86c71aadbce963a3d7e6275f1ca%252Fpa%252FHA59022_f8fb6e588021fe5434ae014a000e996e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_f8fb6e588021fe5434ae014a000e996e.jpg already downloaded
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa0%252Fd8a0b86c71aadbce963a3d7e6275f1ca%252Fpa%252FHA59022_2c1cb4fc5eb75c6c83b5e6cce2923061.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_2c1cb4fc5eb75c6c83b5e6cce2923061.jpg already downloaded
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa0%252Fd8a0b86c71aadbce963a3d7e6275f1ca%252Fpa%252FHA59022_805b7ec7ed8dfa38da8f7de47a8929f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_805b7ec7ed8dfa38da8f7de47a8929f3.jpg already downloaded
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa0%252Fd8a0b86c71aadbce963a3d7e6275f1ca%252Fpa%252FHA59022_98a345e619a80072b6507b717e545052.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_98a345e619a80072b6507b717e545052.jpg already downloaded
2026-03-30 10:40:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2287c6b4-71bf-5611-a0fd-035cf53d91d7, identifier: HA59022
2026-03-30 10:40:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2287c6b4-71bf-5611-a0fd-035cf53d91d7 with identifier: HA59022
2026-03-30 10:40:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2287c6b4-71bf-5611-a0fd-035cf53d91d7 with identifier: HA59022
2026-03-30 10:40:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2287c6b4-71bf-5611-a0fd-035cf53d91d7 with identifier: HA59022 to the API
2026-03-30 10:40:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HA59022>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:19:10Z',
 'fuel_type': 'petrol',
 'id': '2287c6b4-71bf-5611-a0fd-035cf53d91d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA59022',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 45649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_e7f23476b08f58e5d140ceedfb967d12.jpg',
                'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_b6bb6e1184eff22d281e6f635c197dad.jpg',
                'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_dae67cc360ca62321d8449d5e3daf225.jpg',
                'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_1ef107c564e7178043cb71001fcc31aa.jpg',
                'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_c2de4f22051af128313647a09262db49.jpg',
                'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_9f63657e45106fd6884bada5eb98dfc3.jpg',
                'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_f8fb6e588021fe5434ae014a000e996e.jpg',
                'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_2c1cb4fc5eb75c6c83b5e6cce2923061.jpg',
                'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_805b7ec7ed8dfa38da8f7de47a8929f3.jpg',
                'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_98a345e619a80072b6507b717e545052.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2287c6b4-71bf-5611-a0fd-035cf53d91d7/2287c6b4-71bf-5611-a0fd-035cf53d91d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_e7f23476b08f58e5d140ceedfb967d12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2287c6b4-71bf-5611-a0fd-035cf53d91d7/2287c6b4-71bf-5611-a0fd-035cf53d91d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_b6bb6e1184eff22d281e6f635c197dad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2287c6b4-71bf-5611-a0fd-035cf53d91d7/2287c6b4-71bf-5611-a0fd-035cf53d91d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_dae67cc360ca62321d8449d5e3daf225.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2287c6b4-71bf-5611-a0fd-035cf53d91d7/2287c6b4-71bf-5611-a0fd-035cf53d91d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_1ef107c564e7178043cb71001fcc31aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2287c6b4-71bf-5611-a0fd-035cf53d91d7/2287c6b4-71bf-5611-a0fd-035cf53d91d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_c2de4f22051af128313647a09262db49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2287c6b4-71bf-5611-a0fd-035cf53d91d7/2287c6b4-71bf-5611-a0fd-035cf53d91d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_9f63657e45106fd6884bada5eb98dfc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2287c6b4-71bf-5611-a0fd-035cf53d91d7/2287c6b4-71bf-5611-a0fd-035cf53d91d7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_f8fb6e588021fe5434ae014a000e996e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2287c6b4-71bf-5611-a0fd-035cf53d91d7/2287c6b4-71bf-5611-a0fd-035cf53d91d7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_2c1cb4fc5eb75c6c83b5e6cce2923061.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2287c6b4-71bf-5611-a0fd-035cf53d91d7/2287c6b4-71bf-5611-a0fd-035cf53d91d7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_805b7ec7ed8dfa38da8f7de47a8929f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2287c6b4-71bf-5611-a0fd-035cf53d91d7/2287c6b4-71bf-5611-a0fd-035cf53d91d7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a0/d8a0b86c71aadbce963a3d7e6275f1ca/pa/HA59022_98a345e619a80072b6507b717e545052.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2023}
2026-03-30 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA59022%27 HTTP/1.1" 200 None
2026-03-30 10:40:53 [auto1.de] INFO: Saving data for HA59022: {'created_time': 1774867253.189239, 'last_price_update_time': 1774867253.189253, 'auction_closing_time': 1774970350.0}
2026-03-30 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA59022') HTTP/1.1" 204 0
2026-03-30 10:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UU86547/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB72682> (referer: https://www.auto1.com/v1/car-details-view/YB72682/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:40:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c8ef02-81c4-5509-9573-d2be94b888b6 with identifier: YB72682
2026-03-30 10:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c8ef02-81c4-5509-9573-d2be94b888b6 with scrape type 1
2026-03-30 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36c8ef02-81c4-5509-9573-d2be94b888b6
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_201628e37bca89adf571aee2e22418a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_201628e37bca89adf571aee2e22418a2.jpg not downloaded yet
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_cdb5f57637e56557ddd4b6d3235c7135.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_cdb5f57637e56557ddd4b6d3235c7135.jpg not downloaded yet
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_ddf44d36016cdef084a54c40b616ec2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_ddf44d36016cdef084a54c40b616ec2c.jpg not downloaded yet
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_1dcbc1b1a8d0fb5b3d8a45fe7657dd4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_1dcbc1b1a8d0fb5b3d8a45fe7657dd4b.jpg not downloaded yet
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_175d906fb915fabaeff154406555562b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_175d906fb915fabaeff154406555562b.jpg not downloaded yet
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_0d342b929e6b908007248fc9a706e7f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_0d342b929e6b908007248fc9a706e7f1.jpg not downloaded yet
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_1ac2ac58fbceee89be5f71490642ff2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_1ac2ac58fbceee89be5f71490642ff2b.jpg not downloaded yet
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_7549a8ec04c45487236a06a1ee89960e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_7549a8ec04c45487236a06a1ee89960e.jpg not downloaded yet
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_e960cecf51137bfd414e833785f8abec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_e960cecf51137bfd414e833785f8abec.jpg not downloaded yet
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_0cf1351106fb2d104c1e8e118cda31a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_0cf1351106fb2d104c1e8e118cda31a8.jpg not downloaded yet
2026-03-30 10:41:03 [scrapy.extensions.logstats] INFO: Crawled 279 pages (at 47 pages/min), scraped 216 items (at 32 items/min)
2026-03-30 10:41:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-30 10:41:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM54313> (referer: https://www.auto1.com/v1/car-details-view/FM54313/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e776769-c390-5a94-9551-0430cc09036e with identifier: FM54313
2026-03-30 10:41:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e776769-c390-5a94-9551-0430cc09036e with scrape type 1
2026-03-30 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e776769-c390-5a94-9551-0430cc09036e
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_1c112a5f7057c1dc3a425867c4a0d6ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_1c112a5f7057c1dc3a425867c4a0d6ae.jpg not downloaded yet
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_affbef531f7a563bb9ca4c5b217a2c84.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_affbef531f7a563bb9ca4c5b217a2c84.jpg not downloaded yet
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_f3ac56d9c1702e0b1a9d7fd930cea912.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_f3ac56d9c1702e0b1a9d7fd930cea912.jpg not downloaded yet
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_24f8e8fb2f897cf587d1519e5abef26f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_24f8e8fb2f897cf587d1519e5abef26f.jpg not downloaded yet
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_cd6e18c0e71590372f73e3d6744b9a66.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_cd6e18c0e71590372f73e3d6744b9a66.jpg not downloaded yet
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_c9cdc89ffa00cdc1597f7805de6708b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_c9cdc89ffa00cdc1597f7805de6708b1.jpg not downloaded yet
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_22f5190a3bcb09e693e50239aa3fccf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_22f5190a3bcb09e693e50239aa3fccf3.jpg not downloaded yet
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_4886eeab915920669be4db77670fed71.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_4886eeab915920669be4db77670fed71.jpg not downloaded yet
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_7c673fa0723debb0cefc009521283a5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_7c673fa0723debb0cefc009521283a5e.jpg not downloaded yet
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_e966baaff5ad96bff5773ecab57e854e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_e966baaff5ad96bff5773ecab57e854e.jpg not downloaded yet
2026-03-30 10:41:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_0cf1351106fb2d104c1e8e118cda31a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7e510>
2026-03-30 10:41:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_0cf1351106fb2d104c1e8e118cda31a8.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_0cf1351106fb2d104c1e8e118cda31a8.jpg saved to cache
2026-03-30 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36c8ef02-81c4-5509-9573-d2be94b888b6
2026-03-30 10:41:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_e966baaff5ad96bff5773ecab57e854e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e79350>
2026-03-30 10:41:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_e966baaff5ad96bff5773ecab57e854e.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_e966baaff5ad96bff5773ecab57e854e.jpg saved to cache
2026-03-30 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e776769-c390-5a94-9551-0430cc09036e
2026-03-30 10:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_7c673fa0723debb0cefc009521283a5e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f45a50>
2026-03-30 10:41:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_7c673fa0723debb0cefc009521283a5e.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_7c673fa0723debb0cefc009521283a5e.jpg saved to cache
2026-03-30 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e776769-c390-5a94-9551-0430cc09036e
2026-03-30 10:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_4886eeab915920669be4db77670fed71.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6af90>
2026-03-30 10:41:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_4886eeab915920669be4db77670fed71.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_4886eeab915920669be4db77670fed71.jpg saved to cache
2026-03-30 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e776769-c390-5a94-9551-0430cc09036e
2026-03-30 10:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_22f5190a3bcb09e693e50239aa3fccf3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb0210>
2026-03-30 10:41:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_22f5190a3bcb09e693e50239aa3fccf3.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_22f5190a3bcb09e693e50239aa3fccf3.jpg saved to cache
2026-03-30 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e776769-c390-5a94-9551-0430cc09036e
2026-03-30 10:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_c9cdc89ffa00cdc1597f7805de6708b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee4990>
2026-03-30 10:41:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_c9cdc89ffa00cdc1597f7805de6708b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_c9cdc89ffa00cdc1597f7805de6708b1.jpg saved to cache
2026-03-30 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e776769-c390-5a94-9551-0430cc09036e
2026-03-30 10:41:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_cd6e18c0e71590372f73e3d6744b9a66.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59a8950>
2026-03-30 10:41:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_cd6e18c0e71590372f73e3d6744b9a66.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_cd6e18c0e71590372f73e3d6744b9a66.jpg saved to cache
2026-03-30 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e776769-c390-5a94-9551-0430cc09036e
2026-03-30 10:41:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_24f8e8fb2f897cf587d1519e5abef26f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a669d0>
2026-03-30 10:41:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_24f8e8fb2f897cf587d1519e5abef26f.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_24f8e8fb2f897cf587d1519e5abef26f.jpg saved to cache
2026-03-30 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e776769-c390-5a94-9551-0430cc09036e
2026-03-30 10:41:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_f3ac56d9c1702e0b1a9d7fd930cea912.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f3250>
2026-03-30 10:41:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_f3ac56d9c1702e0b1a9d7fd930cea912.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_f3ac56d9c1702e0b1a9d7fd930cea912.jpg saved to cache
2026-03-30 10:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e776769-c390-5a94-9551-0430cc09036e
2026-03-30 10:41:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_affbef531f7a563bb9ca4c5b217a2c84.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6b890>
2026-03-30 10:41:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_affbef531f7a563bb9ca4c5b217a2c84.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_affbef531f7a563bb9ca4c5b217a2c84.jpg saved to cache
2026-03-30 10:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e776769-c390-5a94-9551-0430cc09036e
2026-03-30 10:41:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_1c112a5f7057c1dc3a425867c4a0d6ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508e110>
2026-03-30 10:41:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f834cc621673aee13fed4a0803a5f%252Fpa%252FFM54313_1c112a5f7057c1dc3a425867c4a0d6ae.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_1c112a5f7057c1dc3a425867c4a0d6ae.jpg saved to cache
2026-03-30 10:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e776769-c390-5a94-9551-0430cc09036e
2026-03-30 10:41:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e776769-c390-5a94-9551-0430cc09036e, skipping ID generation
2026-03-30 10:41:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e776769-c390-5a94-9551-0430cc09036e with scrape type 1
2026-03-30 10:41:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e776769-c390-5a94-9551-0430cc09036e sending to next pipeline
2026-03-30 10:41:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e776769-c390-5a94-9551-0430cc09036e, identifier: FM54313
2026-03-30 10:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e776769-c390-5a94-9551-0430cc09036e with identifier: FM54313
2026-03-30 10:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e776769-c390-5a94-9551-0430cc09036e with identifier: FM54313
2026-03-30 10:41:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e776769-c390-5a94-9551-0430cc09036e with identifier: FM54313 to the API
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_1c112a5f7057c1dc3a425867c4a0d6ae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:19:30Z',
 'fuel_type': 'petrol',
 'id': '8e776769-c390-5a94-9551-0430cc09036e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM54313',
 'listing': 'auction',
 'location': 'DE, Dornach',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 147467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2849881,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_1c112a5f7057c1dc3a425867c4a0d6ae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_affbef531f7a563bb9ca4c5b217a2c84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2826913,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_f3ac56d9c1702e0b1a9d7fd930cea912.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2851145,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_24f8e8fb2f897cf587d1519e5abef26f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_cd6e18c0e71590372f73e3d6744b9a66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2977123,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_c9cdc89ffa00cdc1597f7805de6708b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_22f5190a3bcb09e693e50239aa3fccf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_4886eeab915920669be4db77670fed71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2939444,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_7c673fa0723debb0cefc009521283a5e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e776769-c390-5a94-9551-0430cc09036e/8e776769-c390-5a94-9551-0430cc09036e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f834cc621673aee13fed4a0803a5f/pa/FM54313_e966baaff5ad96bff5773ecab57e854e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM54313%27 HTTP/1.1" 200 None
2026-03-30 10:41:30 [auto1.de] INFO: Saving data for FM54313: {'created_time': 1774867290.966022, 'last_price_update_time': 1774867290.966032, 'auction_closing_time': 1774970370.0}
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM54313') HTTP/1.1" 204 0
2026-03-30 10:41:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_e960cecf51137bfd414e833785f8abec.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b2a8d0>
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_e960cecf51137bfd414e833785f8abec.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_e960cecf51137bfd414e833785f8abec.jpg saved to cache
2026-03-30 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36c8ef02-81c4-5509-9573-d2be94b888b6
2026-03-30 10:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_7549a8ec04c45487236a06a1ee89960e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f46510>
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_7549a8ec04c45487236a06a1ee89960e.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_7549a8ec04c45487236a06a1ee89960e.jpg saved to cache
2026-03-30 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36c8ef02-81c4-5509-9573-d2be94b888b6
2026-03-30 10:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_1ac2ac58fbceee89be5f71490642ff2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59a84d0>
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_1ac2ac58fbceee89be5f71490642ff2b.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_1ac2ac58fbceee89be5f71490642ff2b.jpg saved to cache
2026-03-30 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36c8ef02-81c4-5509-9573-d2be94b888b6
2026-03-30 10:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_0d342b929e6b908007248fc9a706e7f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6a190>
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_0d342b929e6b908007248fc9a706e7f1.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_0d342b929e6b908007248fc9a706e7f1.jpg saved to cache
2026-03-30 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36c8ef02-81c4-5509-9573-d2be94b888b6
2026-03-30 10:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_175d906fb915fabaeff154406555562b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb3350>
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_175d906fb915fabaeff154406555562b.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_175d906fb915fabaeff154406555562b.jpg saved to cache
2026-03-30 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36c8ef02-81c4-5509-9573-d2be94b888b6
2026-03-30 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_1dcbc1b1a8d0fb5b3d8a45fe7657dd4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb6a50>
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_1dcbc1b1a8d0fb5b3d8a45fe7657dd4b.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_1dcbc1b1a8d0fb5b3d8a45fe7657dd4b.jpg saved to cache
2026-03-30 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36c8ef02-81c4-5509-9573-d2be94b888b6
2026-03-30 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_ddf44d36016cdef084a54c40b616ec2c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb0a90>
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_ddf44d36016cdef084a54c40b616ec2c.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_ddf44d36016cdef084a54c40b616ec2c.jpg saved to cache
2026-03-30 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36c8ef02-81c4-5509-9573-d2be94b888b6
2026-03-30 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_cdb5f57637e56557ddd4b6d3235c7135.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_201628e37bca89adf571aee2e22418a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f11d90>
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_cdb5f57637e56557ddd4b6d3235c7135.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_cdb5f57637e56557ddd4b6d3235c7135.jpg saved to cache
2026-03-30 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36c8ef02-81c4-5509-9573-d2be94b888b6
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef789d710>
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F10%252F0210bf9d019f155efb0888eee2b198db%252Fpa%252FYB72682_201628e37bca89adf571aee2e22418a2.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_201628e37bca89adf571aee2e22418a2.jpg saved to cache
2026-03-30 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36c8ef02-81c4-5509-9573-d2be94b888b6
2026-03-30 10:41:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36c8ef02-81c4-5509-9573-d2be94b888b6, skipping ID generation
2026-03-30 10:41:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c8ef02-81c4-5509-9573-d2be94b888b6 with scrape type 1
2026-03-30 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36c8ef02-81c4-5509-9573-d2be94b888b6 sending to next pipeline
2026-03-30 10:41:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36c8ef02-81c4-5509-9573-d2be94b888b6, identifier: YB72682
2026-03-30 10:41:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36c8ef02-81c4-5509-9573-d2be94b888b6 with identifier: YB72682
2026-03-30 10:41:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36c8ef02-81c4-5509-9573-d2be94b888b6 with identifier: YB72682
2026-03-30 10:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36c8ef02-81c4-5509-9573-d2be94b888b6 with identifier: YB72682 to the API
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_201628e37bca89adf571aee2e22418a2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:17:11Z',
 'fuel_type': 'petrol',
 'id': '36c8ef02-81c4-5509-9573-d2be94b888b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB72682',
 'listing': 'auction',
 'location': 'DE, Hilden',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 124665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_201628e37bca89adf571aee2e22418a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2441073,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_cdb5f57637e56557ddd4b6d3235c7135.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_ddf44d36016cdef084a54c40b616ec2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2154361,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_1dcbc1b1a8d0fb5b3d8a45fe7657dd4b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2439887,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_175d906fb915fabaeff154406555562b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_0d342b929e6b908007248fc9a706e7f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2229929,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_1ac2ac58fbceee89be5f71490642ff2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_7549a8ec04c45487236a06a1ee89960e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_e960cecf51137bfd414e833785f8abec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c8ef02-81c4-5509-9573-d2be94b888b6/36c8ef02-81c4-5509-9573-d2be94b888b6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2336875,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/10/0210bf9d019f155efb0888eee2b198db/pa/YB72682_0cf1351106fb2d104c1e8e118cda31a8.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Take up!',
 'transmission': 'manual',
 'trim': 'Take',
 'year': 2015}
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB72682%27 HTTP/1.1" 200 None
2026-03-30 10:41:33 [auto1.de] INFO: Saving data for YB72682: {'created_time': 1774867293.521009, 'last_price_update_time': 1774867293.521019, 'auction_closing_time': 1774970231.0}
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB72682') HTTP/1.1" 204 0
2026-03-30 10:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_bdcf0438ac97e8ba267cbc4371c6f14d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_467f21066a8360dd4f39eac4ffa771d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508cc90>
2026-03-30 10:41:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4aa40bf-899b-5c97-8268-7e6c47ec4446/b4aa40bf-899b-5c97-8268-7e6c47ec4446_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F5a%252F955aa5d66cf91292044eb08424302b53%252Fpa%252FXT31239_bdcf0438ac97e8ba267cbc4371c6f14d.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_bdcf0438ac97e8ba267cbc4371c6f14d.jpg saved to cache
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4aa40bf-899b-5c97-8268-7e6c47ec4446
2026-03-30 10:41:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7e250>
2026-03-30 10:41:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4aa40bf-899b-5c97-8268-7e6c47ec4446/b4aa40bf-899b-5c97-8268-7e6c47ec4446_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F5a%252F955aa5d66cf91292044eb08424302b53%252Fpa%252FXT31239_467f21066a8360dd4f39eac4ffa771d8.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_467f21066a8360dd4f39eac4ffa771d8.jpg saved to cache
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4aa40bf-899b-5c97-8268-7e6c47ec4446
2026-03-30 10:41:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4aa40bf-899b-5c97-8268-7e6c47ec4446, skipping ID generation
2026-03-30 10:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4aa40bf-899b-5c97-8268-7e6c47ec4446 with scrape type 1
2026-03-30 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4aa40bf-899b-5c97-8268-7e6c47ec4446 sending to next pipeline
2026-03-30 10:41:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4aa40bf-899b-5c97-8268-7e6c47ec4446, identifier: XT31239
2026-03-30 10:41:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4aa40bf-899b-5c97-8268-7e6c47ec4446 with identifier: XT31239
2026-03-30 10:41:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4aa40bf-899b-5c97-8268-7e6c47ec4446 with identifier: XT31239
2026-03-30 10:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4aa40bf-899b-5c97-8268-7e6c47ec4446 with identifier: XT31239 to the API
2026-03-30 10:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_467f21066a8360dd4f39eac4ffa771d8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:00:40Z',
 'fuel_type': 'petrol',
 'id': 'b4aa40bf-899b-5c97-8268-7e6c47ec4446',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT31239',
 'listing': 'auction',
 'location': 'DE, Kaarst',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 142657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4aa40bf-899b-5c97-8268-7e6c47ec4446/b4aa40bf-899b-5c97-8268-7e6c47ec4446_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_467f21066a8360dd4f39eac4ffa771d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4aa40bf-899b-5c97-8268-7e6c47ec4446/b4aa40bf-899b-5c97-8268-7e6c47ec4446_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_bdcf0438ac97e8ba267cbc4371c6f14d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4aa40bf-899b-5c97-8268-7e6c47ec4446/b4aa40bf-899b-5c97-8268-7e6c47ec4446_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_b44a8b992b3e7f6ced5ec7f9ad1f2578.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4aa40bf-899b-5c97-8268-7e6c47ec4446/b4aa40bf-899b-5c97-8268-7e6c47ec4446_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_3aab7f453036b04be97297206a9b60b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4aa40bf-899b-5c97-8268-7e6c47ec4446/b4aa40bf-899b-5c97-8268-7e6c47ec4446_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/5a/955aa5d66cf91292044eb08424302b53/pa/XT31239_727e9e9f3baaeaa0a53431ff1dc8a05e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-13',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2010}
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT31239%27 HTTP/1.1" 200 None
2026-03-30 10:41:34 [auto1.de] INFO: Saving data for XT31239: {'created_time': 1774867294.200875, 'last_price_update_time': 1774867294.200885, 'auction_closing_time': 1774969240.0}
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT31239') HTTP/1.1" 204 0
2026-03-30 10:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF53328/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ56368/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS83622> (referer: https://www.auto1.com/v1/car-details-view/VS83622/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2fb9d2d-052f-5b42-b035-f917a1557bd2 with identifier: VS83622
2026-03-30 10:41:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2fb9d2d-052f-5b42-b035-f917a1557bd2 with scrape type 1
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2fb9d2d-052f-5b42-b035-f917a1557bd2
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_c0bf7da6cb4126e41c8846f5dc132d31.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_c0bf7da6cb4126e41c8846f5dc132d31.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_536012a5fe2421bdfb188e05c118dfbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_536012a5fe2421bdfb188e05c118dfbc.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_abf6df8b519509dc16379046c6d1a000.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_abf6df8b519509dc16379046c6d1a000.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_a1f49ec7bf01cba1eaccdb83f6994bd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_a1f49ec7bf01cba1eaccdb83f6994bd1.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_8bcd68ba27e9e621c37e2aa137c29330.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_8bcd68ba27e9e621c37e2aa137c29330.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_7a8e5b42cd8d11c1119ba858c4ce7477.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_7a8e5b42cd8d11c1119ba858c4ce7477.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_66d2881bdfbc518985a2d2fbfe1954b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_66d2881bdfbc518985a2d2fbfe1954b4.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_890d9068ac4d9797b9850f1ed9d15082.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_890d9068ac4d9797b9850f1ed9d15082.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_34102af731489eec6f5ebf96f7aadff4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_34102af731489eec6f5ebf96f7aadff4.jpg not downloaded yet
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_00fbed1dd9ec96e6137196f3332b4d0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_00fbed1dd9ec96e6137196f3332b4d0c.jpg not downloaded yet
2026-03-30 10:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF89175> (referer: https://www.auto1.com/v1/car-details-view/LF89175/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29f60b3e-4292-533b-9f62-15b2a9293d5c with identifier: LF89175
2026-03-30 10:41:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29f60b3e-4292-533b-9f62-15b2a9293d5c with scrape type 1
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 29f60b3e-4292-533b-9f62-15b2a9293d5c
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e2ea207acc4cee463f4f53aa67baa%252Fpa%252FLF89175_401a4cd13586f529abaf21ebfe6b7e52.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_401a4cd13586f529abaf21ebfe6b7e52.jpg not downloaded yet
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e2ea207acc4cee463f4f53aa67baa%252Fpa%252FLF89175_dfc1b68744432b1c5b6d5bc4d6faf745.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_dfc1b68744432b1c5b6d5bc4d6faf745.jpg not downloaded yet
2026-03-30 10:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_00fbed1dd9ec96e6137196f3332b4d0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e2ea207acc4cee463f4f53aa67baa%252Fpa%252FLF89175_9b898166e949270653d6a4ad55ad26a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_9b898166e949270653d6a4ad55ad26a9.jpg not downloaded yet
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e2ea207acc4cee463f4f53aa67baa%252Fpa%252FLF89175_e3902900e744a3224b0a404e80add83b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_e3902900e744a3224b0a404e80add83b.jpg not downloaded yet
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e2ea207acc4cee463f4f53aa67baa%252Fpa%252FLF89175_0a565e9bbec4c30ac0f50d132c01a7f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_0a565e9bbec4c30ac0f50d132c01a7f7.jpg not downloaded yet
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb3350>
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_00fbed1dd9ec96e6137196f3332b4d0c.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_00fbed1dd9ec96e6137196f3332b4d0c.jpg saved to cache
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2fb9d2d-052f-5b42-b035-f917a1557bd2
2026-03-30 10:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_dfc1b68744432b1c5b6d5bc4d6faf745.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_0a565e9bbec4c30ac0f50d132c01a7f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508c4d0>
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f60b3e-4292-533b-9f62-15b2a9293d5c/29f60b3e-4292-533b-9f62-15b2a9293d5c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e2ea207acc4cee463f4f53aa67baa%252Fpa%252FLF89175_dfc1b68744432b1c5b6d5bc4d6faf745.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_dfc1b68744432b1c5b6d5bc4d6faf745.jpg saved to cache
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29f60b3e-4292-533b-9f62-15b2a9293d5c
2026-03-30 10:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_e3902900e744a3224b0a404e80add83b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b2aa10>
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f60b3e-4292-533b-9f62-15b2a9293d5c/29f60b3e-4292-533b-9f62-15b2a9293d5c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e2ea207acc4cee463f4f53aa67baa%252Fpa%252FLF89175_0a565e9bbec4c30ac0f50d132c01a7f7.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_0a565e9bbec4c30ac0f50d132c01a7f7.jpg saved to cache
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29f60b3e-4292-533b-9f62-15b2a9293d5c
2026-03-30 10:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_9b898166e949270653d6a4ad55ad26a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea8790>
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f60b3e-4292-533b-9f62-15b2a9293d5c/29f60b3e-4292-533b-9f62-15b2a9293d5c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e2ea207acc4cee463f4f53aa67baa%252Fpa%252FLF89175_e3902900e744a3224b0a404e80add83b.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_e3902900e744a3224b0a404e80add83b.jpg saved to cache
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29f60b3e-4292-533b-9f62-15b2a9293d5c
2026-03-30 10:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_401a4cd13586f529abaf21ebfe6b7e52.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e49bd0>
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f60b3e-4292-533b-9f62-15b2a9293d5c/29f60b3e-4292-533b-9f62-15b2a9293d5c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e2ea207acc4cee463f4f53aa67baa%252Fpa%252FLF89175_9b898166e949270653d6a4ad55ad26a9.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_9b898166e949270653d6a4ad55ad26a9.jpg saved to cache
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29f60b3e-4292-533b-9f62-15b2a9293d5c
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7f5d0>
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29f60b3e-4292-533b-9f62-15b2a9293d5c/29f60b3e-4292-533b-9f62-15b2a9293d5c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e2ea207acc4cee463f4f53aa67baa%252Fpa%252FLF89175_401a4cd13586f529abaf21ebfe6b7e52.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_401a4cd13586f529abaf21ebfe6b7e52.jpg saved to cache
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29f60b3e-4292-533b-9f62-15b2a9293d5c
2026-03-30 10:41:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29f60b3e-4292-533b-9f62-15b2a9293d5c, skipping ID generation
2026-03-30 10:41:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29f60b3e-4292-533b-9f62-15b2a9293d5c with scrape type 1
2026-03-30 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29f60b3e-4292-533b-9f62-15b2a9293d5c sending to next pipeline
2026-03-30 10:41:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29f60b3e-4292-533b-9f62-15b2a9293d5c, identifier: LF89175
2026-03-30 10:41:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29f60b3e-4292-533b-9f62-15b2a9293d5c with identifier: LF89175
2026-03-30 10:41:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29f60b3e-4292-533b-9f62-15b2a9293d5c with identifier: LF89175
2026-03-30 10:41:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29f60b3e-4292-533b-9f62-15b2a9293d5c with identifier: LF89175 to the API
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_401a4cd13586f529abaf21ebfe6b7e52.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:44:57Z',
 'fuel_type': 'petrol',
 'id': '29f60b3e-4292-533b-9f62-15b2a9293d5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF89175',
 'listing': 'auction',
 'location': 'DE, Bayreuth',
 'make': 'Mazda',
 'model': '3',
 'odometer': 218632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29f60b3e-4292-533b-9f62-15b2a9293d5c/29f60b3e-4292-533b-9f62-15b2a9293d5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_401a4cd13586f529abaf21ebfe6b7e52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29f60b3e-4292-533b-9f62-15b2a9293d5c/29f60b3e-4292-533b-9f62-15b2a9293d5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_dfc1b68744432b1c5b6d5bc4d6faf745.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29f60b3e-4292-533b-9f62-15b2a9293d5c/29f60b3e-4292-533b-9f62-15b2a9293d5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_9b898166e949270653d6a4ad55ad26a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29f60b3e-4292-533b-9f62-15b2a9293d5c/29f60b3e-4292-533b-9f62-15b2a9293d5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_e3902900e744a3224b0a404e80add83b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29f60b3e-4292-533b-9f62-15b2a9293d5c/29f60b3e-4292-533b-9f62-15b2a9293d5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/0e/470e2ea207acc4cee463f4f53aa67baa/pa/LF89175_0a565e9bbec4c30ac0f50d132c01a7f7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 3 1.6 90th Anniversary',
 'transmission': 'manual',
 'trim': '90th Anniversary',
 'year': 2010}
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF89175%27 HTTP/1.1" 200 None
2026-03-30 10:41:52 [auto1.de] INFO: Saving data for LF89175: {'created_time': 1774867312.486674, 'last_price_update_time': 1774867312.486684, 'auction_closing_time': 1774971897.0}
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF89175') HTTP/1.1" 204 0
2026-03-30 10:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_34102af731489eec6f5ebf96f7aadff4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_890d9068ac4d9797b9850f1ed9d15082.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f44950>
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_34102af731489eec6f5ebf96f7aadff4.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_34102af731489eec6f5ebf96f7aadff4.jpg saved to cache
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2fb9d2d-052f-5b42-b035-f917a1557bd2
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb2790>
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_890d9068ac4d9797b9850f1ed9d15082.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_890d9068ac4d9797b9850f1ed9d15082.jpg saved to cache
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2fb9d2d-052f-5b42-b035-f917a1557bd2
2026-03-30 10:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_66d2881bdfbc518985a2d2fbfe1954b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_7a8e5b42cd8d11c1119ba858c4ce7477.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7c050>
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_66d2881bdfbc518985a2d2fbfe1954b4.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_66d2881bdfbc518985a2d2fbfe1954b4.jpg saved to cache
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2fb9d2d-052f-5b42-b035-f917a1557bd2
2026-03-30 10:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_8bcd68ba27e9e621c37e2aa137c29330.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea8e90>
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_7a8e5b42cd8d11c1119ba858c4ce7477.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_7a8e5b42cd8d11c1119ba858c4ce7477.jpg saved to cache
2026-03-30 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2fb9d2d-052f-5b42-b035-f917a1557bd2
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50349d0>
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_8bcd68ba27e9e621c37e2aa137c29330.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_8bcd68ba27e9e621c37e2aa137c29330.jpg saved to cache
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2fb9d2d-052f-5b42-b035-f917a1557bd2
2026-03-30 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_a1f49ec7bf01cba1eaccdb83f6994bd1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_abf6df8b519509dc16379046c6d1a000.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f47d90>
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_a1f49ec7bf01cba1eaccdb83f6994bd1.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_a1f49ec7bf01cba1eaccdb83f6994bd1.jpg saved to cache
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2fb9d2d-052f-5b42-b035-f917a1557bd2
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c69fd0>
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_abf6df8b519509dc16379046c6d1a000.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_abf6df8b519509dc16379046c6d1a000.jpg saved to cache
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2fb9d2d-052f-5b42-b035-f917a1557bd2
2026-03-30 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_536012a5fe2421bdfb188e05c118dfbc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_c0bf7da6cb4126e41c8846f5dc132d31.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b28150>
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_536012a5fe2421bdfb188e05c118dfbc.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_536012a5fe2421bdfb188e05c118dfbc.jpg saved to cache
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2fb9d2d-052f-5b42-b035-f917a1557bd2
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e8b590>
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4a%252Fae4aab6b60d230cef29049baeac38557%252Fpa%252FVS83622_c0bf7da6cb4126e41c8846f5dc132d31.jpg') HTTP/1.1" 204 0
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_c0bf7da6cb4126e41c8846f5dc132d31.jpg saved to cache
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2fb9d2d-052f-5b42-b035-f917a1557bd2
2026-03-30 10:41:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2fb9d2d-052f-5b42-b035-f917a1557bd2, skipping ID generation
2026-03-30 10:41:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2fb9d2d-052f-5b42-b035-f917a1557bd2 with scrape type 1
2026-03-30 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2fb9d2d-052f-5b42-b035-f917a1557bd2 sending to next pipeline
2026-03-30 10:41:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2fb9d2d-052f-5b42-b035-f917a1557bd2, identifier: VS83622
2026-03-30 10:41:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2fb9d2d-052f-5b42-b035-f917a1557bd2 with identifier: VS83622
2026-03-30 10:41:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2fb9d2d-052f-5b42-b035-f917a1557bd2 with identifier: VS83622
2026-03-30 10:41:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2fb9d2d-052f-5b42-b035-f917a1557bd2 with identifier: VS83622 to the API
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_c0bf7da6cb4126e41c8846f5dc132d31.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 990,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 3',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:12:04Z',
 'fuel_type': 'petrol',
 'id': 'c2fb9d2d-052f-5b42-b035-f917a1557bd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS83622',
 'listing': 'auction',
 'location': 'DE, Göttingen',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 108781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_c0bf7da6cb4126e41c8846f5dc132d31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_536012a5fe2421bdfb188e05c118dfbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_abf6df8b519509dc16379046c6d1a000.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_a1f49ec7bf01cba1eaccdb83f6994bd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_8bcd68ba27e9e621c37e2aa137c29330.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_7a8e5b42cd8d11c1119ba858c4ce7477.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_66d2881bdfbc518985a2d2fbfe1954b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_890d9068ac4d9797b9850f1ed9d15082.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_34102af731489eec6f5ebf96f7aadff4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2fb9d2d-052f-5b42-b035-f917a1557bd2/c2fb9d2d-052f-5b42-b035-f917a1557bd2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4a/ae4aab6b60d230cef29049baeac38557/pa/VS83622_00fbed1dd9ec96e6137196f3332b4d0c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Kompressor Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2001}
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS83622%27 HTTP/1.1" 200 None
2026-03-30 10:41:53 [auto1.de] INFO: Saving data for VS83622: {'created_time': 1774867313.946964, 'last_price_update_time': 1774867313.946974, 'auction_closing_time': 1774969924.0}
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS83622') HTTP/1.1" 204 0
2026-03-30 10:41:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.905(s), this was the 1st time calling it.
2026-03-30 10:41:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.1842686544991645 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP91908> (referer: https://www.auto1.com/v1/car-details-view/GP91908/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:41:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:41:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac1c569d-cc9e-5d9e-8102-4b49cab56c39 with identifier: GP91908
2026-03-30 10:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac1c569d-cc9e-5d9e-8102-4b49cab56c39 with scrape type 1
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac1c569d-cc9e-5d9e-8102-4b49cab56c39
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fad%252Fc5ad568f644469294994bd26d8ebe498%252Fpa%252FGP91908_2c02e1021c3bfa59f7fae178a12511f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_2c02e1021c3bfa59f7fae178a12511f6.jpg already downloaded
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fad%252Fc5ad568f644469294994bd26d8ebe498%252Fpa%252FGP91908_19d8b4058d2c1cfff2f1889d02d8da56.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_19d8b4058d2c1cfff2f1889d02d8da56.jpg already downloaded
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fad%252Fc5ad568f644469294994bd26d8ebe498%252Fpa%252FGP91908_9b9aedec55b27dec5a5716c77e3ba15e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_9b9aedec55b27dec5a5716c77e3ba15e.jpg already downloaded
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fad%252Fc5ad568f644469294994bd26d8ebe498%252Fpa%252FGP91908_7a552cb7dd790ef79eb77804370a827e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_7a552cb7dd790ef79eb77804370a827e.jpg already downloaded
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fad%252Fc5ad568f644469294994bd26d8ebe498%252Fpa%252FGP91908_35824829a1a7d652a9cef1b0b3ccf8a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_35824829a1a7d652a9cef1b0b3ccf8a6.jpg already downloaded
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fad%252Fc5ad568f644469294994bd26d8ebe498%252Fpa%252FGP91908_66ff63c25237167c29207db9d4da3e99.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_66ff63c25237167c29207db9d4da3e99.jpg already downloaded
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fad%252Fc5ad568f644469294994bd26d8ebe498%252Fpa%252FGP91908_e3aefca2c3c6185a4c4219109e7bd377.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_e3aefca2c3c6185a4c4219109e7bd377.jpg already downloaded
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fad%252Fc5ad568f644469294994bd26d8ebe498%252Fpa%252FGP91908_24b7c2b25a158e2730e74349eae5752a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_24b7c2b25a158e2730e74349eae5752a.jpg already downloaded
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fad%252Fc5ad568f644469294994bd26d8ebe498%252Fpa%252FGP91908_826fd5fe3ce9448136a88654b4b67783.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_826fd5fe3ce9448136a88654b4b67783.jpg already downloaded
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fad%252Fc5ad568f644469294994bd26d8ebe498%252Fpa%252FGP91908_879d9999c3d28d513170cb1bfff9401b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_879d9999c3d28d513170cb1bfff9401b.jpg already downloaded
2026-03-30 10:41:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac1c569d-cc9e-5d9e-8102-4b49cab56c39, identifier: GP91908
2026-03-30 10:41:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac1c569d-cc9e-5d9e-8102-4b49cab56c39 with identifier: GP91908
2026-03-30 10:41:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac1c569d-cc9e-5d9e-8102-4b49cab56c39 with identifier: GP91908
2026-03-30 10:41:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac1c569d-cc9e-5d9e-8102-4b49cab56c39 with identifier: GP91908 to the API
2026-03-30 10:41:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GP91908>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:52:57Z',
 'fuel_type': 'petrol',
 'id': 'ac1c569d-cc9e-5d9e-8102-4b49cab56c39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP91908',
 'listing': 'auction',
 'location': 'DE, Kitzingen',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 145727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_2c02e1021c3bfa59f7fae178a12511f6.jpg',
                'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_19d8b4058d2c1cfff2f1889d02d8da56.jpg',
                'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_9b9aedec55b27dec5a5716c77e3ba15e.jpg',
                'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_7a552cb7dd790ef79eb77804370a827e.jpg',
                'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_35824829a1a7d652a9cef1b0b3ccf8a6.jpg',
                'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_66ff63c25237167c29207db9d4da3e99.jpg',
                'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_e3aefca2c3c6185a4c4219109e7bd377.jpg',
                'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_24b7c2b25a158e2730e74349eae5752a.jpg',
                'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_826fd5fe3ce9448136a88654b4b67783.jpg',
                'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_879d9999c3d28d513170cb1bfff9401b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1c569d-cc9e-5d9e-8102-4b49cab56c39/ac1c569d-cc9e-5d9e-8102-4b49cab56c39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2224767,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_2c02e1021c3bfa59f7fae178a12511f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1c569d-cc9e-5d9e-8102-4b49cab56c39/ac1c569d-cc9e-5d9e-8102-4b49cab56c39_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2287369,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_19d8b4058d2c1cfff2f1889d02d8da56.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1c569d-cc9e-5d9e-8102-4b49cab56c39/ac1c569d-cc9e-5d9e-8102-4b49cab56c39_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2264980,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_9b9aedec55b27dec5a5716c77e3ba15e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1c569d-cc9e-5d9e-8102-4b49cab56c39/ac1c569d-cc9e-5d9e-8102-4b49cab56c39_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2277493,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_7a552cb7dd790ef79eb77804370a827e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1c569d-cc9e-5d9e-8102-4b49cab56c39/ac1c569d-cc9e-5d9e-8102-4b49cab56c39_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_35824829a1a7d652a9cef1b0b3ccf8a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1c569d-cc9e-5d9e-8102-4b49cab56c39/ac1c569d-cc9e-5d9e-8102-4b49cab56c39_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_66ff63c25237167c29207db9d4da3e99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1c569d-cc9e-5d9e-8102-4b49cab56c39/ac1c569d-cc9e-5d9e-8102-4b49cab56c39_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2317955,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_e3aefca2c3c6185a4c4219109e7bd377.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1c569d-cc9e-5d9e-8102-4b49cab56c39/ac1c569d-cc9e-5d9e-8102-4b49cab56c39_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2339854,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_24b7c2b25a158e2730e74349eae5752a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1c569d-cc9e-5d9e-8102-4b49cab56c39/ac1c569d-cc9e-5d9e-8102-4b49cab56c39_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_826fd5fe3ce9448136a88654b4b67783.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1c569d-cc9e-5d9e-8102-4b49cab56c39/ac1c569d-cc9e-5d9e-8102-4b49cab56c39_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2204047,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ad/c5ad568f644469294994bd26d8ebe498/pa/GP91908_879d9999c3d28d513170cb1bfff9401b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-08-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2014}
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP91908%27 HTTP/1.1" 200 None
2026-03-30 10:41:56 [auto1.de] INFO: Saving data for GP91908: {'created_time': 1774867316.108679, 'last_price_update_time': 1774867316.108693, 'auction_closing_time': 1774972377.0}
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP91908') HTTP/1.1" 204 0
2026-03-30 10:41:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BA43176> (referer: https://www.auto1.com/v1/car-details-view/BA43176/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 686950f5-88cd-5a9d-a6ec-8412ad8c1c61 with identifier: BA43176
2026-03-30 10:42:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 686950f5-88cd-5a9d-a6ec-8412ad8c1c61 with scrape type 1
2026-03-30 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 686950f5-88cd-5a9d-a6ec-8412ad8c1c61
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F50%252Fca50e5b0183579ca5540d042e33a76e0%252Fpa%252FBA43176_3133dd721a737ed63977f8696f3f97f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/50/ca50e5b0183579ca5540d042e33a76e0/pa/BA43176_3133dd721a737ed63977f8696f3f97f5.jpg already downloaded
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F50%252Fca50e5b0183579ca5540d042e33a76e0%252Fpa%252FBA43176_6cd094f281e11adcd7e741a781f20007.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/50/ca50e5b0183579ca5540d042e33a76e0/pa/BA43176_6cd094f281e11adcd7e741a781f20007.jpg already downloaded
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F50%252Fca50e5b0183579ca5540d042e33a76e0%252Fpa%252FBA43176_5f5884b4b13a8f0cfb41a511a0a914df.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/50/ca50e5b0183579ca5540d042e33a76e0/pa/BA43176_5f5884b4b13a8f0cfb41a511a0a914df.jpg already downloaded
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F50%252Fca50e5b0183579ca5540d042e33a76e0%252Fpa%252FBA43176_bbd1a6696c4b31d6dde06093f483e36e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/50/ca50e5b0183579ca5540d042e33a76e0/pa/BA43176_bbd1a6696c4b31d6dde06093f483e36e.jpg already downloaded
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F50%252Fca50e5b0183579ca5540d042e33a76e0%252Fpa%252FBA43176_3f77fff59da0a708fc2acc116980c84d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/50/ca50e5b0183579ca5540d042e33a76e0/pa/BA43176_3f77fff59da0a708fc2acc116980c84d.jpg already downloaded
2026-03-30 10:42:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 686950f5-88cd-5a9d-a6ec-8412ad8c1c61, identifier: BA43176
2026-03-30 10:42:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 686950f5-88cd-5a9d-a6ec-8412ad8c1c61 with identifier: BA43176
2026-03-30 10:42:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 686950f5-88cd-5a9d-a6ec-8412ad8c1c61 with identifier: BA43176
2026-03-30 10:42:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 686950f5-88cd-5a9d-a6ec-8412ad8c1c61 with identifier: BA43176 to the API
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BA43176>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:55:45Z',
 'fuel_type': 'diesel',
 'id': '686950f5-88cd-5a9d-a6ec-8412ad8c1c61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA43176',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 237046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgca/50/ca50e5b0183579ca5540d042e33a76e0/pa/BA43176_3133dd721a737ed63977f8696f3f97f5.jpg',
                'https://img-pa.auto1.com/imgca/50/ca50e5b0183579ca5540d042e33a76e0/pa/BA43176_6cd094f281e11adcd7e741a781f20007.jpg',
                'https://img-pa.auto1.com/imgca/50/ca50e5b0183579ca5540d042e33a76e0/pa/BA43176_5f5884b4b13a8f0cfb41a511a0a914df.jpg',
                'https://img-pa.auto1.com/imgca/50/ca50e5b0183579ca5540d042e33a76e0/pa/BA43176_bbd1a6696c4b31d6dde06093f483e36e.jpg',
                'https://img-pa.auto1.com/imgca/50/ca50e5b0183579ca5540d042e33a76e0/pa/BA43176_3f77fff59da0a708fc2acc116980c84d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686950f5-88cd-5a9d-a6ec-8412ad8c1c61/686950f5-88cd-5a9d-a6ec-8412ad8c1c61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/50/ca50e5b0183579ca5540d042e33a76e0/pa/BA43176_3133dd721a737ed63977f8696f3f97f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686950f5-88cd-5a9d-a6ec-8412ad8c1c61/686950f5-88cd-5a9d-a6ec-8412ad8c1c61_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/50/ca50e5b0183579ca5540d042e33a76e0/pa/BA43176_6cd094f281e11adcd7e741a781f20007.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686950f5-88cd-5a9d-a6ec-8412ad8c1c61/686950f5-88cd-5a9d-a6ec-8412ad8c1c61_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/50/ca50e5b0183579ca5540d042e33a76e0/pa/BA43176_5f5884b4b13a8f0cfb41a511a0a914df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686950f5-88cd-5a9d-a6ec-8412ad8c1c61/686950f5-88cd-5a9d-a6ec-8412ad8c1c61_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/50/ca50e5b0183579ca5540d042e33a76e0/pa/BA43176_bbd1a6696c4b31d6dde06093f483e36e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686950f5-88cd-5a9d-a6ec-8412ad8c1c61/686950f5-88cd-5a9d-a6ec-8412ad8c1c61_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/50/ca50e5b0183579ca5540d042e33a76e0/pa/BA43176_3f77fff59da0a708fc2acc116980c84d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi SYNC Edition',
 'transmission': 'manual',
 'trim': 'SYNC Edition',
 'year': 2014}
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA43176%27 HTTP/1.1" 200 None
2026-03-30 10:42:03 [auto1.de] INFO: Saving data for BA43176: {'created_time': 1774867323.592512, 'last_price_update_time': 1774867323.592522, 'auction_closing_time': 1774972545.0}
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA43176') HTTP/1.1" 204 0
2026-03-30 10:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP66204> (referer: https://www.auto1.com/v1/car-details-view/BP66204/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:03 [crawlers.middlewares.id_gen_middleware] INFO: Duplicate ID generated for item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: BP66204, dropping item
2026-03-30 10:42:03 [scrapy.extensions.logstats] INFO: Crawled 287 pages (at 8 pages/min), scraped 223 items (at 7 items/min)
2026-03-30 10:42:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-30 10:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR19122/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.669(s), this was the 1st time calling it.
2026-03-30 10:42:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.017284041277246 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:42:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UU86547> (referer: https://www.auto1.com/v1/car-details-view/UU86547/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f50b1a9-65a2-52ae-aac3-df13f765bd99 with identifier: UU86547
2026-03-30 10:42:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f50b1a9-65a2-52ae-aac3-df13f765bd99 with scrape type 1
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6f50b1a9-65a2-52ae-aac3-df13f765bd99
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4d%252Ff64d1a3ce58749f23ba6355a22bac613%252Fpa%252FUU86547_a1858abfb5b225906da53207f6ddd5ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_a1858abfb5b225906da53207f6ddd5ce.jpg already downloaded
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4d%252Ff64d1a3ce58749f23ba6355a22bac613%252Fpa%252FUU86547_c4f6930218829b8c775524de19c6ff85.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_c4f6930218829b8c775524de19c6ff85.jpg already downloaded
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4d%252Ff64d1a3ce58749f23ba6355a22bac613%252Fpa%252FUU86547_61d7b9df027908051f328fc71ff39689.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_61d7b9df027908051f328fc71ff39689.jpg already downloaded
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4d%252Ff64d1a3ce58749f23ba6355a22bac613%252Fpa%252FUU86547_1a070d965809f7b17a98d8e12a1d76eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_1a070d965809f7b17a98d8e12a1d76eb.jpg already downloaded
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4d%252Ff64d1a3ce58749f23ba6355a22bac613%252Fpa%252FUU86547_9517781b6f064dca1dcd579ec8292f5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_9517781b6f064dca1dcd579ec8292f5c.jpg already downloaded
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4d%252Ff64d1a3ce58749f23ba6355a22bac613%252Fpa%252FUU86547_9ad14830799f3640b5a4cf5a017842ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_9ad14830799f3640b5a4cf5a017842ab.jpg already downloaded
2026-03-30 10:42:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f50b1a9-65a2-52ae-aac3-df13f765bd99, identifier: UU86547
2026-03-30 10:42:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f50b1a9-65a2-52ae-aac3-df13f765bd99 with identifier: UU86547
2026-03-30 10:42:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f50b1a9-65a2-52ae-aac3-df13f765bd99 with identifier: UU86547
2026-03-30 10:42:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f50b1a9-65a2-52ae-aac3-df13f765bd99 with identifier: UU86547 to the API
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UU86547>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:10:34Z',
 'fuel_type': 'petrol',
 'id': '6f50b1a9-65a2-52ae-aac3-df13f765bd99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU86547',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Mazda',
 'model': '6',
 'odometer': 221548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_a1858abfb5b225906da53207f6ddd5ce.jpg',
                'https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_c4f6930218829b8c775524de19c6ff85.jpg',
                'https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_61d7b9df027908051f328fc71ff39689.jpg',
                'https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_1a070d965809f7b17a98d8e12a1d76eb.jpg',
                'https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_9517781b6f064dca1dcd579ec8292f5c.jpg',
                'https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_9ad14830799f3640b5a4cf5a017842ab.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f50b1a9-65a2-52ae-aac3-df13f765bd99/6f50b1a9-65a2-52ae-aac3-df13f765bd99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_a1858abfb5b225906da53207f6ddd5ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f50b1a9-65a2-52ae-aac3-df13f765bd99/6f50b1a9-65a2-52ae-aac3-df13f765bd99_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_c4f6930218829b8c775524de19c6ff85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f50b1a9-65a2-52ae-aac3-df13f765bd99/6f50b1a9-65a2-52ae-aac3-df13f765bd99_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_61d7b9df027908051f328fc71ff39689.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f50b1a9-65a2-52ae-aac3-df13f765bd99/6f50b1a9-65a2-52ae-aac3-df13f765bd99_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_1a070d965809f7b17a98d8e12a1d76eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f50b1a9-65a2-52ae-aac3-df13f765bd99/6f50b1a9-65a2-52ae-aac3-df13f765bd99_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_9517781b6f064dca1dcd579ec8292f5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f50b1a9-65a2-52ae-aac3-df13f765bd99/6f50b1a9-65a2-52ae-aac3-df13f765bd99_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4d/f64d1a3ce58749f23ba6355a22bac613/pa/UU86547_9ad14830799f3640b5a4cf5a017842ab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 6 2.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2011}
2026-03-30 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU86547%27 HTTP/1.1" 200 None
2026-03-30 10:42:13 [auto1.de] INFO: Saving data for UU86547: {'created_time': 1774867333.005764, 'last_price_update_time': 1774867333.005776, 'auction_closing_time': 1774969834.0}
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU86547') HTTP/1.1" 204 0
2026-03-30 10:42:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM89418/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU89070> (referer: https://www.auto1.com/v1/car-details-view/AU89070/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b6475a8-9ece-50b7-9853-397d9355921d with identifier: AU89070
2026-03-30 10:42:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b6475a8-9ece-50b7-9853-397d9355921d with scrape type 1
2026-03-30 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b6475a8-9ece-50b7-9853-397d9355921d
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fce%252F1acef065b79a1ec74df0eaec95f3ce68%252Fpa%252FAU89070_03b66d07f1847a477dca74284894f0e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_03b66d07f1847a477dca74284894f0e3.jpg already downloaded
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fce%252F1acef065b79a1ec74df0eaec95f3ce68%252Fpa%252FAU89070_2df12056b538da39fcb5f2b16a55a048.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_2df12056b538da39fcb5f2b16a55a048.jpg already downloaded
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fce%252F1acef065b79a1ec74df0eaec95f3ce68%252Fpa%252FAU89070_1b55f1322c4d09648c584f44ea3c8043.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_1b55f1322c4d09648c584f44ea3c8043.jpg already downloaded
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fce%252F1acef065b79a1ec74df0eaec95f3ce68%252Fpa%252FAU89070_5c8e6b99e005174c8270a118f34f8049.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_5c8e6b99e005174c8270a118f34f8049.jpg already downloaded
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fce%252F1acef065b79a1ec74df0eaec95f3ce68%252Fpa%252FAU89070_824bddb0d6a2addbd91366c0050a0eb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_824bddb0d6a2addbd91366c0050a0eb6.jpg already downloaded
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fce%252F1acef065b79a1ec74df0eaec95f3ce68%252Fpa%252FAU89070_9b56e483661ea22e4afbf1b8eaa04233.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_9b56e483661ea22e4afbf1b8eaa04233.jpg already downloaded
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fce%252F1acef065b79a1ec74df0eaec95f3ce68%252Fpa%252FAU89070_f2aab21acfb31c239de3155c086f2da9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_f2aab21acfb31c239de3155c086f2da9.jpg already downloaded
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fce%252F1acef065b79a1ec74df0eaec95f3ce68%252Fpa%252FAU89070_c3f1890c8ac097011a87ed79a70fe384.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_c3f1890c8ac097011a87ed79a70fe384.jpg already downloaded
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fce%252F1acef065b79a1ec74df0eaec95f3ce68%252Fpa%252FAU89070_4b77a9bdfeb5aaeb4a0cea0e78306a2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_4b77a9bdfeb5aaeb4a0cea0e78306a2b.jpg already downloaded
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fce%252F1acef065b79a1ec74df0eaec95f3ce68%252Fpa%252FAU89070_e02fee0d47b8031f0c52dea6e153e6ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_e02fee0d47b8031f0c52dea6e153e6ec.jpg already downloaded
2026-03-30 10:42:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b6475a8-9ece-50b7-9853-397d9355921d, identifier: AU89070
2026-03-30 10:42:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b6475a8-9ece-50b7-9853-397d9355921d with identifier: AU89070
2026-03-30 10:42:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b6475a8-9ece-50b7-9853-397d9355921d with identifier: AU89070
2026-03-30 10:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b6475a8-9ece-50b7-9853-397d9355921d with identifier: AU89070 to the API
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AU89070>
{'auction_title': '',
 'c_o_2_emission_value': 207,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:48:43Z',
 'fuel_type': 'diesel',
 'id': '3b6475a8-9ece-50b7-9853-397d9355921d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU89070',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 184695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_03b66d07f1847a477dca74284894f0e3.jpg',
                'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_2df12056b538da39fcb5f2b16a55a048.jpg',
                'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_1b55f1322c4d09648c584f44ea3c8043.jpg',
                'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_5c8e6b99e005174c8270a118f34f8049.jpg',
                'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_824bddb0d6a2addbd91366c0050a0eb6.jpg',
                'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_9b56e483661ea22e4afbf1b8eaa04233.jpg',
                'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_f2aab21acfb31c239de3155c086f2da9.jpg',
                'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_c3f1890c8ac097011a87ed79a70fe384.jpg',
                'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_4b77a9bdfeb5aaeb4a0cea0e78306a2b.jpg',
                'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_e02fee0d47b8031f0c52dea6e153e6ec.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b6475a8-9ece-50b7-9853-397d9355921d/3b6475a8-9ece-50b7-9853-397d9355921d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_03b66d07f1847a477dca74284894f0e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b6475a8-9ece-50b7-9853-397d9355921d/3b6475a8-9ece-50b7-9853-397d9355921d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3210420,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_2df12056b538da39fcb5f2b16a55a048.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b6475a8-9ece-50b7-9853-397d9355921d/3b6475a8-9ece-50b7-9853-397d9355921d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3040941,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_1b55f1322c4d09648c584f44ea3c8043.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b6475a8-9ece-50b7-9853-397d9355921d/3b6475a8-9ece-50b7-9853-397d9355921d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3050668,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_5c8e6b99e005174c8270a118f34f8049.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b6475a8-9ece-50b7-9853-397d9355921d/3b6475a8-9ece-50b7-9853-397d9355921d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_824bddb0d6a2addbd91366c0050a0eb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b6475a8-9ece-50b7-9853-397d9355921d/3b6475a8-9ece-50b7-9853-397d9355921d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_9b56e483661ea22e4afbf1b8eaa04233.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b6475a8-9ece-50b7-9853-397d9355921d/3b6475a8-9ece-50b7-9853-397d9355921d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2712918,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_f2aab21acfb31c239de3155c086f2da9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b6475a8-9ece-50b7-9853-397d9355921d/3b6475a8-9ece-50b7-9853-397d9355921d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3239654,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_c3f1890c8ac097011a87ed79a70fe384.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b6475a8-9ece-50b7-9853-397d9355921d/3b6475a8-9ece-50b7-9853-397d9355921d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3065717,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_4b77a9bdfeb5aaeb4a0cea0e78306a2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b6475a8-9ece-50b7-9853-397d9355921d/3b6475a8-9ece-50b7-9853-397d9355921d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/ce/1acef065b79a1ec74df0eaec95f3ce68/pa/AU89070_e02fee0d47b8031f0c52dea6e153e6ec.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Fiat Ducato 3.0 JTD 180 Power',
 'transmission': 'automatic',
 'trim': '180 Power',
 'year': 2012}
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU89070%27 HTTP/1.1" 200 None
2026-03-30 10:42:19 [auto1.de] INFO: Saving data for AU89070: {'created_time': 1774867339.642981, 'last_price_update_time': 1774867339.643, 'auction_closing_time': 1774972123.0}
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU89070') HTTP/1.1" 204 0
2026-03-30 10:42:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL10422/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ56368> (referer: https://www.auto1.com/v1/car-details-view/BJ56368/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3260aa74-602f-5aa5-bff2-3eb2e7a43e54 with identifier: BJ56368
2026-03-30 10:42:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3260aa74-602f-5aa5-bff2-3eb2e7a43e54 with scrape type 1
2026-03-30 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3260aa74-602f-5aa5-bff2-3eb2e7a43e54
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fb3%252F4ab35381a1f99247ffca493b76fbb160%252Fpa%252FBJ56368_4f87d2b33933521ca65b62877e311a58.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_4f87d2b33933521ca65b62877e311a58.jpg not downloaded yet
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fb3%252F4ab35381a1f99247ffca493b76fbb160%252Fpa%252FBJ56368_6f6177d67c8950d8e098240f5be3c3a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_6f6177d67c8950d8e098240f5be3c3a1.jpg not downloaded yet
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fb3%252F4ab35381a1f99247ffca493b76fbb160%252Fpa%252FBJ56368_084d5de2710e3fa333ebe491358d3f05.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_084d5de2710e3fa333ebe491358d3f05.jpg not downloaded yet
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fb3%252F4ab35381a1f99247ffca493b76fbb160%252Fpa%252FBJ56368_08ec461fde52ca32d35cb2724122850e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_08ec461fde52ca32d35cb2724122850e.jpg not downloaded yet
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fb3%252F4ab35381a1f99247ffca493b76fbb160%252Fpa%252FBJ56368_204ffc2e15d78795822487abfeffa59f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_204ffc2e15d78795822487abfeffa59f.jpg not downloaded yet
2026-03-30 10:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF53328> (referer: https://www.auto1.com/v1/car-details-view/FF53328/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_204ffc2e15d78795822487abfeffa59f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b718de3-db47-5208-959b-0f1d70175058 with identifier: FF53328
2026-03-30 10:42:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b718de3-db47-5208-959b-0f1d70175058 with scrape type 1
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b718de3-db47-5208-959b-0f1d70175058
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_84408bd1b9a58c2d9e22762a842c7c9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_84408bd1b9a58c2d9e22762a842c7c9c.jpg not downloaded yet
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_f9683ef4fdf70a80a8d3187d7c7f6c52.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_f9683ef4fdf70a80a8d3187d7c7f6c52.jpg not downloaded yet
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_7bec032856962a467678868c52163b6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_7bec032856962a467678868c52163b6c.jpg not downloaded yet
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_d38df60ff263c62156db1ab5232c77ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_d38df60ff263c62156db1ab5232c77ef.jpg not downloaded yet
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_864b4854b84bb0aa7970202fd2ee5871.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_864b4854b84bb0aa7970202fd2ee5871.jpg not downloaded yet
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_ca9063104413655bed10c8d869cb3225.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_ca9063104413655bed10c8d869cb3225.jpg not downloaded yet
2026-03-30 10:42:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef596d3d0>
2026-03-30 10:42:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3260aa74-602f-5aa5-bff2-3eb2e7a43e54/3260aa74-602f-5aa5-bff2-3eb2e7a43e54_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fb3%252F4ab35381a1f99247ffca493b76fbb160%252Fpa%252FBJ56368_204ffc2e15d78795822487abfeffa59f.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_204ffc2e15d78795822487abfeffa59f.jpg saved to cache
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3260aa74-602f-5aa5-bff2-3eb2e7a43e54
2026-03-30 10:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_08ec461fde52ca32d35cb2724122850e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_b2d1125756a61f9ea7613b8ccd16ef08.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_b2d1125756a61f9ea7613b8ccd16ef08.jpg not downloaded yet
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_e763eeab13284dbfe63fd2a55e479042.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_e763eeab13284dbfe63fd2a55e479042.jpg not downloaded yet
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_88045e004e73dd4e44c192dfe15fa163.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_88045e004e73dd4e44c192dfe15fa163.jpg not downloaded yet
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_5a0e7fa621eab613e8971c0469a36526.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_5a0e7fa621eab613e8971c0469a36526.jpg not downloaded yet
2026-03-30 10:42:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595db50>
2026-03-30 10:42:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3260aa74-602f-5aa5-bff2-3eb2e7a43e54/3260aa74-602f-5aa5-bff2-3eb2e7a43e54_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fb3%252F4ab35381a1f99247ffca493b76fbb160%252Fpa%252FBJ56368_08ec461fde52ca32d35cb2724122850e.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_08ec461fde52ca32d35cb2724122850e.jpg saved to cache
2026-03-30 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3260aa74-602f-5aa5-bff2-3eb2e7a43e54
2026-03-30 10:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_ca9063104413655bed10c8d869cb3225.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dbb790>
2026-03-30 10:42:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_ca9063104413655bed10c8d869cb3225.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_ca9063104413655bed10c8d869cb3225.jpg saved to cache
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b718de3-db47-5208-959b-0f1d70175058
2026-03-30 10:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_5a0e7fa621eab613e8971c0469a36526.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_88045e004e73dd4e44c192dfe15fa163.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e4aa50>
2026-03-30 10:42:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_5a0e7fa621eab613e8971c0469a36526.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_5a0e7fa621eab613e8971c0469a36526.jpg saved to cache
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b718de3-db47-5208-959b-0f1d70175058
2026-03-30 10:42:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef789e850>
2026-03-30 10:42:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_88045e004e73dd4e44c192dfe15fa163.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_88045e004e73dd4e44c192dfe15fa163.jpg saved to cache
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b718de3-db47-5208-959b-0f1d70175058
2026-03-30 10:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL29012> (referer: https://www.auto1.com/v1/car-details-view/FL29012/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_e763eeab13284dbfe63fd2a55e479042.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4 with identifier: FL29012
2026-03-30 10:42:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4 with scrape type 1
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F08%252F600828bc4f5dafb0a55a3448b88f3898%252Fpa%252FFL29012_eb71b1339b9fc4544fa68083bd2f4dc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_eb71b1339b9fc4544fa68083bd2f4dc3.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F08%252F600828bc4f5dafb0a55a3448b88f3898%252Fpa%252FFL29012_d49bac379f2a49e5eaee2378a7eed9f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_d49bac379f2a49e5eaee2378a7eed9f6.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F08%252F600828bc4f5dafb0a55a3448b88f3898%252Fpa%252FFL29012_c58fe1a5a28b6e1d78b619d216690e61.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_c58fe1a5a28b6e1d78b619d216690e61.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F08%252F600828bc4f5dafb0a55a3448b88f3898%252Fpa%252FFL29012_8320c89eb1cba51fb25f9a8edd172574.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_8320c89eb1cba51fb25f9a8edd172574.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F08%252F600828bc4f5dafb0a55a3448b88f3898%252Fpa%252FFL29012_b297943f5cefa959846d52c323b6eb23.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_b297943f5cefa959846d52c323b6eb23.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F08%252F600828bc4f5dafb0a55a3448b88f3898%252Fpa%252FFL29012_7e41941388ff01211a1e4d1112fe60d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_7e41941388ff01211a1e4d1112fe60d3.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F08%252F600828bc4f5dafb0a55a3448b88f3898%252Fpa%252FFL29012_988f18e206906213b335a655f58131ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_988f18e206906213b335a655f58131ff.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F08%252F600828bc4f5dafb0a55a3448b88f3898%252Fpa%252FFL29012_a7663f80c3d14a2b313acdf9a479f200.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_a7663f80c3d14a2b313acdf9a479f200.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F08%252F600828bc4f5dafb0a55a3448b88f3898%252Fpa%252FFL29012_d330a22d1852b46ee4951059ce1f016f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_d330a22d1852b46ee4951059ce1f016f.jpg already downloaded
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F08%252F600828bc4f5dafb0a55a3448b88f3898%252Fpa%252FFL29012_40d7dbe45bbf6f25920df432ab066c67.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_40d7dbe45bbf6f25920df432ab066c67.jpg already downloaded
2026-03-30 10:42:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4, identifier: FL29012
2026-03-30 10:42:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4 with identifier: FL29012
2026-03-30 10:42:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4 with identifier: FL29012
2026-03-30 10:42:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4 with identifier: FL29012 to the API
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FL29012>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-31T15:45:22Z',
 'fuel_type': 'petrol',
 'id': 'ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL29012',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 112839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_eb71b1339b9fc4544fa68083bd2f4dc3.jpg',
                'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_d49bac379f2a49e5eaee2378a7eed9f6.jpg',
                'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_c58fe1a5a28b6e1d78b619d216690e61.jpg',
                'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_8320c89eb1cba51fb25f9a8edd172574.jpg',
                'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_b297943f5cefa959846d52c323b6eb23.jpg',
                'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_7e41941388ff01211a1e4d1112fe60d3.jpg',
                'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_988f18e206906213b335a655f58131ff.jpg',
                'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_a7663f80c3d14a2b313acdf9a479f200.jpg',
                'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_d330a22d1852b46ee4951059ce1f016f.jpg',
                'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_40d7dbe45bbf6f25920df432ab066c67.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4/ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_eb71b1339b9fc4544fa68083bd2f4dc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4/ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2593519,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_d49bac379f2a49e5eaee2378a7eed9f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4/ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_c58fe1a5a28b6e1d78b619d216690e61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4/ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_8320c89eb1cba51fb25f9a8edd172574.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4/ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_b297943f5cefa959846d52c323b6eb23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4/ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_7e41941388ff01211a1e4d1112fe60d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4/ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_988f18e206906213b335a655f58131ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4/ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_a7663f80c3d14a2b313acdf9a479f200.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4/ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_d330a22d1852b46ee4951059ce1f016f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4/ef9dd20c-ff5e-5ec9-a58e-51b5b23b44e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/08/600828bc4f5dafb0a55a3448b88f3898/pa/FL29012_40d7dbe45bbf6f25920df432ab066c67.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Sendo 2WD',
 'transmission': 'manual',
 'trim': 'Sendo 2WD',
 'year': 2014}
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL29012%27 HTTP/1.1" 200 None
2026-03-30 10:42:35 [auto1.de] INFO: Saving data for FL29012: {'created_time': 1774867355.334543, 'last_price_update_time': 1774867355.334552, 'auction_closing_time': 1774971922.0}
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL29012') HTTP/1.1" 204 0
2026-03-30 10:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_b2d1125756a61f9ea7613b8ccd16ef08.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_864b4854b84bb0aa7970202fd2ee5871.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b363d0>
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_e763eeab13284dbfe63fd2a55e479042.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_e763eeab13284dbfe63fd2a55e479042.jpg saved to cache
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b718de3-db47-5208-959b-0f1d70175058
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a42a10>
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_b2d1125756a61f9ea7613b8ccd16ef08.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_b2d1125756a61f9ea7613b8ccd16ef08.jpg saved to cache
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b718de3-db47-5208-959b-0f1d70175058
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5037390>
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_864b4854b84bb0aa7970202fd2ee5871.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_864b4854b84bb0aa7970202fd2ee5871.jpg saved to cache
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b718de3-db47-5208-959b-0f1d70175058
2026-03-30 10:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_d38df60ff263c62156db1ab5232c77ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_7bec032856962a467678868c52163b6c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fea7d0>
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_d38df60ff263c62156db1ab5232c77ef.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_d38df60ff263c62156db1ab5232c77ef.jpg saved to cache
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b718de3-db47-5208-959b-0f1d70175058
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe8150>
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_7bec032856962a467678868c52163b6c.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_7bec032856962a467678868c52163b6c.jpg saved to cache
2026-03-30 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b718de3-db47-5208-959b-0f1d70175058
2026-03-30 10:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_f9683ef4fdf70a80a8d3187d7c7f6c52.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_84408bd1b9a58c2d9e22762a842c7c9c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f1790>
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_f9683ef4fdf70a80a8d3187d7c7f6c52.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_f9683ef4fdf70a80a8d3187d7c7f6c52.jpg saved to cache
2026-03-30 10:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b718de3-db47-5208-959b-0f1d70175058
2026-03-30 10:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_084d5de2710e3fa333ebe491358d3f05.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fbb810>
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F46%252Fbf461ecef9c33462f1a1893caa7ce9c8%252Fpa%252FFF53328_84408bd1b9a58c2d9e22762a842c7c9c.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_84408bd1b9a58c2d9e22762a842c7c9c.jpg saved to cache
2026-03-30 10:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b718de3-db47-5208-959b-0f1d70175058
2026-03-30 10:42:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b718de3-db47-5208-959b-0f1d70175058, skipping ID generation
2026-03-30 10:42:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b718de3-db47-5208-959b-0f1d70175058 with scrape type 1
2026-03-30 10:42:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b718de3-db47-5208-959b-0f1d70175058 sending to next pipeline
2026-03-30 10:42:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b718de3-db47-5208-959b-0f1d70175058, identifier: FF53328
2026-03-30 10:42:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b718de3-db47-5208-959b-0f1d70175058 with identifier: FF53328
2026-03-30 10:42:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b718de3-db47-5208-959b-0f1d70175058 with identifier: FF53328
2026-03-30 10:42:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b718de3-db47-5208-959b-0f1d70175058 with identifier: FF53328 to the API
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_84408bd1b9a58c2d9e22762a842c7c9c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:11:28Z',
 'fuel_type': 'petrol',
 'id': '3b718de3-db47-5208-959b-0f1d70175058',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF53328',
 'listing': 'auction',
 'location': 'DE, Mannheim',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 92290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2584149,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_84408bd1b9a58c2d9e22762a842c7c9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2617084,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_f9683ef4fdf70a80a8d3187d7c7f6c52.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_7bec032856962a467678868c52163b6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2383712,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_d38df60ff263c62156db1ab5232c77ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_864b4854b84bb0aa7970202fd2ee5871.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2468523,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_ca9063104413655bed10c8d869cb3225.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_b2d1125756a61f9ea7613b8ccd16ef08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2687004,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_e763eeab13284dbfe63fd2a55e479042.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_88045e004e73dd4e44c192dfe15fa163.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b718de3-db47-5208-959b-0f1d70175058/3b718de3-db47-5208-959b-0f1d70175058_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608236,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/46/bf461ecef9c33462f1a1893caa7ce9c8/pa/FF53328_5a0e7fa621eab613e8971c0469a36526.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI Cupra 300 4Drive',
 'transmission': 'automatic',
 'trim': 'Cupra 300 4Drive',
 'year': 2020}
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF53328%27 HTTP/1.1" 200 None
2026-03-30 10:42:36 [auto1.de] INFO: Saving data for FF53328: {'created_time': 1774867356.817104, 'last_price_update_time': 1774867356.817121, 'auction_closing_time': 1774969888.0}
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF53328') HTTP/1.1" 204 0
2026-03-30 10:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_6f6177d67c8950d8e098240f5be3c3a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_4f87d2b33933521ca65b62877e311a58.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe9f10>
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3260aa74-602f-5aa5-bff2-3eb2e7a43e54/3260aa74-602f-5aa5-bff2-3eb2e7a43e54_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fb3%252F4ab35381a1f99247ffca493b76fbb160%252Fpa%252FBJ56368_084d5de2710e3fa333ebe491358d3f05.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_084d5de2710e3fa333ebe491358d3f05.jpg saved to cache
2026-03-30 10:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3260aa74-602f-5aa5-bff2-3eb2e7a43e54
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f81f10>
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3260aa74-602f-5aa5-bff2-3eb2e7a43e54/3260aa74-602f-5aa5-bff2-3eb2e7a43e54_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fb3%252F4ab35381a1f99247ffca493b76fbb160%252Fpa%252FBJ56368_6f6177d67c8950d8e098240f5be3c3a1.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_6f6177d67c8950d8e098240f5be3c3a1.jpg saved to cache
2026-03-30 10:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3260aa74-602f-5aa5-bff2-3eb2e7a43e54
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb9510>
2026-03-30 10:42:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3260aa74-602f-5aa5-bff2-3eb2e7a43e54/3260aa74-602f-5aa5-bff2-3eb2e7a43e54_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fb3%252F4ab35381a1f99247ffca493b76fbb160%252Fpa%252FBJ56368_4f87d2b33933521ca65b62877e311a58.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_4f87d2b33933521ca65b62877e311a58.jpg saved to cache
2026-03-30 10:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3260aa74-602f-5aa5-bff2-3eb2e7a43e54
2026-03-30 10:42:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3260aa74-602f-5aa5-bff2-3eb2e7a43e54, skipping ID generation
2026-03-30 10:42:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3260aa74-602f-5aa5-bff2-3eb2e7a43e54 with scrape type 1
2026-03-30 10:42:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3260aa74-602f-5aa5-bff2-3eb2e7a43e54 sending to next pipeline
2026-03-30 10:42:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3260aa74-602f-5aa5-bff2-3eb2e7a43e54, identifier: BJ56368
2026-03-30 10:42:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3260aa74-602f-5aa5-bff2-3eb2e7a43e54 with identifier: BJ56368
2026-03-30 10:42:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3260aa74-602f-5aa5-bff2-3eb2e7a43e54 with identifier: BJ56368
2026-03-30 10:42:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3260aa74-602f-5aa5-bff2-3eb2e7a43e54 with identifier: BJ56368 to the API
2026-03-30 10:42:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_4f87d2b33933521ca65b62877e311a58.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:00:26Z',
 'fuel_type': 'diesel',
 'id': '3260aa74-602f-5aa5-bff2-3eb2e7a43e54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ56368',
 'listing': 'auction',
 'location': 'DE, Chemnitz',
 'make': 'Alfa Romeo',
 'model': 'Alfa 159',
 'odometer': 213541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3260aa74-602f-5aa5-bff2-3eb2e7a43e54/3260aa74-602f-5aa5-bff2-3eb2e7a43e54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_4f87d2b33933521ca65b62877e311a58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3260aa74-602f-5aa5-bff2-3eb2e7a43e54/3260aa74-602f-5aa5-bff2-3eb2e7a43e54_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_6f6177d67c8950d8e098240f5be3c3a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3260aa74-602f-5aa5-bff2-3eb2e7a43e54/3260aa74-602f-5aa5-bff2-3eb2e7a43e54_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_084d5de2710e3fa333ebe491358d3f05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3260aa74-602f-5aa5-bff2-3eb2e7a43e54/3260aa74-602f-5aa5-bff2-3eb2e7a43e54_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_08ec461fde52ca32d35cb2724122850e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3260aa74-602f-5aa5-bff2-3eb2e7a43e54/3260aa74-602f-5aa5-bff2-3eb2e7a43e54_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/b3/4ab35381a1f99247ffca493b76fbb160/pa/BJ56368_204ffc2e15d78795822487abfeffa59f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Alfa 159 1.9 JTD JTDM ti',
 'transmission': 'manual',
 'trim': 'JTDM ti',
 'year': 2009}
2026-03-30 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ56368%27 HTTP/1.1" 200 None
2026-03-30 10:42:37 [auto1.de] INFO: Saving data for BJ56368: {'created_time': 1774867357.53849, 'last_price_update_time': 1774867357.538501, 'auction_closing_time': 1774969226.0}
2026-03-30 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ56368') HTTP/1.1" 204 0
2026-03-30 10:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:39 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 9449 | hits on page: 40
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: RU80356
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: FR25339
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR25339%27 HTTP/1.1" 200 None
2026-03-30 10:42:39 [auto1.de] INFO: Scrape type for FR25339: 0
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: NE66153
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: MF98789
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: LF89175
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF89175%27 HTTP/1.1" 200 None
2026-03-30 10:42:39 [auto1.de] INFO: Scrape type for LF89175: 0
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: SE64605
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: BP66204
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: LT56720
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: CF26327
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF26327%27 HTTP/1.1" 200 None
2026-03-30 10:42:39 [auto1.de] INFO: Scrape type for CF26327: 0
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: UT28191
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: VS83622
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS83622%27 HTTP/1.1" 200 None
2026-03-30 10:42:39 [auto1.de] INFO: Scrape type for VS83622: 0
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: GJ55737
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: XK64077
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: XJ81537
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ81537%27 HTTP/1.1" 200 None
2026-03-30 10:42:39 [auto1.de] INFO: Scrape type for XJ81537: 2
2026-03-30 10:42:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52793649-905e-53ee-8ea4-055dd9ab060b with identifier: XJ81537
2026-03-30 10:42:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52793649-905e-53ee-8ea4-055dd9ab060b with scrape type 2
2026-03-30 10:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52793649-905e-53ee-8ea4-055dd9ab060b with scrape type 2
2026-03-30 10:42:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52793649-905e-53ee-8ea4-055dd9ab060b, identifier: XJ81537
2026-03-30 10:42:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52793649-905e-53ee-8ea4-055dd9ab060b with identifier: XJ81537
2026-03-30 10:42:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52793649-905e-53ee-8ea4-055dd9ab060b with identifier: XJ81537
2026-03-30 10:42:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52793649-905e-53ee-8ea4-055dd9ab060b with identifier: XJ81537 to the API
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:16:14Z',
 'fuel_type': 'petrol',
 'id': '52793649-905e-53ee-8ea4-055dd9ab060b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ81537',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 140673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-28',
 'seller_name': None,
 'title': 'Toyota Auris 1.2 Turbo Edition-S',
 'transmission': 'manual',
 'trim': 'Edition-S',
 'year': 2016}
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ81537%27 HTTP/1.1" 200 None
2026-03-30 10:42:39 [auto1.de] INFO: Saving data for XJ81537: {'auction_closing_time': 1774970174.0, 'created_time': 1773306120.941509, 'last_price_update_time': 1774867359.670475}
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ81537') HTTP/1.1" 204 0
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: DA23365
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: YC26029
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: CN26761
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: GG38022
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: ZF27503
2026-03-30 10:42:39 [auto1.de] INFO: Found listing with ID: WR30114
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR30114%27 HTTP/1.1" 200 None
2026-03-30 10:42:39 [auto1.de] INFO: Scrape type for WR30114: 2
2026-03-30 10:42:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7316d257-02f8-5f7f-a2c7-058459faf1e9 with identifier: WR30114
2026-03-30 10:42:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7316d257-02f8-5f7f-a2c7-058459faf1e9 with scrape type 2
2026-03-30 10:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7316d257-02f8-5f7f-a2c7-058459faf1e9 with scrape type 2
2026-03-30 10:42:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7316d257-02f8-5f7f-a2c7-058459faf1e9, identifier: WR30114
2026-03-30 10:42:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7316d257-02f8-5f7f-a2c7-058459faf1e9 with identifier: WR30114
2026-03-30 10:42:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7316d257-02f8-5f7f-a2c7-058459faf1e9 with identifier: WR30114
2026-03-30 10:42:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7316d257-02f8-5f7f-a2c7-058459faf1e9 with identifier: WR30114 to the API
2026-03-30 10:42:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:09:49Z',
 'fuel_type': 'petrol',
 'id': '7316d257-02f8-5f7f-a2c7-058459faf1e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR30114',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 118202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-21',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Ultimate Start/Stop',
 'transmission': 'manual',
 'trim': 'Ultimate Start/Stop',
 'year': 2019}
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR30114%27 HTTP/1.1" 200 None
2026-03-30 10:42:40 [auto1.de] INFO: Saving data for WR30114: {'auction_closing_time': 1774969789.0, 'created_time': 1774262884.39474, 'last_price_update_time': 1774867360.361672}
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR30114') HTTP/1.1" 204 0
2026-03-30 10:42:40 [auto1.de] INFO: Found listing with ID: RU61041
2026-03-30 10:42:40 [auto1.de] INFO: Found listing with ID: AE13145
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE13145%27 HTTP/1.1" 200 None
2026-03-30 10:42:40 [auto1.de] INFO: Scrape type for AE13145: 1
2026-03-30 10:42:40 [auto1.de] INFO: Found listing with ID: FJ23052
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ23052%27 HTTP/1.1" 200 None
2026-03-30 10:42:40 [auto1.de] INFO: Scrape type for FJ23052: 1
2026-03-30 10:42:40 [auto1.de] INFO: Found listing with ID: WS77371
2026-03-30 10:42:40 [auto1.de] INFO: Found listing with ID: CK72706
2026-03-30 10:42:40 [auto1.de] INFO: Found listing with ID: TM60818
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM60818%27 HTTP/1.1" 200 None
2026-03-30 10:42:40 [auto1.de] INFO: Scrape type for TM60818: 1
2026-03-30 10:42:40 [auto1.de] INFO: Found listing with ID: GN56413
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN56413%27 HTTP/1.1" 200 None
2026-03-30 10:42:40 [auto1.de] INFO: Scrape type for GN56413: 1
2026-03-30 10:42:40 [auto1.de] INFO: Found listing with ID: SE98527
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE98527%27 HTTP/1.1" 200 None
2026-03-30 10:42:40 [auto1.de] INFO: Scrape type for SE98527: 1
2026-03-30 10:42:40 [auto1.de] INFO: Found listing with ID: UJ24923
2026-03-30 10:42:40 [auto1.de] INFO: Found listing with ID: VS32434
2026-03-30 10:42:40 [auto1.de] INFO: Found listing with ID: CS60894
2026-03-30 10:42:40 [auto1.de] INFO: Found listing with ID: MX32778
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX32778%27 HTTP/1.1" 200 None
2026-03-30 10:42:40 [auto1.de] INFO: Scrape type for MX32778: 1
2026-03-30 10:42:40 [auto1.de] INFO: Found listing with ID: SN55790
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN55790%27 HTTP/1.1" 200 None
2026-03-30 10:42:40 [auto1.de] INFO: Scrape type for SN55790: 2
2026-03-30 10:42:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96f7523a-0849-5dfa-81a1-f8804877c4d0 with identifier: SN55790
2026-03-30 10:42:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96f7523a-0849-5dfa-81a1-f8804877c4d0 with scrape type 2
2026-03-30 10:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96f7523a-0849-5dfa-81a1-f8804877c4d0 with scrape type 2
2026-03-30 10:42:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96f7523a-0849-5dfa-81a1-f8804877c4d0, identifier: SN55790
2026-03-30 10:42:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96f7523a-0849-5dfa-81a1-f8804877c4d0 with identifier: SN55790
2026-03-30 10:42:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96f7523a-0849-5dfa-81a1-f8804877c4d0 with identifier: SN55790
2026-03-30 10:42:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96f7523a-0849-5dfa-81a1-f8804877c4d0 with identifier: SN55790 to the API
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:18:53Z',
 'fuel_type': 'diesel',
 'id': '96f7523a-0849-5dfa-81a1-f8804877c4d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN55790',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 130289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-13',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2020}
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN55790%27 HTTP/1.1" 200 None
2026-03-30 10:42:40 [auto1.de] INFO: Saving data for SN55790: {'auction_closing_time': 1774970333.0, 'created_time': 1774292796.520754, 'last_price_update_time': 1774867360.948901}
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN55790') HTTP/1.1" 204 0
2026-03-30 10:42:41 [auto1.de] INFO: Found listing with ID: MZ56747
2026-03-30 10:42:41 [auto1.de] INFO: Found listing with ID: UR76017
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR76017%27 HTTP/1.1" 200 None
2026-03-30 10:42:41 [auto1.de] INFO: Scrape type for UR76017: 1
2026-03-30 10:42:41 [auto1.de] INFO: Found listing with ID: PA34245
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA34245%27 HTTP/1.1" 200 None
2026-03-30 10:42:41 [auto1.de] INFO: Scrape type for PA34245: 2
2026-03-30 10:42:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7308d0f-26e8-52f6-b64a-0772e12a0c9b with identifier: PA34245
2026-03-30 10:42:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7308d0f-26e8-52f6-b64a-0772e12a0c9b with scrape type 2
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7308d0f-26e8-52f6-b64a-0772e12a0c9b with scrape type 2
2026-03-30 10:42:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7308d0f-26e8-52f6-b64a-0772e12a0c9b, identifier: PA34245
2026-03-30 10:42:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE83879/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7308d0f-26e8-52f6-b64a-0772e12a0c9b with identifier: PA34245
2026-03-30 10:42:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7308d0f-26e8-52f6-b64a-0772e12a0c9b with identifier: PA34245
2026-03-30 10:42:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7308d0f-26e8-52f6-b64a-0772e12a0c9b with identifier: PA34245 to the API
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:25:38Z',
 'fuel_type': 'diesel',
 'id': 'c7308d0f-26e8-52f6-b64a-0772e12a0c9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA34245',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 55564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-14',
 'seller_name': None,
 'title': 'Ford EcoSport 1.5 TDCi EcoBlue ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA34245%27 HTTP/1.1" 200 None
2026-03-30 10:42:41 [auto1.de] INFO: Saving data for PA34245: {'auction_closing_time': 1774970738.0, 'created_time': 1773688876.76301, 'last_price_update_time': 1774867361.562098}
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA34245') HTTP/1.1" 204 0
2026-03-30 10:42:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:41 [auto1.de] INFO: Found listing with ID: JP72611
2026-03-30 10:42:41 [auto1.de] INFO: Found listing with ID: SB79116
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB79116%27 HTTP/1.1" 200 None
2026-03-30 10:42:41 [auto1.de] INFO: Scrape type for SB79116: 2
2026-03-30 10:42:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64222445-4142-5927-9e5b-73a3aadfd62f with identifier: SB79116
2026-03-30 10:42:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64222445-4142-5927-9e5b-73a3aadfd62f with scrape type 2
2026-03-30 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64222445-4142-5927-9e5b-73a3aadfd62f with scrape type 2
2026-03-30 10:42:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64222445-4142-5927-9e5b-73a3aadfd62f, identifier: SB79116
2026-03-30 10:42:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64222445-4142-5927-9e5b-73a3aadfd62f with identifier: SB79116
2026-03-30 10:42:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64222445-4142-5927-9e5b-73a3aadfd62f with identifier: SB79116
2026-03-30 10:42:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64222445-4142-5927-9e5b-73a3aadfd62f with identifier: SB79116 to the API
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:42:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:42:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:48:29Z',
 'fuel_type': 'petrol',
 'id': '64222445-4142-5927-9e5b-73a3aadfd62f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB79116',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 56860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-22',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 220 4Matic Urban Style Edition',
 'transmission': 'automatic',
 'trim': '4Matic Urban Style Edition',
 'year': 2018}
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB79116%27 HTTP/1.1" 200 None
2026-03-30 10:42:42 [auto1.de] INFO: Saving data for SB79116: {'auction_closing_time': 1774972109.0, 'created_time': 1773303849.648501, 'last_price_update_time': 1774867362.102951}
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB79116') HTTP/1.1" 204 0
2026-03-30 10:42:42 [auto1.de] INFO: Found listing with ID: XY94240
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY94240%27 HTTP/1.1" 200 None
2026-03-30 10:42:42 [auto1.de] INFO: Scrape type for XY94240: 1
2026-03-30 10:42:42 [auto1.de] INFO: Found listing with ID: PT50052
2026-03-30 10:42:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR19122> (referer: https://www.auto1.com/v1/car-details-view/KR19122/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 999ac472-503d-555b-8533-4ef97aa4b507 with identifier: KR19122
2026-03-30 10:42:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 999ac472-503d-555b-8533-4ef97aa4b507 with scrape type 1
2026-03-30 10:42:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 999ac472-503d-555b-8533-4ef97aa4b507
2026-03-30 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9b%252F949b768a7ff5a86858ba50558d791da9%252Fpa%252FKR19122_c303b0d419af7b1f1eea032e7396d57a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_c303b0d419af7b1f1eea032e7396d57a.jpg not downloaded yet
2026-03-30 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9b%252F949b768a7ff5a86858ba50558d791da9%252Fpa%252FKR19122_687ef67c849b9cb1cc221521e7aa1e27.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_687ef67c849b9cb1cc221521e7aa1e27.jpg not downloaded yet
2026-03-30 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9b%252F949b768a7ff5a86858ba50558d791da9%252Fpa%252FKR19122_81d121eef087388bd61b3a4a4ae61f35.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_81d121eef087388bd61b3a4a4ae61f35.jpg not downloaded yet
2026-03-30 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9b%252F949b768a7ff5a86858ba50558d791da9%252Fpa%252FKR19122_4479b0ceab5e4dbea5abfd460314eaf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_4479b0ceab5e4dbea5abfd460314eaf7.jpg not downloaded yet
2026-03-30 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9b%252F949b768a7ff5a86858ba50558d791da9%252Fpa%252FKR19122_55d807b17de383457b92224845513ba7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:42:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_55d807b17de383457b92224845513ba7.jpg not downloaded yet
2026-03-30 10:42:47 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.019(s), this was the 1st time calling it.
2026-03-30 10:42:47 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.194915104750373 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:42:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:42:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE24637/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_55d807b17de383457b92224845513ba7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_4479b0ceab5e4dbea5abfd460314eaf7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:42:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595ed90>
2026-03-30 10:42:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_999ac472-503d-555b-8533-4ef97aa4b507/999ac472-503d-555b-8533-4ef97aa4b507_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9b%252F949b768a7ff5a86858ba50558d791da9%252Fpa%252FKR19122_55d807b17de383457b92224845513ba7.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_55d807b17de383457b92224845513ba7.jpg saved to cache
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 999ac472-503d-555b-8533-4ef97aa4b507
2026-03-30 10:42:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:42:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4df1f10>
2026-03-30 10:42:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:42:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_999ac472-503d-555b-8533-4ef97aa4b507/999ac472-503d-555b-8533-4ef97aa4b507_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9b%252F949b768a7ff5a86858ba50558d791da9%252Fpa%252FKR19122_4479b0ceab5e4dbea5abfd460314eaf7.jpg') HTTP/1.1" 204 0
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_4479b0ceab5e4dbea5abfd460314eaf7.jpg saved to cache
2026-03-30 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 999ac472-503d-555b-8533-4ef97aa4b507
2026-03-30 10:42:59 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.530(s), this was the 1st time calling it.
2026-03-30 10:42:59 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.700277001469475 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM89950/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:42:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_81d121eef087388bd61b3a4a4ae61f35.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_687ef67c849b9cb1cc221521e7aa1e27.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e09210>
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_999ac472-503d-555b-8533-4ef97aa4b507/999ac472-503d-555b-8533-4ef97aa4b507_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9b%252F949b768a7ff5a86858ba50558d791da9%252Fpa%252FKR19122_81d121eef087388bd61b3a4a4ae61f35.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_81d121eef087388bd61b3a4a4ae61f35.jpg saved to cache
2026-03-30 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 999ac472-503d-555b-8533-4ef97aa4b507
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e004d0>
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_999ac472-503d-555b-8533-4ef97aa4b507/999ac472-503d-555b-8533-4ef97aa4b507_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9b%252F949b768a7ff5a86858ba50558d791da9%252Fpa%252FKR19122_687ef67c849b9cb1cc221521e7aa1e27.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_687ef67c849b9cb1cc221521e7aa1e27.jpg saved to cache
2026-03-30 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 999ac472-503d-555b-8533-4ef97aa4b507
2026-03-30 10:43:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:43:03 [scrapy.extensions.logstats] INFO: Crawled 300 pages (at 13 pages/min), scraped 233 items (at 10 items/min)
2026-03-30 10:43:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-30 10:43:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG67358/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_c303b0d419af7b1f1eea032e7396d57a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4df3fd0>
2026-03-30 10:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_999ac472-503d-555b-8533-4ef97aa4b507/999ac472-503d-555b-8533-4ef97aa4b507_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F9b%252F949b768a7ff5a86858ba50558d791da9%252Fpa%252FKR19122_c303b0d419af7b1f1eea032e7396d57a.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_c303b0d419af7b1f1eea032e7396d57a.jpg saved to cache
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 999ac472-503d-555b-8533-4ef97aa4b507
2026-03-30 10:43:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 999ac472-503d-555b-8533-4ef97aa4b507, skipping ID generation
2026-03-30 10:43:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 999ac472-503d-555b-8533-4ef97aa4b507 with scrape type 1
2026-03-30 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 999ac472-503d-555b-8533-4ef97aa4b507 sending to next pipeline
2026-03-30 10:43:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 999ac472-503d-555b-8533-4ef97aa4b507, identifier: KR19122
2026-03-30 10:43:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 999ac472-503d-555b-8533-4ef97aa4b507 with identifier: KR19122
2026-03-30 10:43:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 999ac472-503d-555b-8533-4ef97aa4b507 with identifier: KR19122
2026-03-30 10:43:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 999ac472-503d-555b-8533-4ef97aa4b507 with identifier: KR19122 to the API
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_c303b0d419af7b1f1eea032e7396d57a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:26:04Z',
 'fuel_type': 'diesel',
 'id': '999ac472-503d-555b-8533-4ef97aa4b507',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR19122',
 'listing': 'auction',
 'location': 'DE, Herborn',
 'make': 'Peugeot',
 'model': 'RCZ',
 'odometer': 473803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_999ac472-503d-555b-8533-4ef97aa4b507/999ac472-503d-555b-8533-4ef97aa4b507_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_c303b0d419af7b1f1eea032e7396d57a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_999ac472-503d-555b-8533-4ef97aa4b507/999ac472-503d-555b-8533-4ef97aa4b507_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_687ef67c849b9cb1cc221521e7aa1e27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_999ac472-503d-555b-8533-4ef97aa4b507/999ac472-503d-555b-8533-4ef97aa4b507_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_81d121eef087388bd61b3a4a4ae61f35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_999ac472-503d-555b-8533-4ef97aa4b507/999ac472-503d-555b-8533-4ef97aa4b507_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_4479b0ceab5e4dbea5abfd460314eaf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_999ac472-503d-555b-8533-4ef97aa4b507/999ac472-503d-555b-8533-4ef97aa4b507_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/9b/949b768a7ff5a86858ba50558d791da9/pa/KR19122_55d807b17de383457b92224845513ba7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-13',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot RCZ 2.0 HDi Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2010}
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR19122%27 HTTP/1.1" 200 None
2026-03-30 10:43:08 [auto1.de] INFO: Saving data for KR19122: {'created_time': 1774867388.597644, 'last_price_update_time': 1774867388.597656, 'auction_closing_time': 1774970764.0}
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR19122') HTTP/1.1" 204 0
2026-03-30 10:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM89418> (referer: https://www.auto1.com/v1/car-details-view/LM89418/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad131e25-0f14-52e0-ba74-14b0651af6a1 with identifier: LM89418
2026-03-30 10:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad131e25-0f14-52e0-ba74-14b0651af6a1 with scrape type 1
2026-03-30 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad131e25-0f14-52e0-ba74-14b0651af6a1
2026-03-30 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_a8265c6fdb76b0fbcedbd92a1b02d1a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_a8265c6fdb76b0fbcedbd92a1b02d1a0.jpg not downloaded yet
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_440e487105dffcfbf11ebe1ac3fab4b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_440e487105dffcfbf11ebe1ac3fab4b4.jpg not downloaded yet
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_14a05b5eb9f5802fe5dbbb8fc14f470c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_14a05b5eb9f5802fe5dbbb8fc14f470c.jpg not downloaded yet
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_5345a39244f00d2bde82b3047eb04ec9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_5345a39244f00d2bde82b3047eb04ec9.jpg not downloaded yet
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_c8efbefbe2721c1f823f6682d8f6e226.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_c8efbefbe2721c1f823f6682d8f6e226.jpg not downloaded yet
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP47539/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_74b84b8495e4fa9abcf63f4635a2981e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_74b84b8495e4fa9abcf63f4635a2981e.jpg not downloaded yet
2026-03-30 10:43:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_7a36750515f8f9bb145fe914df029da6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_7a36750515f8f9bb145fe914df029da6.jpg not downloaded yet
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_a636ee8d019731c344e11be254810ac9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_a636ee8d019731c344e11be254810ac9.jpg not downloaded yet
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC82095/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_070058430ce556ace9318339c61ea462.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_070058430ce556ace9318339c61ea462.jpg not downloaded yet
2026-03-30 10:43:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_f0f920637142dca924b1a3128712f53f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_f0f920637142dca924b1a3128712f53f.jpg not downloaded yet
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_c8efbefbe2721c1f823f6682d8f6e226.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c43e50>
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_c8efbefbe2721c1f823f6682d8f6e226.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_c8efbefbe2721c1f823f6682d8f6e226.jpg saved to cache
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad131e25-0f14-52e0-ba74-14b0651af6a1
2026-03-30 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_a636ee8d019731c344e11be254810ac9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db4190>
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_a636ee8d019731c344e11be254810ac9.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_a636ee8d019731c344e11be254810ac9.jpg saved to cache
2026-03-30 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad131e25-0f14-52e0-ba74-14b0651af6a1
2026-03-30 10:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE80616/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD73357/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_f0f920637142dca924b1a3128712f53f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ddb0d0>
2026-03-30 10:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_f0f920637142dca924b1a3128712f53f.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_f0f920637142dca924b1a3128712f53f.jpg saved to cache
2026-03-30 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad131e25-0f14-52e0-ba74-14b0651af6a1
2026-03-30 10:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_070058430ce556ace9318339c61ea462.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e7ad10>
2026-03-30 10:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_070058430ce556ace9318339c61ea462.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_070058430ce556ace9318339c61ea462.jpg saved to cache
2026-03-30 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad131e25-0f14-52e0-ba74-14b0651af6a1
2026-03-30 10:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR76017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_7a36750515f8f9bb145fe914df029da6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ad5c90>
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_7a36750515f8f9bb145fe914df029da6.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_7a36750515f8f9bb145fe914df029da6.jpg saved to cache
2026-03-30 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad131e25-0f14-52e0-ba74-14b0651af6a1
2026-03-30 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE24637> (referer: https://www.auto1.com/v1/car-details-view/NE24637/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a850403-cdf6-5cad-9c91-928c81e3b593 with identifier: NE24637
2026-03-30 10:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a850403-cdf6-5cad-9c91-928c81e3b593 with scrape type 1
2026-03-30 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a850403-cdf6-5cad-9c91-928c81e3b593
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_a4fcb8a05f581b6186d8ad4922dd85ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_a4fcb8a05f581b6186d8ad4922dd85ec.jpg not downloaded yet
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_8d19dd9d90665028a5e0204809d635d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_8d19dd9d90665028a5e0204809d635d2.jpg not downloaded yet
2026-03-30 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_74b84b8495e4fa9abcf63f4635a2981e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_9654e36c600a44772cf6771c402d439e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_9654e36c600a44772cf6771c402d439e.jpg not downloaded yet
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_e6600f155f125d4b7351c773916f47bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_e6600f155f125d4b7351c773916f47bd.jpg not downloaded yet
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_071ad8b36ba60455e83a872f1e841a08.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_071ad8b36ba60455e83a872f1e841a08.jpg not downloaded yet
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_c6bd349b161cf12344a1b5504112ec01.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_c6bd349b161cf12344a1b5504112ec01.jpg not downloaded yet
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_8484acea6a569ed0370b2b7d4e380b33.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_8484acea6a569ed0370b2b7d4e380b33.jpg not downloaded yet
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_7657bb3657901e14820a65c713ac75d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_7657bb3657901e14820a65c713ac75d1.jpg not downloaded yet
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_a036f96a3a272a563edc8ae13f051f95.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_a036f96a3a272a563edc8ae13f051f95.jpg not downloaded yet
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5035b10>
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_74b84b8495e4fa9abcf63f4635a2981e.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_74b84b8495e4fa9abcf63f4635a2981e.jpg saved to cache
2026-03-30 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad131e25-0f14-52e0-ba74-14b0651af6a1
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_471b6a487cba44a0d60436854a0c489b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_471b6a487cba44a0d60436854a0c489b.jpg not downloaded yet
2026-03-30 10:43:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_8d19dd9d90665028a5e0204809d635d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e49fd0>
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_8d19dd9d90665028a5e0204809d635d2.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_8d19dd9d90665028a5e0204809d635d2.jpg saved to cache
2026-03-30 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a850403-cdf6-5cad-9c91-928c81e3b593
2026-03-30 10:43:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_471b6a487cba44a0d60436854a0c489b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595fcd0>
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_471b6a487cba44a0d60436854a0c489b.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_471b6a487cba44a0d60436854a0c489b.jpg saved to cache
2026-03-30 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a850403-cdf6-5cad-9c91-928c81e3b593
2026-03-30 10:43:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_a036f96a3a272a563edc8ae13f051f95.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe3490>
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_a036f96a3a272a563edc8ae13f051f95.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_a036f96a3a272a563edc8ae13f051f95.jpg saved to cache
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a850403-cdf6-5cad-9c91-928c81e3b593
2026-03-30 10:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_7657bb3657901e14820a65c713ac75d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ad5c90>
2026-03-30 10:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_7657bb3657901e14820a65c713ac75d1.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_7657bb3657901e14820a65c713ac75d1.jpg saved to cache
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a850403-cdf6-5cad-9c91-928c81e3b593
2026-03-30 10:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_8484acea6a569ed0370b2b7d4e380b33.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL10422> (referer: https://www.auto1.com/v1/car-details-view/BL10422/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e48590>
2026-03-30 10:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_8484acea6a569ed0370b2b7d4e380b33.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_8484acea6a569ed0370b2b7d4e380b33.jpg saved to cache
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a850403-cdf6-5cad-9c91-928c81e3b593
2026-03-30 10:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a47c3a64-7fa1-5698-919c-1709f94a20f7 with identifier: BL10422
2026-03-30 10:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a47c3a64-7fa1-5698-919c-1709f94a20f7 with scrape type 1
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a47c3a64-7fa1-5698-919c-1709f94a20f7
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F35%252Fa535607aa12fd631e9b2932d6d35fc7a%252Fpa%252FBL10422_9780ff334ab36ed8c5b8a4cca261d2df.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_9780ff334ab36ed8c5b8a4cca261d2df.jpg already downloaded
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F35%252Fa535607aa12fd631e9b2932d6d35fc7a%252Fpa%252FBL10422_147ee7583fcf4d6957a5725650c9f356.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_147ee7583fcf4d6957a5725650c9f356.jpg already downloaded
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F35%252Fa535607aa12fd631e9b2932d6d35fc7a%252Fpa%252FBL10422_179ce7910b230c847579265c29264e56.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_179ce7910b230c847579265c29264e56.jpg already downloaded
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F35%252Fa535607aa12fd631e9b2932d6d35fc7a%252Fpa%252FBL10422_1fd5ff69dd41147f7e31bbfd07f07f65.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_1fd5ff69dd41147f7e31bbfd07f07f65.jpg already downloaded
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F35%252Fa535607aa12fd631e9b2932d6d35fc7a%252Fpa%252FBL10422_3ee125fa3d4513f22ca180d604b7f6c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_3ee125fa3d4513f22ca180d604b7f6c8.jpg already downloaded
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F35%252Fa535607aa12fd631e9b2932d6d35fc7a%252Fpa%252FBL10422_16984ccedc0d0c7013e25ce0b885e3a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_16984ccedc0d0c7013e25ce0b885e3a1.jpg already downloaded
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F35%252Fa535607aa12fd631e9b2932d6d35fc7a%252Fpa%252FBL10422_51703df711b96d6025135d25d020b4c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_51703df711b96d6025135d25d020b4c6.jpg already downloaded
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F35%252Fa535607aa12fd631e9b2932d6d35fc7a%252Fpa%252FBL10422_1289140589bff33e3a35f99096169387.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_1289140589bff33e3a35f99096169387.jpg already downloaded
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F35%252Fa535607aa12fd631e9b2932d6d35fc7a%252Fpa%252FBL10422_1b59209f7dcc548507c834f8eba312a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_1b59209f7dcc548507c834f8eba312a4.jpg already downloaded
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F35%252Fa535607aa12fd631e9b2932d6d35fc7a%252Fpa%252FBL10422_c299a061c33f4aa2f0b2bcdac50f4178.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_c299a061c33f4aa2f0b2bcdac50f4178.jpg already downloaded
2026-03-30 10:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a47c3a64-7fa1-5698-919c-1709f94a20f7, identifier: BL10422
2026-03-30 10:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a47c3a64-7fa1-5698-919c-1709f94a20f7 with identifier: BL10422
2026-03-30 10:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a47c3a64-7fa1-5698-919c-1709f94a20f7 with identifier: BL10422
2026-03-30 10:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a47c3a64-7fa1-5698-919c-1709f94a20f7 with identifier: BL10422 to the API
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BL10422>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.3L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:57:34Z',
 'fuel_type': 'petrol',
 'id': 'a47c3a64-7fa1-5698-919c-1709f94a20f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL10422',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 38547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_9780ff334ab36ed8c5b8a4cca261d2df.jpg',
                'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_147ee7583fcf4d6957a5725650c9f356.jpg',
                'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_179ce7910b230c847579265c29264e56.jpg',
                'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_1fd5ff69dd41147f7e31bbfd07f07f65.jpg',
                'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_3ee125fa3d4513f22ca180d604b7f6c8.jpg',
                'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_16984ccedc0d0c7013e25ce0b885e3a1.jpg',
                'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_51703df711b96d6025135d25d020b4c6.jpg',
                'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_1289140589bff33e3a35f99096169387.jpg',
                'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_1b59209f7dcc548507c834f8eba312a4.jpg',
                'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_c299a061c33f4aa2f0b2bcdac50f4178.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c3a64-7fa1-5698-919c-1709f94a20f7/a47c3a64-7fa1-5698-919c-1709f94a20f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_9780ff334ab36ed8c5b8a4cca261d2df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c3a64-7fa1-5698-919c-1709f94a20f7/a47c3a64-7fa1-5698-919c-1709f94a20f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_147ee7583fcf4d6957a5725650c9f356.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c3a64-7fa1-5698-919c-1709f94a20f7/a47c3a64-7fa1-5698-919c-1709f94a20f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_179ce7910b230c847579265c29264e56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c3a64-7fa1-5698-919c-1709f94a20f7/a47c3a64-7fa1-5698-919c-1709f94a20f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_1fd5ff69dd41147f7e31bbfd07f07f65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c3a64-7fa1-5698-919c-1709f94a20f7/a47c3a64-7fa1-5698-919c-1709f94a20f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_3ee125fa3d4513f22ca180d604b7f6c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c3a64-7fa1-5698-919c-1709f94a20f7/a47c3a64-7fa1-5698-919c-1709f94a20f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_16984ccedc0d0c7013e25ce0b885e3a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c3a64-7fa1-5698-919c-1709f94a20f7/a47c3a64-7fa1-5698-919c-1709f94a20f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2831064,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_51703df711b96d6025135d25d020b4c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c3a64-7fa1-5698-919c-1709f94a20f7/a47c3a64-7fa1-5698-919c-1709f94a20f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_1289140589bff33e3a35f99096169387.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c3a64-7fa1-5698-919c-1709f94a20f7/a47c3a64-7fa1-5698-919c-1709f94a20f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_1b59209f7dcc548507c834f8eba312a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c3a64-7fa1-5698-919c-1709f94a20f7/a47c3a64-7fa1-5698-919c-1709f94a20f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/35/a535607aa12fd631e9b2932d6d35fc7a/pa/BL10422_c299a061c33f4aa2f0b2bcdac50f4178.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 XTRA',
 'transmission': 'automatic',
 'trim': 'XTRA',
 'year': 2011}
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL10422%27 HTTP/1.1" 200 None
2026-03-30 10:43:17 [auto1.de] INFO: Saving data for BL10422: {'created_time': 1774867397.367642, 'last_price_update_time': 1774867397.367657, 'auction_closing_time': 1774972654.0}
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL10422') HTTP/1.1" 204 0
2026-03-30 10:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_c6bd349b161cf12344a1b5504112ec01.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_071ad8b36ba60455e83a872f1e841a08.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595e450>
2026-03-30 10:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_c6bd349b161cf12344a1b5504112ec01.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_c6bd349b161cf12344a1b5504112ec01.jpg saved to cache
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a850403-cdf6-5cad-9c91-928c81e3b593
2026-03-30 10:43:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eb7410>
2026-03-30 10:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_071ad8b36ba60455e83a872f1e841a08.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_071ad8b36ba60455e83a872f1e841a08.jpg saved to cache
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a850403-cdf6-5cad-9c91-928c81e3b593
2026-03-30 10:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_e6600f155f125d4b7351c773916f47bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_9654e36c600a44772cf6771c402d439e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b2db10>
2026-03-30 10:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_e6600f155f125d4b7351c773916f47bd.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_e6600f155f125d4b7351c773916f47bd.jpg saved to cache
2026-03-30 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a850403-cdf6-5cad-9c91-928c81e3b593
2026-03-30 10:43:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5037f90>
2026-03-30 10:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_9654e36c600a44772cf6771c402d439e.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_9654e36c600a44772cf6771c402d439e.jpg saved to cache
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a850403-cdf6-5cad-9c91-928c81e3b593
2026-03-30 10:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_5345a39244f00d2bde82b3047eb04ec9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_a4fcb8a05f581b6186d8ad4922dd85ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe20d0>
2026-03-30 10:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_5345a39244f00d2bde82b3047eb04ec9.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_5345a39244f00d2bde82b3047eb04ec9.jpg saved to cache
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad131e25-0f14-52e0-ba74-14b0651af6a1
2026-03-30 10:43:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe2310>
2026-03-30 10:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fdc%252F9fdc98c505d2c2a4a065689b2ee098ed%252Fpa%252FNE24637_a4fcb8a05f581b6186d8ad4922dd85ec.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_a4fcb8a05f581b6186d8ad4922dd85ec.jpg saved to cache
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a850403-cdf6-5cad-9c91-928c81e3b593
2026-03-30 10:43:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a850403-cdf6-5cad-9c91-928c81e3b593, skipping ID generation
2026-03-30 10:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a850403-cdf6-5cad-9c91-928c81e3b593 with scrape type 1
2026-03-30 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a850403-cdf6-5cad-9c91-928c81e3b593 sending to next pipeline
2026-03-30 10:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a850403-cdf6-5cad-9c91-928c81e3b593, identifier: NE24637
2026-03-30 10:43:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a850403-cdf6-5cad-9c91-928c81e3b593 with identifier: NE24637
2026-03-30 10:43:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a850403-cdf6-5cad-9c91-928c81e3b593 with identifier: NE24637
2026-03-30 10:43:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a850403-cdf6-5cad-9c91-928c81e3b593 with identifier: NE24637 to the API
2026-03-30 10:43:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_a4fcb8a05f581b6186d8ad4922dd85ec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:22:40Z',
 'fuel_type': 'diesel',
 'id': '3a850403-cdf6-5cad-9c91-928c81e3b593',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE24637',
 'listing': 'auction',
 'location': 'DE, Ingolstadt',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 47417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2893393,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_a4fcb8a05f581b6186d8ad4922dd85ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3089278,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_8d19dd9d90665028a5e0204809d635d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2811220,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_9654e36c600a44772cf6771c402d439e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_e6600f155f125d4b7351c773916f47bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2896341,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_071ad8b36ba60455e83a872f1e841a08.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_c6bd349b161cf12344a1b5504112ec01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_8484acea6a569ed0370b2b7d4e380b33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3062153,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_7657bb3657901e14820a65c713ac75d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_a036f96a3a272a563edc8ae13f051f95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a850403-cdf6-5cad-9c91-928c81e3b593/3a850403-cdf6-5cad-9c91-928c81e3b593_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3000378,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/dc/9fdc98c505d2c2a4a065689b2ee098ed/pa/NE24637_471b6a487cba44a0d60436854a0c489b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2022}
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE24637%27 HTTP/1.1" 200 None
2026-03-30 10:43:19 [auto1.de] INFO: Saving data for NE24637: {'created_time': 1774867399.208389, 'last_price_update_time': 1774867399.208399, 'auction_closing_time': 1774970560.0}
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE24637') HTTP/1.1" 204 0
2026-03-30 10:43:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_440e487105dffcfbf11ebe1ac3fab4b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_14a05b5eb9f5802fe5dbbb8fc14f470c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_a8265c6fdb76b0fbcedbd92a1b02d1a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef596c250>
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_440e487105dffcfbf11ebe1ac3fab4b4.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_440e487105dffcfbf11ebe1ac3fab4b4.jpg saved to cache
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad131e25-0f14-52e0-ba74-14b0651af6a1
2026-03-30 10:43:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5034990>
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_14a05b5eb9f5802fe5dbbb8fc14f470c.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_14a05b5eb9f5802fe5dbbb8fc14f470c.jpg saved to cache
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad131e25-0f14-52e0-ba74-14b0651af6a1
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fba750>
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6df81a0f1f72009b1cc974dc9034b%252Fpa%252FLM89418_a8265c6fdb76b0fbcedbd92a1b02d1a0.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_a8265c6fdb76b0fbcedbd92a1b02d1a0.jpg saved to cache
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad131e25-0f14-52e0-ba74-14b0651af6a1
2026-03-30 10:43:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad131e25-0f14-52e0-ba74-14b0651af6a1, skipping ID generation
2026-03-30 10:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad131e25-0f14-52e0-ba74-14b0651af6a1 with scrape type 1
2026-03-30 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad131e25-0f14-52e0-ba74-14b0651af6a1 sending to next pipeline
2026-03-30 10:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad131e25-0f14-52e0-ba74-14b0651af6a1, identifier: LM89418
2026-03-30 10:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad131e25-0f14-52e0-ba74-14b0651af6a1 with identifier: LM89418
2026-03-30 10:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad131e25-0f14-52e0-ba74-14b0651af6a1 with identifier: LM89418
2026-03-30 10:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad131e25-0f14-52e0-ba74-14b0651af6a1 with identifier: LM89418 to the API
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_a8265c6fdb76b0fbcedbd92a1b02d1a0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:36:11Z',
 'fuel_type': 'diesel',
 'id': 'ad131e25-0f14-52e0-ba74-14b0651af6a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM89418',
 'listing': 'auction',
 'location': 'DE, Heidelberg',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 143557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_a8265c6fdb76b0fbcedbd92a1b02d1a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_440e487105dffcfbf11ebe1ac3fab4b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3016758,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_14a05b5eb9f5802fe5dbbb8fc14f470c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_5345a39244f00d2bde82b3047eb04ec9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_c8efbefbe2721c1f823f6682d8f6e226.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_74b84b8495e4fa9abcf63f4635a2981e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2370999,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_7a36750515f8f9bb145fe914df029da6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2524639,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_a636ee8d019731c344e11be254810ac9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_070058430ce556ace9318339c61ea462.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad131e25-0f14-52e0-ba74-14b0651af6a1/ad131e25-0f14-52e0-ba74-14b0651af6a1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6df81a0f1f72009b1cc974dc9034b/pa/LM89418_f0f920637142dca924b1a3128712f53f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2015}
2026-03-30 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89418%27 HTTP/1.1" 200 None
2026-03-30 10:43:20 [auto1.de] INFO: Saving data for LM89418: {'created_time': 1774867400.05878, 'last_price_update_time': 1774867400.058791, 'auction_closing_time': 1774971371.0}
2026-03-30 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM89418') HTTP/1.1" 204 0
2026-03-30 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM89950> (referer: https://www.auto1.com/v1/car-details-view/ZM89950/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9319ce9-91e5-5f9f-971b-63528d64a8fb with identifier: ZM89950
2026-03-30 10:43:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9319ce9-91e5-5f9f-971b-63528d64a8fb with scrape type 1
2026-03-30 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9319ce9-91e5-5f9f-971b-63528d64a8fb
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F49%252F8749cfd7f0b3bd660cf8bf3db0e2b61b%252Fpa%252FZM89950_ac72b1b5e8cef3d956094ad425f7de8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_ac72b1b5e8cef3d956094ad425f7de8a.jpg already downloaded
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F49%252F8749cfd7f0b3bd660cf8bf3db0e2b61b%252Fpa%252FZM89950_d816e11f6fbe81b94b97d4edd424e2b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_d816e11f6fbe81b94b97d4edd424e2b9.jpg already downloaded
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F49%252F8749cfd7f0b3bd660cf8bf3db0e2b61b%252Fpa%252FZM89950_e45dff3d28f5288630409f684b316a9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_e45dff3d28f5288630409f684b316a9f.jpg already downloaded
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F49%252F8749cfd7f0b3bd660cf8bf3db0e2b61b%252Fpa%252FZM89950_8b8eb30590d58108966baabfe8e6d8c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_8b8eb30590d58108966baabfe8e6d8c9.jpg already downloaded
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F49%252F8749cfd7f0b3bd660cf8bf3db0e2b61b%252Fpa%252FZM89950_e725d83d911ab8e6f58193e3f17595be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_e725d83d911ab8e6f58193e3f17595be.jpg already downloaded
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F49%252F8749cfd7f0b3bd660cf8bf3db0e2b61b%252Fpa%252FZM89950_2425b3486fa69f1a7d95728687a234a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_2425b3486fa69f1a7d95728687a234a3.jpg already downloaded
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F49%252F8749cfd7f0b3bd660cf8bf3db0e2b61b%252Fpa%252FZM89950_20bb36e5a93321e6fa91938b2657fe68.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_20bb36e5a93321e6fa91938b2657fe68.jpg already downloaded
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F49%252F8749cfd7f0b3bd660cf8bf3db0e2b61b%252Fpa%252FZM89950_4e94e93bc8d98444d28db32ac038d003.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_4e94e93bc8d98444d28db32ac038d003.jpg already downloaded
2026-03-30 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F49%252F8749cfd7f0b3bd660cf8bf3db0e2b61b%252Fpa%252FZM89950_370861d0e6b6248091c3aac2d734cd8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_370861d0e6b6248091c3aac2d734cd8a.jpg already downloaded
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F49%252F8749cfd7f0b3bd660cf8bf3db0e2b61b%252Fpa%252FZM89950_9d67e6ca35606a71d7dd1ef0fca95335.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_9d67e6ca35606a71d7dd1ef0fca95335.jpg already downloaded
2026-03-30 10:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9319ce9-91e5-5f9f-971b-63528d64a8fb, identifier: ZM89950
2026-03-30 10:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9319ce9-91e5-5f9f-971b-63528d64a8fb with identifier: ZM89950
2026-03-30 10:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9319ce9-91e5-5f9f-971b-63528d64a8fb with identifier: ZM89950
2026-03-30 10:43:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9319ce9-91e5-5f9f-971b-63528d64a8fb with identifier: ZM89950 to the API
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZM89950>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:26:45Z',
 'fuel_type': 'diesel',
 'id': 'a9319ce9-91e5-5f9f-971b-63528d64a8fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM89950',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 170861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_ac72b1b5e8cef3d956094ad425f7de8a.jpg',
                'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_d816e11f6fbe81b94b97d4edd424e2b9.jpg',
                'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_e45dff3d28f5288630409f684b316a9f.jpg',
                'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_8b8eb30590d58108966baabfe8e6d8c9.jpg',
                'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_e725d83d911ab8e6f58193e3f17595be.jpg',
                'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_2425b3486fa69f1a7d95728687a234a3.jpg',
                'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_20bb36e5a93321e6fa91938b2657fe68.jpg',
                'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_4e94e93bc8d98444d28db32ac038d003.jpg',
                'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_370861d0e6b6248091c3aac2d734cd8a.jpg',
                'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_9d67e6ca35606a71d7dd1ef0fca95335.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9319ce9-91e5-5f9f-971b-63528d64a8fb/a9319ce9-91e5-5f9f-971b-63528d64a8fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3143467,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_ac72b1b5e8cef3d956094ad425f7de8a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9319ce9-91e5-5f9f-971b-63528d64a8fb/a9319ce9-91e5-5f9f-971b-63528d64a8fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2724559,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_d816e11f6fbe81b94b97d4edd424e2b9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9319ce9-91e5-5f9f-971b-63528d64a8fb/a9319ce9-91e5-5f9f-971b-63528d64a8fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_e45dff3d28f5288630409f684b316a9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9319ce9-91e5-5f9f-971b-63528d64a8fb/a9319ce9-91e5-5f9f-971b-63528d64a8fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2833997,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_8b8eb30590d58108966baabfe8e6d8c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9319ce9-91e5-5f9f-971b-63528d64a8fb/a9319ce9-91e5-5f9f-971b-63528d64a8fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2910211,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_e725d83d911ab8e6f58193e3f17595be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9319ce9-91e5-5f9f-971b-63528d64a8fb/a9319ce9-91e5-5f9f-971b-63528d64a8fb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2750283,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_2425b3486fa69f1a7d95728687a234a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9319ce9-91e5-5f9f-971b-63528d64a8fb/a9319ce9-91e5-5f9f-971b-63528d64a8fb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703073,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_20bb36e5a93321e6fa91938b2657fe68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9319ce9-91e5-5f9f-971b-63528d64a8fb/a9319ce9-91e5-5f9f-971b-63528d64a8fb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_4e94e93bc8d98444d28db32ac038d003.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9319ce9-91e5-5f9f-971b-63528d64a8fb/a9319ce9-91e5-5f9f-971b-63528d64a8fb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2883625,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_370861d0e6b6248091c3aac2d734cd8a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9319ce9-91e5-5f9f-971b-63528d64a8fb/a9319ce9-91e5-5f9f-971b-63528d64a8fb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/49/8749cfd7f0b3bd660cf8bf3db0e2b61b/pa/ZM89950_9d67e6ca35606a71d7dd1ef0fca95335.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford S-Max 2.2 TDCi Titanium S',
 'transmission': 'automatic',
 'trim': 'Titanium S',
 'year': 2014}
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM89950%27 HTTP/1.1" 200 None
2026-03-30 10:43:22 [auto1.de] INFO: Saving data for ZM89950: {'created_time': 1774867402.431162, 'last_price_update_time': 1774867402.431172, 'auction_closing_time': 1774970805.0}
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM89950') HTTP/1.1" 204 0
2026-03-30 10:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MY16405> (referer: https://www.auto1.com/v1/car-details-view/MY16405/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f9dfaaa-df86-5c72-abf0-637c0c50a20e with identifier: MY16405
2026-03-30 10:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f9dfaaa-df86-5c72-abf0-637c0c50a20e with scrape type 1
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f9dfaaa-df86-5c72-abf0-637c0c50a20e
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_b40eeba88c7ee214dc3c9cf88c66c6f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_b40eeba88c7ee214dc3c9cf88c66c6f1.jpg not downloaded yet
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_7cdaef51c6c4a05aa67740baad213d43.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_7cdaef51c6c4a05aa67740baad213d43.jpg not downloaded yet
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_3706904c4368d4e02e26f7dcccd014df.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_3706904c4368d4e02e26f7dcccd014df.jpg not downloaded yet
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_7e310b97a0c1da4ddff2aa444ddd353b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_7e310b97a0c1da4ddff2aa444ddd353b.jpg not downloaded yet
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_db8b9a1c9e64da5eb96ca43b0746c7ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_db8b9a1c9e64da5eb96ca43b0746c7ad.jpg not downloaded yet
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_95d77097693e4d9605c778417881e635.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_95d77097693e4d9605c778417881e635.jpg not downloaded yet
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_24c8b56f800b4aedf5e424768d6d1a7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_24c8b56f800b4aedf5e424768d6d1a7e.jpg not downloaded yet
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_f9c54d0f78c83a0e1454d72208b727e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_f9c54d0f78c83a0e1454d72208b727e4.jpg not downloaded yet
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_1bddb5dcfd5164e65fa68e52225a44b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_1bddb5dcfd5164e65fa68e52225a44b1.jpg not downloaded yet
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_0faf8c587c548a23b86e1a8ef0d9ff8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_0faf8c587c548a23b86e1a8ef0d9ff8c.jpg not downloaded yet
2026-03-30 10:43:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY94240/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_0faf8c587c548a23b86e1a8ef0d9ff8c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb9c90>
2026-03-30 10:43:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_0faf8c587c548a23b86e1a8ef0d9ff8c.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_0faf8c587c548a23b86e1a8ef0d9ff8c.jpg saved to cache
2026-03-30 10:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f9dfaaa-df86-5c72-abf0-637c0c50a20e
2026-03-30 10:43:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SF81844> (referer: https://www.auto1.com/v1/car-details-view/SF81844/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16b9bae2-d97f-5917-bcb6-b1830ca7c808 with identifier: SF81844
2026-03-30 10:43:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16b9bae2-d97f-5917-bcb6-b1830ca7c808 with scrape type 1
2026-03-30 10:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 16b9bae2-d97f-5917-bcb6-b1830ca7c808
2026-03-30 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe9%252F98e9d9c2775d9cbd8654725d46299910%252Fpa%252FSF81844_e6f905540236d5828879b2c5b5f60ca5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e9/98e9d9c2775d9cbd8654725d46299910/pa/SF81844_e6f905540236d5828879b2c5b5f60ca5.jpg already downloaded
2026-03-30 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe9%252F98e9d9c2775d9cbd8654725d46299910%252Fpa%252FSF81844_6f6da0480422845161da23d7599bc705.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e9/98e9d9c2775d9cbd8654725d46299910/pa/SF81844_6f6da0480422845161da23d7599bc705.jpg already downloaded
2026-03-30 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe9%252F98e9d9c2775d9cbd8654725d46299910%252Fpa%252FSF81844_bfd3e041e18466fb3c3d99d170fd793f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e9/98e9d9c2775d9cbd8654725d46299910/pa/SF81844_bfd3e041e18466fb3c3d99d170fd793f.jpg already downloaded
2026-03-30 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe9%252F98e9d9c2775d9cbd8654725d46299910%252Fpa%252FSF81844_0fb5db8b3fc13b41c7fe3a61e0870d91.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e9/98e9d9c2775d9cbd8654725d46299910/pa/SF81844_0fb5db8b3fc13b41c7fe3a61e0870d91.jpg already downloaded
2026-03-30 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe9%252F98e9d9c2775d9cbd8654725d46299910%252Fpa%252FSF81844_55fbcee349a90a131b13dadd65d24558.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e9/98e9d9c2775d9cbd8654725d46299910/pa/SF81844_55fbcee349a90a131b13dadd65d24558.jpg already downloaded
2026-03-30 10:43:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16b9bae2-d97f-5917-bcb6-b1830ca7c808, identifier: SF81844
2026-03-30 10:43:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16b9bae2-d97f-5917-bcb6-b1830ca7c808 with identifier: SF81844
2026-03-30 10:43:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16b9bae2-d97f-5917-bcb6-b1830ca7c808 with identifier: SF81844
2026-03-30 10:43:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16b9bae2-d97f-5917-bcb6-b1830ca7c808 with identifier: SF81844 to the API
2026-03-30 10:43:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SF81844>
{'auction_title': '',
 'c_o_2_emission_value': 250,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.6L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:03:17Z',
 'fuel_type': 'petrol',
 'id': '16b9bae2-d97f-5917-bcb6-b1830ca7c808',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF81844',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 111961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img98/e9/98e9d9c2775d9cbd8654725d46299910/pa/SF81844_e6f905540236d5828879b2c5b5f60ca5.jpg',
                'https://img-pa.auto1.com/img98/e9/98e9d9c2775d9cbd8654725d46299910/pa/SF81844_6f6da0480422845161da23d7599bc705.jpg',
                'https://img-pa.auto1.com/img98/e9/98e9d9c2775d9cbd8654725d46299910/pa/SF81844_bfd3e041e18466fb3c3d99d170fd793f.jpg',
                'https://img-pa.auto1.com/img98/e9/98e9d9c2775d9cbd8654725d46299910/pa/SF81844_0fb5db8b3fc13b41c7fe3a61e0870d91.jpg',
                'https://img-pa.auto1.com/img98/e9/98e9d9c2775d9cbd8654725d46299910/pa/SF81844_55fbcee349a90a131b13dadd65d24558.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16b9bae2-d97f-5917-bcb6-b1830ca7c808/16b9bae2-d97f-5917-bcb6-b1830ca7c808_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e9/98e9d9c2775d9cbd8654725d46299910/pa/SF81844_e6f905540236d5828879b2c5b5f60ca5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16b9bae2-d97f-5917-bcb6-b1830ca7c808/16b9bae2-d97f-5917-bcb6-b1830ca7c808_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e9/98e9d9c2775d9cbd8654725d46299910/pa/SF81844_6f6da0480422845161da23d7599bc705.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16b9bae2-d97f-5917-bcb6-b1830ca7c808/16b9bae2-d97f-5917-bcb6-b1830ca7c808_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e9/98e9d9c2775d9cbd8654725d46299910/pa/SF81844_bfd3e041e18466fb3c3d99d170fd793f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16b9bae2-d97f-5917-bcb6-b1830ca7c808/16b9bae2-d97f-5917-bcb6-b1830ca7c808_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e9/98e9d9c2775d9cbd8654725d46299910/pa/SF81844_0fb5db8b3fc13b41c7fe3a61e0870d91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16b9bae2-d97f-5917-bcb6-b1830ca7c808/16b9bae2-d97f-5917-bcb6-b1830ca7c808_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e9/98e9d9c2775d9cbd8654725d46299910/pa/SF81844_55fbcee349a90a131b13dadd65d24558.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 240 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2000}
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF81844%27 HTTP/1.1" 200 None
2026-03-30 10:43:27 [auto1.de] INFO: Saving data for SF81844: {'created_time': 1774867407.17433, 'last_price_update_time': 1774867407.174341, 'auction_closing_time': 1774969397.0}
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF81844') HTTP/1.1" 204 0
2026-03-30 10:43:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_1bddb5dcfd5164e65fa68e52225a44b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG67358> (referer: https://www.auto1.com/v1/car-details-view/ZG67358/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0a250>
2026-03-30 10:43:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_1bddb5dcfd5164e65fa68e52225a44b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_1bddb5dcfd5164e65fa68e52225a44b1.jpg saved to cache
2026-03-30 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f9dfaaa-df86-5c72-abf0-637c0c50a20e
2026-03-30 10:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0539ae3f-8641-50da-8a39-0c5a8ee4f9fa with identifier: ZG67358
2026-03-30 10:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0539ae3f-8641-50da-8a39-0c5a8ee4f9fa with scrape type 1
2026-03-30 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0539ae3f-8641-50da-8a39-0c5a8ee4f9fa
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8cd2d88a614f9081fbcb3718a3f7b6%252Fpa%252FZG67358_9d0dc4e63aee47591074625cb5e41214.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_9d0dc4e63aee47591074625cb5e41214.jpg already downloaded
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8cd2d88a614f9081fbcb3718a3f7b6%252Fpa%252FZG67358_aedf3c8bb45314d81881c6b8f8097c24.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_aedf3c8bb45314d81881c6b8f8097c24.jpg already downloaded
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8cd2d88a614f9081fbcb3718a3f7b6%252Fpa%252FZG67358_e1b50037d8b30df40205340b5d89a69a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_e1b50037d8b30df40205340b5d89a69a.jpg already downloaded
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8cd2d88a614f9081fbcb3718a3f7b6%252Fpa%252FZG67358_32c9f53b4805f874500dde99ab2f032a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_32c9f53b4805f874500dde99ab2f032a.jpg already downloaded
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8cd2d88a614f9081fbcb3718a3f7b6%252Fpa%252FZG67358_ee8094ab711f6ad8d80497b32e520edd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_ee8094ab711f6ad8d80497b32e520edd.jpg already downloaded
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8cd2d88a614f9081fbcb3718a3f7b6%252Fpa%252FZG67358_640b7dfc07df63def40ad32308a2cce8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_640b7dfc07df63def40ad32308a2cce8.jpg already downloaded
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8cd2d88a614f9081fbcb3718a3f7b6%252Fpa%252FZG67358_86c970e4cc3decd79cc4f1c730bd59e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_86c970e4cc3decd79cc4f1c730bd59e2.jpg already downloaded
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8cd2d88a614f9081fbcb3718a3f7b6%252Fpa%252FZG67358_c4fb50ada78ac922b5c14feccacfd386.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_c4fb50ada78ac922b5c14feccacfd386.jpg already downloaded
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8cd2d88a614f9081fbcb3718a3f7b6%252Fpa%252FZG67358_76285ade43a9ef706fa097dbe6ca3494.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_76285ade43a9ef706fa097dbe6ca3494.jpg already downloaded
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8c%252F1e8cd2d88a614f9081fbcb3718a3f7b6%252Fpa%252FZG67358_ea0310f0c56220395b903faf3dfa40e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_ea0310f0c56220395b903faf3dfa40e2.jpg already downloaded
2026-03-30 10:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0539ae3f-8641-50da-8a39-0c5a8ee4f9fa, identifier: ZG67358
2026-03-30 10:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0539ae3f-8641-50da-8a39-0c5a8ee4f9fa with identifier: ZG67358
2026-03-30 10:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0539ae3f-8641-50da-8a39-0c5a8ee4f9fa with identifier: ZG67358
2026-03-30 10:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0539ae3f-8641-50da-8a39-0c5a8ee4f9fa with identifier: ZG67358 to the API
2026-03-30 10:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZG67358>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:33:39Z',
 'fuel_type': 'petrol',
 'id': '0539ae3f-8641-50da-8a39-0c5a8ee4f9fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG67358',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 118463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_9d0dc4e63aee47591074625cb5e41214.jpg',
                'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_aedf3c8bb45314d81881c6b8f8097c24.jpg',
                'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_e1b50037d8b30df40205340b5d89a69a.jpg',
                'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_32c9f53b4805f874500dde99ab2f032a.jpg',
                'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_ee8094ab711f6ad8d80497b32e520edd.jpg',
                'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_640b7dfc07df63def40ad32308a2cce8.jpg',
                'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_86c970e4cc3decd79cc4f1c730bd59e2.jpg',
                'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_c4fb50ada78ac922b5c14feccacfd386.jpg',
                'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_76285ade43a9ef706fa097dbe6ca3494.jpg',
                'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_ea0310f0c56220395b903faf3dfa40e2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0539ae3f-8641-50da-8a39-0c5a8ee4f9fa/0539ae3f-8641-50da-8a39-0c5a8ee4f9fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_9d0dc4e63aee47591074625cb5e41214.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0539ae3f-8641-50da-8a39-0c5a8ee4f9fa/0539ae3f-8641-50da-8a39-0c5a8ee4f9fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_aedf3c8bb45314d81881c6b8f8097c24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0539ae3f-8641-50da-8a39-0c5a8ee4f9fa/0539ae3f-8641-50da-8a39-0c5a8ee4f9fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2502730,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_e1b50037d8b30df40205340b5d89a69a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0539ae3f-8641-50da-8a39-0c5a8ee4f9fa/0539ae3f-8641-50da-8a39-0c5a8ee4f9fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2729210,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_32c9f53b4805f874500dde99ab2f032a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0539ae3f-8641-50da-8a39-0c5a8ee4f9fa/0539ae3f-8641-50da-8a39-0c5a8ee4f9fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2465246,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_ee8094ab711f6ad8d80497b32e520edd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0539ae3f-8641-50da-8a39-0c5a8ee4f9fa/0539ae3f-8641-50da-8a39-0c5a8ee4f9fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2575752,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_640b7dfc07df63def40ad32308a2cce8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0539ae3f-8641-50da-8a39-0c5a8ee4f9fa/0539ae3f-8641-50da-8a39-0c5a8ee4f9fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_86c970e4cc3decd79cc4f1c730bd59e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0539ae3f-8641-50da-8a39-0c5a8ee4f9fa/0539ae3f-8641-50da-8a39-0c5a8ee4f9fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2766206,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_c4fb50ada78ac922b5c14feccacfd386.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0539ae3f-8641-50da-8a39-0c5a8ee4f9fa/0539ae3f-8641-50da-8a39-0c5a8ee4f9fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_76285ade43a9ef706fa097dbe6ca3494.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0539ae3f-8641-50da-8a39-0c5a8ee4f9fa/0539ae3f-8641-50da-8a39-0c5a8ee4f9fa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/8c/1e8cd2d88a614f9081fbcb3718a3f7b6/pa/ZG67358_ea0310f0c56220395b903faf3dfa40e2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Fresh BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Fresh BlueMotion Tech',
 'year': 2014}
2026-03-30 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG67358%27 HTTP/1.1" 200 None
2026-03-30 10:43:28 [auto1.de] INFO: Saving data for ZG67358: {'created_time': 1774867408.88405, 'last_price_update_time': 1774867408.884062, 'auction_closing_time': 1774971219.0}
2026-03-30 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG67358') HTTP/1.1" 204 0
2026-03-30 10:43:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_24c8b56f800b4aedf5e424768d6d1a7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP86151/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_f9c54d0f78c83a0e1454d72208b727e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b09010>
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_24c8b56f800b4aedf5e424768d6d1a7e.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_24c8b56f800b4aedf5e424768d6d1a7e.jpg saved to cache
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f9dfaaa-df86-5c72-abf0-637c0c50a20e
2026-03-30 10:43:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e00190>
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_f9c54d0f78c83a0e1454d72208b727e4.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_f9c54d0f78c83a0e1454d72208b727e4.jpg saved to cache
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f9dfaaa-df86-5c72-abf0-637c0c50a20e
2026-03-30 10:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_db8b9a1c9e64da5eb96ca43b0746c7ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_7e310b97a0c1da4ddff2aa444ddd353b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_95d77097693e4d9605c778417881e635.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b01490>
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_db8b9a1c9e64da5eb96ca43b0746c7ad.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_db8b9a1c9e64da5eb96ca43b0746c7ad.jpg saved to cache
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f9dfaaa-df86-5c72-abf0-637c0c50a20e
2026-03-30 10:43:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eb76d0>
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_7e310b97a0c1da4ddff2aa444ddd353b.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_7e310b97a0c1da4ddff2aa444ddd353b.jpg saved to cache
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f9dfaaa-df86-5c72-abf0-637c0c50a20e
2026-03-30 10:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_3706904c4368d4e02e26f7dcccd014df.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb3210>
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_95d77097693e4d9605c778417881e635.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_95d77097693e4d9605c778417881e635.jpg saved to cache
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f9dfaaa-df86-5c72-abf0-637c0c50a20e
2026-03-30 10:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD73357> (referer: https://www.auto1.com/v1/car-details-view/SD73357/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0be50>
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_3706904c4368d4e02e26f7dcccd014df.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_3706904c4368d4e02e26f7dcccd014df.jpg saved to cache
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f9dfaaa-df86-5c72-abf0-637c0c50a20e
2026-03-30 10:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_b40eeba88c7ee214dc3c9cf88c66c6f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe with identifier: SD73357
2026-03-30 10:43:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe with scrape type 1
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_11502af29ee420133eeb9a7a0a9a2163.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_11502af29ee420133eeb9a7a0a9a2163.jpg not downloaded yet
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_8aa6e6fbb70e65038d83c5ca8a06e251.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_8aa6e6fbb70e65038d83c5ca8a06e251.jpg not downloaded yet
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_7f09dd4b70c281d0faffc49ba7e39873.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_7f09dd4b70c281d0faffc49ba7e39873.jpg not downloaded yet
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_d51bd11f772dcb1c76d1fc0f9ecf91a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_d51bd11f772dcb1c76d1fc0f9ecf91a0.jpg not downloaded yet
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0aad0>
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_b40eeba88c7ee214dc3c9cf88c66c6f1.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_b40eeba88c7ee214dc3c9cf88c66c6f1.jpg saved to cache
2026-03-30 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f9dfaaa-df86-5c72-abf0-637c0c50a20e
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_131a55e6ad5356a4a4c65879e3c9752d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_131a55e6ad5356a4a4c65879e3c9752d.jpg not downloaded yet
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_b792fc668dac704208762c8634ab7e39.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_b792fc668dac704208762c8634ab7e39.jpg not downloaded yet
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_77f80e9558e8778714bb3b3014776c31.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_77f80e9558e8778714bb3b3014776c31.jpg not downloaded yet
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_3a213d88bb324b6df193446ecffe8b4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_3a213d88bb324b6df193446ecffe8b4f.jpg not downloaded yet
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_0f1ab956109da573e56a9cc32af160eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_0f1ab956109da573e56a9cc32af160eb.jpg not downloaded yet
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_f596d3b070f030524a3ff0e6a8689cf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_f596d3b070f030524a3ff0e6a8689cf7.jpg not downloaded yet
2026-03-30 10:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_7cdaef51c6c4a05aa67740baad213d43.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e8b450>
2026-03-30 10:43:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Ff4%252F25f4270a26fbd4ee4b7c86a035e62013%252Fpa%252FMY16405_7cdaef51c6c4a05aa67740baad213d43.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_7cdaef51c6c4a05aa67740baad213d43.jpg saved to cache
2026-03-30 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f9dfaaa-df86-5c72-abf0-637c0c50a20e
2026-03-30 10:43:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f9dfaaa-df86-5c72-abf0-637c0c50a20e, skipping ID generation
2026-03-30 10:43:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f9dfaaa-df86-5c72-abf0-637c0c50a20e with scrape type 1
2026-03-30 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f9dfaaa-df86-5c72-abf0-637c0c50a20e sending to next pipeline
2026-03-30 10:43:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f9dfaaa-df86-5c72-abf0-637c0c50a20e, identifier: MY16405
2026-03-30 10:43:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f9dfaaa-df86-5c72-abf0-637c0c50a20e with identifier: MY16405
2026-03-30 10:43:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f9dfaaa-df86-5c72-abf0-637c0c50a20e with identifier: MY16405
2026-03-30 10:43:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f9dfaaa-df86-5c72-abf0-637c0c50a20e with identifier: MY16405 to the API
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_7cdaef51c6c4a05aa67740baad213d43.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:37:20Z',
 'fuel_type': 'petrol',
 'id': '5f9dfaaa-df86-5c72-abf0-637c0c50a20e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY16405',
 'listing': 'auction',
 'location': 'DE, Karlsruhe',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 227349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_b40eeba88c7ee214dc3c9cf88c66c6f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2861632,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_7cdaef51c6c4a05aa67740baad213d43.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_3706904c4368d4e02e26f7dcccd014df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2683606,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_7e310b97a0c1da4ddff2aa444ddd353b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_db8b9a1c9e64da5eb96ca43b0746c7ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2798997,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_95d77097693e4d9605c778417881e635.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_24c8b56f800b4aedf5e424768d6d1a7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2943029,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_f9c54d0f78c83a0e1454d72208b727e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_1bddb5dcfd5164e65fa68e52225a44b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f9dfaaa-df86-5c72-abf0-637c0c50a20e/5f9dfaaa-df86-5c72-abf0-637c0c50a20e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2808482,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/f4/25f4270a26fbd4ee4b7c86a035e62013/pa/MY16405_0faf8c587c548a23b86e1a8ef0d9ff8c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY16405%27 HTTP/1.1" 200 None
2026-03-30 10:43:30 [auto1.de] INFO: Saving data for MY16405: {'created_time': 1774867410.817147, 'last_price_update_time': 1774867410.81716, 'auction_closing_time': 1774971440.0}
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY16405') HTTP/1.1" 204 0
2026-03-30 10:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_f596d3b070f030524a3ff0e6a8689cf7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_0f1ab956109da573e56a9cc32af160eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c41450>
2026-03-30 10:43:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_f596d3b070f030524a3ff0e6a8689cf7.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_f596d3b070f030524a3ff0e6a8689cf7.jpg saved to cache
2026-03-30 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e889d0>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_0f1ab956109da573e56a9cc32af160eb.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_0f1ab956109da573e56a9cc32af160eb.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC82095> (referer: https://www.auto1.com/v1/car-details-view/YC82095/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_3a213d88bb324b6df193446ecffe8b4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_77f80e9558e8778714bb3b3014776c31.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d84f7bc-c947-5aae-8919-61218bf163a1 with identifier: YC82095
2026-03-30 10:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d84f7bc-c947-5aae-8919-61218bf163a1 with scrape type 1
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d84f7bc-c947-5aae-8919-61218bf163a1
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_820ce7ffdf135cedb38e5697baaed4f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_820ce7ffdf135cedb38e5697baaed4f6.jpg not downloaded yet
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_b792fc668dac704208762c8634ab7e39.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_c84b8174e92d6c59a478bd632e0b1e87.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_c84b8174e92d6c59a478bd632e0b1e87.jpg not downloaded yet
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_9ff83af114184716c17cbbd57904d649.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_9ff83af114184716c17cbbd57904d649.jpg not downloaded yet
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_901fc1a5acd0524908da764b02405ad5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_901fc1a5acd0524908da764b02405ad5.jpg not downloaded yet
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee7d50>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_3a213d88bb324b6df193446ecffe8b4f.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_3a213d88bb324b6df193446ecffe8b4f.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_299c6ec782bdff91b36b8011313a09e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_299c6ec782bdff91b36b8011313a09e6.jpg not downloaded yet
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fbb290>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_77f80e9558e8778714bb3b3014776c31.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_77f80e9558e8778714bb3b3014776c31.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_820ce7ffdf135cedb38e5697baaed4f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_131a55e6ad5356a4a4c65879e3c9752d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_7c0be5529d54357e5b509779183535ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_7c0be5529d54357e5b509779183535ce.jpg not downloaded yet
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb9bd0>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_b792fc668dac704208762c8634ab7e39.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_b792fc668dac704208762c8634ab7e39.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_8d2c88efb10e4bdf1134285fa96b4e50.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_8d2c88efb10e4bdf1134285fa96b4e50.jpg not downloaded yet
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_c1316dfd6934895a7a74df396a3f3a01.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_c1316dfd6934895a7a74df396a3f3a01.jpg not downloaded yet
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_9425c58b56f8283e08fe499613f27540.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_9425c58b56f8283e08fe499613f27540.jpg not downloaded yet
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_ebc8ec702268b5970b7cbf03b9a0bfbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_ebc8ec702268b5970b7cbf03b9a0bfbc.jpg not downloaded yet
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2aa10>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_820ce7ffdf135cedb38e5697baaed4f6.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_820ce7ffdf135cedb38e5697baaed4f6.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d84f7bc-c947-5aae-8919-61218bf163a1
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fea810>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_131a55e6ad5356a4a4c65879e3c9752d.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_131a55e6ad5356a4a4c65879e3c9752d.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_299c6ec782bdff91b36b8011313a09e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_901fc1a5acd0524908da764b02405ad5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_ebc8ec702268b5970b7cbf03b9a0bfbc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6bb90>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_299c6ec782bdff91b36b8011313a09e6.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_299c6ec782bdff91b36b8011313a09e6.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d84f7bc-c947-5aae-8919-61218bf163a1
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_c1316dfd6934895a7a74df396a3f3a01.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_9425c58b56f8283e08fe499613f27540.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef789c350>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_901fc1a5acd0524908da764b02405ad5.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_901fc1a5acd0524908da764b02405ad5.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d84f7bc-c947-5aae-8919-61218bf163a1
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e793d0>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_ebc8ec702268b5970b7cbf03b9a0bfbc.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_ebc8ec702268b5970b7cbf03b9a0bfbc.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d84f7bc-c947-5aae-8919-61218bf163a1
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_8d2c88efb10e4bdf1134285fa96b4e50.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a8f8d0>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_c1316dfd6934895a7a74df396a3f3a01.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_c1316dfd6934895a7a74df396a3f3a01.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d84f7bc-c947-5aae-8919-61218bf163a1
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe3210>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_9425c58b56f8283e08fe499613f27540.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_9425c58b56f8283e08fe499613f27540.jpg saved to cache
2026-03-30 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d84f7bc-c947-5aae-8919-61218bf163a1
2026-03-30 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_7c0be5529d54357e5b509779183535ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4df3190>
2026-03-30 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_8d2c88efb10e4bdf1134285fa96b4e50.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_8d2c88efb10e4bdf1134285fa96b4e50.jpg saved to cache
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d84f7bc-c947-5aae-8919-61218bf163a1
2026-03-30 10:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_9ff83af114184716c17cbbd57904d649.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_c84b8174e92d6c59a478bd632e0b1e87.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a67b90>
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_7c0be5529d54357e5b509779183535ce.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_7c0be5529d54357e5b509779183535ce.jpg saved to cache
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d84f7bc-c947-5aae-8919-61218bf163a1
2026-03-30 10:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_7f09dd4b70c281d0faffc49ba7e39873.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ddb750>
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_9ff83af114184716c17cbbd57904d649.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_9ff83af114184716c17cbbd57904d649.jpg saved to cache
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d84f7bc-c947-5aae-8919-61218bf163a1
2026-03-30 10:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_d51bd11f772dcb1c76d1fc0f9ecf91a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_8aa6e6fbb70e65038d83c5ca8a06e251.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f12450>
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F28%252F2828ddaf35ad6d7c022db11efe246381%252Fpa%252FYC82095_c84b8174e92d6c59a478bd632e0b1e87.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_c84b8174e92d6c59a478bd632e0b1e87.jpg saved to cache
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d84f7bc-c947-5aae-8919-61218bf163a1
2026-03-30 10:43:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d84f7bc-c947-5aae-8919-61218bf163a1, skipping ID generation
2026-03-30 10:43:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d84f7bc-c947-5aae-8919-61218bf163a1 with scrape type 1
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d84f7bc-c947-5aae-8919-61218bf163a1 sending to next pipeline
2026-03-30 10:43:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d84f7bc-c947-5aae-8919-61218bf163a1, identifier: YC82095
2026-03-30 10:43:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d84f7bc-c947-5aae-8919-61218bf163a1 with identifier: YC82095
2026-03-30 10:43:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d84f7bc-c947-5aae-8919-61218bf163a1 with identifier: YC82095
2026-03-30 10:43:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d84f7bc-c947-5aae-8919-61218bf163a1 with identifier: YC82095 to the API
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_c84b8174e92d6c59a478bd632e0b1e87.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:36:40Z',
 'fuel_type': 'petrol',
 'id': '4d84f7bc-c947-5aae-8919-61218bf163a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC82095',
 'listing': 'auction',
 'location': 'DE, Oldenburg',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 104174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_820ce7ffdf135cedb38e5697baaed4f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_c84b8174e92d6c59a478bd632e0b1e87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_9ff83af114184716c17cbbd57904d649.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_901fc1a5acd0524908da764b02405ad5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_299c6ec782bdff91b36b8011313a09e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_7c0be5529d54357e5b509779183535ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_8d2c88efb10e4bdf1134285fa96b4e50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_c1316dfd6934895a7a74df396a3f3a01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_9425c58b56f8283e08fe499613f27540.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d84f7bc-c947-5aae-8919-61218bf163a1/4d84f7bc-c947-5aae-8919-61218bf163a1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/28/2828ddaf35ad6d7c022db11efe246381/pa/YC82095_ebc8ec702268b5970b7cbf03b9a0bfbc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC82095%27 HTTP/1.1" 200 None
2026-03-30 10:43:32 [auto1.de] INFO: Saving data for YC82095: {'created_time': 1774867412.82334, 'last_price_update_time': 1774867412.823355, 'auction_closing_time': 1774971400.0}
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC82095') HTTP/1.1" 204 0
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a27090>
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_7f09dd4b70c281d0faffc49ba7e39873.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_7f09dd4b70c281d0faffc49ba7e39873.jpg saved to cache
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a96b50>
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_d51bd11f772dcb1c76d1fc0f9ecf91a0.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_d51bd11f772dcb1c76d1fc0f9ecf91a0.jpg saved to cache
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0f5d0>
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_8aa6e6fbb70e65038d83c5ca8a06e251.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_8aa6e6fbb70e65038d83c5ca8a06e251.jpg saved to cache
2026-03-30 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe
2026-03-30 10:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_11502af29ee420133eeb9a7a0a9a2163.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ece490>
2026-03-30 10:43:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F47%252Fe447e4bf4f9e315c6ca11ab210960772%252Fpa%252FSD73357_11502af29ee420133eeb9a7a0a9a2163.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_11502af29ee420133eeb9a7a0a9a2163.jpg saved to cache
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe
2026-03-30 10:43:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe, skipping ID generation
2026-03-30 10:43:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe with scrape type 1
2026-03-30 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe sending to next pipeline
2026-03-30 10:43:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe, identifier: SD73357
2026-03-30 10:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe with identifier: SD73357
2026-03-30 10:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe with identifier: SD73357
2026-03-30 10:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe with identifier: SD73357 to the API
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_11502af29ee420133eeb9a7a0a9a2163.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:01:38Z',
 'fuel_type': 'petrol',
 'id': '40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD73357',
 'listing': 'auction',
 'location': 'DE, Wismar',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 191850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_11502af29ee420133eeb9a7a0a9a2163.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_8aa6e6fbb70e65038d83c5ca8a06e251.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_7f09dd4b70c281d0faffc49ba7e39873.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_d51bd11f772dcb1c76d1fc0f9ecf91a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_131a55e6ad5356a4a4c65879e3c9752d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_b792fc668dac704208762c8634ab7e39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_77f80e9558e8778714bb3b3014776c31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_3a213d88bb324b6df193446ecffe8b4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_0f1ab956109da573e56a9cc32af160eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe/40c4d98c-02e4-5a6d-a462-34cf5c2ab2fe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/47/e447e4bf4f9e315c6ca11ab210960772/pa/SD73357_f596d3b070f030524a3ff0e6a8689cf7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2014}
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD73357%27 HTTP/1.1" 200 None
2026-03-30 10:43:34 [auto1.de] INFO: Saving data for SD73357: {'created_time': 1774867414.050845, 'last_price_update_time': 1774867414.050857, 'auction_closing_time': 1774969298.0}
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD73357') HTTP/1.1" 204 0
2026-03-30 10:43:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MX32778/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN56413/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP47539> (referer: https://www.auto1.com/v1/car-details-view/BP47539/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de61cc5e-edb5-5783-bde5-80437bcd92cd with identifier: BP47539
2026-03-30 10:43:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de61cc5e-edb5-5783-bde5-80437bcd92cd with scrape type 1
2026-03-30 10:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item de61cc5e-edb5-5783-bde5-80437bcd92cd
2026-03-30 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F60%252F57604948ba1f2d927e391b5c2433d252%252Fpa%252FBP47539_294aee314ea838605cea9be793edff7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_294aee314ea838605cea9be793edff7f.jpg not downloaded yet
2026-03-30 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F60%252F57604948ba1f2d927e391b5c2433d252%252Fpa%252FBP47539_251b29456f71328638b2fc0f3c1e1516.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_251b29456f71328638b2fc0f3c1e1516.jpg not downloaded yet
2026-03-30 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F60%252F57604948ba1f2d927e391b5c2433d252%252Fpa%252FBP47539_d1c6441dc79fb68b324cb977d020f9f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_d1c6441dc79fb68b324cb977d020f9f9.jpg not downloaded yet
2026-03-30 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F60%252F57604948ba1f2d927e391b5c2433d252%252Fpa%252FBP47539_eafdd36f07f55126df8b3b6cc520981c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_eafdd36f07f55126df8b3b6cc520981c.jpg not downloaded yet
2026-03-30 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F60%252F57604948ba1f2d927e391b5c2433d252%252Fpa%252FBP47539_53503a23b2c1bca6e2747536f8b75774.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_53503a23b2c1bca6e2747536f8b75774.jpg not downloaded yet
2026-03-30 10:43:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV99442/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_53503a23b2c1bca6e2747536f8b75774.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e62a90>
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de61cc5e-edb5-5783-bde5-80437bcd92cd/de61cc5e-edb5-5783-bde5-80437bcd92cd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F60%252F57604948ba1f2d927e391b5c2433d252%252Fpa%252FBP47539_53503a23b2c1bca6e2747536f8b75774.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_53503a23b2c1bca6e2747536f8b75774.jpg saved to cache
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de61cc5e-edb5-5783-bde5-80437bcd92cd
2026-03-30 10:43:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_eafdd36f07f55126df8b3b6cc520981c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e89b50>
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de61cc5e-edb5-5783-bde5-80437bcd92cd/de61cc5e-edb5-5783-bde5-80437bcd92cd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F60%252F57604948ba1f2d927e391b5c2433d252%252Fpa%252FBP47539_eafdd36f07f55126df8b3b6cc520981c.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_eafdd36f07f55126df8b3b6cc520981c.jpg saved to cache
2026-03-30 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de61cc5e-edb5-5783-bde5-80437bcd92cd
2026-03-30 10:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP86151> (referer: https://www.auto1.com/v1/car-details-view/UP86151/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_d1c6441dc79fb68b324cb977d020f9f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c51f845a-b46b-5322-acd8-e3b0f5ff41f3 with identifier: UP86151
2026-03-30 10:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c51f845a-b46b-5322-acd8-e3b0f5ff41f3 with scrape type 1
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c51f845a-b46b-5322-acd8-e3b0f5ff41f3
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_ba64d2cfb354812a8fd6a86a28e5e7ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_ba64d2cfb354812a8fd6a86a28e5e7ad.jpg not downloaded yet
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_61b5ad1fbfa6318328847a3767bde5f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_61b5ad1fbfa6318328847a3767bde5f2.jpg not downloaded yet
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_8364a5250115e72207be5860e50a32fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_8364a5250115e72207be5860e50a32fc.jpg not downloaded yet
2026-03-30 10:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_251b29456f71328638b2fc0f3c1e1516.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_ed09783fec7f9d096d8ff04ae809b121.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_ed09783fec7f9d096d8ff04ae809b121.jpg not downloaded yet
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_56e35deca3a53947ae16d5625fd757e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_56e35deca3a53947ae16d5625fd757e0.jpg not downloaded yet
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_6448a571fa0bc92ad70cc247e4619812.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_6448a571fa0bc92ad70cc247e4619812.jpg not downloaded yet
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0aa90>
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de61cc5e-edb5-5783-bde5-80437bcd92cd/de61cc5e-edb5-5783-bde5-80437bcd92cd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F60%252F57604948ba1f2d927e391b5c2433d252%252Fpa%252FBP47539_d1c6441dc79fb68b324cb977d020f9f9.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_d1c6441dc79fb68b324cb977d020f9f9.jpg saved to cache
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de61cc5e-edb5-5783-bde5-80437bcd92cd
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_c790169a6dbef0e2fcdd21b63915d1ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_c790169a6dbef0e2fcdd21b63915d1ea.jpg not downloaded yet
2026-03-30 10:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_61b5ad1fbfa6318328847a3767bde5f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_a6e7b4889abae84b5050f5df32808664.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_a6e7b4889abae84b5050f5df32808664.jpg not downloaded yet
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_57ec0f163ff5ccfab5ea09bb9c4dd744.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_57ec0f163ff5ccfab5ea09bb9c4dd744.jpg not downloaded yet
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ae2f90>
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de61cc5e-edb5-5783-bde5-80437bcd92cd/de61cc5e-edb5-5783-bde5-80437bcd92cd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F60%252F57604948ba1f2d927e391b5c2433d252%252Fpa%252FBP47539_251b29456f71328638b2fc0f3c1e1516.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_251b29456f71328638b2fc0f3c1e1516.jpg saved to cache
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de61cc5e-edb5-5783-bde5-80437bcd92cd
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_0c4b331982bf5a042671c056fd61df81.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_0c4b331982bf5a042671c056fd61df81.jpg not downloaded yet
2026-03-30 10:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_6448a571fa0bc92ad70cc247e4619812.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ffce90>
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_61b5ad1fbfa6318328847a3767bde5f2.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_61b5ad1fbfa6318328847a3767bde5f2.jpg saved to cache
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c51f845a-b46b-5322-acd8-e3b0f5ff41f3
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7885390>
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_6448a571fa0bc92ad70cc247e4619812.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_6448a571fa0bc92ad70cc247e4619812.jpg saved to cache
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c51f845a-b46b-5322-acd8-e3b0f5ff41f3
2026-03-30 10:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_57ec0f163ff5ccfab5ea09bb9c4dd744.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_0c4b331982bf5a042671c056fd61df81.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ddb3d0>
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_57ec0f163ff5ccfab5ea09bb9c4dd744.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_57ec0f163ff5ccfab5ea09bb9c4dd744.jpg saved to cache
2026-03-30 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c51f845a-b46b-5322-acd8-e3b0f5ff41f3
2026-03-30 10:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_a6e7b4889abae84b5050f5df32808664.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef79f9c90>
2026-03-30 10:43:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_0c4b331982bf5a042671c056fd61df81.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_0c4b331982bf5a042671c056fd61df81.jpg saved to cache
2026-03-30 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c51f845a-b46b-5322-acd8-e3b0f5ff41f3
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ecdb50>
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_a6e7b4889abae84b5050f5df32808664.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_a6e7b4889abae84b5050f5df32808664.jpg saved to cache
2026-03-30 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c51f845a-b46b-5322-acd8-e3b0f5ff41f3
2026-03-30 10:43:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_c790169a6dbef0e2fcdd21b63915d1ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da1650>
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_c790169a6dbef0e2fcdd21b63915d1ea.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_c790169a6dbef0e2fcdd21b63915d1ea.jpg saved to cache
2026-03-30 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c51f845a-b46b-5322-acd8-e3b0f5ff41f3
2026-03-30 10:43:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_56e35deca3a53947ae16d5625fd757e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_ed09783fec7f9d096d8ff04ae809b121.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e63690>
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_56e35deca3a53947ae16d5625fd757e0.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_56e35deca3a53947ae16d5625fd757e0.jpg saved to cache
2026-03-30 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c51f845a-b46b-5322-acd8-e3b0f5ff41f3
2026-03-30 10:43:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_8364a5250115e72207be5860e50a32fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb5750>
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_ed09783fec7f9d096d8ff04ae809b121.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_ed09783fec7f9d096d8ff04ae809b121.jpg saved to cache
2026-03-30 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c51f845a-b46b-5322-acd8-e3b0f5ff41f3
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e89890>
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_8364a5250115e72207be5860e50a32fc.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_8364a5250115e72207be5860e50a32fc.jpg saved to cache
2026-03-30 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c51f845a-b46b-5322-acd8-e3b0f5ff41f3
2026-03-30 10:43:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_ba64d2cfb354812a8fd6a86a28e5e7ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_294aee314ea838605cea9be793edff7f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f47150>
2026-03-30 10:43:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ffe%252Fc3fe33f42aee3f2ef25811cfc44e0f25%252Fpa%252FUP86151_ba64d2cfb354812a8fd6a86a28e5e7ad.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_ba64d2cfb354812a8fd6a86a28e5e7ad.jpg saved to cache
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c51f845a-b46b-5322-acd8-e3b0f5ff41f3
2026-03-30 10:43:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c51f845a-b46b-5322-acd8-e3b0f5ff41f3, skipping ID generation
2026-03-30 10:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c51f845a-b46b-5322-acd8-e3b0f5ff41f3 with scrape type 1
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c51f845a-b46b-5322-acd8-e3b0f5ff41f3 sending to next pipeline
2026-03-30 10:43:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c51f845a-b46b-5322-acd8-e3b0f5ff41f3, identifier: UP86151
2026-03-30 10:43:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c51f845a-b46b-5322-acd8-e3b0f5ff41f3 with identifier: UP86151
2026-03-30 10:43:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c51f845a-b46b-5322-acd8-e3b0f5ff41f3 with identifier: UP86151
2026-03-30 10:43:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c51f845a-b46b-5322-acd8-e3b0f5ff41f3 with identifier: UP86151 to the API
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_ba64d2cfb354812a8fd6a86a28e5e7ad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:15:09Z',
 'fuel_type': 'petrol',
 'id': 'c51f845a-b46b-5322-acd8-e3b0f5ff41f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP86151',
 'listing': 'auction',
 'location': 'DE, Göttingen',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 96079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_ba64d2cfb354812a8fd6a86a28e5e7ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_61b5ad1fbfa6318328847a3767bde5f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_8364a5250115e72207be5860e50a32fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_ed09783fec7f9d096d8ff04ae809b121.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_56e35deca3a53947ae16d5625fd757e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_6448a571fa0bc92ad70cc247e4619812.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_c790169a6dbef0e2fcdd21b63915d1ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_a6e7b4889abae84b5050f5df32808664.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3377360,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_57ec0f163ff5ccfab5ea09bb9c4dd744.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51f845a-b46b-5322-acd8-e3b0f5ff41f3/c51f845a-b46b-5322-acd8-e3b0f5ff41f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/fe/c3fe33f42aee3f2ef25811cfc44e0f25/pa/UP86151_0c4b331982bf5a042671c056fd61df81.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-03',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2013}
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP86151%27 HTTP/1.1" 200 None
2026-03-30 10:43:50 [auto1.de] INFO: Saving data for UP86151: {'created_time': 1774867430.633309, 'last_price_update_time': 1774867430.63332, 'auction_closing_time': 1774970109.0}
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP86151') HTTP/1.1" 204 0
2026-03-30 10:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_871450bb0d12ff9098cb74df503c99e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TM60818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ae1610>
2026-03-30 10:43:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de61cc5e-edb5-5783-bde5-80437bcd92cd/de61cc5e-edb5-5783-bde5-80437bcd92cd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F60%252F57604948ba1f2d927e391b5c2433d252%252Fpa%252FBP47539_294aee314ea838605cea9be793edff7f.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_294aee314ea838605cea9be793edff7f.jpg saved to cache
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de61cc5e-edb5-5783-bde5-80437bcd92cd
2026-03-30 10:43:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de61cc5e-edb5-5783-bde5-80437bcd92cd, skipping ID generation
2026-03-30 10:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de61cc5e-edb5-5783-bde5-80437bcd92cd with scrape type 1
2026-03-30 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de61cc5e-edb5-5783-bde5-80437bcd92cd sending to next pipeline
2026-03-30 10:43:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de61cc5e-edb5-5783-bde5-80437bcd92cd, identifier: BP47539
2026-03-30 10:43:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de61cc5e-edb5-5783-bde5-80437bcd92cd with identifier: BP47539
2026-03-30 10:43:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de61cc5e-edb5-5783-bde5-80437bcd92cd with identifier: BP47539
2026-03-30 10:43:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de61cc5e-edb5-5783-bde5-80437bcd92cd with identifier: BP47539 to the API
2026-03-30 10:43:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_294aee314ea838605cea9be793edff7f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:55:01Z',
 'fuel_type': 'petrol',
 'id': 'de61cc5e-edb5-5783-bde5-80437bcd92cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP47539',
 'listing': 'auction',
 'location': 'DE, Bayreuth',
 'make': 'BMW',
 'model': '1er',
 'odometer': 170985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de61cc5e-edb5-5783-bde5-80437bcd92cd/de61cc5e-edb5-5783-bde5-80437bcd92cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_294aee314ea838605cea9be793edff7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de61cc5e-edb5-5783-bde5-80437bcd92cd/de61cc5e-edb5-5783-bde5-80437bcd92cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_251b29456f71328638b2fc0f3c1e1516.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de61cc5e-edb5-5783-bde5-80437bcd92cd/de61cc5e-edb5-5783-bde5-80437bcd92cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_d1c6441dc79fb68b324cb977d020f9f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de61cc5e-edb5-5783-bde5-80437bcd92cd/de61cc5e-edb5-5783-bde5-80437bcd92cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_eafdd36f07f55126df8b3b6cc520981c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de61cc5e-edb5-5783-bde5-80437bcd92cd/de61cc5e-edb5-5783-bde5-80437bcd92cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/60/57604948ba1f2d927e391b5c2433d252/pa/BP47539_53503a23b2c1bca6e2747536f8b75774.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP47539%27 HTTP/1.1" 200 None
2026-03-30 10:43:51 [auto1.de] INFO: Saving data for BP47539: {'created_time': 1774867431.192959, 'last_price_update_time': 1774867431.192969, 'auction_closing_time': 1774972501.0}
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP47539') HTTP/1.1" 204 0
2026-03-30 10:43:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE98527/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b21d90>
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F8c%252F2a8c54d2a7a7ec327f9417000a903c0b%252Fpa%252FVC21585_871450bb0d12ff9098cb74df503c99e6.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_871450bb0d12ff9098cb74df503c99e6.jpg saved to cache
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08865125-5435-54f8-9e5a-3c9855c2b82b
2026-03-30 10:43:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08865125-5435-54f8-9e5a-3c9855c2b82b, skipping ID generation
2026-03-30 10:43:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08865125-5435-54f8-9e5a-3c9855c2b82b with scrape type 1
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08865125-5435-54f8-9e5a-3c9855c2b82b sending to next pipeline
2026-03-30 10:43:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08865125-5435-54f8-9e5a-3c9855c2b82b, identifier: VC21585
2026-03-30 10:43:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08865125-5435-54f8-9e5a-3c9855c2b82b with identifier: VC21585
2026-03-30 10:43:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08865125-5435-54f8-9e5a-3c9855c2b82b with identifier: VC21585
2026-03-30 10:43:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08865125-5435-54f8-9e5a-3c9855c2b82b with identifier: VC21585 to the API
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_871450bb0d12ff9098cb74df503c99e6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:12:35Z',
 'fuel_type': 'petrol',
 'id': '08865125-5435-54f8-9e5a-3c9855c2b82b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC21585',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Fiat',
 'model': '500',
 'odometer': 91513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_380229a355044a995b07ff2300fade03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_871450bb0d12ff9098cb74df503c99e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_d1718f318678a625084def2581485afb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_e4cdb549583912b9a16a7f5b574b73ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_1ccf9616217659d26e700a49fb61ffe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_ebbcf6c4166d75eb93bc3c27dc29c267.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_1bb7f675d4f0381563a4484bbcc0b8c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_d4e7bbcde48ed68a42451567fca5da19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_b731629dd7fc5b4c70668b83c40486e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08865125-5435-54f8-9e5a-3c9855c2b82b/08865125-5435-54f8-9e5a-3c9855c2b82b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/8c/2a8c54d2a7a7ec327f9417000a903c0b/pa/VC21585_d2c93888eda5c42c5b23a824d4a0b90e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 0.9 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2018}
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC21585%27 HTTP/1.1" 200 None
2026-03-30 10:43:51 [auto1.de] INFO: Saving data for VC21585: {'created_time': 1774867431.696119, 'last_price_update_time': 1774867431.696135, 'auction_closing_time': 1774969955.0}
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC21585') HTTP/1.1" 204 0
2026-03-30 10:43:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_58838e80066f76997595a79ffccfd12f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_6621af3432187c6ca45ee675c8b87d03.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50736d0>
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32597ede-11c0-54b0-86a3-01a15dfadc2c/32597ede-11c0-54b0-86a3-01a15dfadc2c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F86%252F2f86619233805d65f32d270490a5cfb2%252Fpa%252FHK07148_58838e80066f76997595a79ffccfd12f.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_58838e80066f76997595a79ffccfd12f.jpg saved to cache
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 32597ede-11c0-54b0-86a3-01a15dfadc2c
2026-03-30 10:43:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32597ede-11c0-54b0-86a3-01a15dfadc2c, skipping ID generation
2026-03-30 10:43:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32597ede-11c0-54b0-86a3-01a15dfadc2c with scrape type 1
2026-03-30 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32597ede-11c0-54b0-86a3-01a15dfadc2c sending to next pipeline
2026-03-30 10:43:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32597ede-11c0-54b0-86a3-01a15dfadc2c, identifier: HK07148
2026-03-30 10:43:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32597ede-11c0-54b0-86a3-01a15dfadc2c with identifier: HK07148
2026-03-30 10:43:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-30 10:43:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:43:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32597ede-11c0-54b0-86a3-01a15dfadc2c with identifier: HK07148
2026-03-30 10:43:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32597ede-11c0-54b0-86a3-01a15dfadc2c with identifier: HK07148 to the API
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_58838e80066f76997595a79ffccfd12f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:04:26Z',
 'fuel_type': 'petrol',
 'id': '32597ede-11c0-54b0-86a3-01a15dfadc2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK07148',
 'listing': 'auction',
 'location': 'DE, Greifswald',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 145427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32597ede-11c0-54b0-86a3-01a15dfadc2c/32597ede-11c0-54b0-86a3-01a15dfadc2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_574e3c3765f491a3c40cd95dfb518118.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32597ede-11c0-54b0-86a3-01a15dfadc2c/32597ede-11c0-54b0-86a3-01a15dfadc2c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_46b0a3dd90186e9658948c09a41f40a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32597ede-11c0-54b0-86a3-01a15dfadc2c/32597ede-11c0-54b0-86a3-01a15dfadc2c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_045a21c01cffc63974b99813fa303eca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32597ede-11c0-54b0-86a3-01a15dfadc2c/32597ede-11c0-54b0-86a3-01a15dfadc2c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_b5a9e33b2ba747a35d239037ca77c1b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32597ede-11c0-54b0-86a3-01a15dfadc2c/32597ede-11c0-54b0-86a3-01a15dfadc2c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/86/2f86619233805d65f32d270490a5cfb2/pa/HK07148_58838e80066f76997595a79ffccfd12f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-09-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Edition Dynamique',
 'transmission': 'manual',
 'trim': 'Edition Dynamique',
 'year': 2008}
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK07148%27 HTTP/1.1" 200 None
2026-03-30 10:43:52 [auto1.de] INFO: Saving data for HK07148: {'created_time': 1774867432.866427, 'last_price_update_time': 1774867432.866441, 'auction_closing_time': 1774969466.0}
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK07148') HTTP/1.1" 204 0
2026-03-30 10:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AE13145/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5072bd0>
2026-03-30 10:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bfede8-da23-5e5f-bb44-1332f5105aad/08bfede8-da23-5e5f-bb44-1332f5105aad_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fab%252Fb6ab4d6f894d932a41ad66dad7c351ac%252Fpa%252FTD64392_6621af3432187c6ca45ee675c8b87d03.jpg') HTTP/1.1" 204 0
2026-03-30 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_6621af3432187c6ca45ee675c8b87d03.jpg saved to cache
2026-03-30 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08bfede8-da23-5e5f-bb44-1332f5105aad
2026-03-30 10:43:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08bfede8-da23-5e5f-bb44-1332f5105aad, skipping ID generation
2026-03-30 10:43:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08bfede8-da23-5e5f-bb44-1332f5105aad with scrape type 1
2026-03-30 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08bfede8-da23-5e5f-bb44-1332f5105aad sending to next pipeline
2026-03-30 10:43:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08bfede8-da23-5e5f-bb44-1332f5105aad, identifier: TD64392
2026-03-30 10:43:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08bfede8-da23-5e5f-bb44-1332f5105aad with identifier: TD64392
2026-03-30 10:43:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08bfede8-da23-5e5f-bb44-1332f5105aad with identifier: TD64392
2026-03-30 10:43:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08bfede8-da23-5e5f-bb44-1332f5105aad with identifier: TD64392 to the API
2026-03-30 10:43:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_6621af3432187c6ca45ee675c8b87d03.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:39:14Z',
 'fuel_type': 'petrol',
 'id': '08bfede8-da23-5e5f-bb44-1332f5105aad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD64392',
 'listing': 'auction',
 'location': 'DE, Kempten (Allgäu)',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 196446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bfede8-da23-5e5f-bb44-1332f5105aad/08bfede8-da23-5e5f-bb44-1332f5105aad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_166a327f4e5e5a4064085ba545726cfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bfede8-da23-5e5f-bb44-1332f5105aad/08bfede8-da23-5e5f-bb44-1332f5105aad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_6621af3432187c6ca45ee675c8b87d03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bfede8-da23-5e5f-bb44-1332f5105aad/08bfede8-da23-5e5f-bb44-1332f5105aad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_a519cbaa40d82248079bbc4e6ebab700.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bfede8-da23-5e5f-bb44-1332f5105aad/08bfede8-da23-5e5f-bb44-1332f5105aad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_2d9e542c06316a64c809f13d0b6460ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bfede8-da23-5e5f-bb44-1332f5105aad/08bfede8-da23-5e5f-bb44-1332f5105aad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_5488583c138b7f7229e72abcb96153b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bfede8-da23-5e5f-bb44-1332f5105aad/08bfede8-da23-5e5f-bb44-1332f5105aad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ab/b6ab4d6f894d932a41ad66dad7c351ac/pa/TD64392_fcb09084947348604b57c12766d3f28f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Europe',
 'transmission': 'manual',
 'trim': 'Europe',
 'year': 2011}
2026-03-30 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD64392%27 HTTP/1.1" 200 None
2026-03-30 10:43:53 [auto1.de] INFO: Saving data for TD64392: {'created_time': 1774867433.515598, 'last_price_update_time': 1774867433.515606, 'auction_closing_time': 1774971554.0}
2026-03-30 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD64392') HTTP/1.1" 204 0
2026-03-30 10:43:53 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.336(s), this was the 1st time calling it.
2026-03-30 10:43:53 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.800251290677886 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:43:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY94240> (referer: https://www.auto1.com/v1/car-details-view/XY94240/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1 with identifier: XY94240
2026-03-30 10:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1 with scrape type 1
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F4f%252F904fdba2ff55363c2f2f945038eeb7ea%252Fpa%252FXY94240_fe835d4652aa5fccbc3eaff86abc8a91.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_fe835d4652aa5fccbc3eaff86abc8a91.jpg already downloaded
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F4f%252F904fdba2ff55363c2f2f945038eeb7ea%252Fpa%252FXY94240_57e6975de381f5494096337c58c49704.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_57e6975de381f5494096337c58c49704.jpg already downloaded
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F4f%252F904fdba2ff55363c2f2f945038eeb7ea%252Fpa%252FXY94240_b0d95265ce4176948a5c56e08a12ba01.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_b0d95265ce4176948a5c56e08a12ba01.jpg already downloaded
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F4f%252F904fdba2ff55363c2f2f945038eeb7ea%252Fpa%252FXY94240_71931c935d3e1a9293733cbc91c83bc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_71931c935d3e1a9293733cbc91c83bc7.jpg already downloaded
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F4f%252F904fdba2ff55363c2f2f945038eeb7ea%252Fpa%252FXY94240_d5f7d1b05ad4de596a8dca8dbc9316df.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_d5f7d1b05ad4de596a8dca8dbc9316df.jpg already downloaded
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F4f%252F904fdba2ff55363c2f2f945038eeb7ea%252Fpa%252FXY94240_3cdb1020d3151343b9abc4da65bdfcd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_3cdb1020d3151343b9abc4da65bdfcd6.jpg already downloaded
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F4f%252F904fdba2ff55363c2f2f945038eeb7ea%252Fpa%252FXY94240_eaef07155c2daf08fdbfcaa778d98f23.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_eaef07155c2daf08fdbfcaa778d98f23.jpg already downloaded
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F4f%252F904fdba2ff55363c2f2f945038eeb7ea%252Fpa%252FXY94240_1ebc80ca7420f4311f4a09140f23c5a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_1ebc80ca7420f4311f4a09140f23c5a7.jpg already downloaded
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F4f%252F904fdba2ff55363c2f2f945038eeb7ea%252Fpa%252FXY94240_7eeb7cb5d690fc65bf420d8086f26ca3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_7eeb7cb5d690fc65bf420d8086f26ca3.jpg already downloaded
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F4f%252F904fdba2ff55363c2f2f945038eeb7ea%252Fpa%252FXY94240_6db942d2c045ac615b8ceef02fca5735.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_6db942d2c045ac615b8ceef02fca5735.jpg already downloaded
2026-03-30 10:43:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1, identifier: XY94240
2026-03-30 10:43:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1 with identifier: XY94240
2026-03-30 10:43:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1 with identifier: XY94240
2026-03-30 10:43:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1 with identifier: XY94240 to the API
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XY94240>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-31T15:26:17Z',
 'fuel_type': 'petrol',
 'id': 'bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY94240',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 93437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_fe835d4652aa5fccbc3eaff86abc8a91.jpg',
                'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_57e6975de381f5494096337c58c49704.jpg',
                'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_b0d95265ce4176948a5c56e08a12ba01.jpg',
                'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_71931c935d3e1a9293733cbc91c83bc7.jpg',
                'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_d5f7d1b05ad4de596a8dca8dbc9316df.jpg',
                'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_3cdb1020d3151343b9abc4da65bdfcd6.jpg',
                'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_eaef07155c2daf08fdbfcaa778d98f23.jpg',
                'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_1ebc80ca7420f4311f4a09140f23c5a7.jpg',
                'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_7eeb7cb5d690fc65bf420d8086f26ca3.jpg',
                'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_6db942d2c045ac615b8ceef02fca5735.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1/bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2309616,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_fe835d4652aa5fccbc3eaff86abc8a91.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1/bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2214655,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_57e6975de381f5494096337c58c49704.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1/bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2252803,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_b0d95265ce4176948a5c56e08a12ba01.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1/bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_71931c935d3e1a9293733cbc91c83bc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1/bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2716528,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_d5f7d1b05ad4de596a8dca8dbc9316df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1/bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2733751,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_3cdb1020d3151343b9abc4da65bdfcd6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1/bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_eaef07155c2daf08fdbfcaa778d98f23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1/bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2891899,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_1ebc80ca7420f4311f4a09140f23c5a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1/bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_7eeb7cb5d690fc65bf420d8086f26ca3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1/bd0f02d6-6c3a-5d16-9f7f-5b51c93641d1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2671168,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/4f/904fdba2ff55363c2f2f945038eeb7ea/pa/XY94240_6db942d2c045ac615b8ceef02fca5735.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-13',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Adam 1.4 Jam ecoFlex',
 'transmission': 'manual',
 'trim': 'Jam ecoFlex',
 'year': 2017}
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY94240%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [auto1.de] INFO: Saving data for XY94240: {'created_time': 1774867434.668058, 'last_price_update_time': 1774867434.668069, 'auction_closing_time': 1774970777.0}
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY94240') HTTP/1.1" 204 0
2026-03-30 10:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:54 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 9457 | hits on page: 40
2026-03-30 10:43:54 [auto1.de] INFO: Found listing with ID: SN55790
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN55790%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [auto1.de] INFO: Scrape type for SN55790: 0
2026-03-30 10:43:54 [auto1.de] INFO: Found listing with ID: MZ56747
2026-03-30 10:43:54 [auto1.de] INFO: Found listing with ID: UR76017
2026-03-30 10:43:54 [auto1.de] INFO: Found listing with ID: PA34245
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA34245%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [auto1.de] INFO: Scrape type for PA34245: 0
2026-03-30 10:43:54 [auto1.de] INFO: Found listing with ID: JP72611
2026-03-30 10:43:54 [auto1.de] INFO: Found listing with ID: SB79116
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB79116%27 HTTP/1.1" 200 None
2026-03-30 10:43:54 [auto1.de] INFO: Scrape type for SB79116: 0
2026-03-30 10:43:54 [auto1.de] INFO: Found listing with ID: XY94240
2026-03-30 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY94240%27 HTTP/1.1" 200 None
2026-03-30 10:43:55 [auto1.de] INFO: Scrape type for XY94240: 0
2026-03-30 10:43:55 [auto1.de] INFO: Found listing with ID: PT50052
2026-03-30 10:43:55 [auto1.de] INFO: Found listing with ID: WK68540
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK68540%27 HTTP/1.1" 200 None
2026-03-30 10:43:55 [auto1.de] INFO: Scrape type for WK68540: 1
2026-03-30 10:43:55 [auto1.de] INFO: Found listing with ID: NZ13044
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ13044%27 HTTP/1.1" 200 None
2026-03-30 10:43:55 [auto1.de] INFO: Scrape type for NZ13044: 1
2026-03-30 10:43:55 [auto1.de] INFO: Found listing with ID: WS16596
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS16596%27 HTTP/1.1" 200 None
2026-03-30 10:43:55 [auto1.de] INFO: Scrape type for WS16596: 1
2026-03-30 10:43:55 [auto1.de] INFO: Found listing with ID: WS95832
2026-03-30 10:43:55 [auto1.de] INFO: Found listing with ID: JF28410
2026-03-30 10:43:55 [auto1.de] INFO: Found listing with ID: UY77162
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY77162%27 HTTP/1.1" 200 None
2026-03-30 10:43:55 [auto1.de] INFO: Scrape type for UY77162: 1
2026-03-30 10:43:55 [auto1.de] INFO: Found listing with ID: WV54187
2026-03-30 10:43:55 [auto1.de] INFO: Found listing with ID: ZE83569
2026-03-30 10:43:55 [auto1.de] INFO: Found listing with ID: CS21706
2026-03-30 10:43:55 [auto1.de] INFO: Found listing with ID: YY05397
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY05397%27 HTTP/1.1" 200 None
2026-03-30 10:43:55 [auto1.de] INFO: Scrape type for YY05397: 1
2026-03-30 10:43:55 [auto1.de] INFO: Found listing with ID: HR01670
2026-03-30 10:43:55 [auto1.de] INFO: Found listing with ID: KF93104
2026-03-30 10:43:55 [auto1.de] INFO: Found listing with ID: WZ29509
2026-03-30 10:43:55 [auto1.de] INFO: Found listing with ID: AN42226
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN42226%27 HTTP/1.1" 200 None
2026-03-30 10:43:55 [auto1.de] INFO: Scrape type for AN42226: 1
2026-03-30 10:43:55 [auto1.de] INFO: Found listing with ID: UB07132
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB07132%27 HTTP/1.1" 200 None
2026-03-30 10:43:55 [auto1.de] INFO: Scrape type for UB07132: 2
2026-03-30 10:43:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e9076f6-5662-5346-b9ed-fe5c2d6183a4 with identifier: UB07132
2026-03-30 10:43:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e9076f6-5662-5346-b9ed-fe5c2d6183a4 with scrape type 2
2026-03-30 10:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e9076f6-5662-5346-b9ed-fe5c2d6183a4 with scrape type 2
2026-03-30 10:43:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e9076f6-5662-5346-b9ed-fe5c2d6183a4, identifier: UB07132
2026-03-30 10:43:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e9076f6-5662-5346-b9ed-fe5c2d6183a4 with identifier: UB07132
2026-03-30 10:43:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e9076f6-5662-5346-b9ed-fe5c2d6183a4 with identifier: UB07132
2026-03-30 10:43:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e9076f6-5662-5346-b9ed-fe5c2d6183a4 with identifier: UB07132 to the API
2026-03-30 10:43:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:42:17Z',
 'fuel_type': 'petrol',
 'id': '1e9076f6-5662-5346-b9ed-fe5c2d6183a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB07132',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 208542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-23',
 'seller_name': None,
 'title': 'Mazda 5 1.8 Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2011}
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB07132%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [auto1.de] INFO: Saving data for UB07132: {'auction_closing_time': 1774971737.0, 'created_time': 1774292617.357114, 'last_price_update_time': 1774867436.148591}
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB07132') HTTP/1.1" 204 0
2026-03-30 10:43:56 [auto1.de] INFO: Found listing with ID: FG55708
2026-03-30 10:43:56 [auto1.de] INFO: Found listing with ID: NG28539
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG28539%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [auto1.de] INFO: Scrape type for NG28539: 1
2026-03-30 10:43:56 [auto1.de] INFO: Found listing with ID: HA37625
2026-03-30 10:43:56 [auto1.de] INFO: Found listing with ID: TJ26559
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ26559%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [auto1.de] INFO: Scrape type for TJ26559: 2
2026-03-30 10:43:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4948a38-b48b-5085-ae11-ffcdcccaa689 with identifier: TJ26559
2026-03-30 10:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4948a38-b48b-5085-ae11-ffcdcccaa689 with scrape type 2
2026-03-30 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4948a38-b48b-5085-ae11-ffcdcccaa689 with scrape type 2
2026-03-30 10:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4948a38-b48b-5085-ae11-ffcdcccaa689, identifier: TJ26559
2026-03-30 10:43:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4948a38-b48b-5085-ae11-ffcdcccaa689 with identifier: TJ26559
2026-03-30 10:43:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4948a38-b48b-5085-ae11-ffcdcccaa689 with identifier: TJ26559
2026-03-30 10:43:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4948a38-b48b-5085-ae11-ffcdcccaa689 with identifier: TJ26559 to the API
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-31T15:44:27Z',
 'fuel_type': 'petrol',
 'id': 'b4948a38-b48b-5085-ae11-ffcdcccaa689',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ26559',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 11342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-20',
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 1.5 SIDI Turbo Business INNOVATION',
 'transmission': 'automatic',
 'trim': 'Business INNOVATION',
 'year': 2017}
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ26559%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [auto1.de] INFO: Saving data for TJ26559: {'auction_closing_time': 1774971867.0, 'created_time': 1773302775.984103, 'last_price_update_time': 1774867436.800261}
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ26559') HTTP/1.1" 204 0
2026-03-30 10:43:56 [auto1.de] INFO: Found listing with ID: XE37827
2026-03-30 10:43:56 [auto1.de] INFO: Found listing with ID: ZE58561
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE58561%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [auto1.de] INFO: Scrape type for ZE58561: 1
2026-03-30 10:43:56 [auto1.de] INFO: Found listing with ID: ZD15817
2026-03-30 10:43:56 [auto1.de] INFO: Found listing with ID: PA09004
2026-03-30 10:43:56 [auto1.de] INFO: Found listing with ID: SY18278
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY18278%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [auto1.de] INFO: Scrape type for SY18278: 1
2026-03-30 10:43:56 [auto1.de] INFO: Found listing with ID: RM37791
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM37791%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [auto1.de] INFO: Scrape type for RM37791: 1
2026-03-30 10:43:56 [auto1.de] INFO: Found listing with ID: HB77071
2026-03-30 10:43:56 [auto1.de] INFO: Found listing with ID: ZA75332
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA75332%27 HTTP/1.1" 200 None
2026-03-30 10:43:56 [auto1.de] INFO: Scrape type for ZA75332: 2
2026-03-30 10:43:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4dd0f3e-bdaf-509a-b258-ad6ab122deb6 with identifier: ZA75332
2026-03-30 10:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4dd0f3e-bdaf-509a-b258-ad6ab122deb6 with scrape type 2
2026-03-30 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4dd0f3e-bdaf-509a-b258-ad6ab122deb6 with scrape type 2
2026-03-30 10:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4dd0f3e-bdaf-509a-b258-ad6ab122deb6, identifier: ZA75332
2026-03-30 10:43:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4dd0f3e-bdaf-509a-b258-ad6ab122deb6 with identifier: ZA75332
2026-03-30 10:43:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4dd0f3e-bdaf-509a-b258-ad6ab122deb6 with identifier: ZA75332
2026-03-30 10:43:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4dd0f3e-bdaf-509a-b258-ad6ab122deb6 with identifier: ZA75332 to the API
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-31T15:57:52Z',
 'fuel_type': 'diesel',
 'id': 'e4dd0f3e-bdaf-509a-b258-ad6ab122deb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA75332',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 122416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA75332%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [auto1.de] INFO: Saving data for ZA75332: {'auction_closing_time': 1774972672.0, 'created_time': 1773688777.398717, 'last_price_update_time': 1774867437.407519}
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA75332') HTTP/1.1" 204 0
2026-03-30 10:43:57 [auto1.de] INFO: Found listing with ID: AA14040
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA14040%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [auto1.de] INFO: Scrape type for AA14040: 2
2026-03-30 10:43:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a088fcc7-d22c-5152-93cb-21bb567dbdd8 with identifier: AA14040
2026-03-30 10:43:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a088fcc7-d22c-5152-93cb-21bb567dbdd8 with scrape type 2
2026-03-30 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a088fcc7-d22c-5152-93cb-21bb567dbdd8 with scrape type 2
2026-03-30 10:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a088fcc7-d22c-5152-93cb-21bb567dbdd8, identifier: AA14040
2026-03-30 10:43:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a088fcc7-d22c-5152-93cb-21bb567dbdd8 with identifier: AA14040
2026-03-30 10:43:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a088fcc7-d22c-5152-93cb-21bb567dbdd8 with identifier: AA14040
2026-03-30 10:43:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a088fcc7-d22c-5152-93cb-21bb567dbdd8 with identifier: AA14040 to the API
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:48:26Z',
 'fuel_type': 'diesel',
 'id': 'a088fcc7-d22c-5152-93cb-21bb567dbdd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA14040',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 437374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-12',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2016}
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA14040%27 HTTP/1.1" 200 None
2026-03-30 10:43:57 [auto1.de] INFO: Saving data for AA14040: {'auction_closing_time': 1774972106.0, 'created_time': 1774293910.938175, 'last_price_update_time': 1774867437.962851}
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA14040') HTTP/1.1" 204 0
2026-03-30 10:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS54833/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:57 [auto1.de] INFO: Found listing with ID: MF97779
2026-03-30 10:43:57 [auto1.de] INFO: Found listing with ID: DY24892
2026-03-30 10:43:57 [auto1.de] INFO: Found listing with ID: GH80135
2026-03-30 10:43:57 [auto1.de] INFO: Found listing with ID: MK76692
2026-03-30 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK76692%27 HTTP/1.1" 200 None
2026-03-30 10:43:58 [auto1.de] INFO: Scrape type for MK76692: 2
2026-03-30 10:43:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5139f1c-ceec-5543-b1c8-5d15d9292567 with identifier: MK76692
2026-03-30 10:43:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5139f1c-ceec-5543-b1c8-5d15d9292567 with scrape type 2
2026-03-30 10:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5139f1c-ceec-5543-b1c8-5d15d9292567 with scrape type 2
2026-03-30 10:43:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5139f1c-ceec-5543-b1c8-5d15d9292567, identifier: MK76692
2026-03-30 10:43:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5139f1c-ceec-5543-b1c8-5d15d9292567 with identifier: MK76692
2026-03-30 10:43:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5139f1c-ceec-5543-b1c8-5d15d9292567 with identifier: MK76692
2026-03-30 10:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5139f1c-ceec-5543-b1c8-5d15d9292567 with identifier: MK76692 to the API
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:43:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:03:53Z',
 'fuel_type': 'diesel',
 'id': 'a5139f1c-ceec-5543-b1c8-5d15d9292567',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK76692',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 280978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-28',
 'seller_name': None,
 'title': 'Honda Civic 2.2 CTDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK76692%27 HTTP/1.1" 200 None
2026-03-30 10:43:58 [auto1.de] INFO: Saving data for MK76692: {'auction_closing_time': 1774969433.0, 'created_time': 1773382419.483414, 'last_price_update_time': 1774867438.48316}
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK76692') HTTP/1.1" 204 0
2026-03-30 10:43:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC19039/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MX32778> (referer: https://www.auto1.com/v1/car-details-view/MX32778/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0993f370-4903-5a68-8c6f-42f147305f3c with identifier: MX32778
2026-03-30 10:43:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0993f370-4903-5a68-8c6f-42f147305f3c with scrape type 1
2026-03-30 10:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0993f370-4903-5a68-8c6f-42f147305f3c
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_f2ff1c16a02e70ef3217bbaa93b4f044.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_f2ff1c16a02e70ef3217bbaa93b4f044.jpg not downloaded yet
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_76c8ea7ba490214f5e83432204931106.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_76c8ea7ba490214f5e83432204931106.jpg not downloaded yet
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_eacdeac9608345545b64cc3d4ae3796b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_eacdeac9608345545b64cc3d4ae3796b.jpg not downloaded yet
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_07c8f178d5fbe9a347e47935796c808f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_07c8f178d5fbe9a347e47935796c808f.jpg not downloaded yet
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_79b94ea9643138ccb88d75dc5bc75f5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_79b94ea9643138ccb88d75dc5bc75f5f.jpg not downloaded yet
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_c9159474462601434ce3d3694585e0e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_c9159474462601434ce3d3694585e0e3.jpg not downloaded yet
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_98dd97416cf585ddfbc07dd621ce6e7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_98dd97416cf585ddfbc07dd621ce6e7a.jpg not downloaded yet
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_08642612b602bf0c20469da2be89ed66.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_08642612b602bf0c20469da2be89ed66.jpg not downloaded yet
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_8104283401324e4cc9c052a31802e87f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_8104283401324e4cc9c052a31802e87f.jpg not downloaded yet
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_bd55c7cb087a08dfe8b238ce35f24905.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_bd55c7cb087a08dfe8b238ce35f24905.jpg not downloaded yet
2026-03-30 10:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV99442> (referer: https://www.auto1.com/v1/car-details-view/FV99442/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN56413> (referer: https://www.auto1.com/v1/car-details-view/GN56413/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:43:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e7fff8e-3366-5341-a222-e105fd53b1c3 with identifier: FV99442
2026-03-30 10:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e7fff8e-3366-5341-a222-e105fd53b1c3 with scrape type 1
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e7fff8e-3366-5341-a222-e105fd53b1c3
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_77693102d7f5285862c169175bfefe65.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_77693102d7f5285862c169175bfefe65.jpg not downloaded yet
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_cff076f36c9917ec4bf7efa052eaeea5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_cff076f36c9917ec4bf7efa052eaeea5.jpg not downloaded yet
2026-03-30 10:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_8104283401324e4cc9c052a31802e87f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_9b1d5235a6d7858f6cc4b3881b8315f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_9b1d5235a6d7858f6cc4b3881b8315f3.jpg not downloaded yet
2026-03-30 10:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e29dbf5f-f334-5556-ae4e-7e904db8f1e8 with identifier: GN56413
2026-03-30 10:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e29dbf5f-f334-5556-ae4e-7e904db8f1e8 with scrape type 1
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e29dbf5f-f334-5556-ae4e-7e904db8f1e8
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F76%252F30769a1bdebb55cbd233f117f220c280%252Fpa%252FGN56413_53d14d0a1d27a65fdb9e24c9e65bc03f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_53d14d0a1d27a65fdb9e24c9e65bc03f.jpg already downloaded
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F76%252F30769a1bdebb55cbd233f117f220c280%252Fpa%252FGN56413_abc5af5555c95164edc1c8319367d17f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_abc5af5555c95164edc1c8319367d17f.jpg already downloaded
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F76%252F30769a1bdebb55cbd233f117f220c280%252Fpa%252FGN56413_832fcc139824a02f2b5618ce42f09be6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_832fcc139824a02f2b5618ce42f09be6.jpg already downloaded
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F76%252F30769a1bdebb55cbd233f117f220c280%252Fpa%252FGN56413_61121d71916ebc9bd14188ce4246cead.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_61121d71916ebc9bd14188ce4246cead.jpg already downloaded
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F76%252F30769a1bdebb55cbd233f117f220c280%252Fpa%252FGN56413_8e95a71beb9e2fe2c4a726d58b2fe60f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_8e95a71beb9e2fe2c4a726d58b2fe60f.jpg already downloaded
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F76%252F30769a1bdebb55cbd233f117f220c280%252Fpa%252FGN56413_f60a5789167f30348553d8432959b139.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_f60a5789167f30348553d8432959b139.jpg already downloaded
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F76%252F30769a1bdebb55cbd233f117f220c280%252Fpa%252FGN56413_fa794c2bfb346081d330dbfa370268b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_fa794c2bfb346081d330dbfa370268b5.jpg already downloaded
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F76%252F30769a1bdebb55cbd233f117f220c280%252Fpa%252FGN56413_23ce6d20fbf30d67a3697b16cfbba58c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_23ce6d20fbf30d67a3697b16cfbba58c.jpg already downloaded
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F76%252F30769a1bdebb55cbd233f117f220c280%252Fpa%252FGN56413_7e07d75737aac744c1a2bc463ca99142.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_7e07d75737aac744c1a2bc463ca99142.jpg already downloaded
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F76%252F30769a1bdebb55cbd233f117f220c280%252Fpa%252FGN56413_4345c8cb43eff848fe81efa58a02bef1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_4345c8cb43eff848fe81efa58a02bef1.jpg already downloaded
2026-03-30 10:44:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e29dbf5f-f334-5556-ae4e-7e904db8f1e8, identifier: GN56413
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_4a509e2f2fd4f668ee779427b2ba2447.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_4a509e2f2fd4f668ee779427b2ba2447.jpg not downloaded yet
2026-03-30 10:44:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e29dbf5f-f334-5556-ae4e-7e904db8f1e8 with identifier: GN56413
2026-03-30 10:44:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e29dbf5f-f334-5556-ae4e-7e904db8f1e8 with identifier: GN56413
2026-03-30 10:44:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e29dbf5f-f334-5556-ae4e-7e904db8f1e8 with identifier: GN56413 to the API
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GN56413>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:21:34Z',
 'fuel_type': 'petrol',
 'id': 'e29dbf5f-f334-5556-ae4e-7e904db8f1e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN56413',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 119305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_53d14d0a1d27a65fdb9e24c9e65bc03f.jpg',
                'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_abc5af5555c95164edc1c8319367d17f.jpg',
                'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_832fcc139824a02f2b5618ce42f09be6.jpg',
                'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_61121d71916ebc9bd14188ce4246cead.jpg',
                'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_8e95a71beb9e2fe2c4a726d58b2fe60f.jpg',
                'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_f60a5789167f30348553d8432959b139.jpg',
                'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_fa794c2bfb346081d330dbfa370268b5.jpg',
                'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_23ce6d20fbf30d67a3697b16cfbba58c.jpg',
                'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_7e07d75737aac744c1a2bc463ca99142.jpg',
                'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_4345c8cb43eff848fe81efa58a02bef1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29dbf5f-f334-5556-ae4e-7e904db8f1e8/e29dbf5f-f334-5556-ae4e-7e904db8f1e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_53d14d0a1d27a65fdb9e24c9e65bc03f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29dbf5f-f334-5556-ae4e-7e904db8f1e8/e29dbf5f-f334-5556-ae4e-7e904db8f1e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_abc5af5555c95164edc1c8319367d17f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29dbf5f-f334-5556-ae4e-7e904db8f1e8/e29dbf5f-f334-5556-ae4e-7e904db8f1e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_832fcc139824a02f2b5618ce42f09be6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29dbf5f-f334-5556-ae4e-7e904db8f1e8/e29dbf5f-f334-5556-ae4e-7e904db8f1e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_61121d71916ebc9bd14188ce4246cead.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29dbf5f-f334-5556-ae4e-7e904db8f1e8/e29dbf5f-f334-5556-ae4e-7e904db8f1e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_8e95a71beb9e2fe2c4a726d58b2fe60f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29dbf5f-f334-5556-ae4e-7e904db8f1e8/e29dbf5f-f334-5556-ae4e-7e904db8f1e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_f60a5789167f30348553d8432959b139.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29dbf5f-f334-5556-ae4e-7e904db8f1e8/e29dbf5f-f334-5556-ae4e-7e904db8f1e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_fa794c2bfb346081d330dbfa370268b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29dbf5f-f334-5556-ae4e-7e904db8f1e8/e29dbf5f-f334-5556-ae4e-7e904db8f1e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_23ce6d20fbf30d67a3697b16cfbba58c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29dbf5f-f334-5556-ae4e-7e904db8f1e8/e29dbf5f-f334-5556-ae4e-7e904db8f1e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_7e07d75737aac744c1a2bc463ca99142.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29dbf5f-f334-5556-ae4e-7e904db8f1e8/e29dbf5f-f334-5556-ae4e-7e904db8f1e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/76/30769a1bdebb55cbd233f117f220c280/pa/GN56413_4345c8cb43eff848fe81efa58a02bef1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2015}
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN56413%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [auto1.de] INFO: Saving data for GN56413: {'created_time': 1774867440.40282, 'last_price_update_time': 1774867440.402831, 'auction_closing_time': 1774970494.0}
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN56413') HTTP/1.1" 204 0
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_bd55c7cb087a08dfe8b238ce35f24905.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_7fa1ae3cd7c047302cdb0df8e629a264.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_7fa1ae3cd7c047302cdb0df8e629a264.jpg not downloaded yet
2026-03-30 10:44:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508d2d0>
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_8104283401324e4cc9c052a31802e87f.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_8104283401324e4cc9c052a31802e87f.jpg saved to cache
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0993f370-4903-5a68-8c6f-42f147305f3c
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_52c188c81c8c8e6d2e3acd536d505c51.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_52c188c81c8c8e6d2e3acd536d505c51.jpg not downloaded yet
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_cff076f36c9917ec4bf7efa052eaeea5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_d43a641d35174bbee8b0f62bd330c2c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_d43a641d35174bbee8b0f62bd330c2c3.jpg not downloaded yet
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_21eedb8cf22d7da8efb0527c8b0e7723.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_21eedb8cf22d7da8efb0527c8b0e7723.jpg not downloaded yet
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_6a152377b51b8fc68f80fa02a6900e85.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_6a152377b51b8fc68f80fa02a6900e85.jpg not downloaded yet
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c68190>
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_bd55c7cb087a08dfe8b238ce35f24905.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_bd55c7cb087a08dfe8b238ce35f24905.jpg saved to cache
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0993f370-4903-5a68-8c6f-42f147305f3c
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_591151f0c13093941fc3f6010978e714.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_591151f0c13093941fc3f6010978e714.jpg not downloaded yet
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_7fa1ae3cd7c047302cdb0df8e629a264.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c3d5d0>
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_cff076f36c9917ec4bf7efa052eaeea5.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_cff076f36c9917ec4bf7efa052eaeea5.jpg saved to cache
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e7fff8e-3366-5341-a222-e105fd53b1c3
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_4a509e2f2fd4f668ee779427b2ba2447.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe2bd0>
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_7fa1ae3cd7c047302cdb0df8e629a264.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_7fa1ae3cd7c047302cdb0df8e629a264.jpg saved to cache
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e7fff8e-3366-5341-a222-e105fd53b1c3
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_591151f0c13093941fc3f6010978e714.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eced90>
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_4a509e2f2fd4f668ee779427b2ba2447.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_4a509e2f2fd4f668ee779427b2ba2447.jpg saved to cache
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e7fff8e-3366-5341-a222-e105fd53b1c3
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_6a152377b51b8fc68f80fa02a6900e85.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_21eedb8cf22d7da8efb0527c8b0e7723.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ecd790>
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_591151f0c13093941fc3f6010978e714.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_591151f0c13093941fc3f6010978e714.jpg saved to cache
2026-03-30 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e7fff8e-3366-5341-a222-e105fd53b1c3
2026-03-30 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_d43a641d35174bbee8b0f62bd330c2c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef79fab10>
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_6a152377b51b8fc68f80fa02a6900e85.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_6a152377b51b8fc68f80fa02a6900e85.jpg saved to cache
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e7fff8e-3366-5341-a222-e105fd53b1c3
2026-03-30 10:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_9b1d5235a6d7858f6cc4b3881b8315f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eab490>
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_21eedb8cf22d7da8efb0527c8b0e7723.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_21eedb8cf22d7da8efb0527c8b0e7723.jpg saved to cache
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e7fff8e-3366-5341-a222-e105fd53b1c3
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0b310>
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_d43a641d35174bbee8b0f62bd330c2c3.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_d43a641d35174bbee8b0f62bd330c2c3.jpg saved to cache
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e7fff8e-3366-5341-a222-e105fd53b1c3
2026-03-30 10:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_52c188c81c8c8e6d2e3acd536d505c51.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f098d0>
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_9b1d5235a6d7858f6cc4b3881b8315f3.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_9b1d5235a6d7858f6cc4b3881b8315f3.jpg saved to cache
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e7fff8e-3366-5341-a222-e105fd53b1c3
2026-03-30 10:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_77693102d7f5285862c169175bfefe65.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595d210>
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_52c188c81c8c8e6d2e3acd536d505c51.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_52c188c81c8c8e6d2e3acd536d505c51.jpg saved to cache
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e7fff8e-3366-5341-a222-e105fd53b1c3
2026-03-30 10:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TM60818> (referer: https://www.auto1.com/v1/car-details-view/TM60818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ecc850>
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fef%252F56efaf62dc076f04ea6da5c0738bb230%252Fpa%252FFV99442_77693102d7f5285862c169175bfefe65.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_77693102d7f5285862c169175bfefe65.jpg saved to cache
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e7fff8e-3366-5341-a222-e105fd53b1c3
2026-03-30 10:44:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e7fff8e-3366-5341-a222-e105fd53b1c3, skipping ID generation
2026-03-30 10:44:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e7fff8e-3366-5341-a222-e105fd53b1c3 with scrape type 1
2026-03-30 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e7fff8e-3366-5341-a222-e105fd53b1c3 sending to next pipeline
2026-03-30 10:44:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e7fff8e-3366-5341-a222-e105fd53b1c3, identifier: FV99442
2026-03-30 10:44:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e7fff8e-3366-5341-a222-e105fd53b1c3 with identifier: FV99442
2026-03-30 10:44:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e7fff8e-3366-5341-a222-e105fd53b1c3 with identifier: FV99442
2026-03-30 10:44:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e7fff8e-3366-5341-a222-e105fd53b1c3 with identifier: FV99442 to the API
2026-03-30 10:44:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_77693102d7f5285862c169175bfefe65.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:34:31Z',
 'fuel_type': 'diesel',
 'id': '6e7fff8e-3366-5341-a222-e105fd53b1c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV99442',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 154430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_77693102d7f5285862c169175bfefe65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_cff076f36c9917ec4bf7efa052eaeea5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_9b1d5235a6d7858f6cc4b3881b8315f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_4a509e2f2fd4f668ee779427b2ba2447.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_7fa1ae3cd7c047302cdb0df8e629a264.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_52c188c81c8c8e6d2e3acd536d505c51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_d43a641d35174bbee8b0f62bd330c2c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_21eedb8cf22d7da8efb0527c8b0e7723.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_6a152377b51b8fc68f80fa02a6900e85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7fff8e-3366-5341-a222-e105fd53b1c3/6e7fff8e-3366-5341-a222-e105fd53b1c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ef/56efaf62dc076f04ea6da5c0738bb230/pa/FV99442_591151f0c13093941fc3f6010978e714.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Beach Edition 4Motion',
 'transmission': 'automatic',
 'trim': 'Beach Edition 4Motion',
 'year': 2017}
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV99442%27 HTTP/1.1" 200 None
2026-03-30 10:44:02 [auto1.de] INFO: Saving data for FV99442: {'created_time': 1774867442.960875, 'last_price_update_time': 1774867442.960884, 'auction_closing_time': 1774971271.0}
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV99442') HTTP/1.1" 204 0
2026-03-30 10:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_08642612b602bf0c20469da2be89ed66.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_98dd97416cf585ddfbc07dd621ce6e7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_c9159474462601434ce3d3694585e0e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE98527> (referer: https://www.auto1.com/v1/car-details-view/SE98527/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AE13145> (referer: https://www.auto1.com/v1/car-details-view/AE13145/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35188f9f-bbf9-5c5b-a758-9b170847229a with identifier: TM60818
2026-03-30 10:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35188f9f-bbf9-5c5b-a758-9b170847229a with scrape type 1
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 35188f9f-bbf9-5c5b-a758-9b170847229a
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_b657a3087ceb0a665d2dc5ed91c853c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_b657a3087ceb0a665d2dc5ed91c853c0.jpg not downloaded yet
2026-03-30 10:44:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_7bb91fd57ccd60baba579323b2951f29.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_7bb91fd57ccd60baba579323b2951f29.jpg not downloaded yet
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_a691d32a21d7a6f2bce2ac5017daf0b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_a691d32a21d7a6f2bce2ac5017daf0b1.jpg not downloaded yet
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c414d0>
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_08642612b602bf0c20469da2be89ed66.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_08642612b602bf0c20469da2be89ed66.jpg saved to cache
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0993f370-4903-5a68-8c6f-42f147305f3c
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5013710>
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_98dd97416cf585ddfbc07dd621ce6e7a.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_98dd97416cf585ddfbc07dd621ce6e7a.jpg saved to cache
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0993f370-4903-5a68-8c6f-42f147305f3c
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5af1650>
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_c9159474462601434ce3d3694585e0e3.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_c9159474462601434ce3d3694585e0e3.jpg saved to cache
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0993f370-4903-5a68-8c6f-42f147305f3c
2026-03-30 10:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aec38de5-9b44-516c-9341-237fd83bed8b with identifier: SE98527
2026-03-30 10:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aec38de5-9b44-516c-9341-237fd83bed8b with scrape type 1
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aec38de5-9b44-516c-9341-237fd83bed8b
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_0b7338adfa8b2de1d1d2c5043e37b8ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_0b7338adfa8b2de1d1d2c5043e37b8ab.jpg not downloaded yet
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_2816cc2006ab9406683939341a7379f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_2816cc2006ab9406683939341a7379f4.jpg not downloaded yet
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_b65af2a2fb5ae7bf1be4eff5e841cf7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_b65af2a2fb5ae7bf1be4eff5e841cf7c.jpg not downloaded yet
2026-03-30 10:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_07c8f178d5fbe9a347e47935796c808f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_eacdeac9608345545b64cc3d4ae3796b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_f2ff1c16a02e70ef3217bbaa93b4f044.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_76c8ea7ba490214f5e83432204931106.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_79b94ea9643138ccb88d75dc5bc75f5f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_f84eeaca65bdca1d9a741dff6ac26ed7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_f84eeaca65bdca1d9a741dff6ac26ed7.jpg not downloaded yet
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_32be2a360e35a371feb01620ffadb022.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_32be2a360e35a371feb01620ffadb022.jpg not downloaded yet
2026-03-30 10:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3 with identifier: AE13145
2026-03-30 10:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3 with scrape type 1
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_e571e30241c758e2b5f5dac3b376541a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_e571e30241c758e2b5f5dac3b376541a.jpg not downloaded yet
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_22e2f4b2a16372533592e3b6d9a532e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_22e2f4b2a16372533592e3b6d9a532e2.jpg not downloaded yet
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_fc7506c93623cf257116676c412fe68e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_fc7506c93623cf257116676c412fe68e.jpg not downloaded yet
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_73d44030e31bad00f0c3537ed068721e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_73d44030e31bad00f0c3537ed068721e.jpg not downloaded yet
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_6771fea13232a71a3b8f8d97d8459f6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_6771fea13232a71a3b8f8d97d8459f6e.jpg not downloaded yet
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_c88e17bbf6d7c2e5be3812c3167865b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_c88e17bbf6d7c2e5be3812c3167865b1.jpg not downloaded yet
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_4093ecb9a92de1b632b737d66ab2c3e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_4093ecb9a92de1b632b737d66ab2c3e3.jpg not downloaded yet
2026-03-30 10:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_0b7338adfa8b2de1d1d2c5043e37b8ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0f710>
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_07c8f178d5fbe9a347e47935796c808f.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_07c8f178d5fbe9a347e47935796c808f.jpg saved to cache
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0993f370-4903-5a68-8c6f-42f147305f3c
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c5890>
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_eacdeac9608345545b64cc3d4ae3796b.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_eacdeac9608345545b64cc3d4ae3796b.jpg saved to cache
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0993f370-4903-5a68-8c6f-42f147305f3c
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e7d3d0>
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_f2ff1c16a02e70ef3217bbaa93b4f044.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_f2ff1c16a02e70ef3217bbaa93b4f044.jpg saved to cache
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0993f370-4903-5a68-8c6f-42f147305f3c
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c7a50>
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_76c8ea7ba490214f5e83432204931106.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_76c8ea7ba490214f5e83432204931106.jpg saved to cache
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0993f370-4903-5a68-8c6f-42f147305f3c
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a27e10>
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F1d%252Fc61dee002baacf2e7104de7295e46693%252Fpa%252FMX32778_79b94ea9643138ccb88d75dc5bc75f5f.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_79b94ea9643138ccb88d75dc5bc75f5f.jpg saved to cache
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0993f370-4903-5a68-8c6f-42f147305f3c
2026-03-30 10:44:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0993f370-4903-5a68-8c6f-42f147305f3c, skipping ID generation
2026-03-30 10:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0993f370-4903-5a68-8c6f-42f147305f3c with scrape type 1
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0993f370-4903-5a68-8c6f-42f147305f3c sending to next pipeline
2026-03-30 10:44:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0993f370-4903-5a68-8c6f-42f147305f3c, identifier: MX32778
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_ab223ac86d7d29ab58d1dc8b3d326d91.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_ab223ac86d7d29ab58d1dc8b3d326d91.jpg not downloaded yet
2026-03-30 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_132a332ced6bdd775982e950d39752d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_132a332ced6bdd775982e950d39752d7.jpg not downloaded yet
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_bbabc2d44a46b1af1beeebae9c6a4ef7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_bbabc2d44a46b1af1beeebae9c6a4ef7.jpg not downloaded yet
2026-03-30 10:44:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0993f370-4903-5a68-8c6f-42f147305f3c with identifier: MX32778
2026-03-30 10:44:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0993f370-4903-5a68-8c6f-42f147305f3c with identifier: MX32778
2026-03-30 10:44:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0993f370-4903-5a68-8c6f-42f147305f3c with identifier: MX32778 to the API
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_79b94ea9643138ccb88d75dc5bc75f5f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:08:06Z',
 'fuel_type': 'petrol',
 'id': '0993f370-4903-5a68-8c6f-42f147305f3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX32778',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 66511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_f2ff1c16a02e70ef3217bbaa93b4f044.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_76c8ea7ba490214f5e83432204931106.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_eacdeac9608345545b64cc3d4ae3796b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_07c8f178d5fbe9a347e47935796c808f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_79b94ea9643138ccb88d75dc5bc75f5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_c9159474462601434ce3d3694585e0e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_98dd97416cf585ddfbc07dd621ce6e7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_08642612b602bf0c20469da2be89ed66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_8104283401324e4cc9c052a31802e87f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0993f370-4903-5a68-8c6f-42f147305f3c/0993f370-4903-5a68-8c6f-42f147305f3c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/1d/c61dee002baacf2e7104de7295e46693/pa/MX32778_bd55c7cb087a08dfe8b238ce35f24905.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Platinum Edition',
 'transmission': 'automatic',
 'trim': 'Platinum Edition',
 'year': 2019}
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX32778%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [auto1.de] INFO: Saving data for MX32778: {'created_time': 1774867444.412137, 'last_price_update_time': 1774867444.412149, 'auction_closing_time': 1774969686.0}
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX32778') HTTP/1.1" 204 0
2026-03-30 10:44:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_a691d32a21d7a6f2bce2ac5017daf0b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_7bb91fd57ccd60baba579323b2951f29.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:04 [scrapy.extensions.logstats] INFO: Crawled 338 pages (at 38 pages/min), scraped 257 items (at 24 items/min)
2026-03-30 10:44:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_b8a7fe297f90f56d554decf5c01e44eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_b8a7fe297f90f56d554decf5c01e44eb.jpg not downloaded yet
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_725304d49fbe241032de6e7460f6c78b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_725304d49fbe241032de6e7460f6c78b.jpg not downloaded yet
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_79d04bfc5e8d9d8a3fab68bca928df6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_79d04bfc5e8d9d8a3fab68bca928df6e.jpg not downloaded yet
2026-03-30 10:44:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WK68540/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5107210>
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_0b7338adfa8b2de1d1d2c5043e37b8ab.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_0b7338adfa8b2de1d1d2c5043e37b8ab.jpg saved to cache
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aec38de5-9b44-516c-9341-237fd83bed8b
2026-03-30 10:44:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT28191> (referer: https://www.auto1.com/v1/car-details-view/UT28191/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR76017> (referer: https://www.auto1.com/v1/car-details-view/UR76017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_07f1283b7bcd5e5cc3adec9e0fdee6da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_07f1283b7bcd5e5cc3adec9e0fdee6da.jpg not downloaded yet
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_b37e882938c37059d785b6fe035e14ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_b37e882938c37059d785b6fe035e14ed.jpg not downloaded yet
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_6da15128c81de204f14975fddcc45185.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_6da15128c81de204f14975fddcc45185.jpg not downloaded yet
2026-03-30 10:44:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef51063d0>
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_a691d32a21d7a6f2bce2ac5017daf0b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_a691d32a21d7a6f2bce2ac5017daf0b1.jpg saved to cache
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 35188f9f-bbf9-5c5b-a758-9b170847229a
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fef910>
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_7bb91fd57ccd60baba579323b2951f29.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_7bb91fd57ccd60baba579323b2951f29.jpg saved to cache
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 35188f9f-bbf9-5c5b-a758-9b170847229a
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_0a545038c6a45f575fa7c5b222e4db1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_0a545038c6a45f575fa7c5b222e4db1f.jpg not downloaded yet
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_68adf24f6d37d6d6facffb05c4fb0503.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_68adf24f6d37d6d6facffb05c4fb0503.jpg not downloaded yet
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_d4719a187aa109e79878345b883144d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_d4719a187aa109e79878345b883144d2.jpg not downloaded yet
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_98a081a8ac911a47c8f5cc8eb90efe60.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_98a081a8ac911a47c8f5cc8eb90efe60.jpg not downloaded yet
2026-03-30 10:44:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45250a25-ec32-574e-917a-4e44a57c4377 with identifier: UT28191
2026-03-30 10:44:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45250a25-ec32-574e-917a-4e44a57c4377 with scrape type 1
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 45250a25-ec32-574e-917a-4e44a57c4377
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff4%252F5bf4ec64882e8d4c1231456832f4ce4e%252Fpa%252FUT28191_b885f1ca72eaee68c5f713ed56eee4a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_b885f1ca72eaee68c5f713ed56eee4a6.jpg not downloaded yet
2026-03-30 10:44:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e99597e-48fa-5cb1-a80c-5db2cb1741f4 with identifier: UR76017
2026-03-30 10:44:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e99597e-48fa-5cb1-a80c-5db2cb1741f4 with scrape type 1
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e99597e-48fa-5cb1-a80c-5db2cb1741f4
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_50cdad0b473e75bad9a4771a4ecf3584.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_50cdad0b473e75bad9a4771a4ecf3584.jpg not downloaded yet
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_17b32717f7cded2a4bc5d6da04cce290.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_17b32717f7cded2a4bc5d6da04cce290.jpg not downloaded yet
2026-03-30 10:44:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_132a332ced6bdd775982e950d39752d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_725304d49fbe241032de6e7460f6c78b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff4%252F5bf4ec64882e8d4c1231456832f4ce4e%252Fpa%252FUT28191_fe31341f88d221881f30c76623211c23.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_fe31341f88d221881f30c76623211c23.jpg not downloaded yet
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_19e3149b770c2c92f13e789ae3a77e89.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_19e3149b770c2c92f13e789ae3a77e89.jpg not downloaded yet
2026-03-30 10:44:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_79d04bfc5e8d9d8a3fab68bca928df6e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_939cf62538cb5bee328e8f1ef33467cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_939cf62538cb5bee328e8f1ef33467cd.jpg not downloaded yet
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff4%252F5bf4ec64882e8d4c1231456832f4ce4e%252Fpa%252FUT28191_855651de6d244762e5dc554f4c514863.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_855651de6d244762e5dc554f4c514863.jpg not downloaded yet
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_15c9b1db33c940c7c1f8e2dfdf022734.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_15c9b1db33c940c7c1f8e2dfdf022734.jpg not downloaded yet
2026-03-30 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff4%252F5bf4ec64882e8d4c1231456832f4ce4e%252Fpa%252FUT28191_7b9b1928db0e4ab2133321501d50e955.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_7b9b1928db0e4ab2133321501d50e955.jpg not downloaded yet
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_05522b6bcee879d32582345a76698bbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_05522b6bcee879d32582345a76698bbf.jpg not downloaded yet
2026-03-30 10:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_b885f1ca72eaee68c5f713ed56eee4a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff4%252F5bf4ec64882e8d4c1231456832f4ce4e%252Fpa%252FUT28191_83dc09d3b7257248cedb2ccfe2df7fbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_83dc09d3b7257248cedb2ccfe2df7fbf.jpg not downloaded yet
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_11b8ff9cb5e1b69dde7daa4d9977ca48.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_11b8ff9cb5e1b69dde7daa4d9977ca48.jpg not downloaded yet
2026-03-30 10:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_50cdad0b473e75bad9a4771a4ecf3584.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_4abdb04e897e6884ea0cd2fb3af21721.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_4abdb04e897e6884ea0cd2fb3af21721.jpg not downloaded yet
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50e41d0>
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_132a332ced6bdd775982e950d39752d7.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_132a332ced6bdd775982e950d39752d7.jpg saved to cache
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aec38de5-9b44-516c-9341-237fd83bed8b
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e664d0>
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_725304d49fbe241032de6e7460f6c78b.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_725304d49fbe241032de6e7460f6c78b.jpg saved to cache
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aec38de5-9b44-516c-9341-237fd83bed8b
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_987b149817f928e6663ce8bf8c0aa96f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_987b149817f928e6663ce8bf8c0aa96f.jpg not downloaded yet
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508f590>
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_79d04bfc5e8d9d8a3fab68bca928df6e.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_79d04bfc5e8d9d8a3fab68bca928df6e.jpg saved to cache
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3
2026-03-30 10:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_17b32717f7cded2a4bc5d6da04cce290.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_05522b6bcee879d32582345a76698bbf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_f336771a0f9911d56ecd851eb6f8b8b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_f336771a0f9911d56ecd851eb6f8b8b3.jpg not downloaded yet
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508d6d0>
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45250a25-ec32-574e-917a-4e44a57c4377/45250a25-ec32-574e-917a-4e44a57c4377_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff4%252F5bf4ec64882e8d4c1231456832f4ce4e%252Fpa%252FUT28191_b885f1ca72eaee68c5f713ed56eee4a6.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_b885f1ca72eaee68c5f713ed56eee4a6.jpg saved to cache
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45250a25-ec32-574e-917a-4e44a57c4377
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2b9d0>
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_50cdad0b473e75bad9a4771a4ecf3584.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_50cdad0b473e75bad9a4771a4ecf3584.jpg saved to cache
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e99597e-48fa-5cb1-a80c-5db2cb1741f4
2026-03-30 10:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ13044/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_7b9b1928db0e4ab2133321501d50e955.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_fca0ccdf711641fb9fac80bcf17092b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_fca0ccdf711641fb9fac80bcf17092b2.jpg not downloaded yet
2026-03-30 10:44:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f16d10>
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_17b32717f7cded2a4bc5d6da04cce290.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_17b32717f7cded2a4bc5d6da04cce290.jpg saved to cache
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2a650>
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_05522b6bcee879d32582345a76698bbf.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_05522b6bcee879d32582345a76698bbf.jpg saved to cache
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e99597e-48fa-5cb1-a80c-5db2cb1741f4
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_22716a43fc440f80302db2b7d92e7f67.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_22716a43fc440f80302db2b7d92e7f67.jpg not downloaded yet
2026-03-30 10:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_987b149817f928e6663ce8bf8c0aa96f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a21550>
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45250a25-ec32-574e-917a-4e44a57c4377/45250a25-ec32-574e-917a-4e44a57c4377_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff4%252F5bf4ec64882e8d4c1231456832f4ce4e%252Fpa%252FUT28191_7b9b1928db0e4ab2133321501d50e955.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_7b9b1928db0e4ab2133321501d50e955.jpg saved to cache
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45250a25-ec32-574e-917a-4e44a57c4377
2026-03-30 10:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_4abdb04e897e6884ea0cd2fb3af21721.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_b657a3087ceb0a665d2dc5ed91c853c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_bbabc2d44a46b1af1beeebae9c6a4ef7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_ab223ac86d7d29ab58d1dc8b3d326d91.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_73d44030e31bad00f0c3537ed068721e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e662d0>
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_987b149817f928e6663ce8bf8c0aa96f.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_987b149817f928e6663ce8bf8c0aa96f.jpg saved to cache
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e99597e-48fa-5cb1-a80c-5db2cb1741f4
2026-03-30 10:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_11b8ff9cb5e1b69dde7daa4d9977ca48.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6f2d0>
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_4abdb04e897e6884ea0cd2fb3af21721.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_4abdb04e897e6884ea0cd2fb3af21721.jpg saved to cache
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e99597e-48fa-5cb1-a80c-5db2cb1741f4
2026-03-30 10:44:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d7af50>
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_b657a3087ceb0a665d2dc5ed91c853c0.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_b657a3087ceb0a665d2dc5ed91c853c0.jpg saved to cache
2026-03-30 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35188f9f-bbf9-5c5b-a758-9b170847229a
2026-03-30 10:44:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dfac90>
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_bbabc2d44a46b1af1beeebae9c6a4ef7.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_bbabc2d44a46b1af1beeebae9c6a4ef7.jpg saved to cache
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3
2026-03-30 10:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_f336771a0f9911d56ecd851eb6f8b8b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c4dc90>
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_ab223ac86d7d29ab58d1dc8b3d326d91.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_ab223ac86d7d29ab58d1dc8b3d326d91.jpg saved to cache
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 35188f9f-bbf9-5c5b-a758-9b170847229a
2026-03-30 10:44:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b227d0>
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_73d44030e31bad00f0c3537ed068721e.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_73d44030e31bad00f0c3537ed068721e.jpg saved to cache
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3
2026-03-30 10:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_fca0ccdf711641fb9fac80bcf17092b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_22716a43fc440f80302db2b7d92e7f67.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59801d0>
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_11b8ff9cb5e1b69dde7daa4d9977ca48.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_11b8ff9cb5e1b69dde7daa4d9977ca48.jpg saved to cache
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e99597e-48fa-5cb1-a80c-5db2cb1741f4
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f08950>
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_f336771a0f9911d56ecd851eb6f8b8b3.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_f336771a0f9911d56ecd851eb6f8b8b3.jpg saved to cache
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e99597e-48fa-5cb1-a80c-5db2cb1741f4
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8b050>
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_fca0ccdf711641fb9fac80bcf17092b2.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_fca0ccdf711641fb9fac80bcf17092b2.jpg saved to cache
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e99597e-48fa-5cb1-a80c-5db2cb1741f4
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fef010>
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_22716a43fc440f80302db2b7d92e7f67.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_22716a43fc440f80302db2b7d92e7f67.jpg saved to cache
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e99597e-48fa-5cb1-a80c-5db2cb1741f4
2026-03-30 10:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_83dc09d3b7257248cedb2ccfe2df7fbf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_855651de6d244762e5dc554f4c514863.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_15c9b1db33c940c7c1f8e2dfdf022734.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_98a081a8ac911a47c8f5cc8eb90efe60.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_fe31341f88d221881f30c76623211c23.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_19e3149b770c2c92f13e789ae3a77e89.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee0310>
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45250a25-ec32-574e-917a-4e44a57c4377/45250a25-ec32-574e-917a-4e44a57c4377_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff4%252F5bf4ec64882e8d4c1231456832f4ce4e%252Fpa%252FUT28191_83dc09d3b7257248cedb2ccfe2df7fbf.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_83dc09d3b7257248cedb2ccfe2df7fbf.jpg saved to cache
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45250a25-ec32-574e-917a-4e44a57c4377
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a77c90>
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45250a25-ec32-574e-917a-4e44a57c4377/45250a25-ec32-574e-917a-4e44a57c4377_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff4%252F5bf4ec64882e8d4c1231456832f4ce4e%252Fpa%252FUT28191_855651de6d244762e5dc554f4c514863.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_855651de6d244762e5dc554f4c514863.jpg saved to cache
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45250a25-ec32-574e-917a-4e44a57c4377
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b35850>
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_15c9b1db33c940c7c1f8e2dfdf022734.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_15c9b1db33c940c7c1f8e2dfdf022734.jpg saved to cache
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e99597e-48fa-5cb1-a80c-5db2cb1741f4
2026-03-30 10:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_d4719a187aa109e79878345b883144d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e28d10>
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_98a081a8ac911a47c8f5cc8eb90efe60.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_98a081a8ac911a47c8f5cc8eb90efe60.jpg saved to cache
2026-03-30 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5acb3d0>
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45250a25-ec32-574e-917a-4e44a57c4377/45250a25-ec32-574e-917a-4e44a57c4377_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Ff4%252F5bf4ec64882e8d4c1231456832f4ce4e%252Fpa%252FUT28191_fe31341f88d221881f30c76623211c23.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_fe31341f88d221881f30c76623211c23.jpg saved to cache
2026-03-30 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45250a25-ec32-574e-917a-4e44a57c4377
2026-03-30 10:44:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45250a25-ec32-574e-917a-4e44a57c4377, skipping ID generation
2026-03-30 10:44:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45250a25-ec32-574e-917a-4e44a57c4377 with scrape type 1
2026-03-30 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45250a25-ec32-574e-917a-4e44a57c4377 sending to next pipeline
2026-03-30 10:44:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45250a25-ec32-574e-917a-4e44a57c4377, identifier: UT28191
2026-03-30 10:44:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e52650>
2026-03-30 10:44:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F13%252Faf13e799142787407806cfe11be66cad%252Fpa%252FUR76017_19e3149b770c2c92f13e789ae3a77e89.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_19e3149b770c2c92f13e789ae3a77e89.jpg saved to cache
2026-03-30 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e99597e-48fa-5cb1-a80c-5db2cb1741f4
2026-03-30 10:44:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e99597e-48fa-5cb1-a80c-5db2cb1741f4, skipping ID generation
2026-03-30 10:44:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e99597e-48fa-5cb1-a80c-5db2cb1741f4 with scrape type 1
2026-03-30 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e99597e-48fa-5cb1-a80c-5db2cb1741f4 sending to next pipeline
2026-03-30 10:44:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e99597e-48fa-5cb1-a80c-5db2cb1741f4, identifier: UR76017
2026-03-30 10:44:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45250a25-ec32-574e-917a-4e44a57c4377 with identifier: UT28191
2026-03-30 10:44:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45250a25-ec32-574e-917a-4e44a57c4377 with identifier: UT28191
2026-03-30 10:44:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45250a25-ec32-574e-917a-4e44a57c4377 with identifier: UT28191 to the API
2026-03-30 10:44:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_fe31341f88d221881f30c76623211c23.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:37:44Z',
 'fuel_type': 'petrol',
 'id': '45250a25-ec32-574e-917a-4e44a57c4377',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT28191',
 'listing': 'auction',
 'location': 'DE, Augsburg',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 161801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45250a25-ec32-574e-917a-4e44a57c4377/45250a25-ec32-574e-917a-4e44a57c4377_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_b885f1ca72eaee68c5f713ed56eee4a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45250a25-ec32-574e-917a-4e44a57c4377/45250a25-ec32-574e-917a-4e44a57c4377_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_fe31341f88d221881f30c76623211c23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45250a25-ec32-574e-917a-4e44a57c4377/45250a25-ec32-574e-917a-4e44a57c4377_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_855651de6d244762e5dc554f4c514863.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45250a25-ec32-574e-917a-4e44a57c4377/45250a25-ec32-574e-917a-4e44a57c4377_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_7b9b1928db0e4ab2133321501d50e955.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45250a25-ec32-574e-917a-4e44a57c4377/45250a25-ec32-574e-917a-4e44a57c4377_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/f4/5bf4ec64882e8d4c1231456832f4ce4e/pa/UT28191_83dc09d3b7257248cedb2ccfe2df7fbf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra GTC 1.6 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-30 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT28191%27 HTTP/1.1" 200 None
2026-03-30 10:44:07 [auto1.de] INFO: Saving data for UT28191: {'created_time': 1774867447.835084, 'last_price_update_time': 1774867447.835093, 'auction_closing_time': 1774971464.0}
2026-03-30 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT28191') HTTP/1.1" 204 0
2026-03-30 10:44:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e99597e-48fa-5cb1-a80c-5db2cb1741f4 with identifier: UR76017
2026-03-30 10:44:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e99597e-48fa-5cb1-a80c-5db2cb1741f4 with identifier: UR76017
2026-03-30 10:44:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e99597e-48fa-5cb1-a80c-5db2cb1741f4 with identifier: UR76017 to the API
2026-03-30 10:44:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_19e3149b770c2c92f13e789ae3a77e89.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 20,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:34:04Z',
 'fuel_type': 'diesel',
 'id': '0e99597e-48fa-5cb1-a80c-5db2cb1741f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR76017',
 'listing': 'auction',
 'location': 'DE, Bremerhaven',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 157754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_50cdad0b473e75bad9a4771a4ecf3584.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_19e3149b770c2c92f13e789ae3a77e89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_15c9b1db33c940c7c1f8e2dfdf022734.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_05522b6bcee879d32582345a76698bbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_11b8ff9cb5e1b69dde7daa4d9977ca48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_4abdb04e897e6884ea0cd2fb3af21721.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_987b149817f928e6663ce8bf8c0aa96f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_f336771a0f9911d56ecd851eb6f8b8b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_fca0ccdf711641fb9fac80bcf17092b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e99597e-48fa-5cb1-a80c-5db2cb1741f4/0e99597e-48fa-5cb1-a80c-5db2cb1741f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/13/af13e799142787407806cfe11be66cad/pa/UR76017_22716a43fc440f80302db2b7d92e7f67.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2017}
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR76017%27 HTTP/1.1" 200 None
2026-03-30 10:44:08 [auto1.de] INFO: Saving data for UR76017: {'created_time': 1774867448.252805, 'last_price_update_time': 1774867448.252816, 'auction_closing_time': 1774971244.0}
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR76017') HTTP/1.1" 204 0
2026-03-30 10:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_b37e882938c37059d785b6fe035e14ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_07f1283b7bcd5e5cc3adec9e0fdee6da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM37791/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fee790>
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_d4719a187aa109e79878345b883144d2.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_d4719a187aa109e79878345b883144d2.jpg saved to cache
2026-03-30 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aec38de5-9b44-516c-9341-237fd83bed8b
2026-03-30 10:44:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_939cf62538cb5bee328e8f1ef33467cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_68adf24f6d37d6d6facffb05c4fb0503.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_0a545038c6a45f575fa7c5b222e4db1f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_6da15128c81de204f14975fddcc45185.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a32150>
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_b37e882938c37059d785b6fe035e14ed.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_b37e882938c37059d785b6fe035e14ed.jpg saved to cache
2026-03-30 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aec38de5-9b44-516c-9341-237fd83bed8b
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b35a90>
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_07f1283b7bcd5e5cc3adec9e0fdee6da.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_07f1283b7bcd5e5cc3adec9e0fdee6da.jpg saved to cache
2026-03-30 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 35188f9f-bbf9-5c5b-a758-9b170847229a
2026-03-30 10:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_b8a7fe297f90f56d554decf5c01e44eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_6771fea13232a71a3b8f8d97d8459f6e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50e7690>
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_939cf62538cb5bee328e8f1ef33467cd.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_939cf62538cb5bee328e8f1ef33467cd.jpg saved to cache
2026-03-30 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3
2026-03-30 10:44:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd2090>
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_68adf24f6d37d6d6facffb05c4fb0503.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_68adf24f6d37d6d6facffb05c4fb0503.jpg saved to cache
2026-03-30 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3
2026-03-30 10:44:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508e4d0>
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_0a545038c6a45f575fa7c5b222e4db1f.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_0a545038c6a45f575fa7c5b222e4db1f.jpg saved to cache
2026-03-30 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aec38de5-9b44-516c-9341-237fd83bed8b
2026-03-30 10:44:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50e5010>
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_6da15128c81de204f14975fddcc45185.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_6da15128c81de204f14975fddcc45185.jpg saved to cache
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3
2026-03-30 10:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_4093ecb9a92de1b632b737d66ab2c3e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_c88e17bbf6d7c2e5be3812c3167865b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c62d0>
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_b8a7fe297f90f56d554decf5c01e44eb.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_b8a7fe297f90f56d554decf5c01e44eb.jpg saved to cache
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 35188f9f-bbf9-5c5b-a758-9b170847229a
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59947d0>
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_6771fea13232a71a3b8f8d97d8459f6e.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_6771fea13232a71a3b8f8d97d8459f6e.jpg saved to cache
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 35188f9f-bbf9-5c5b-a758-9b170847229a
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5996650>
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_4093ecb9a92de1b632b737d66ab2c3e3.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_4093ecb9a92de1b632b737d66ab2c3e3.jpg saved to cache
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5acb1d0>
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_c88e17bbf6d7c2e5be3812c3167865b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_c88e17bbf6d7c2e5be3812c3167865b1.jpg saved to cache
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aec38de5-9b44-516c-9341-237fd83bed8b
2026-03-30 10:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_22e2f4b2a16372533592e3b6d9a532e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_f84eeaca65bdca1d9a741dff6ac26ed7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_b65af2a2fb5ae7bf1be4eff5e841cf7c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_32be2a360e35a371feb01620ffadb022.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_fc7506c93623cf257116676c412fe68e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c5c10>
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_22e2f4b2a16372533592e3b6d9a532e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_22e2f4b2a16372533592e3b6d9a532e2.jpg saved to cache
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 35188f9f-bbf9-5c5b-a758-9b170847229a
2026-03-30 10:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_2816cc2006ab9406683939341a7379f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb9950>
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_f84eeaca65bdca1d9a741dff6ac26ed7.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_f84eeaca65bdca1d9a741dff6ac26ed7.jpg saved to cache
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 35188f9f-bbf9-5c5b-a758-9b170847229a
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5076090>
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_b65af2a2fb5ae7bf1be4eff5e841cf7c.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_b65af2a2fb5ae7bf1be4eff5e841cf7c.jpg saved to cache
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aec38de5-9b44-516c-9341-237fd83bed8b
2026-03-30 10:44:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0c950>
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_32be2a360e35a371feb01620ffadb022.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_32be2a360e35a371feb01620ffadb022.jpg saved to cache
2026-03-30 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aec38de5-9b44-516c-9341-237fd83bed8b
2026-03-30 10:44:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b21890>
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F2e%252F022ebf8970e113bbc7fa31360c08e47c%252Fpa%252FSE98527_fc7506c93623cf257116676c412fe68e.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_fc7506c93623cf257116676c412fe68e.jpg saved to cache
2026-03-30 10:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aec38de5-9b44-516c-9341-237fd83bed8b
2026-03-30 10:44:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aec38de5-9b44-516c-9341-237fd83bed8b, skipping ID generation
2026-03-30 10:44:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aec38de5-9b44-516c-9341-237fd83bed8b with scrape type 1
2026-03-30 10:44:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aec38de5-9b44-516c-9341-237fd83bed8b sending to next pipeline
2026-03-30 10:44:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aec38de5-9b44-516c-9341-237fd83bed8b, identifier: SE98527
2026-03-30 10:44:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aec38de5-9b44-516c-9341-237fd83bed8b with identifier: SE98527
2026-03-30 10:44:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aec38de5-9b44-516c-9341-237fd83bed8b with identifier: SE98527
2026-03-30 10:44:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aec38de5-9b44-516c-9341-237fd83bed8b with identifier: SE98527 to the API
2026-03-30 10:44:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_fc7506c93623cf257116676c412fe68e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:35:45Z',
 'fuel_type': 'petrol',
 'id': 'aec38de5-9b44-516c-9341-237fd83bed8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE98527',
 'listing': 'auction',
 'location': 'DE, Zwickau',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 89614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_0b7338adfa8b2de1d1d2c5043e37b8ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_b65af2a2fb5ae7bf1be4eff5e841cf7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3228228,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_32be2a360e35a371feb01620ffadb022.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2815186,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_fc7506c93623cf257116676c412fe68e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_c88e17bbf6d7c2e5be3812c3167865b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_132a332ced6bdd775982e950d39752d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_725304d49fbe241032de6e7460f6c78b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_b37e882938c37059d785b6fe035e14ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2770302,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_0a545038c6a45f575fa7c5b222e4db1f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec38de5-9b44-516c-9341-237fd83bed8b/aec38de5-9b44-516c-9341-237fd83bed8b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/2e/022ebf8970e113bbc7fa31360c08e47c/pa/SE98527_d4719a187aa109e79878345b883144d2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT IQ.DRIVE BlueMotion',
 'transmission': 'manual',
 'trim': 'IQ.DRIVE BlueMotion',
 'year': 2019}
2026-03-30 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE98527%27 HTTP/1.1" 200 None
2026-03-30 10:44:10 [auto1.de] INFO: Saving data for SE98527: {'created_time': 1774867450.533529, 'last_price_update_time': 1774867450.53354, 'auction_closing_time': 1774971345.0}
2026-03-30 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE98527') HTTP/1.1" 204 0
2026-03-30 10:44:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eaaf10>
2026-03-30 10:44:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F89%252F47897dde138907d2e7a296d2ab464562%252Fpa%252FTM60818_2816cc2006ab9406683939341a7379f4.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_2816cc2006ab9406683939341a7379f4.jpg saved to cache
2026-03-30 10:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 35188f9f-bbf9-5c5b-a758-9b170847229a
2026-03-30 10:44:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35188f9f-bbf9-5c5b-a758-9b170847229a, skipping ID generation
2026-03-30 10:44:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35188f9f-bbf9-5c5b-a758-9b170847229a with scrape type 1
2026-03-30 10:44:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35188f9f-bbf9-5c5b-a758-9b170847229a sending to next pipeline
2026-03-30 10:44:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35188f9f-bbf9-5c5b-a758-9b170847229a, identifier: TM60818
2026-03-30 10:44:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35188f9f-bbf9-5c5b-a758-9b170847229a with identifier: TM60818
2026-03-30 10:44:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35188f9f-bbf9-5c5b-a758-9b170847229a with identifier: TM60818
2026-03-30 10:44:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35188f9f-bbf9-5c5b-a758-9b170847229a with identifier: TM60818 to the API
2026-03-30 10:44:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_2816cc2006ab9406683939341a7379f4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:53:02Z',
 'fuel_type': 'petrol',
 'id': '35188f9f-bbf9-5c5b-a758-9b170847229a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM60818',
 'listing': 'auction',
 'location': 'DE, Mainz-Kastel (Wiesbaden)',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 78923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2546796,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_b657a3087ceb0a665d2dc5ed91c853c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_7bb91fd57ccd60baba579323b2951f29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_a691d32a21d7a6f2bce2ac5017daf0b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_2816cc2006ab9406683939341a7379f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_f84eeaca65bdca1d9a741dff6ac26ed7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2842642,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_22e2f4b2a16372533592e3b6d9a532e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_6771fea13232a71a3b8f8d97d8459f6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2652196,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_ab223ac86d7d29ab58d1dc8b3d326d91.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_b8a7fe297f90f56d554decf5c01e44eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35188f9f-bbf9-5c5b-a758-9b170847229a/35188f9f-bbf9-5c5b-a758-9b170847229a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/89/47897dde138907d2e7a296d2ab464562/pa/TM60818_07f1283b7bcd5e5cc3adec9e0fdee6da.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM60818%27 HTTP/1.1" 200 None
2026-03-30 10:44:11 [auto1.de] INFO: Saving data for TM60818: {'created_time': 1774867451.055892, 'last_price_update_time': 1774867451.055904, 'auction_closing_time': 1774972382.0}
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM60818') HTTP/1.1" 204 0
2026-03-30 10:44:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_e571e30241c758e2b5f5dac3b376541a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ13044> (referer: https://www.auto1.com/v1/car-details-view/NZ13044/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC19039> (referer: https://www.auto1.com/v1/car-details-view/KC19039/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f170d0>
2026-03-30 10:44:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fde%252F40deef9739292d21a9c6934e0827be3b%252Fpa%252FAE13145_e571e30241c758e2b5f5dac3b376541a.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_e571e30241c758e2b5f5dac3b376541a.jpg saved to cache
2026-03-30 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3
2026-03-30 10:44:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3, skipping ID generation
2026-03-30 10:44:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3 with scrape type 1
2026-03-30 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3 sending to next pipeline
2026-03-30 10:44:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3, identifier: AE13145
2026-03-30 10:44:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3 with identifier: AE13145
2026-03-30 10:44:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3 with identifier: AE13145
2026-03-30 10:44:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7655c8ce-0a81-544e-b6d3-e1da14ac8aa3 with identifier: AE13145 to the API
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_e571e30241c758e2b5f5dac3b376541a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:28:41Z',
 'fuel_type': 'petrol',
 'id': '7655c8ce-0a81-544e-b6d3-e1da14ac8aa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE13145',
 'listing': 'auction',
 'location': 'DE, Greifswald',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 83853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2890221,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_e571e30241c758e2b5f5dac3b376541a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2955531,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_73d44030e31bad00f0c3537ed068721e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_4093ecb9a92de1b632b737d66ab2c3e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2662947,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_bbabc2d44a46b1af1beeebae9c6a4ef7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_79d04bfc5e8d9d8a3fab68bca928df6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2795491,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_6da15128c81de204f14975fddcc45185.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2670328,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_68adf24f6d37d6d6facffb05c4fb0503.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_98a081a8ac911a47c8f5cc8eb90efe60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_17b32717f7cded2a4bc5d6da04cce290.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7655c8ce-0a81-544e-b6d3-e1da14ac8aa3/7655c8ce-0a81-544e-b6d3-e1da14ac8aa3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2946074,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/de/40deef9739292d21a9c6934e0827be3b/pa/AE13145_939cf62538cb5bee328e8f1ef33467cd.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Champions Edition',
 'transmission': 'manual',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE13145%27 HTTP/1.1" 200 None
2026-03-30 10:44:11 [auto1.de] INFO: Saving data for AE13145: {'created_time': 1774867451.77592, 'last_price_update_time': 1774867451.77598, 'auction_closing_time': 1774970921.0}
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE13145') HTTP/1.1" 204 0
2026-03-30 10:44:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7524211e-b18e-5e5e-a189-11774481da69 with identifier: NZ13044
2026-03-30 10:44:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7524211e-b18e-5e5e-a189-11774481da69 with scrape type 1
2026-03-30 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7524211e-b18e-5e5e-a189-11774481da69
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_1f8746a7db2ca8119f0e19da2b24fecf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_1f8746a7db2ca8119f0e19da2b24fecf.jpg not downloaded yet
2026-03-30 10:44:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bce88d22-8497-561c-b788-ec730a6992c6 with identifier: KC19039
2026-03-30 10:44:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce88d22-8497-561c-b788-ec730a6992c6 with scrape type 1
2026-03-30 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bce88d22-8497-561c-b788-ec730a6992c6
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F91%252F1791d8f131f1b8b9b358333f600630ad%252Fpa%252FKC19039_8c9b4e8a07f0c08b601454ecb42d58be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_8c9b4e8a07f0c08b601454ecb42d58be.jpg already downloaded
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F91%252F1791d8f131f1b8b9b358333f600630ad%252Fpa%252FKC19039_89e9160e075bc7ad1bf339faab535799.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_89e9160e075bc7ad1bf339faab535799.jpg already downloaded
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F91%252F1791d8f131f1b8b9b358333f600630ad%252Fpa%252FKC19039_b64af77b72c5ac28c8a80766487dcbab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_b64af77b72c5ac28c8a80766487dcbab.jpg already downloaded
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F91%252F1791d8f131f1b8b9b358333f600630ad%252Fpa%252FKC19039_5dfe7eaed60f4639eedfdcb87f4936e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_5dfe7eaed60f4639eedfdcb87f4936e0.jpg already downloaded
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F91%252F1791d8f131f1b8b9b358333f600630ad%252Fpa%252FKC19039_c5560b633539e9f963fab2e75784b2e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_c5560b633539e9f963fab2e75784b2e1.jpg already downloaded
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F91%252F1791d8f131f1b8b9b358333f600630ad%252Fpa%252FKC19039_2e7a1d7c0df13d3adaa36b7ca3fbf393.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_2e7a1d7c0df13d3adaa36b7ca3fbf393.jpg already downloaded
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F91%252F1791d8f131f1b8b9b358333f600630ad%252Fpa%252FKC19039_6a35c13847423a5cd3c1ad57fd08583b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_6a35c13847423a5cd3c1ad57fd08583b.jpg already downloaded
2026-03-30 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F91%252F1791d8f131f1b8b9b358333f600630ad%252Fpa%252FKC19039_abb4a3177bdc56a82f104ef3df9ae438.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_abb4a3177bdc56a82f104ef3df9ae438.jpg already downloaded
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F91%252F1791d8f131f1b8b9b358333f600630ad%252Fpa%252FKC19039_497fa479f3bb7811970713e0fe56c1fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_497fa479f3bb7811970713e0fe56c1fb.jpg already downloaded
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F91%252F1791d8f131f1b8b9b358333f600630ad%252Fpa%252FKC19039_8ed09bb919f30decb238dfc17767efe1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_8ed09bb919f30decb238dfc17767efe1.jpg already downloaded
2026-03-30 10:44:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bce88d22-8497-561c-b788-ec730a6992c6, identifier: KC19039
2026-03-30 10:44:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bce88d22-8497-561c-b788-ec730a6992c6 with identifier: KC19039
2026-03-30 10:44:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bce88d22-8497-561c-b788-ec730a6992c6 with identifier: KC19039
2026-03-30 10:44:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bce88d22-8497-561c-b788-ec730a6992c6 with identifier: KC19039 to the API
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KC19039>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-31T15:42:27Z',
 'fuel_type': 'petrol',
 'id': 'bce88d22-8497-561c-b788-ec730a6992c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC19039',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 29862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_8c9b4e8a07f0c08b601454ecb42d58be.jpg',
                'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_89e9160e075bc7ad1bf339faab535799.jpg',
                'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_b64af77b72c5ac28c8a80766487dcbab.jpg',
                'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_5dfe7eaed60f4639eedfdcb87f4936e0.jpg',
                'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_c5560b633539e9f963fab2e75784b2e1.jpg',
                'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_2e7a1d7c0df13d3adaa36b7ca3fbf393.jpg',
                'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_6a35c13847423a5cd3c1ad57fd08583b.jpg',
                'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_abb4a3177bdc56a82f104ef3df9ae438.jpg',
                'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_497fa479f3bb7811970713e0fe56c1fb.jpg',
                'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_8ed09bb919f30decb238dfc17767efe1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce88d22-8497-561c-b788-ec730a6992c6/bce88d22-8497-561c-b788-ec730a6992c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2865390,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_8c9b4e8a07f0c08b601454ecb42d58be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce88d22-8497-561c-b788-ec730a6992c6/bce88d22-8497-561c-b788-ec730a6992c6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_89e9160e075bc7ad1bf339faab535799.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce88d22-8497-561c-b788-ec730a6992c6/bce88d22-8497-561c-b788-ec730a6992c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2562035,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_b64af77b72c5ac28c8a80766487dcbab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce88d22-8497-561c-b788-ec730a6992c6/bce88d22-8497-561c-b788-ec730a6992c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2747239,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_5dfe7eaed60f4639eedfdcb87f4936e0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce88d22-8497-561c-b788-ec730a6992c6/bce88d22-8497-561c-b788-ec730a6992c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2627936,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_c5560b633539e9f963fab2e75784b2e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce88d22-8497-561c-b788-ec730a6992c6/bce88d22-8497-561c-b788-ec730a6992c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_2e7a1d7c0df13d3adaa36b7ca3fbf393.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce88d22-8497-561c-b788-ec730a6992c6/bce88d22-8497-561c-b788-ec730a6992c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_6a35c13847423a5cd3c1ad57fd08583b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce88d22-8497-561c-b788-ec730a6992c6/bce88d22-8497-561c-b788-ec730a6992c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_abb4a3177bdc56a82f104ef3df9ae438.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce88d22-8497-561c-b788-ec730a6992c6/bce88d22-8497-561c-b788-ec730a6992c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2693393,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_497fa479f3bb7811970713e0fe56c1fb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce88d22-8497-561c-b788-ec730a6992c6/bce88d22-8497-561c-b788-ec730a6992c6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2622245,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/91/1791d8f131f1b8b9b358333f600630ad/pa/KC19039_8ed09bb919f30decb238dfc17767efe1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2011}
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC19039%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [auto1.de] INFO: Saving data for KC19039: {'created_time': 1774867452.471815, 'last_price_update_time': 1774867452.471822, 'auction_closing_time': 1774971747.0}
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC19039') HTTP/1.1" 204 0
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_097968b051ecc81d55e09b9e4bdfb89b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_097968b051ecc81d55e09b9e4bdfb89b.jpg not downloaded yet
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_e58a50859ac3f75a2d48c1223a2916c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_e58a50859ac3f75a2d48c1223a2916c3.jpg not downloaded yet
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_2d382537a2aedadba27d100c068db2cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_2d382537a2aedadba27d100c068db2cb.jpg not downloaded yet
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_81d89c2be4588745e3e377312b7cf2f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_81d89c2be4588745e3e377312b7cf2f6.jpg not downloaded yet
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_04d3bc3548f7eaceecffd4d110ef33d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_04d3bc3548f7eaceecffd4d110ef33d5.jpg not downloaded yet
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_ecc1deebc5d3dd134ddeefb6175ead76.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_ecc1deebc5d3dd134ddeefb6175ead76.jpg not downloaded yet
2026-03-30 10:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_1f8746a7db2ca8119f0e19da2b24fecf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_cc58ce1fb673a28b89c050621c56182a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_cc58ce1fb673a28b89c050621c56182a.jpg not downloaded yet
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_b320c526436da63872cd1441a3b4096b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_b320c526436da63872cd1441a3b4096b.jpg not downloaded yet
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_d0ef3ab0e951da637010df2536bbf248.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_d0ef3ab0e951da637010df2536bbf248.jpg not downloaded yet
2026-03-30 10:44:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea27d0>
2026-03-30 10:44:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_1f8746a7db2ca8119f0e19da2b24fecf.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_1f8746a7db2ca8119f0e19da2b24fecf.jpg saved to cache
2026-03-30 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7524211e-b18e-5e5e-a189-11774481da69
2026-03-30 10:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_097968b051ecc81d55e09b9e4bdfb89b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_ecc1deebc5d3dd134ddeefb6175ead76.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5107ed0>
2026-03-30 10:44:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_097968b051ecc81d55e09b9e4bdfb89b.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_097968b051ecc81d55e09b9e4bdfb89b.jpg saved to cache
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7524211e-b18e-5e5e-a189-11774481da69
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd2490>
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_ecc1deebc5d3dd134ddeefb6175ead76.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_ecc1deebc5d3dd134ddeefb6175ead76.jpg saved to cache
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7524211e-b18e-5e5e-a189-11774481da69
2026-03-30 10:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_d0ef3ab0e951da637010df2536bbf248.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_b320c526436da63872cd1441a3b4096b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f09a50>
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_d0ef3ab0e951da637010df2536bbf248.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_d0ef3ab0e951da637010df2536bbf248.jpg saved to cache
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7524211e-b18e-5e5e-a189-11774481da69
2026-03-30 10:44:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a20890>
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_b320c526436da63872cd1441a3b4096b.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_b320c526436da63872cd1441a3b4096b.jpg saved to cache
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7524211e-b18e-5e5e-a189-11774481da69
2026-03-30 10:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_04d3bc3548f7eaceecffd4d110ef33d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a21ed0>
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_04d3bc3548f7eaceecffd4d110ef33d5.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_04d3bc3548f7eaceecffd4d110ef33d5.jpg saved to cache
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7524211e-b18e-5e5e-a189-11774481da69
2026-03-30 10:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_cc58ce1fb673a28b89c050621c56182a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WK68540> (referer: https://www.auto1.com/v1/car-details-view/WK68540/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5104250>
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_cc58ce1fb673a28b89c050621c56182a.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_cc58ce1fb673a28b89c050621c56182a.jpg saved to cache
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7524211e-b18e-5e5e-a189-11774481da69
2026-03-30 10:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_2d382537a2aedadba27d100c068db2cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dbe68b1-2402-50fa-abab-35b5a5c40f41 with identifier: WK68540
2026-03-30 10:44:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dbe68b1-2402-50fa-abab-35b5a5c40f41 with scrape type 1
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8dbe68b1-2402-50fa-abab-35b5a5c40f41
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_1133f78ee5eb1f9ccd0babc96bf3f646.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_1133f78ee5eb1f9ccd0babc96bf3f646.jpg not downloaded yet
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_0d317df11a53a73eaf9506b6b1786ea7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_0d317df11a53a73eaf9506b6b1786ea7.jpg not downloaded yet
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_0621b84a22935e7f8875e3b491c37312.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_0621b84a22935e7f8875e3b491c37312.jpg not downloaded yet
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_f6ca07724c9aa1ff964b779ea15b1e1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_f6ca07724c9aa1ff964b779ea15b1e1a.jpg not downloaded yet
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_a42a54d0692d70799e9f0fc52ed41c61.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_a42a54d0692d70799e9f0fc52ed41c61.jpg not downloaded yet
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_0e2d814b602a8ebc3a8ef108e1cbe181.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_0e2d814b602a8ebc3a8ef108e1cbe181.jpg not downloaded yet
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_55a1d98b637ab8c6af57e9f3f614c03b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_55a1d98b637ab8c6af57e9f3f614c03b.jpg not downloaded yet
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fc98d0>
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_2d382537a2aedadba27d100c068db2cb.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_2d382537a2aedadba27d100c068db2cb.jpg saved to cache
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7524211e-b18e-5e5e-a189-11774481da69
2026-03-30 10:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_1133f78ee5eb1f9ccd0babc96bf3f646.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_5b25b835af8566c9fa2363cf89cd59b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_5b25b835af8566c9fa2363cf89cd59b1.jpg not downloaded yet
2026-03-30 10:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_81d89c2be4588745e3e377312b7cf2f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_39238b52b54b3442ea879ba3d56ed409.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_39238b52b54b3442ea879ba3d56ed409.jpg not downloaded yet
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_065394a7a1d80c7547395fa6ea4cade2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_065394a7a1d80c7547395fa6ea4cade2.jpg not downloaded yet
2026-03-30 10:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_e58a50859ac3f75a2d48c1223a2916c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eaa1d0>
2026-03-30 10:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_1133f78ee5eb1f9ccd0babc96bf3f646.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_1133f78ee5eb1f9ccd0babc96bf3f646.jpg saved to cache
2026-03-30 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8dbe68b1-2402-50fa-abab-35b5a5c40f41
2026-03-30 10:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_5b25b835af8566c9fa2363cf89cd59b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f179d0>
2026-03-30 10:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_81d89c2be4588745e3e377312b7cf2f6.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_81d89c2be4588745e3e377312b7cf2f6.jpg saved to cache
2026-03-30 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7524211e-b18e-5e5e-a189-11774481da69
2026-03-30 10:44:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a23e10>
2026-03-30 10:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fdb%252Fdcdba86283214c6ca10b27decc62daa0%252Fpa%252FNZ13044_e58a50859ac3f75a2d48c1223a2916c3.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_e58a50859ac3f75a2d48c1223a2916c3.jpg saved to cache
2026-03-30 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7524211e-b18e-5e5e-a189-11774481da69
2026-03-30 10:44:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7524211e-b18e-5e5e-a189-11774481da69, skipping ID generation
2026-03-30 10:44:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7524211e-b18e-5e5e-a189-11774481da69 with scrape type 1
2026-03-30 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7524211e-b18e-5e5e-a189-11774481da69 sending to next pipeline
2026-03-30 10:44:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7524211e-b18e-5e5e-a189-11774481da69, identifier: NZ13044
2026-03-30 10:44:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7524211e-b18e-5e5e-a189-11774481da69 with identifier: NZ13044
2026-03-30 10:44:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7524211e-b18e-5e5e-a189-11774481da69 with identifier: NZ13044
2026-03-30 10:44:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7524211e-b18e-5e5e-a189-11774481da69 with identifier: NZ13044 to the API
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_e58a50859ac3f75a2d48c1223a2916c3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:15:55Z',
 'fuel_type': 'diesel',
 'id': '7524211e-b18e-5e5e-a189-11774481da69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ13044',
 'listing': 'auction',
 'location': 'DE, Flensburg',
 'make': 'BMW',
 'model': '3er',
 'odometer': 153755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_1f8746a7db2ca8119f0e19da2b24fecf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2870659,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_097968b051ecc81d55e09b9e4bdfb89b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2829777,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_e58a50859ac3f75a2d48c1223a2916c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_2d382537a2aedadba27d100c068db2cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2885372,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_81d89c2be4588745e3e377312b7cf2f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_04d3bc3548f7eaceecffd4d110ef33d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_ecc1deebc5d3dd134ddeefb6175ead76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2724169,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_cc58ce1fb673a28b89c050621c56182a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2869079,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_b320c526436da63872cd1441a3b4096b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7524211e-b18e-5e5e-a189-11774481da69/7524211e-b18e-5e5e-a189-11774481da69_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/db/dcdba86283214c6ca10b27decc62daa0/pa/NZ13044_d0ef3ab0e951da637010df2536bbf248.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ13044%27 HTTP/1.1" 200 None
2026-03-30 10:44:14 [auto1.de] INFO: Saving data for NZ13044: {'created_time': 1774867454.944138, 'last_price_update_time': 1774867454.944148, 'auction_closing_time': 1774970155.0}
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ13044') HTTP/1.1" 204 0
2026-03-30 10:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_55a1d98b637ab8c6af57e9f3f614c03b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e6a4d0>
2026-03-30 10:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_5b25b835af8566c9fa2363cf89cd59b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_5b25b835af8566c9fa2363cf89cd59b1.jpg saved to cache
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8dbe68b1-2402-50fa-abab-35b5a5c40f41
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee39d0>
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_55a1d98b637ab8c6af57e9f3f614c03b.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_55a1d98b637ab8c6af57e9f3f614c03b.jpg saved to cache
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8dbe68b1-2402-50fa-abab-35b5a5c40f41
2026-03-30 10:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_39238b52b54b3442ea879ba3d56ed409.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_065394a7a1d80c7547395fa6ea4cade2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_0e2d814b602a8ebc3a8ef108e1cbe181.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5107810>
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_39238b52b54b3442ea879ba3d56ed409.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_39238b52b54b3442ea879ba3d56ed409.jpg saved to cache
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8dbe68b1-2402-50fa-abab-35b5a5c40f41
2026-03-30 10:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_f6ca07724c9aa1ff964b779ea15b1e1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_0621b84a22935e7f8875e3b491c37312.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee39d0>
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_065394a7a1d80c7547395fa6ea4cade2.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_065394a7a1d80c7547395fa6ea4cade2.jpg saved to cache
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8dbe68b1-2402-50fa-abab-35b5a5c40f41
2026-03-30 10:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_a42a54d0692d70799e9f0fc52ed41c61.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50ddd50>
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_0e2d814b602a8ebc3a8ef108e1cbe181.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_0e2d814b602a8ebc3a8ef108e1cbe181.jpg saved to cache
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8dbe68b1-2402-50fa-abab-35b5a5c40f41
2026-03-30 10:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_0d317df11a53a73eaf9506b6b1786ea7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5104690>
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_f6ca07724c9aa1ff964b779ea15b1e1a.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_f6ca07724c9aa1ff964b779ea15b1e1a.jpg saved to cache
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8dbe68b1-2402-50fa-abab-35b5a5c40f41
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5077910>
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_0621b84a22935e7f8875e3b491c37312.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_0621b84a22935e7f8875e3b491c37312.jpg saved to cache
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8dbe68b1-2402-50fa-abab-35b5a5c40f41
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f1190>
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_a42a54d0692d70799e9f0fc52ed41c61.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_a42a54d0692d70799e9f0fc52ed41c61.jpg saved to cache
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8dbe68b1-2402-50fa-abab-35b5a5c40f41
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7c41110>
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F02%252Fce0270e23a3e8e74b83f43c9f881be7f%252Fpa%252FWK68540_0d317df11a53a73eaf9506b6b1786ea7.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_0d317df11a53a73eaf9506b6b1786ea7.jpg saved to cache
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8dbe68b1-2402-50fa-abab-35b5a5c40f41
2026-03-30 10:44:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8dbe68b1-2402-50fa-abab-35b5a5c40f41, skipping ID generation
2026-03-30 10:44:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dbe68b1-2402-50fa-abab-35b5a5c40f41 with scrape type 1
2026-03-30 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8dbe68b1-2402-50fa-abab-35b5a5c40f41 sending to next pipeline
2026-03-30 10:44:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8dbe68b1-2402-50fa-abab-35b5a5c40f41, identifier: WK68540
2026-03-30 10:44:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8dbe68b1-2402-50fa-abab-35b5a5c40f41 with identifier: WK68540
2026-03-30 10:44:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8dbe68b1-2402-50fa-abab-35b5a5c40f41 with identifier: WK68540
2026-03-30 10:44:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8dbe68b1-2402-50fa-abab-35b5a5c40f41 with identifier: WK68540 to the API
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_0d317df11a53a73eaf9506b6b1786ea7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:54:21Z',
 'fuel_type': 'diesel',
 'id': '8dbe68b1-2402-50fa-abab-35b5a5c40f41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK68540',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 125593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_1133f78ee5eb1f9ccd0babc96bf3f646.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_0d317df11a53a73eaf9506b6b1786ea7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_0621b84a22935e7f8875e3b491c37312.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_f6ca07724c9aa1ff964b779ea15b1e1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_a42a54d0692d70799e9f0fc52ed41c61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_0e2d814b602a8ebc3a8ef108e1cbe181.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_55a1d98b637ab8c6af57e9f3f614c03b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_5b25b835af8566c9fa2363cf89cd59b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_39238b52b54b3442ea879ba3d56ed409.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dbe68b1-2402-50fa-abab-35b5a5c40f41/8dbe68b1-2402-50fa-abab-35b5a5c40f41_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/02/ce0270e23a3e8e74b83f43c9f881be7f/pa/WK68540_065394a7a1d80c7547395fa6ea4cade2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2014}
2026-03-30 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK68540%27 HTTP/1.1" 200 None
2026-03-30 10:44:16 [auto1.de] INFO: Saving data for WK68540: {'created_time': 1774867456.103295, 'last_price_update_time': 1774867456.103305, 'auction_closing_time': 1774972461.0}
2026-03-30 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK68540') HTTP/1.1" 204 0
2026-03-30 10:44:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS54833> (referer: https://www.auto1.com/v1/car-details-view/TS54833/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9333e4ac-a66a-55d5-adf0-c064be9cbb46 with identifier: TS54833
2026-03-30 10:44:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9333e4ac-a66a-55d5-adf0-c064be9cbb46 with scrape type 1
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9333e4ac-a66a-55d5-adf0-c064be9cbb46
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_aca684406fffb840f5f9587ae7198ea5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_aca684406fffb840f5f9587ae7198ea5.jpg not downloaded yet
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_ba9c5de6352ccc319af5692063334936.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_ba9c5de6352ccc319af5692063334936.jpg not downloaded yet
2026-03-30 10:44:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM37791> (referer: https://www.auto1.com/v1/car-details-view/RM37791/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_5c236e0f56865a545ce7766aac7ce22f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_5c236e0f56865a545ce7766aac7ce22f.jpg not downloaded yet
2026-03-30 10:44:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_24179d5ab85046c2de6347acf321811c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_24179d5ab85046c2de6347acf321811c.jpg not downloaded yet
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_d5cb380cf798734fd8bdc0e3637a0b54.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_d5cb380cf798734fd8bdc0e3637a0b54.jpg not downloaded yet
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_9ff65b53601b76dbd5fa055f5987047f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_9ff65b53601b76dbd5fa055f5987047f.jpg not downloaded yet
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_ca7c69ad905d565ce5014990fc70ac79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_ca7c69ad905d565ce5014990fc70ac79.jpg not downloaded yet
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_9681e56e0d4912955bfbb795a692e6ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_9681e56e0d4912955bfbb795a692e6ef.jpg not downloaded yet
2026-03-30 10:44:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_aca684406fffb840f5f9587ae7198ea5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_ba9c5de6352ccc319af5692063334936.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_c19341979b665f250127f3d49345b74a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_c19341979b665f250127f3d49345b74a.jpg not downloaded yet
2026-03-30 10:44:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9935d62c-ff15-5d5c-b500-6cc044356dd9 with identifier: RM37791
2026-03-30 10:44:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9935d62c-ff15-5d5c-b500-6cc044356dd9 with scrape type 1
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9935d62c-ff15-5d5c-b500-6cc044356dd9
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F3c%252Fcc3cddb803cfdde4669c9d2219533d22%252Fpa%252FRM37791_dea61f133aa09986f00cbcce5e46b357.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_dea61f133aa09986f00cbcce5e46b357.jpg already downloaded
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F3c%252Fcc3cddb803cfdde4669c9d2219533d22%252Fpa%252FRM37791_cb96d9c02b9a1495a2543c33c1090329.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_cb96d9c02b9a1495a2543c33c1090329.jpg already downloaded
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F3c%252Fcc3cddb803cfdde4669c9d2219533d22%252Fpa%252FRM37791_bcb93339dbd3ec900d281acaf89f5601.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_bcb93339dbd3ec900d281acaf89f5601.jpg already downloaded
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F3c%252Fcc3cddb803cfdde4669c9d2219533d22%252Fpa%252FRM37791_3022508d23ddd7fe66e76b403fe6d9b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_3022508d23ddd7fe66e76b403fe6d9b1.jpg already downloaded
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F3c%252Fcc3cddb803cfdde4669c9d2219533d22%252Fpa%252FRM37791_b457498a51a045ea9a18ed6f577599dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_b457498a51a045ea9a18ed6f577599dc.jpg already downloaded
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F3c%252Fcc3cddb803cfdde4669c9d2219533d22%252Fpa%252FRM37791_ed7a5645baec65e5a5b084b99646ee64.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_ed7a5645baec65e5a5b084b99646ee64.jpg already downloaded
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F3c%252Fcc3cddb803cfdde4669c9d2219533d22%252Fpa%252FRM37791_70ce4dcca7cfb173492622864f86a222.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_70ce4dcca7cfb173492622864f86a222.jpg already downloaded
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F3c%252Fcc3cddb803cfdde4669c9d2219533d22%252Fpa%252FRM37791_c8a7e451c29a2f1a6ccb53ca308618df.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_c8a7e451c29a2f1a6ccb53ca308618df.jpg already downloaded
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F3c%252Fcc3cddb803cfdde4669c9d2219533d22%252Fpa%252FRM37791_71a520c5268592780e3e05cb6dbcf87d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_71a520c5268592780e3e05cb6dbcf87d.jpg already downloaded
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F3c%252Fcc3cddb803cfdde4669c9d2219533d22%252Fpa%252FRM37791_cb283df719217f81971615f5878c3043.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_cb283df719217f81971615f5878c3043.jpg already downloaded
2026-03-30 10:44:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9935d62c-ff15-5d5c-b500-6cc044356dd9, identifier: RM37791
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_b85a29a856b7a167979c8283f7ef2d4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_b85a29a856b7a167979c8283f7ef2d4e.jpg not downloaded yet
2026-03-30 10:44:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9935d62c-ff15-5d5c-b500-6cc044356dd9 with identifier: RM37791
2026-03-30 10:44:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9935d62c-ff15-5d5c-b500-6cc044356dd9 with identifier: RM37791
2026-03-30 10:44:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9935d62c-ff15-5d5c-b500-6cc044356dd9 with identifier: RM37791 to the API
2026-03-30 10:44:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RM37791>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:15:26Z',
 'fuel_type': 'diesel',
 'id': '9935d62c-ff15-5d5c-b500-6cc044356dd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM37791',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 94222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_dea61f133aa09986f00cbcce5e46b357.jpg',
                'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_cb96d9c02b9a1495a2543c33c1090329.jpg',
                'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_bcb93339dbd3ec900d281acaf89f5601.jpg',
                'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_3022508d23ddd7fe66e76b403fe6d9b1.jpg',
                'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_b457498a51a045ea9a18ed6f577599dc.jpg',
                'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_ed7a5645baec65e5a5b084b99646ee64.jpg',
                'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_70ce4dcca7cfb173492622864f86a222.jpg',
                'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_c8a7e451c29a2f1a6ccb53ca308618df.jpg',
                'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_71a520c5268592780e3e05cb6dbcf87d.jpg',
                'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_cb283df719217f81971615f5878c3043.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9935d62c-ff15-5d5c-b500-6cc044356dd9/9935d62c-ff15-5d5c-b500-6cc044356dd9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_dea61f133aa09986f00cbcce5e46b357.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9935d62c-ff15-5d5c-b500-6cc044356dd9/9935d62c-ff15-5d5c-b500-6cc044356dd9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_cb96d9c02b9a1495a2543c33c1090329.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9935d62c-ff15-5d5c-b500-6cc044356dd9/9935d62c-ff15-5d5c-b500-6cc044356dd9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_bcb93339dbd3ec900d281acaf89f5601.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9935d62c-ff15-5d5c-b500-6cc044356dd9/9935d62c-ff15-5d5c-b500-6cc044356dd9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_3022508d23ddd7fe66e76b403fe6d9b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9935d62c-ff15-5d5c-b500-6cc044356dd9/9935d62c-ff15-5d5c-b500-6cc044356dd9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_b457498a51a045ea9a18ed6f577599dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9935d62c-ff15-5d5c-b500-6cc044356dd9/9935d62c-ff15-5d5c-b500-6cc044356dd9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_ed7a5645baec65e5a5b084b99646ee64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9935d62c-ff15-5d5c-b500-6cc044356dd9/9935d62c-ff15-5d5c-b500-6cc044356dd9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_70ce4dcca7cfb173492622864f86a222.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9935d62c-ff15-5d5c-b500-6cc044356dd9/9935d62c-ff15-5d5c-b500-6cc044356dd9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_c8a7e451c29a2f1a6ccb53ca308618df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9935d62c-ff15-5d5c-b500-6cc044356dd9/9935d62c-ff15-5d5c-b500-6cc044356dd9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_71a520c5268592780e3e05cb6dbcf87d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9935d62c-ff15-5d5c-b500-6cc044356dd9/9935d62c-ff15-5d5c-b500-6cc044356dd9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/3c/cc3cddb803cfdde4669c9d2219533d22/pa/RM37791_cb283df719217f81971615f5878c3043.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.5 CDTI Opel 2020 Start/Stop',
 'transmission': 'manual',
 'trim': '2020 Start/Stop',
 'year': 2020}
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM37791%27 HTTP/1.1" 200 None
2026-03-30 10:44:18 [auto1.de] INFO: Saving data for RM37791: {'created_time': 1774867458.568364, 'last_price_update_time': 1774867458.568375, 'auction_closing_time': 1774970126.0}
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM37791') HTTP/1.1" 204 0
2026-03-30 10:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_d5cb380cf798734fd8bdc0e3637a0b54.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_5c236e0f56865a545ce7766aac7ce22f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_24179d5ab85046c2de6347acf321811c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG28539/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e442d0>
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_aca684406fffb840f5f9587ae7198ea5.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_aca684406fffb840f5f9587ae7198ea5.jpg saved to cache
2026-03-30 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9333e4ac-a66a-55d5-adf0-c064be9cbb46
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5963310>
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_ba9c5de6352ccc319af5692063334936.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_ba9c5de6352ccc319af5692063334936.jpg saved to cache
2026-03-30 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9333e4ac-a66a-55d5-adf0-c064be9cbb46
2026-03-30 10:44:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE58561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_9681e56e0d4912955bfbb795a692e6ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c2a90>
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_d5cb380cf798734fd8bdc0e3637a0b54.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_d5cb380cf798734fd8bdc0e3637a0b54.jpg saved to cache
2026-03-30 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9333e4ac-a66a-55d5-adf0-c064be9cbb46
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595e790>
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_5c236e0f56865a545ce7766aac7ce22f.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_5c236e0f56865a545ce7766aac7ce22f.jpg saved to cache
2026-03-30 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9333e4ac-a66a-55d5-adf0-c064be9cbb46
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f11e50>
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_24179d5ab85046c2de6347acf321811c.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_24179d5ab85046c2de6347acf321811c.jpg saved to cache
2026-03-30 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9333e4ac-a66a-55d5-adf0-c064be9cbb46
2026-03-30 10:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_9ff65b53601b76dbd5fa055f5987047f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_b85a29a856b7a167979c8283f7ef2d4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_ca7c69ad905d565ce5014990fc70ac79.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_c19341979b665f250127f3d49345b74a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b3e90>
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_9681e56e0d4912955bfbb795a692e6ef.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_9681e56e0d4912955bfbb795a692e6ef.jpg saved to cache
2026-03-30 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9333e4ac-a66a-55d5-adf0-c064be9cbb46
2026-03-30 10:44:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY18278/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a32390>
2026-03-30 10:44:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_9ff65b53601b76dbd5fa055f5987047f.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_9ff65b53601b76dbd5fa055f5987047f.jpg saved to cache
2026-03-30 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9333e4ac-a66a-55d5-adf0-c064be9cbb46
2026-03-30 10:44:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a76910>
2026-03-30 10:44:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_b85a29a856b7a167979c8283f7ef2d4e.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_b85a29a856b7a167979c8283f7ef2d4e.jpg saved to cache
2026-03-30 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9333e4ac-a66a-55d5-adf0-c064be9cbb46
2026-03-30 10:44:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7904110>
2026-03-30 10:44:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_ca7c69ad905d565ce5014990fc70ac79.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_ca7c69ad905d565ce5014990fc70ac79.jpg saved to cache
2026-03-30 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9333e4ac-a66a-55d5-adf0-c064be9cbb46
2026-03-30 10:44:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ23052/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50e5e90>
2026-03-30 10:44:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fe9%252Fa3e922cc6846010172f1fd04bc0955ec%252Fpa%252FTS54833_c19341979b665f250127f3d49345b74a.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_c19341979b665f250127f3d49345b74a.jpg saved to cache
2026-03-30 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9333e4ac-a66a-55d5-adf0-c064be9cbb46
2026-03-30 10:44:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9333e4ac-a66a-55d5-adf0-c064be9cbb46, skipping ID generation
2026-03-30 10:44:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9333e4ac-a66a-55d5-adf0-c064be9cbb46 with scrape type 1
2026-03-30 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9333e4ac-a66a-55d5-adf0-c064be9cbb46 sending to next pipeline
2026-03-30 10:44:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9333e4ac-a66a-55d5-adf0-c064be9cbb46, identifier: TS54833
2026-03-30 10:44:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9333e4ac-a66a-55d5-adf0-c064be9cbb46 with identifier: TS54833
2026-03-30 10:44:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9333e4ac-a66a-55d5-adf0-c064be9cbb46 with identifier: TS54833
2026-03-30 10:44:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9333e4ac-a66a-55d5-adf0-c064be9cbb46 with identifier: TS54833 to the API
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_c19341979b665f250127f3d49345b74a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:53:41Z',
 'fuel_type': 'petrol',
 'id': '9333e4ac-a66a-55d5-adf0-c064be9cbb46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS54833',
 'listing': 'auction',
 'location': 'DE, Köln',
 'make': 'BMW',
 'model': '1er',
 'odometer': 194713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_aca684406fffb840f5f9587ae7198ea5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_ba9c5de6352ccc319af5692063334936.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_5c236e0f56865a545ce7766aac7ce22f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_24179d5ab85046c2de6347acf321811c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_d5cb380cf798734fd8bdc0e3637a0b54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_9ff65b53601b76dbd5fa055f5987047f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_ca7c69ad905d565ce5014990fc70ac79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_9681e56e0d4912955bfbb795a692e6ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_c19341979b665f250127f3d49345b74a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9333e4ac-a66a-55d5-adf0-c064be9cbb46/9333e4ac-a66a-55d5-adf0-c064be9cbb46_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/e9/a3e922cc6846010172f1fd04bc0955ec/pa/TS54833_b85a29a856b7a167979c8283f7ef2d4e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS54833%27 HTTP/1.1" 200 None
2026-03-30 10:44:19 [auto1.de] INFO: Saving data for TS54833: {'created_time': 1774867459.996052, 'last_price_update_time': 1774867459.996061, 'auction_closing_time': 1774972421.0}
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS54833') HTTP/1.1" 204 0
2026-03-30 10:44:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY05397/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG28539> (referer: https://www.auto1.com/v1/car-details-view/NG28539/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6e0829f-e568-510c-87e5-ebace5834b2c with identifier: NG28539
2026-03-30 10:44:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6e0829f-e568-510c-87e5-ebace5834b2c with scrape type 1
2026-03-30 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6e0829f-e568-510c-87e5-ebace5834b2c
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbb%252Fc7bbeb0e6ad8c9bec723d7367d1c4e90%252Fpa%252FNG28539_88aa003aa09afc356f9967ce1546bfee.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_88aa003aa09afc356f9967ce1546bfee.jpg already downloaded
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbb%252Fc7bbeb0e6ad8c9bec723d7367d1c4e90%252Fpa%252FNG28539_7797c16a234db3ee53bd00ca0c689604.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_7797c16a234db3ee53bd00ca0c689604.jpg already downloaded
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbb%252Fc7bbeb0e6ad8c9bec723d7367d1c4e90%252Fpa%252FNG28539_23945d4b47911f8974818539675bb54a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_23945d4b47911f8974818539675bb54a.jpg already downloaded
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbb%252Fc7bbeb0e6ad8c9bec723d7367d1c4e90%252Fpa%252FNG28539_c9fcf14ec42a3da819ff56e6e50dfadc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_c9fcf14ec42a3da819ff56e6e50dfadc.jpg already downloaded
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbb%252Fc7bbeb0e6ad8c9bec723d7367d1c4e90%252Fpa%252FNG28539_86eee013174de524788e0633b70a6693.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_86eee013174de524788e0633b70a6693.jpg already downloaded
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbb%252Fc7bbeb0e6ad8c9bec723d7367d1c4e90%252Fpa%252FNG28539_85d66911d726a004d844562bba2d6eb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_85d66911d726a004d844562bba2d6eb5.jpg already downloaded
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbb%252Fc7bbeb0e6ad8c9bec723d7367d1c4e90%252Fpa%252FNG28539_42cd920b7815ea606ab94826d7b32346.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_42cd920b7815ea606ab94826d7b32346.jpg already downloaded
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbb%252Fc7bbeb0e6ad8c9bec723d7367d1c4e90%252Fpa%252FNG28539_f1fa24457c95a5a5c03b135a17cb1b3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_f1fa24457c95a5a5c03b135a17cb1b3b.jpg already downloaded
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbb%252Fc7bbeb0e6ad8c9bec723d7367d1c4e90%252Fpa%252FNG28539_9d80ddfa60b51d475f77f69e07c749d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_9d80ddfa60b51d475f77f69e07c749d7.jpg already downloaded
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbb%252Fc7bbeb0e6ad8c9bec723d7367d1c4e90%252Fpa%252FNG28539_b9f76d165ff2604c356ecc3fe8e2321c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_b9f76d165ff2604c356ecc3fe8e2321c.jpg already downloaded
2026-03-30 10:44:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6e0829f-e568-510c-87e5-ebace5834b2c, identifier: NG28539
2026-03-30 10:44:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6e0829f-e568-510c-87e5-ebace5834b2c with identifier: NG28539
2026-03-30 10:44:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6e0829f-e568-510c-87e5-ebace5834b2c with identifier: NG28539
2026-03-30 10:44:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6e0829f-e568-510c-87e5-ebace5834b2c with identifier: NG28539 to the API
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NG28539>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:41:52Z',
 'fuel_type': 'diesel',
 'id': 'c6e0829f-e568-510c-87e5-ebace5834b2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG28539',
 'listing': 'auction',
 'location': 'DE, Kippenheim',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 170284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_88aa003aa09afc356f9967ce1546bfee.jpg',
                'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_7797c16a234db3ee53bd00ca0c689604.jpg',
                'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_23945d4b47911f8974818539675bb54a.jpg',
                'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_c9fcf14ec42a3da819ff56e6e50dfadc.jpg',
                'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_86eee013174de524788e0633b70a6693.jpg',
                'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_85d66911d726a004d844562bba2d6eb5.jpg',
                'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_42cd920b7815ea606ab94826d7b32346.jpg',
                'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_f1fa24457c95a5a5c03b135a17cb1b3b.jpg',
                'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_9d80ddfa60b51d475f77f69e07c749d7.jpg',
                'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_b9f76d165ff2604c356ecc3fe8e2321c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e0829f-e568-510c-87e5-ebace5834b2c/c6e0829f-e568-510c-87e5-ebace5834b2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_88aa003aa09afc356f9967ce1546bfee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e0829f-e568-510c-87e5-ebace5834b2c/c6e0829f-e568-510c-87e5-ebace5834b2c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_7797c16a234db3ee53bd00ca0c689604.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e0829f-e568-510c-87e5-ebace5834b2c/c6e0829f-e568-510c-87e5-ebace5834b2c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_23945d4b47911f8974818539675bb54a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e0829f-e568-510c-87e5-ebace5834b2c/c6e0829f-e568-510c-87e5-ebace5834b2c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2503301,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_c9fcf14ec42a3da819ff56e6e50dfadc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e0829f-e568-510c-87e5-ebace5834b2c/c6e0829f-e568-510c-87e5-ebace5834b2c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_86eee013174de524788e0633b70a6693.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e0829f-e568-510c-87e5-ebace5834b2c/c6e0829f-e568-510c-87e5-ebace5834b2c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_85d66911d726a004d844562bba2d6eb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e0829f-e568-510c-87e5-ebace5834b2c/c6e0829f-e568-510c-87e5-ebace5834b2c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2093781,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_42cd920b7815ea606ab94826d7b32346.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e0829f-e568-510c-87e5-ebace5834b2c/c6e0829f-e568-510c-87e5-ebace5834b2c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_f1fa24457c95a5a5c03b135a17cb1b3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e0829f-e568-510c-87e5-ebace5834b2c/c6e0829f-e568-510c-87e5-ebace5834b2c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2497704,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_9d80ddfa60b51d475f77f69e07c749d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e0829f-e568-510c-87e5-ebace5834b2c/c6e0829f-e568-510c-87e5-ebace5834b2c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/bb/c7bbeb0e6ad8c9bec723d7367d1c4e90/pa/NG28539_b9f76d165ff2604c356ecc3fe8e2321c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2014}
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG28539%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [auto1.de] INFO: Saving data for NG28539: {'created_time': 1774867461.604007, 'last_price_update_time': 1774867461.604017, 'auction_closing_time': 1774971712.0}
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG28539') HTTP/1.1" 204 0
2026-03-30 10:44:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE58561> (referer: https://www.auto1.com/v1/car-details-view/ZE58561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be2a69fe-05f0-5dba-9e15-35c6b1219419 with identifier: ZE58561
2026-03-30 10:44:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be2a69fe-05f0-5dba-9e15-35c6b1219419 with scrape type 1
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be2a69fe-05f0-5dba-9e15-35c6b1219419
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_b731da18b2f618d581fa0d5e0a771b42.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_b731da18b2f618d581fa0d5e0a771b42.jpg not downloaded yet
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_f61e6c5412ce3328223f6508e12563b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_f61e6c5412ce3328223f6508e12563b1.jpg not downloaded yet
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_095b7dde21a8102ef730e151f1617460.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_095b7dde21a8102ef730e151f1617460.jpg not downloaded yet
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_f9a1fe77f3d886bfe7e5db53f437a997.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_f9a1fe77f3d886bfe7e5db53f437a997.jpg not downloaded yet
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_1c2a436c0fbfdcb61b5a76dfa0afe37d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_1c2a436c0fbfdcb61b5a76dfa0afe37d.jpg not downloaded yet
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_16cf2a153e43b04105055bbf00e5e12b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_16cf2a153e43b04105055bbf00e5e12b.jpg not downloaded yet
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_bb49a978030869e1a01bc6f363651795.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_bb49a978030869e1a01bc6f363651795.jpg not downloaded yet
2026-03-30 10:44:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_f61e6c5412ce3328223f6508e12563b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_704bd1f5fddc1f65e502cf541d2eb820.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_704bd1f5fddc1f65e502cf541d2eb820.jpg not downloaded yet
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_0b80261a53f1bb2be3678823f6783ba3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_0b80261a53f1bb2be3678823f6783ba3.jpg not downloaded yet
2026-03-30 10:44:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_b731da18b2f618d581fa0d5e0a771b42.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_fd82a7efae3c8d5787003f7d26b685b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_fd82a7efae3c8d5787003f7d26b685b5.jpg not downloaded yet
2026-03-30 10:44:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_f9a1fe77f3d886bfe7e5db53f437a997.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_1c2a436c0fbfdcb61b5a76dfa0afe37d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_095b7dde21a8102ef730e151f1617460.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_16cf2a153e43b04105055bbf00e5e12b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7921f10>
2026-03-30 10:44:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_f61e6c5412ce3328223f6508e12563b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_f61e6c5412ce3328223f6508e12563b1.jpg saved to cache
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be2a69fe-05f0-5dba-9e15-35c6b1219419
2026-03-30 10:44:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_0b80261a53f1bb2be3678823f6783ba3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508eb90>
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_b731da18b2f618d581fa0d5e0a771b42.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_b731da18b2f618d581fa0d5e0a771b42.jpg saved to cache
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be2a69fe-05f0-5dba-9e15-35c6b1219419
2026-03-30 10:44:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe2d10>
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_f9a1fe77f3d886bfe7e5db53f437a997.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_f9a1fe77f3d886bfe7e5db53f437a997.jpg saved to cache
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be2a69fe-05f0-5dba-9e15-35c6b1219419
2026-03-30 10:44:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_fd82a7efae3c8d5787003f7d26b685b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_704bd1f5fddc1f65e502cf541d2eb820.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_bb49a978030869e1a01bc6f363651795.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e502d0>
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_1c2a436c0fbfdcb61b5a76dfa0afe37d.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_1c2a436c0fbfdcb61b5a76dfa0afe37d.jpg saved to cache
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be2a69fe-05f0-5dba-9e15-35c6b1219419
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ec27d0>
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_095b7dde21a8102ef730e151f1617460.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_095b7dde21a8102ef730e151f1617460.jpg saved to cache
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be2a69fe-05f0-5dba-9e15-35c6b1219419
2026-03-30 10:44:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b37e90>
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_16cf2a153e43b04105055bbf00e5e12b.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_16cf2a153e43b04105055bbf00e5e12b.jpg saved to cache
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be2a69fe-05f0-5dba-9e15-35c6b1219419
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f13450>
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_0b80261a53f1bb2be3678823f6783ba3.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_0b80261a53f1bb2be3678823f6783ba3.jpg saved to cache
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be2a69fe-05f0-5dba-9e15-35c6b1219419
2026-03-30 10:44:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e6a7d0>
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_fd82a7efae3c8d5787003f7d26b685b5.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_fd82a7efae3c8d5787003f7d26b685b5.jpg saved to cache
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be2a69fe-05f0-5dba-9e15-35c6b1219419
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2c790>
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_704bd1f5fddc1f65e502cf541d2eb820.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_704bd1f5fddc1f65e502cf541d2eb820.jpg saved to cache
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be2a69fe-05f0-5dba-9e15-35c6b1219419
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ec2b50>
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Fee%252F38ee1fd80860ddec4aac2a82a3fbf308%252Fpa%252FZE58561_bb49a978030869e1a01bc6f363651795.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_bb49a978030869e1a01bc6f363651795.jpg saved to cache
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be2a69fe-05f0-5dba-9e15-35c6b1219419
2026-03-30 10:44:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be2a69fe-05f0-5dba-9e15-35c6b1219419, skipping ID generation
2026-03-30 10:44:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be2a69fe-05f0-5dba-9e15-35c6b1219419 with scrape type 1
2026-03-30 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be2a69fe-05f0-5dba-9e15-35c6b1219419 sending to next pipeline
2026-03-30 10:44:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be2a69fe-05f0-5dba-9e15-35c6b1219419, identifier: ZE58561
2026-03-30 10:44:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be2a69fe-05f0-5dba-9e15-35c6b1219419 with identifier: ZE58561
2026-03-30 10:44:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be2a69fe-05f0-5dba-9e15-35c6b1219419 with identifier: ZE58561
2026-03-30 10:44:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be2a69fe-05f0-5dba-9e15-35c6b1219419 with identifier: ZE58561 to the API
2026-03-30 10:44:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_bb49a978030869e1a01bc6f363651795.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:51:33Z',
 'fuel_type': 'diesel',
 'id': 'be2a69fe-05f0-5dba-9e15-35c6b1219419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE58561',
 'listing': 'auction',
 'location': 'DE, Gelsenkirchen',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 199044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369262,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_b731da18b2f618d581fa0d5e0a771b42.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65839,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_f61e6c5412ce3328223f6508e12563b1.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58893,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_095b7dde21a8102ef730e151f1617460.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296763,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_f9a1fe77f3d886bfe7e5db53f437a997.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320147,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_1c2a436c0fbfdcb61b5a76dfa0afe37d.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323665,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_16cf2a153e43b04105055bbf00e5e12b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45486,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_bb49a978030869e1a01bc6f363651795.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53352,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_704bd1f5fddc1f65e502cf541d2eb820.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66398,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_0b80261a53f1bb2be3678823f6783ba3.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be2a69fe-05f0-5dba-9e15-35c6b1219419/be2a69fe-05f0-5dba-9e15-35c6b1219419_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312745,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/ee/38ee1fd80860ddec4aac2a82a3fbf308/pa/ZE58561_fd82a7efae3c8d5787003f7d26b685b5.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI clean diesel',
 'transmission': 'manual',
 'trim': 'clean diesel',
 'year': 2016}
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE58561%27 HTTP/1.1" 200 None
2026-03-30 10:44:23 [auto1.de] INFO: Saving data for ZE58561: {'created_time': 1774867463.1468, 'last_price_update_time': 1774867463.146811, 'auction_closing_time': 1774972293.0}
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE58561') HTTP/1.1" 204 0
2026-03-30 10:44:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN42226/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:23 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 9458 | hits on page: 40
2026-03-30 10:44:23 [auto1.de] INFO: Found listing with ID: MK76692
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK76692%27 HTTP/1.1" 200 None
2026-03-30 10:44:23 [auto1.de] INFO: Scrape type for MK76692: 0
2026-03-30 10:44:23 [auto1.de] INFO: Found listing with ID: FZ11767
2026-03-30 10:44:23 [auto1.de] INFO: Found listing with ID: NL99287
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL99287%27 HTTP/1.1" 200 None
2026-03-30 10:44:23 [auto1.de] INFO: Scrape type for NL99287: 1
2026-03-30 10:44:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:23 [auto1.de] INFO: Found listing with ID: AD94410
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD94410%27 HTTP/1.1" 200 None
2026-03-30 10:44:23 [auto1.de] INFO: Scrape type for AD94410: 2
2026-03-30 10:44:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3920f2f8-1855-5bd7-9f05-c4e3e684127b with identifier: AD94410
2026-03-30 10:44:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3920f2f8-1855-5bd7-9f05-c4e3e684127b with scrape type 2
2026-03-30 10:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3920f2f8-1855-5bd7-9f05-c4e3e684127b with scrape type 2
2026-03-30 10:44:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3920f2f8-1855-5bd7-9f05-c4e3e684127b, identifier: AD94410
2026-03-30 10:44:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3920f2f8-1855-5bd7-9f05-c4e3e684127b with identifier: AD94410
2026-03-30 10:44:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3920f2f8-1855-5bd7-9f05-c4e3e684127b with identifier: AD94410
2026-03-30 10:44:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3920f2f8-1855-5bd7-9f05-c4e3e684127b with identifier: AD94410 to the API
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:55:13Z',
 'fuel_type': 'diesel',
 'id': '3920f2f8-1855-5bd7-9f05-c4e3e684127b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD94410',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 250753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-14',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD94410%27 HTTP/1.1" 200 None
2026-03-30 10:44:23 [auto1.de] INFO: Saving data for AD94410: {'auction_closing_time': 1774972513.0, 'created_time': 1774294194.698312, 'last_price_update_time': 1774867463.768478}
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD94410') HTTP/1.1" 204 0
2026-03-30 10:44:23 [auto1.de] INFO: Found listing with ID: ZN17495
2026-03-30 10:44:23 [auto1.de] INFO: Found listing with ID: ZL04476
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL04476%27 HTTP/1.1" 200 None
2026-03-30 10:44:23 [auto1.de] INFO: Scrape type for ZL04476: 1
2026-03-30 10:44:23 [auto1.de] INFO: Found listing with ID: JG35280
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35280%27 HTTP/1.1" 200 None
2026-03-30 10:44:23 [auto1.de] INFO: Scrape type for JG35280: 1
2026-03-30 10:44:23 [auto1.de] INFO: Found listing with ID: TS24409
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS24409%27 HTTP/1.1" 200 None
2026-03-30 10:44:23 [auto1.de] INFO: Scrape type for TS24409: 1
2026-03-30 10:44:23 [auto1.de] INFO: Found listing with ID: CK66212
2026-03-30 10:44:23 [auto1.de] INFO: Found listing with ID: AF66532
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF66532%27 HTTP/1.1" 200 None
2026-03-30 10:44:23 [auto1.de] INFO: Scrape type for AF66532: 1
2026-03-30 10:44:23 [auto1.de] INFO: Found listing with ID: MR40804
2026-03-30 10:44:23 [auto1.de] INFO: Found listing with ID: FK20948
2026-03-30 10:44:23 [auto1.de] INFO: Found listing with ID: JJ21697
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ21697%27 HTTP/1.1" 200 None
2026-03-30 10:44:23 [auto1.de] INFO: Scrape type for JJ21697: 2
2026-03-30 10:44:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22676416-3226-5e36-ad20-d708165894f1 with identifier: JJ21697
2026-03-30 10:44:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22676416-3226-5e36-ad20-d708165894f1 with scrape type 2
2026-03-30 10:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22676416-3226-5e36-ad20-d708165894f1 with scrape type 2
2026-03-30 10:44:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22676416-3226-5e36-ad20-d708165894f1, identifier: JJ21697
2026-03-30 10:44:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22676416-3226-5e36-ad20-d708165894f1 with identifier: JJ21697
2026-03-30 10:44:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22676416-3226-5e36-ad20-d708165894f1 with identifier: JJ21697
2026-03-30 10:44:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22676416-3226-5e36-ad20-d708165894f1 with identifier: JJ21697 to the API
2026-03-30 10:44:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:01:29Z',
 'fuel_type': 'diesel',
 'id': '22676416-3226-5e36-ad20-d708165894f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ21697',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 232946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-11',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L2H1 2,9t Expression',
 'transmission': 'manual',
 'trim': 'L2H1 2,9t Expression',
 'year': 2014}
2026-03-30 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ21697%27 HTTP/1.1" 200 None
2026-03-30 10:44:24 [auto1.de] INFO: Saving data for JJ21697: {'auction_closing_time': 1774969289.0, 'created_time': 1774291384.4512, 'last_price_update_time': 1774867464.327256}
2026-03-30 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ21697') HTTP/1.1" 204 0
2026-03-30 10:44:24 [auto1.de] INFO: Found listing with ID: MH00767
2026-03-30 10:44:24 [auto1.de] INFO: Found listing with ID: XU85928
2026-03-30 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU85928%27 HTTP/1.1" 200 None
2026-03-30 10:44:24 [auto1.de] INFO: Scrape type for XU85928: 2
2026-03-30 10:44:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c41f04c-f7be-579e-8d4d-1751c460c3dc with identifier: XU85928
2026-03-30 10:44:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c41f04c-f7be-579e-8d4d-1751c460c3dc with scrape type 2
2026-03-30 10:44:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c41f04c-f7be-579e-8d4d-1751c460c3dc with scrape type 2
2026-03-30 10:44:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c41f04c-f7be-579e-8d4d-1751c460c3dc, identifier: XU85928
2026-03-30 10:44:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c41f04c-f7be-579e-8d4d-1751c460c3dc with identifier: XU85928
2026-03-30 10:44:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c41f04c-f7be-579e-8d4d-1751c460c3dc with identifier: XU85928
2026-03-30 10:44:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c41f04c-f7be-579e-8d4d-1751c460c3dc with identifier: XU85928 to the API
2026-03-30 10:44:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:53:40Z',
 'fuel_type': 'diesel',
 'id': '5c41f04c-f7be-579e-8d4d-1751c460c3dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU85928',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'NP300 Pick-up',
 'odometer': 190515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-18',
 'seller_name': None,
 'title': 'Nissan NP300 Pick-up 2.3 dCi Tekna Double Cab 4x4',
 'transmission': 'automatic',
 'trim': 'Tekna Double Cab 4x4',
 'year': 2019}
2026-03-30 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU85928%27 HTTP/1.1" 200 None
2026-03-30 10:44:24 [auto1.de] INFO: Saving data for XU85928: {'auction_closing_time': 1774972420.0, 'created_time': 1773305443.654346, 'last_price_update_time': 1774867464.968806}
2026-03-30 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU85928') HTTP/1.1" 204 0
2026-03-30 10:44:24 [auto1.de] INFO: Found listing with ID: VW39600
2026-03-30 10:44:24 [auto1.de] INFO: Found listing with ID: TL94146
2026-03-30 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL94146%27 HTTP/1.1" 200 None
2026-03-30 10:44:25 [auto1.de] INFO: Scrape type for TL94146: 1
2026-03-30 10:44:25 [auto1.de] INFO: Found listing with ID: UG74460
2026-03-30 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG74460%27 HTTP/1.1" 200 None
2026-03-30 10:44:25 [auto1.de] INFO: Scrape type for UG74460: 1
2026-03-30 10:44:25 [auto1.de] INFO: Found listing with ID: LM16436
2026-03-30 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM16436%27 HTTP/1.1" 200 None
2026-03-30 10:44:25 [auto1.de] INFO: Scrape type for LM16436: 2
2026-03-30 10:44:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb9e8299-1069-514b-bd98-435c93bcc82b with identifier: LM16436
2026-03-30 10:44:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb9e8299-1069-514b-bd98-435c93bcc82b with scrape type 2
2026-03-30 10:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb9e8299-1069-514b-bd98-435c93bcc82b with scrape type 2
2026-03-30 10:44:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb9e8299-1069-514b-bd98-435c93bcc82b, identifier: LM16436
2026-03-30 10:44:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb9e8299-1069-514b-bd98-435c93bcc82b with identifier: LM16436
2026-03-30 10:44:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb9e8299-1069-514b-bd98-435c93bcc82b with identifier: LM16436
2026-03-30 10:44:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb9e8299-1069-514b-bd98-435c93bcc82b with identifier: LM16436 to the API
2026-03-30 10:44:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:35:53Z',
 'fuel_type': 'diesel',
 'id': 'cb9e8299-1069-514b-bd98-435c93bcc82b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM16436',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 144840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-26',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-30 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM16436%27 HTTP/1.1" 200 None
2026-03-30 10:44:25 [auto1.de] INFO: Saving data for LM16436: {'auction_closing_time': 1774971353.0, 'created_time': 1773687891.650647, 'last_price_update_time': 1774867465.517725}
2026-03-30 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM16436') HTTP/1.1" 204 0
2026-03-30 10:44:25 [auto1.de] INFO: Found listing with ID: PP68012
2026-03-30 10:44:25 [auto1.de] INFO: Found listing with ID: WL31000
2026-03-30 10:44:25 [auto1.de] INFO: Found listing with ID: GV79461
2026-03-30 10:44:25 [auto1.de] INFO: Found listing with ID: MT60714
2026-03-30 10:44:25 [auto1.de] INFO: Found listing with ID: JD61379
2026-03-30 10:44:25 [auto1.de] INFO: Found listing with ID: HH61076
2026-03-30 10:44:25 [auto1.de] INFO: Found listing with ID: VK27516
2026-03-30 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK27516%27 HTTP/1.1" 200 None
2026-03-30 10:44:25 [auto1.de] INFO: Scrape type for VK27516: 2
2026-03-30 10:44:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64cf71c9-46ed-581a-8096-858bf2235286 with identifier: VK27516
2026-03-30 10:44:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64cf71c9-46ed-581a-8096-858bf2235286 with scrape type 2
2026-03-30 10:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64cf71c9-46ed-581a-8096-858bf2235286 with scrape type 2
2026-03-30 10:44:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64cf71c9-46ed-581a-8096-858bf2235286, identifier: VK27516
2026-03-30 10:44:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64cf71c9-46ed-581a-8096-858bf2235286 with identifier: VK27516
2026-03-30 10:44:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64cf71c9-46ed-581a-8096-858bf2235286 with identifier: VK27516
2026-03-30 10:44:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64cf71c9-46ed-581a-8096-858bf2235286 with identifier: VK27516 to the API
2026-03-30 10:44:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:03:43Z',
 'fuel_type': 'petrol',
 'id': '64cf71c9-46ed-581a-8096-858bf2235286',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK27516',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 53207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-01',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK27516%27 HTTP/1.1" 200 None
2026-03-30 10:44:26 [auto1.de] INFO: Saving data for VK27516: {'auction_closing_time': 1774969423.0, 'created_time': 1773225681.051409, 'last_price_update_time': 1774867466.349411}
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK27516') HTTP/1.1" 204 0
2026-03-30 10:44:26 [auto1.de] INFO: Found listing with ID: FG83238
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG83238%27 HTTP/1.1" 200 None
2026-03-30 10:44:26 [auto1.de] INFO: Scrape type for FG83238: 1
2026-03-30 10:44:26 [auto1.de] INFO: Found listing with ID: GS63094
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS63094%27 HTTP/1.1" 200 None
2026-03-30 10:44:26 [auto1.de] INFO: Scrape type for GS63094: 2
2026-03-30 10:44:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 368240fe-bb0a-50e1-99cd-c5bc26cde65a with identifier: GS63094
2026-03-30 10:44:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 368240fe-bb0a-50e1-99cd-c5bc26cde65a with scrape type 2
2026-03-30 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 368240fe-bb0a-50e1-99cd-c5bc26cde65a with scrape type 2
2026-03-30 10:44:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 368240fe-bb0a-50e1-99cd-c5bc26cde65a, identifier: GS63094
2026-03-30 10:44:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 368240fe-bb0a-50e1-99cd-c5bc26cde65a with identifier: GS63094
2026-03-30 10:44:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 368240fe-bb0a-50e1-99cd-c5bc26cde65a with identifier: GS63094
2026-03-30 10:44:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 368240fe-bb0a-50e1-99cd-c5bc26cde65a with identifier: GS63094 to the API
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-31T15:41:36Z',
 'fuel_type': 'petrol',
 'id': '368240fe-bb0a-50e1-99cd-c5bc26cde65a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS63094',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 50109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-03',
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS63094%27 HTTP/1.1" 200 None
2026-03-30 10:44:26 [auto1.de] INFO: Saving data for GS63094: {'auction_closing_time': 1774971696.0, 'created_time': 1773304612.006332, 'last_price_update_time': 1774867466.939656}
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS63094') HTTP/1.1" 204 0
2026-03-30 10:44:26 [auto1.de] INFO: Found listing with ID: FC96399
2026-03-30 10:44:26 [auto1.de] INFO: Found listing with ID: DB06170
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB06170%27 HTTP/1.1" 200 None
2026-03-30 10:44:26 [auto1.de] INFO: Scrape type for DB06170: 2
2026-03-30 10:44:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92863461-8842-593f-a1d1-64212b1c0868 with identifier: DB06170
2026-03-30 10:44:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92863461-8842-593f-a1d1-64212b1c0868 with scrape type 2
2026-03-30 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92863461-8842-593f-a1d1-64212b1c0868 with scrape type 2
2026-03-30 10:44:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92863461-8842-593f-a1d1-64212b1c0868, identifier: DB06170
2026-03-30 10:44:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92863461-8842-593f-a1d1-64212b1c0868 with identifier: DB06170
2026-03-30 10:44:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92863461-8842-593f-a1d1-64212b1c0868 with identifier: DB06170
2026-03-30 10:44:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92863461-8842-593f-a1d1-64212b1c0868 with identifier: DB06170 to the API
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:59:25Z',
 'fuel_type': 'diesel',
 'id': '92863461-8842-593f-a1d1-64212b1c0868',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB06170',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 152149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-29',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2014}
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB06170%27 HTTP/1.1" 200 None
2026-03-30 10:44:27 [auto1.de] INFO: Saving data for DB06170: {'auction_closing_time': 1774972765.0, 'created_time': 1774348999.084742, 'last_price_update_time': 1774867467.399397}
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB06170') HTTP/1.1" 204 0
2026-03-30 10:44:27 [auto1.de] INFO: Found listing with ID: XE05713
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05713%27 HTTP/1.1" 200 None
2026-03-30 10:44:27 [auto1.de] INFO: Scrape type for XE05713: 1
2026-03-30 10:44:27 [auto1.de] INFO: Found listing with ID: MM13759
2026-03-30 10:44:27 [auto1.de] INFO: Found listing with ID: CC81161
2026-03-30 10:44:27 [auto1.de] INFO: Found listing with ID: KE34822
2026-03-30 10:44:27 [auto1.de] INFO: Found listing with ID: YL30393
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL30393%27 HTTP/1.1" 200 None
2026-03-30 10:44:27 [auto1.de] INFO: Scrape type for YL30393: 2
2026-03-30 10:44:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b428a9fe-451b-5909-86fa-3cdeb094fde0 with identifier: YL30393
2026-03-30 10:44:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b428a9fe-451b-5909-86fa-3cdeb094fde0 with scrape type 2
2026-03-30 10:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b428a9fe-451b-5909-86fa-3cdeb094fde0 with scrape type 2
2026-03-30 10:44:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b428a9fe-451b-5909-86fa-3cdeb094fde0, identifier: YL30393
2026-03-30 10:44:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY05397> (referer: https://www.auto1.com/v1/car-details-view/YY05397/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b428a9fe-451b-5909-86fa-3cdeb094fde0 with identifier: YL30393
2026-03-30 10:44:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b428a9fe-451b-5909-86fa-3cdeb094fde0 with identifier: YL30393
2026-03-30 10:44:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b428a9fe-451b-5909-86fa-3cdeb094fde0 with identifier: YL30393 to the API
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:14:24Z',
 'fuel_type': 'diesel',
 'id': 'b428a9fe-451b-5909-86fa-3cdeb094fde0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL30393',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 288510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-14',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2007}
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL30393%27 HTTP/1.1" 200 None
2026-03-30 10:44:27 [auto1.de] INFO: Saving data for YL30393: {'auction_closing_time': 1774970064.0, 'created_time': 1773345588.080453, 'last_price_update_time': 1774867467.839573}
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL30393') HTTP/1.1" 204 0
2026-03-30 10:44:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:27 [auto1.de] INFO: Found listing with ID: VY48423
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY48423%27 HTTP/1.1" 200 None
2026-03-30 10:44:27 [auto1.de] INFO: Scrape type for VY48423: 2
2026-03-30 10:44:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54dc705e-f06d-5cb3-b26a-f31fa2c17c69 with identifier: VY48423
2026-03-30 10:44:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54dc705e-f06d-5cb3-b26a-f31fa2c17c69 with scrape type 2
2026-03-30 10:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54dc705e-f06d-5cb3-b26a-f31fa2c17c69 with scrape type 2
2026-03-30 10:44:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54dc705e-f06d-5cb3-b26a-f31fa2c17c69, identifier: VY48423
2026-03-30 10:44:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54dc705e-f06d-5cb3-b26a-f31fa2c17c69 with identifier: VY48423
2026-03-30 10:44:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54dc705e-f06d-5cb3-b26a-f31fa2c17c69 with identifier: VY48423
2026-03-30 10:44:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54dc705e-f06d-5cb3-b26a-f31fa2c17c69 with identifier: VY48423 to the API
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:40:55Z',
 'fuel_type': 'diesel',
 'id': '54dc705e-f06d-5cb3-b26a-f31fa2c17c69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY48423',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 345402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-06',
 'seller_name': None,
 'title': 'Hyundai i40 1.7 CRDi Style Blue',
 'transmission': 'manual',
 'trim': 'Style Blue',
 'year': 2013}
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY48423%27 HTTP/1.1" 200 None
2026-03-30 10:44:28 [auto1.de] INFO: Saving data for VY48423: {'auction_closing_time': 1774971655.0, 'created_time': 1774291656.496225, 'last_price_update_time': 1774867468.260109}
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY48423') HTTP/1.1" 204 0
2026-03-30 10:44:28 [auto1.de] INFO: Found listing with ID: MN14132
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN14132%27 HTTP/1.1" 200 None
2026-03-30 10:44:28 [auto1.de] INFO: Scrape type for MN14132: 1
2026-03-30 10:44:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42660b72-53ef-5037-a0c3-1e943cad697e with identifier: YY05397
2026-03-30 10:44:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42660b72-53ef-5037-a0c3-1e943cad697e with scrape type 1
2026-03-30 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 42660b72-53ef-5037-a0c3-1e943cad697e
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Ff5%252Fbef513b912b7ef8a297add520878f74c%252Fpa%252FYY05397_48bd37a6b3969272bb78109a0deb9f10.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_48bd37a6b3969272bb78109a0deb9f10.jpg not downloaded yet
2026-03-30 10:44:28 [auto1.de] INFO: Found listing with ID: EW71270
2026-03-30 10:44:28 [auto1.de] INFO: Found listing with ID: UW97572
2026-03-30 10:44:28 [auto1.de] INFO: Found listing with ID: ZY80626
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80626%27 HTTP/1.1" 200 None
2026-03-30 10:44:28 [auto1.de] INFO: Scrape type for ZY80626: 2
2026-03-30 10:44:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af2a3052-9c8c-506a-8f8a-809dd36567cc with identifier: ZY80626
2026-03-30 10:44:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af2a3052-9c8c-506a-8f8a-809dd36567cc with scrape type 2
2026-03-30 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af2a3052-9c8c-506a-8f8a-809dd36567cc with scrape type 2
2026-03-30 10:44:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af2a3052-9c8c-506a-8f8a-809dd36567cc, identifier: ZY80626
2026-03-30 10:44:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ23052> (referer: https://www.auto1.com/v1/car-details-view/FJ23052/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af2a3052-9c8c-506a-8f8a-809dd36567cc with identifier: ZY80626
2026-03-30 10:44:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af2a3052-9c8c-506a-8f8a-809dd36567cc with identifier: ZY80626
2026-03-30 10:44:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af2a3052-9c8c-506a-8f8a-809dd36567cc with identifier: ZY80626 to the API
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:19:27Z',
 'fuel_type': 'petrol',
 'id': 'af2a3052-9c8c-506a-8f8a-809dd36567cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY80626',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 200927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-01',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80626%27 HTTP/1.1" 200 None
2026-03-30 10:44:28 [auto1.de] INFO: Saving data for ZY80626: {'auction_closing_time': 1774970367.0, 'created_time': 1773380532.526951, 'last_price_update_time': 1774867468.764474}
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY80626') HTTP/1.1" 204 0
2026-03-30 10:44:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Ff5%252Fbef513b912b7ef8a297add520878f74c%252Fpa%252FYY05397_87827d769c1aaa5c950b4c0cb73ab387.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_87827d769c1aaa5c950b4c0cb73ab387.jpg not downloaded yet
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Ff5%252Fbef513b912b7ef8a297add520878f74c%252Fpa%252FYY05397_4c00d4aff0fba71ef8aeefe750dcb583.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_4c00d4aff0fba71ef8aeefe750dcb583.jpg not downloaded yet
2026-03-30 10:44:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4c6c534-9392-5f37-b358-046e9304d2fd with identifier: FJ23052
2026-03-30 10:44:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4c6c534-9392-5f37-b358-046e9304d2fd with scrape type 1
2026-03-30 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a4c6c534-9392-5f37-b358-046e9304d2fd
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_6cef3e648466a6e1e4eaaf17f7aac90a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_6cef3e648466a6e1e4eaaf17f7aac90a.jpg not downloaded yet
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Ff5%252Fbef513b912b7ef8a297add520878f74c%252Fpa%252FYY05397_0619265be3d90082eed5084190753ebd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_0619265be3d90082eed5084190753ebd.jpg not downloaded yet
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_38a8fd1517d9f0ec7a394ff57f50cb5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_38a8fd1517d9f0ec7a394ff57f50cb5c.jpg not downloaded yet
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Ff5%252Fbef513b912b7ef8a297add520878f74c%252Fpa%252FYY05397_864f25d8178b1695de4877617e85f4f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_864f25d8178b1695de4877617e85f4f9.jpg not downloaded yet
2026-03-30 10:44:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_48bd37a6b3969272bb78109a0deb9f10.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_c81630e2b2f01ee34b3980d3557ed38f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_c81630e2b2f01ee34b3980d3557ed38f.jpg not downloaded yet
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_5a71819929ee5477a9711681c1303ea9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_5a71819929ee5477a9711681c1303ea9.jpg not downloaded yet
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_2bda20d939c60ecb6f265cf761e584e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_2bda20d939c60ecb6f265cf761e584e2.jpg not downloaded yet
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_83e8c6c3c2d816dbb9f7be8eae266638.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_83e8c6c3c2d816dbb9f7be8eae266638.jpg not downloaded yet
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_6639d885f39f38d164bee08e8e5b1769.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_6639d885f39f38d164bee08e8e5b1769.jpg not downloaded yet
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_80ad72b26b9803173f75391198eb75e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_80ad72b26b9803173f75391198eb75e6.jpg not downloaded yet
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_1d9a7fa91672f67ba8016defab4dbed1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_1d9a7fa91672f67ba8016defab4dbed1.jpg not downloaded yet
2026-03-30 10:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_864f25d8178b1695de4877617e85f4f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe0210>
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42660b72-53ef-5037-a0c3-1e943cad697e/42660b72-53ef-5037-a0c3-1e943cad697e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Ff5%252Fbef513b912b7ef8a297add520878f74c%252Fpa%252FYY05397_48bd37a6b3969272bb78109a0deb9f10.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_48bd37a6b3969272bb78109a0deb9f10.jpg saved to cache
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42660b72-53ef-5037-a0c3-1e943cad697e
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_90c41bda81499f028335df9351833d59.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_90c41bda81499f028335df9351833d59.jpg not downloaded yet
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e29c90>
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42660b72-53ef-5037-a0c3-1e943cad697e/42660b72-53ef-5037-a0c3-1e943cad697e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Ff5%252Fbef513b912b7ef8a297add520878f74c%252Fpa%252FYY05397_864f25d8178b1695de4877617e85f4f9.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_864f25d8178b1695de4877617e85f4f9.jpg saved to cache
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 42660b72-53ef-5037-a0c3-1e943cad697e
2026-03-30 10:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_80ad72b26b9803173f75391198eb75e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_90c41bda81499f028335df9351833d59.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fca350>
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_80ad72b26b9803173f75391198eb75e6.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_80ad72b26b9803173f75391198eb75e6.jpg saved to cache
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a4c6c534-9392-5f37-b358-046e9304d2fd
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee6910>
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_90c41bda81499f028335df9351833d59.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_90c41bda81499f028335df9351833d59.jpg saved to cache
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a4c6c534-9392-5f37-b358-046e9304d2fd
2026-03-30 10:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_1d9a7fa91672f67ba8016defab4dbed1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_6639d885f39f38d164bee08e8e5b1769.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN42226> (referer: https://www.auto1.com/v1/car-details-view/AN42226/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d79c50>
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_1d9a7fa91672f67ba8016defab4dbed1.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_1d9a7fa91672f67ba8016defab4dbed1.jpg saved to cache
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a4c6c534-9392-5f37-b358-046e9304d2fd
2026-03-30 10:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_2bda20d939c60ecb6f265cf761e584e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e74750>
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_6639d885f39f38d164bee08e8e5b1769.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_6639d885f39f38d164bee08e8e5b1769.jpg saved to cache
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a4c6c534-9392-5f37-b358-046e9304d2fd
2026-03-30 10:44:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a81109cb-941d-5b87-a8fc-3ed7a5aed4ce with identifier: AN42226
2026-03-30 10:44:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a81109cb-941d-5b87-a8fc-3ed7a5aed4ce with scrape type 1
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a81109cb-941d-5b87-a8fc-3ed7a5aed4ce
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_dd9b1f6fa0ac7542b37d4e9565712442.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_dd9b1f6fa0ac7542b37d4e9565712442.jpg not downloaded yet
2026-03-30 10:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_5a71819929ee5477a9711681c1303ea9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_1e6f351f829226abc2e8987cb7dbadd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_1e6f351f829226abc2e8987cb7dbadd6.jpg not downloaded yet
2026-03-30 10:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_83e8c6c3c2d816dbb9f7be8eae266638.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_9ee9ad70e242e262ca26ce9998417ca5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_9ee9ad70e242e262ca26ce9998417ca5.jpg not downloaded yet
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_f94926ff059e192997f8d96ebcad0590.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_f94926ff059e192997f8d96ebcad0590.jpg not downloaded yet
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5072c50>
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_2bda20d939c60ecb6f265cf761e584e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_2bda20d939c60ecb6f265cf761e584e2.jpg saved to cache
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4c6c534-9392-5f37-b358-046e9304d2fd
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_44930208e04e7e9f6667be4bfb63bd36.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_44930208e04e7e9f6667be4bfb63bd36.jpg not downloaded yet
2026-03-30 10:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL99287/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_d37e6cbdb3a8ab068a58488328be92d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_d37e6cbdb3a8ab068a58488328be92d2.jpg not downloaded yet
2026-03-30 10:44:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e76350>
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_5a71819929ee5477a9711681c1303ea9.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_5a71819929ee5477a9711681c1303ea9.jpg saved to cache
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4c6c534-9392-5f37-b358-046e9304d2fd
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_cefba125847026d8373930d98e982a23.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_cefba125847026d8373930d98e982a23.jpg not downloaded yet
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e75850>
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_83e8c6c3c2d816dbb9f7be8eae266638.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_83e8c6c3c2d816dbb9f7be8eae266638.jpg saved to cache
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a4c6c534-9392-5f37-b358-046e9304d2fd
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_51735ee920ffff5f17b17f89b0018540.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_51735ee920ffff5f17b17f89b0018540.jpg not downloaded yet
2026-03-30 10:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_1e6f351f829226abc2e8987cb7dbadd6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_d44159539982696535964b6143767a8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_d44159539982696535964b6143767a8b.jpg not downloaded yet
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_216f45bab11cff2bf58938d3dfd5fed7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_216f45bab11cff2bf58938d3dfd5fed7.jpg not downloaded yet
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9f06484890>
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_1e6f351f829226abc2e8987cb7dbadd6.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_1e6f351f829226abc2e8987cb7dbadd6.jpg saved to cache
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a81109cb-941d-5b87-a8fc-3ed7a5aed4ce
2026-03-30 10:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_44930208e04e7e9f6667be4bfb63bd36.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_dd9b1f6fa0ac7542b37d4e9565712442.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_51735ee920ffff5f17b17f89b0018540.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e95290>
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_44930208e04e7e9f6667be4bfb63bd36.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_44930208e04e7e9f6667be4bfb63bd36.jpg saved to cache
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a81109cb-941d-5b87-a8fc-3ed7a5aed4ce
2026-03-30 10:44:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508f710>
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_dd9b1f6fa0ac7542b37d4e9565712442.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_dd9b1f6fa0ac7542b37d4e9565712442.jpg saved to cache
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a81109cb-941d-5b87-a8fc-3ed7a5aed4ce
2026-03-30 10:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_216f45bab11cff2bf58938d3dfd5fed7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_d44159539982696535964b6143767a8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e52d90>
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_51735ee920ffff5f17b17f89b0018540.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_51735ee920ffff5f17b17f89b0018540.jpg saved to cache
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a81109cb-941d-5b87-a8fc-3ed7a5aed4ce
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b20f90>
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_216f45bab11cff2bf58938d3dfd5fed7.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_216f45bab11cff2bf58938d3dfd5fed7.jpg saved to cache
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a81109cb-941d-5b87-a8fc-3ed7a5aed4ce
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eaae50>
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_d44159539982696535964b6143767a8b.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_d44159539982696535964b6143767a8b.jpg saved to cache
2026-03-30 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a81109cb-941d-5b87-a8fc-3ed7a5aed4ce
2026-03-30 10:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_d37e6cbdb3a8ab068a58488328be92d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_cefba125847026d8373930d98e982a23.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50e5c50>
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_d37e6cbdb3a8ab068a58488328be92d2.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_d37e6cbdb3a8ab068a58488328be92d2.jpg saved to cache
2026-03-30 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a81109cb-941d-5b87-a8fc-3ed7a5aed4ce
2026-03-30 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG35280/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ec1f50>
2026-03-30 10:44:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_cefba125847026d8373930d98e982a23.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_cefba125847026d8373930d98e982a23.jpg saved to cache
2026-03-30 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a81109cb-941d-5b87-a8fc-3ed7a5aed4ce
2026-03-30 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_f94926ff059e192997f8d96ebcad0590.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_9ee9ad70e242e262ca26ce9998417ca5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_c81630e2b2f01ee34b3980d3557ed38f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE80616> (referer: https://www.auto1.com/v1/car-details-view/SE80616/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b088d0>
2026-03-30 10:44:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_f94926ff059e192997f8d96ebcad0590.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_f94926ff059e192997f8d96ebcad0590.jpg saved to cache
2026-03-30 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a81109cb-941d-5b87-a8fc-3ed7a5aed4ce
2026-03-30 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_0619265be3d90082eed5084190753ebd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0fc10>
2026-03-30 10:44:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fab%252Fedab753179acbdc60f702189d08bcd8e%252Fpa%252FAN42226_9ee9ad70e242e262ca26ce9998417ca5.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_9ee9ad70e242e262ca26ce9998417ca5.jpg saved to cache
2026-03-30 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a81109cb-941d-5b87-a8fc-3ed7a5aed4ce
2026-03-30 10:44:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a81109cb-941d-5b87-a8fc-3ed7a5aed4ce, skipping ID generation
2026-03-30 10:44:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a81109cb-941d-5b87-a8fc-3ed7a5aed4ce with scrape type 1
2026-03-30 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a81109cb-941d-5b87-a8fc-3ed7a5aed4ce sending to next pipeline
2026-03-30 10:44:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a81109cb-941d-5b87-a8fc-3ed7a5aed4ce, identifier: AN42226
2026-03-30 10:44:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a81109cb-941d-5b87-a8fc-3ed7a5aed4ce with identifier: AN42226
2026-03-30 10:44:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a81109cb-941d-5b87-a8fc-3ed7a5aed4ce with identifier: AN42226
2026-03-30 10:44:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a81109cb-941d-5b87-a8fc-3ed7a5aed4ce with identifier: AN42226 to the API
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_9ee9ad70e242e262ca26ce9998417ca5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:15:14Z',
 'fuel_type': 'gas',
 'id': 'a81109cb-941d-5b87-a8fc-3ed7a5aed4ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN42226',
 'listing': 'auction',
 'location': 'DE, Magdeburg',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 10349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2595989,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_dd9b1f6fa0ac7542b37d4e9565712442.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_1e6f351f829226abc2e8987cb7dbadd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_9ee9ad70e242e262ca26ce9998417ca5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_f94926ff059e192997f8d96ebcad0590.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_44930208e04e7e9f6667be4bfb63bd36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_d37e6cbdb3a8ab068a58488328be92d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_cefba125847026d8373930d98e982a23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_51735ee920ffff5f17b17f89b0018540.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_d44159539982696535964b6143767a8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a81109cb-941d-5b87-a8fc-3ed7a5aed4ce/a81109cb-941d-5b87-a8fc-3ed7a5aed4ce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ab/edab753179acbdc60f702189d08bcd8e/pa/AN42226_216f45bab11cff2bf58938d3dfd5fed7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe LPG Extreme+',
 'transmission': 'manual',
 'trim': 'Extreme+',
 'year': 2023}
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN42226%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [auto1.de] INFO: Saving data for AN42226: {'created_time': 1774867472.044813, 'last_price_update_time': 1774867472.044827, 'auction_closing_time': 1774970114.0}
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN42226') HTTP/1.1" 204 0
2026-03-30 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_6cef3e648466a6e1e4eaaf17f7aac90a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_38a8fd1517d9f0ec7a394ff57f50cb5c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_4c00d4aff0fba71ef8aeefe750dcb583.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9f04fee450>
2026-03-30 10:44:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_c81630e2b2f01ee34b3980d3557ed38f.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_c81630e2b2f01ee34b3980d3557ed38f.jpg saved to cache
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4c6c534-9392-5f37-b358-046e9304d2fd
2026-03-30 10:44:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62b6354e-4c5d-580d-84ad-fe0c3cca27fb with identifier: SE80616
2026-03-30 10:44:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62b6354e-4c5d-580d-84ad-fe0c3cca27fb with scrape type 1
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 62b6354e-4c5d-580d-84ad-fe0c3cca27fb
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F26%252Fb4261fda0532dac3c15bfbc563aed590%252Fpa%252FSE80616_91931cdedcbefa83dd37340b9ed899a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_91931cdedcbefa83dd37340b9ed899a2.jpg already downloaded
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F26%252Fb4261fda0532dac3c15bfbc563aed590%252Fpa%252FSE80616_6c824121b906edcef7bf2d725749be25.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_6c824121b906edcef7bf2d725749be25.jpg already downloaded
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F26%252Fb4261fda0532dac3c15bfbc563aed590%252Fpa%252FSE80616_a184a6448a81188a57ac188aafbccdc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_a184a6448a81188a57ac188aafbccdc1.jpg already downloaded
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F26%252Fb4261fda0532dac3c15bfbc563aed590%252Fpa%252FSE80616_907c712be8b1a61ba766080c4bf9f110.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_907c712be8b1a61ba766080c4bf9f110.jpg already downloaded
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F26%252Fb4261fda0532dac3c15bfbc563aed590%252Fpa%252FSE80616_b565ccbedc2e4886ee9f6efc86e5804d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_b565ccbedc2e4886ee9f6efc86e5804d.jpg already downloaded
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F26%252Fb4261fda0532dac3c15bfbc563aed590%252Fpa%252FSE80616_8dee07ae8d5c410360d4ce5677d1d926.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_8dee07ae8d5c410360d4ce5677d1d926.jpg already downloaded
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F26%252Fb4261fda0532dac3c15bfbc563aed590%252Fpa%252FSE80616_a74ed9cdf6a0e517520864f2df8400a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_a74ed9cdf6a0e517520864f2df8400a8.jpg already downloaded
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F26%252Fb4261fda0532dac3c15bfbc563aed590%252Fpa%252FSE80616_ccefac68fc18b4659365b29470772169.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_ccefac68fc18b4659365b29470772169.jpg already downloaded
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F26%252Fb4261fda0532dac3c15bfbc563aed590%252Fpa%252FSE80616_fd70408e7357467458888e8cbe02372e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_fd70408e7357467458888e8cbe02372e.jpg already downloaded
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F26%252Fb4261fda0532dac3c15bfbc563aed590%252Fpa%252FSE80616_057c4a492892f71398b85f2fe56ad9f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_057c4a492892f71398b85f2fe56ad9f2.jpg already downloaded
2026-03-30 10:44:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62b6354e-4c5d-580d-84ad-fe0c3cca27fb, identifier: SE80616
2026-03-30 10:44:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a23750>
2026-03-30 10:44:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42660b72-53ef-5037-a0c3-1e943cad697e/42660b72-53ef-5037-a0c3-1e943cad697e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Ff5%252Fbef513b912b7ef8a297add520878f74c%252Fpa%252FYY05397_0619265be3d90082eed5084190753ebd.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_0619265be3d90082eed5084190753ebd.jpg saved to cache
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 42660b72-53ef-5037-a0c3-1e943cad697e
2026-03-30 10:44:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62b6354e-4c5d-580d-84ad-fe0c3cca27fb with identifier: SE80616
2026-03-30 10:44:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62b6354e-4c5d-580d-84ad-fe0c3cca27fb with identifier: SE80616
2026-03-30 10:44:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62b6354e-4c5d-580d-84ad-fe0c3cca27fb with identifier: SE80616 to the API
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SE80616>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:41:59Z',
 'fuel_type': 'diesel',
 'id': '62b6354e-4c5d-580d-84ad-fe0c3cca27fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE80616',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 157217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_91931cdedcbefa83dd37340b9ed899a2.jpg',
                'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_6c824121b906edcef7bf2d725749be25.jpg',
                'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_a184a6448a81188a57ac188aafbccdc1.jpg',
                'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_907c712be8b1a61ba766080c4bf9f110.jpg',
                'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_b565ccbedc2e4886ee9f6efc86e5804d.jpg',
                'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_8dee07ae8d5c410360d4ce5677d1d926.jpg',
                'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_a74ed9cdf6a0e517520864f2df8400a8.jpg',
                'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_ccefac68fc18b4659365b29470772169.jpg',
                'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_fd70408e7357467458888e8cbe02372e.jpg',
                'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_057c4a492892f71398b85f2fe56ad9f2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62b6354e-4c5d-580d-84ad-fe0c3cca27fb/62b6354e-4c5d-580d-84ad-fe0c3cca27fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_91931cdedcbefa83dd37340b9ed899a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62b6354e-4c5d-580d-84ad-fe0c3cca27fb/62b6354e-4c5d-580d-84ad-fe0c3cca27fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_6c824121b906edcef7bf2d725749be25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62b6354e-4c5d-580d-84ad-fe0c3cca27fb/62b6354e-4c5d-580d-84ad-fe0c3cca27fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_a184a6448a81188a57ac188aafbccdc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62b6354e-4c5d-580d-84ad-fe0c3cca27fb/62b6354e-4c5d-580d-84ad-fe0c3cca27fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_907c712be8b1a61ba766080c4bf9f110.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62b6354e-4c5d-580d-84ad-fe0c3cca27fb/62b6354e-4c5d-580d-84ad-fe0c3cca27fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_b565ccbedc2e4886ee9f6efc86e5804d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62b6354e-4c5d-580d-84ad-fe0c3cca27fb/62b6354e-4c5d-580d-84ad-fe0c3cca27fb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_8dee07ae8d5c410360d4ce5677d1d926.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62b6354e-4c5d-580d-84ad-fe0c3cca27fb/62b6354e-4c5d-580d-84ad-fe0c3cca27fb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_a74ed9cdf6a0e517520864f2df8400a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62b6354e-4c5d-580d-84ad-fe0c3cca27fb/62b6354e-4c5d-580d-84ad-fe0c3cca27fb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_ccefac68fc18b4659365b29470772169.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62b6354e-4c5d-580d-84ad-fe0c3cca27fb/62b6354e-4c5d-580d-84ad-fe0c3cca27fb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_fd70408e7357467458888e8cbe02372e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62b6354e-4c5d-580d-84ad-fe0c3cca27fb/62b6354e-4c5d-580d-84ad-fe0c3cca27fb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/26/b4261fda0532dac3c15bfbc563aed590/pa/SE80616_057c4a492892f71398b85f2fe56ad9f2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2015}
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE80616%27 HTTP/1.1" 200 None
2026-03-30 10:44:32 [auto1.de] INFO: Saving data for SE80616: {'created_time': 1774867472.803628, 'last_price_update_time': 1774867472.80364, 'auction_closing_time': 1774971719.0}
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE80616') HTTP/1.1" 204 0
2026-03-30 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_87827d769c1aaa5c950b4c0cb73ab387.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL04476/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea2250>
2026-03-30 10:44:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_6cef3e648466a6e1e4eaaf17f7aac90a.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_6cef3e648466a6e1e4eaaf17f7aac90a.jpg saved to cache
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4c6c534-9392-5f37-b358-046e9304d2fd
2026-03-30 10:44:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fcb850>
2026-03-30 10:44:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F40%252Fa6402fd8b4529e861333ffc2a95fa7d2%252Fpa%252FFJ23052_38a8fd1517d9f0ec7a394ff57f50cb5c.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_38a8fd1517d9f0ec7a394ff57f50cb5c.jpg saved to cache
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4c6c534-9392-5f37-b358-046e9304d2fd
2026-03-30 10:44:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4c6c534-9392-5f37-b358-046e9304d2fd, skipping ID generation
2026-03-30 10:44:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4c6c534-9392-5f37-b358-046e9304d2fd with scrape type 1
2026-03-30 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4c6c534-9392-5f37-b358-046e9304d2fd sending to next pipeline
2026-03-30 10:44:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4c6c534-9392-5f37-b358-046e9304d2fd, identifier: FJ23052
2026-03-30 10:44:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eb6450>
2026-03-30 10:44:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42660b72-53ef-5037-a0c3-1e943cad697e/42660b72-53ef-5037-a0c3-1e943cad697e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Ff5%252Fbef513b912b7ef8a297add520878f74c%252Fpa%252FYY05397_4c00d4aff0fba71ef8aeefe750dcb583.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_4c00d4aff0fba71ef8aeefe750dcb583.jpg saved to cache
2026-03-30 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 42660b72-53ef-5037-a0c3-1e943cad697e
2026-03-30 10:44:33 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 9458 | hits on page: 40
2026-03-30 10:44:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4c6c534-9392-5f37-b358-046e9304d2fd with identifier: FJ23052
2026-03-30 10:44:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4c6c534-9392-5f37-b358-046e9304d2fd with identifier: FJ23052
2026-03-30 10:44:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4c6c534-9392-5f37-b358-046e9304d2fd with identifier: FJ23052 to the API
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_38a8fd1517d9f0ec7a394ff57f50cb5c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 243,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:38:27Z',
 'fuel_type': 'petrol',
 'id': 'a4c6c534-9392-5f37-b358-046e9304d2fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ23052',
 'listing': 'auction',
 'location': 'DE, Hamburg-Billstedt',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 64489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_6cef3e648466a6e1e4eaaf17f7aac90a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_38a8fd1517d9f0ec7a394ff57f50cb5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_c81630e2b2f01ee34b3980d3557ed38f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_5a71819929ee5477a9711681c1303ea9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_2bda20d939c60ecb6f265cf761e584e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_83e8c6c3c2d816dbb9f7be8eae266638.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_6639d885f39f38d164bee08e8e5b1769.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_80ad72b26b9803173f75391198eb75e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_1d9a7fa91672f67ba8016defab4dbed1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4c6c534-9392-5f37-b358-046e9304d2fd/a4c6c534-9392-5f37-b358-046e9304d2fd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/40/a6402fd8b4529e861333ffc2a95fa7d2/pa/FJ23052_90c41bda81499f028335df9351833d59.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.5i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ23052%27 HTTP/1.1" 200 None
2026-03-30 10:44:33 [auto1.de] INFO: Saving data for FJ23052: {'created_time': 1774867473.452189, 'last_price_update_time': 1774867473.452201, 'auction_closing_time': 1774971507.0}
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ23052') HTTP/1.1" 204 0
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: GZ32446
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: DH22433
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH22433%27 HTTP/1.1" 200 None
2026-03-30 10:44:33 [auto1.de] INFO: Scrape type for DH22433: 1
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: PJ15817
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ15817%27 HTTP/1.1" 200 None
2026-03-30 10:44:33 [auto1.de] INFO: Scrape type for PJ15817: 1
2026-03-30 10:44:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e97fd0>
2026-03-30 10:44:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42660b72-53ef-5037-a0c3-1e943cad697e/42660b72-53ef-5037-a0c3-1e943cad697e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Ff5%252Fbef513b912b7ef8a297add520878f74c%252Fpa%252FYY05397_87827d769c1aaa5c950b4c0cb73ab387.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_87827d769c1aaa5c950b4c0cb73ab387.jpg saved to cache
2026-03-30 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 42660b72-53ef-5037-a0c3-1e943cad697e
2026-03-30 10:44:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42660b72-53ef-5037-a0c3-1e943cad697e, skipping ID generation
2026-03-30 10:44:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42660b72-53ef-5037-a0c3-1e943cad697e with scrape type 1
2026-03-30 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42660b72-53ef-5037-a0c3-1e943cad697e sending to next pipeline
2026-03-30 10:44:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42660b72-53ef-5037-a0c3-1e943cad697e, identifier: YY05397
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: UA78695
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: RP16081
2026-03-30 10:44:33 [auto1.de] INFO: Found listing with ID: MR77046
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR77046%27 HTTP/1.1" 200 None
2026-03-30 10:44:33 [auto1.de] INFO: Scrape type for MR77046: 1
2026-03-30 10:44:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42660b72-53ef-5037-a0c3-1e943cad697e with identifier: YY05397
2026-03-30 10:44:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42660b72-53ef-5037-a0c3-1e943cad697e with identifier: YY05397
2026-03-30 10:44:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42660b72-53ef-5037-a0c3-1e943cad697e with identifier: YY05397 to the API
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_87827d769c1aaa5c950b4c0cb73ab387.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:31:18Z',
 'fuel_type': 'petrol',
 'id': '42660b72-53ef-5037-a0c3-1e943cad697e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY05397',
 'listing': 'auction',
 'location': 'DE, Donaueschingen',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 133725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42660b72-53ef-5037-a0c3-1e943cad697e/42660b72-53ef-5037-a0c3-1e943cad697e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_48bd37a6b3969272bb78109a0deb9f10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42660b72-53ef-5037-a0c3-1e943cad697e/42660b72-53ef-5037-a0c3-1e943cad697e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_87827d769c1aaa5c950b4c0cb73ab387.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42660b72-53ef-5037-a0c3-1e943cad697e/42660b72-53ef-5037-a0c3-1e943cad697e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_4c00d4aff0fba71ef8aeefe750dcb583.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42660b72-53ef-5037-a0c3-1e943cad697e/42660b72-53ef-5037-a0c3-1e943cad697e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_0619265be3d90082eed5084190753ebd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42660b72-53ef-5037-a0c3-1e943cad697e/42660b72-53ef-5037-a0c3-1e943cad697e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/f5/bef513b912b7ef8a297add520878f74c/pa/YY05397_864f25d8178b1695de4877617e85f4f9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2015}
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY05397%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [auto1.de] INFO: Saving data for YY05397: {'created_time': 1774867474.076826, 'last_price_update_time': 1774867474.076836, 'auction_closing_time': 1774971078.0}
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY05397') HTTP/1.1" 204 0
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: HK11659
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: GF15006
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF15006%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [auto1.de] INFO: Scrape type for GF15006: 1
2026-03-30 10:44:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY18278> (referer: https://www.auto1.com/v1/car-details-view/SY18278/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: TC02406
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: MU06450
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06450%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [auto1.de] INFO: Scrape type for MU06450: 1
2026-03-30 10:44:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: CS99643
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS99643%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [auto1.de] INFO: Scrape type for CS99643: 1
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: EL22398
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL22398%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [auto1.de] INFO: Scrape type for EL22398: 1
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: CL94836
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: RA51445
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: ZA71283
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: WS06409
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS06409%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [auto1.de] INFO: Scrape type for WS06409: 1
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: DV57732
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV57732%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [auto1.de] INFO: Scrape type for DV57732: 1
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: BR36713
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: DV69567
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV69567%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [auto1.de] INFO: Scrape type for DV69567: 1
2026-03-30 10:44:34 [auto1.de] INFO: Found listing with ID: EY94852
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY94852%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [auto1.de] INFO: Scrape type for EY94852: 2
2026-03-30 10:44:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bce5ea64-3e18-5278-9ca4-70850fdb649c with identifier: EY94852
2026-03-30 10:44:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce5ea64-3e18-5278-9ca4-70850fdb649c with scrape type 2
2026-03-30 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bce5ea64-3e18-5278-9ca4-70850fdb649c with scrape type 2
2026-03-30 10:44:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bce5ea64-3e18-5278-9ca4-70850fdb649c, identifier: EY94852
2026-03-30 10:44:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bce5ea64-3e18-5278-9ca4-70850fdb649c with identifier: EY94852
2026-03-30 10:44:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bce5ea64-3e18-5278-9ca4-70850fdb649c with identifier: EY94852
2026-03-30 10:44:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bce5ea64-3e18-5278-9ca4-70850fdb649c with identifier: EY94852 to the API
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:08:51Z',
 'fuel_type': 'electro',
 'id': 'bce5ea64-3e18-5278-9ca4-70850fdb649c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY94852',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 32187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-08',
 'seller_name': None,
 'title': 'Smart fortwo electric drive 60 kW passion',
 'transmission': 'automatic',
 'trim': 'passion',
 'year': 2017}
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY94852%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [auto1.de] INFO: Saving data for EY94852: {'auction_closing_time': 1774969731.0, 'created_time': 1773741311.493768, 'last_price_update_time': 1774867474.698638}
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY94852') HTTP/1.1" 204 0
2026-03-30 10:44:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f42631f-7552-5f8e-8fef-9e2cb25e94b4 with identifier: SY18278
2026-03-30 10:44:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f42631f-7552-5f8e-8fef-9e2cb25e94b4 with scrape type 1
2026-03-30 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f42631f-7552-5f8e-8fef-9e2cb25e94b4
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb71038f579ea3a7b86070fda5f56de1f%252Fpa%252FSY18278_ec0219e73743d0c7e4188a7119b2f1ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_ec0219e73743d0c7e4188a7119b2f1ba.jpg already downloaded
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb71038f579ea3a7b86070fda5f56de1f%252Fpa%252FSY18278_014930bbec9be8d7b579cbeff8b60f56.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_014930bbec9be8d7b579cbeff8b60f56.jpg already downloaded
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb71038f579ea3a7b86070fda5f56de1f%252Fpa%252FSY18278_7f038e7bdd8ec8b55fb039bdcc5926f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_7f038e7bdd8ec8b55fb039bdcc5926f8.jpg already downloaded
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb71038f579ea3a7b86070fda5f56de1f%252Fpa%252FSY18278_91861383ccb1de3cee0dc125bd5eb1b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_91861383ccb1de3cee0dc125bd5eb1b5.jpg already downloaded
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb71038f579ea3a7b86070fda5f56de1f%252Fpa%252FSY18278_542f4dc22c3fb8c7a18ca80adc1e9cad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_542f4dc22c3fb8c7a18ca80adc1e9cad.jpg already downloaded
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb71038f579ea3a7b86070fda5f56de1f%252Fpa%252FSY18278_c2f14142b93c86d191f0d1353382b9a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_c2f14142b93c86d191f0d1353382b9a7.jpg already downloaded
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb71038f579ea3a7b86070fda5f56de1f%252Fpa%252FSY18278_b074dac8bebe34885e9335880b8733a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_b074dac8bebe34885e9335880b8733a3.jpg already downloaded
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb71038f579ea3a7b86070fda5f56de1f%252Fpa%252FSY18278_a32f6f13bc4b129356879a7b2f40f6d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_a32f6f13bc4b129356879a7b2f40f6d3.jpg already downloaded
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb71038f579ea3a7b86070fda5f56de1f%252Fpa%252FSY18278_f46b12330fa3a1f88ca15e9985b14156.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_f46b12330fa3a1f88ca15e9985b14156.jpg already downloaded
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F10%252Fb71038f579ea3a7b86070fda5f56de1f%252Fpa%252FSY18278_43c399b7b5e3033f4c4ae832044d934d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_43c399b7b5e3033f4c4ae832044d934d.jpg already downloaded
2026-03-30 10:44:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f42631f-7552-5f8e-8fef-9e2cb25e94b4, identifier: SY18278
2026-03-30 10:44:35 [auto1.de] INFO: Found listing with ID: PV13293
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV13293%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [auto1.de] INFO: Scrape type for PV13293: 2
2026-03-30 10:44:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4ca09d0-611a-5ef9-a4b7-fc29408f6f26 with identifier: PV13293
2026-03-30 10:44:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4ca09d0-611a-5ef9-a4b7-fc29408f6f26 with scrape type 2
2026-03-30 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4ca09d0-611a-5ef9-a4b7-fc29408f6f26 with scrape type 2
2026-03-30 10:44:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4ca09d0-611a-5ef9-a4b7-fc29408f6f26, identifier: PV13293
2026-03-30 10:44:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f42631f-7552-5f8e-8fef-9e2cb25e94b4 with identifier: SY18278
2026-03-30 10:44:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f42631f-7552-5f8e-8fef-9e2cb25e94b4 with identifier: SY18278
2026-03-30 10:44:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f42631f-7552-5f8e-8fef-9e2cb25e94b4 with identifier: SY18278 to the API
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SY18278>
{'auction_title': '',
 'c_o_2_emission_value': 198,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 390,
 'expiration_date': '2026-03-31T15:32:22Z',
 'fuel_type': 'petrol',
 'id': '2f42631f-7552-5f8e-8fef-9e2cb25e94b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY18278',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Mercedes-Benz',
 'model': 'SLC-Klasse',
 'odometer': 87911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_ec0219e73743d0c7e4188a7119b2f1ba.jpg',
                'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_014930bbec9be8d7b579cbeff8b60f56.jpg',
                'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_7f038e7bdd8ec8b55fb039bdcc5926f8.jpg',
                'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_91861383ccb1de3cee0dc125bd5eb1b5.jpg',
                'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_542f4dc22c3fb8c7a18ca80adc1e9cad.jpg',
                'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_c2f14142b93c86d191f0d1353382b9a7.jpg',
                'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_b074dac8bebe34885e9335880b8733a3.jpg',
                'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_a32f6f13bc4b129356879a7b2f40f6d3.jpg',
                'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_f46b12330fa3a1f88ca15e9985b14156.jpg',
                'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_43c399b7b5e3033f4c4ae832044d934d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f42631f-7552-5f8e-8fef-9e2cb25e94b4/2f42631f-7552-5f8e-8fef-9e2cb25e94b4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_ec0219e73743d0c7e4188a7119b2f1ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f42631f-7552-5f8e-8fef-9e2cb25e94b4/2f42631f-7552-5f8e-8fef-9e2cb25e94b4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_014930bbec9be8d7b579cbeff8b60f56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f42631f-7552-5f8e-8fef-9e2cb25e94b4/2f42631f-7552-5f8e-8fef-9e2cb25e94b4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_7f038e7bdd8ec8b55fb039bdcc5926f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f42631f-7552-5f8e-8fef-9e2cb25e94b4/2f42631f-7552-5f8e-8fef-9e2cb25e94b4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_91861383ccb1de3cee0dc125bd5eb1b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f42631f-7552-5f8e-8fef-9e2cb25e94b4/2f42631f-7552-5f8e-8fef-9e2cb25e94b4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_542f4dc22c3fb8c7a18ca80adc1e9cad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f42631f-7552-5f8e-8fef-9e2cb25e94b4/2f42631f-7552-5f8e-8fef-9e2cb25e94b4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_c2f14142b93c86d191f0d1353382b9a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f42631f-7552-5f8e-8fef-9e2cb25e94b4/2f42631f-7552-5f8e-8fef-9e2cb25e94b4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_b074dac8bebe34885e9335880b8733a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f42631f-7552-5f8e-8fef-9e2cb25e94b4/2f42631f-7552-5f8e-8fef-9e2cb25e94b4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_a32f6f13bc4b129356879a7b2f40f6d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f42631f-7552-5f8e-8fef-9e2cb25e94b4/2f42631f-7552-5f8e-8fef-9e2cb25e94b4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_f46b12330fa3a1f88ca15e9985b14156.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f42631f-7552-5f8e-8fef-9e2cb25e94b4/2f42631f-7552-5f8e-8fef-9e2cb25e94b4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/10/b71038f579ea3a7b86070fda5f56de1f/pa/SY18278_43c399b7b5e3033f4c4ae832044d934d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz SLC-Klasse SLC 43 AMG',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY18278%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [auto1.de] INFO: Saving data for SY18278: {'created_time': 1774867475.643909, 'last_price_update_time': 1774867475.643921, 'auction_closing_time': 1774971142.0}
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY18278') HTTP/1.1" 204 0
2026-03-30 10:44:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4ca09d0-611a-5ef9-a4b7-fc29408f6f26 with identifier: PV13293
2026-03-30 10:44:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4ca09d0-611a-5ef9-a4b7-fc29408f6f26 with identifier: PV13293
2026-03-30 10:44:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4ca09d0-611a-5ef9-a4b7-fc29408f6f26 with identifier: PV13293 to the API
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:30:31Z',
 'fuel_type': 'diesel',
 'id': 'e4ca09d0-611a-5ef9-a4b7-fc29408f6f26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV13293',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 130336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Nissan X-Trail 2.0 dCi N-Connecta 4x4',
 'transmission': 'automatic',
 'trim': 'N-Connecta 4x4',
 'year': 2018}
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV13293%27 HTTP/1.1" 200 None
2026-03-30 10:44:35 [auto1.de] INFO: Saving data for PV13293: {'auction_closing_time': 1774971031.0, 'created_time': 1773688739.572091, 'last_price_update_time': 1774867475.984909}
2026-03-30 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV13293') HTTP/1.1" 204 0
2026-03-30 10:44:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS24409/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:36 [auto1.de] INFO: Found listing with ID: PU16523
2026-03-30 10:44:36 [auto1.de] INFO: Found listing with ID: LB68583
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB68583%27 HTTP/1.1" 200 None
2026-03-30 10:44:36 [auto1.de] INFO: Scrape type for LB68583: 1
2026-03-30 10:44:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:36 [auto1.de] INFO: Found listing with ID: CX98346
2026-03-30 10:44:36 [auto1.de] INFO: Found listing with ID: JU91217
2026-03-30 10:44:36 [auto1.de] INFO: Found listing with ID: JG32491
2026-03-30 10:44:36 [auto1.de] INFO: Found listing with ID: GM30461
2026-03-30 10:44:36 [auto1.de] INFO: Found listing with ID: AS52109
2026-03-30 10:44:36 [auto1.de] INFO: Found listing with ID: GX74523
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX74523%27 HTTP/1.1" 200 None
2026-03-30 10:44:36 [auto1.de] INFO: Scrape type for GX74523: 2
2026-03-30 10:44:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7781eca5-c35a-5a70-995c-a222d87fb588 with identifier: GX74523
2026-03-30 10:44:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7781eca5-c35a-5a70-995c-a222d87fb588 with scrape type 2
2026-03-30 10:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7781eca5-c35a-5a70-995c-a222d87fb588 with scrape type 2
2026-03-30 10:44:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7781eca5-c35a-5a70-995c-a222d87fb588, identifier: GX74523
2026-03-30 10:44:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7781eca5-c35a-5a70-995c-a222d87fb588 with identifier: GX74523
2026-03-30 10:44:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7781eca5-c35a-5a70-995c-a222d87fb588 with identifier: GX74523
2026-03-30 10:44:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7781eca5-c35a-5a70-995c-a222d87fb588 with identifier: GX74523 to the API
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:57:43Z',
 'fuel_type': 'petrol',
 'id': '7781eca5-c35a-5a70-995c-a222d87fb588',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX74523',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 63271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-19',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo ON Start/Stop',
 'transmission': 'manual',
 'trim': 'ON Start/Stop',
 'year': 2017}
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX74523%27 HTTP/1.1" 200 None
2026-03-30 10:44:36 [auto1.de] INFO: Saving data for GX74523: {'auction_closing_time': 1774972663.0, 'created_time': 1774262943.070073, 'last_price_update_time': 1774867476.483265}
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX74523') HTTP/1.1" 204 0
2026-03-30 10:44:36 [auto1.de] INFO: Found listing with ID: SS39773
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS39773%27 HTTP/1.1" 200 None
2026-03-30 10:44:36 [auto1.de] INFO: Scrape type for SS39773: 1
2026-03-30 10:44:36 [auto1.de] INFO: Found listing with ID: FF66514
2026-03-30 10:44:36 [auto1.de] INFO: Found listing with ID: XR67128
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR67128%27 HTTP/1.1" 200 None
2026-03-30 10:44:36 [auto1.de] INFO: Scrape type for XR67128: 1
2026-03-30 10:44:36 [auto1.de] INFO: Found listing with ID: HP05192
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP05192%27 HTTP/1.1" 200 None
2026-03-30 10:44:36 [auto1.de] INFO: Scrape type for HP05192: 2
2026-03-30 10:44:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3482435d-621b-5ef0-a3b4-9ef052ff9bfc with identifier: HP05192
2026-03-30 10:44:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3482435d-621b-5ef0-a3b4-9ef052ff9bfc with scrape type 2
2026-03-30 10:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3482435d-621b-5ef0-a3b4-9ef052ff9bfc with scrape type 2
2026-03-30 10:44:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3482435d-621b-5ef0-a3b4-9ef052ff9bfc, identifier: HP05192
2026-03-30 10:44:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3482435d-621b-5ef0-a3b4-9ef052ff9bfc with identifier: HP05192
2026-03-30 10:44:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3482435d-621b-5ef0-a3b4-9ef052ff9bfc with identifier: HP05192
2026-03-30 10:44:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3482435d-621b-5ef0-a3b4-9ef052ff9bfc with identifier: HP05192 to the API
2026-03-30 10:44:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:36:48Z',
 'fuel_type': 'petrol',
 'id': '3482435d-621b-5ef0-a3b4-9ef052ff9bfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP05192',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 276055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Team BlueMotion',
 'transmission': 'manual',
 'trim': 'Team BlueMotion',
 'year': 2011}
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP05192%27 HTTP/1.1" 200 None
2026-03-30 10:44:37 [auto1.de] INFO: Saving data for HP05192: {'auction_closing_time': 1774971408.0, 'created_time': 1774292256.965561, 'last_price_update_time': 1774867477.184965}
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP05192') HTTP/1.1" 204 0
2026-03-30 10:44:37 [auto1.de] INFO: Found listing with ID: JM60003
2026-03-30 10:44:37 [auto1.de] INFO: Found listing with ID: JA61981
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA61981%27 HTTP/1.1" 200 None
2026-03-30 10:44:37 [auto1.de] INFO: Scrape type for JA61981: 2
2026-03-30 10:44:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e541add-58c8-5ed3-9799-0a6ce0fc7002 with identifier: JA61981
2026-03-30 10:44:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e541add-58c8-5ed3-9799-0a6ce0fc7002 with scrape type 2
2026-03-30 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e541add-58c8-5ed3-9799-0a6ce0fc7002 with scrape type 2
2026-03-30 10:44:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e541add-58c8-5ed3-9799-0a6ce0fc7002, identifier: JA61981
2026-03-30 10:44:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e541add-58c8-5ed3-9799-0a6ce0fc7002 with identifier: JA61981
2026-03-30 10:44:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e541add-58c8-5ed3-9799-0a6ce0fc7002 with identifier: JA61981
2026-03-30 10:44:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e541add-58c8-5ed3-9799-0a6ce0fc7002 with identifier: JA61981 to the API
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:45:30Z',
 'fuel_type': 'diesel',
 'id': '3e541add-58c8-5ed3-9799-0a6ce0fc7002',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA61981',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 147405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-31',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2015}
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA61981%27 HTTP/1.1" 200 None
2026-03-30 10:44:37 [auto1.de] INFO: Saving data for JA61981: {'auction_closing_time': 1774971930.0, 'created_time': 1774349046.246626, 'last_price_update_time': 1774867477.880356}
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA61981') HTTP/1.1" 204 0
2026-03-30 10:44:37 [auto1.de] INFO: Found listing with ID: EU42545
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU42545%27 HTTP/1.1" 200 None
2026-03-30 10:44:37 [auto1.de] INFO: Scrape type for EU42545: 1
2026-03-30 10:44:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG74460/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:37 [auto1.de] INFO: Found listing with ID: DK17732
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK17732%27 HTTP/1.1" 200 None
2026-03-30 10:44:37 [auto1.de] INFO: Scrape type for DK17732: 1
2026-03-30 10:44:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:37 [auto1.de] INFO: Found listing with ID: YL20348
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL20348%27 HTTP/1.1" 200 None
2026-03-30 10:44:37 [auto1.de] INFO: Scrape type for YL20348: 1
2026-03-30 10:44:37 [auto1.de] INFO: Found listing with ID: YN89377
2026-03-30 10:44:37 [auto1.de] INFO: Found listing with ID: EC11597
2026-03-30 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG35280> (referer: https://www.auto1.com/v1/car-details-view/JG35280/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f15c279c-89f1-5a21-8087-0cb21e823b1d with identifier: JG35280
2026-03-30 10:44:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f15c279c-89f1-5a21-8087-0cb21e823b1d with scrape type 1
2026-03-30 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f15c279c-89f1-5a21-8087-0cb21e823b1d
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_b0346df68affcadaaff73b6d21187ac4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_b0346df68affcadaaff73b6d21187ac4.jpg not downloaded yet
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_45f297e7db2d4a98e4d2ebfa95a21c98.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_45f297e7db2d4a98e4d2ebfa95a21c98.jpg not downloaded yet
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_372c04e9c6e7cc34cc2fff432c116a3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_372c04e9c6e7cc34cc2fff432c116a3d.jpg not downloaded yet
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_fa49aeb847fe91d3e842bc54786c41b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_fa49aeb847fe91d3e842bc54786c41b5.jpg not downloaded yet
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_6d850c0707d7451316e6aa8ec2de3d76.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_6d850c0707d7451316e6aa8ec2de3d76.jpg not downloaded yet
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_d04388bf9325e7c33a4c029542c784dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_d04388bf9325e7c33a4c029542c784dd.jpg not downloaded yet
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_4b51f88ead9a661227fd5612cbfccfe8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_4b51f88ead9a661227fd5612cbfccfe8.jpg not downloaded yet
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_bff000090ab0ecb8bbbdb6d028f4c0d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_bff000090ab0ecb8bbbdb6d028f4c0d9.jpg not downloaded yet
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_34c097a8692be1b1010ab3f24fe914e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_34c097a8692be1b1010ab3f24fe914e0.jpg not downloaded yet
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_33babbb6e682b9c93340671825018cac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_33babbb6e682b9c93340671825018cac.jpg not downloaded yet
2026-03-30 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN14132/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_33babbb6e682b9c93340671825018cac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee5c90>
2026-03-30 10:44:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_33babbb6e682b9c93340671825018cac.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_33babbb6e682b9c93340671825018cac.jpg saved to cache
2026-03-30 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f15c279c-89f1-5a21-8087-0cb21e823b1d
2026-03-30 10:44:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG83238/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_34c097a8692be1b1010ab3f24fe914e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_bff000090ab0ecb8bbbdb6d028f4c0d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5acb450>
2026-03-30 10:44:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_34c097a8692be1b1010ab3f24fe914e0.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_34c097a8692be1b1010ab3f24fe914e0.jpg saved to cache
2026-03-30 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f15c279c-89f1-5a21-8087-0cb21e823b1d
2026-03-30 10:44:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b37790>
2026-03-30 10:44:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_bff000090ab0ecb8bbbdb6d028f4c0d9.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_bff000090ab0ecb8bbbdb6d028f4c0d9.jpg saved to cache
2026-03-30 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f15c279c-89f1-5a21-8087-0cb21e823b1d
2026-03-30 10:44:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TL94146/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_4b51f88ead9a661227fd5612cbfccfe8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b02bd0>
2026-03-30 10:44:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_4b51f88ead9a661227fd5612cbfccfe8.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_4b51f88ead9a661227fd5612cbfccfe8.jpg saved to cache
2026-03-30 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f15c279c-89f1-5a21-8087-0cb21e823b1d
2026-03-30 10:44:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:42 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 9460 | hits on page: 40
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: YN89377
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: EC11597
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: JH14903
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH14903%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [auto1.de] INFO: Scrape type for JH14903: 1
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: NS27830
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS27830%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [auto1.de] INFO: Scrape type for NS27830: 1
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: PG39438
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: UK98474
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: AR54418
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR54418%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [auto1.de] INFO: Scrape type for AR54418: 1
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: HD45334
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: JN68320
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN68320%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [auto1.de] INFO: Scrape type for JN68320: 1
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: RP65650
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP65650%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [auto1.de] INFO: Scrape type for RP65650: 1
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: GD36991
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: AW88873
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW88873%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [auto1.de] INFO: Scrape type for AW88873: 1
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: PJ55478
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ55478%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [auto1.de] INFO: Scrape type for PJ55478: 1
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: AS73684
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: VM58526
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: TR40725
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR40725%27 HTTP/1.1" 200 None
2026-03-30 10:44:42 [auto1.de] INFO: Scrape type for TR40725: 1
2026-03-30 10:44:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_d04388bf9325e7c33a4c029542c784dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: HT98852
2026-03-30 10:44:42 [auto1.de] INFO: Found listing with ID: JK85727
2026-03-30 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK85727%27 HTTP/1.1" 200 None
2026-03-30 10:44:43 [auto1.de] INFO: Scrape type for JK85727: 1
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: AR37837
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR37837%27 HTTP/1.1" 200 None
2026-03-30 10:44:43 [auto1.de] INFO: Scrape type for AR37837: 2
2026-03-30 10:44:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9658510a-30ea-564e-a8ed-32f3f7444b13 with identifier: AR37837
2026-03-30 10:44:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9658510a-30ea-564e-a8ed-32f3f7444b13 with scrape type 2
2026-03-30 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9658510a-30ea-564e-a8ed-32f3f7444b13 with scrape type 2
2026-03-30 10:44:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9658510a-30ea-564e-a8ed-32f3f7444b13, identifier: AR37837
2026-03-30 10:44:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9658510a-30ea-564e-a8ed-32f3f7444b13 with identifier: AR37837
2026-03-30 10:44:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9658510a-30ea-564e-a8ed-32f3f7444b13 with identifier: AR37837
2026-03-30 10:44:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9658510a-30ea-564e-a8ed-32f3f7444b13 with identifier: AR37837 to the API
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:49:08Z',
 'fuel_type': 'petrol',
 'id': '9658510a-30ea-564e-a8ed-32f3f7444b13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR37837',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 127676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-20',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Premium 4WD',
 'transmission': 'automatic',
 'trim': 'Premium 4WD',
 'year': 2016}
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR37837%27 HTTP/1.1" 200 None
2026-03-30 10:44:43 [auto1.de] INFO: Saving data for AR37837: {'auction_closing_time': 1774972148.0, 'created_time': 1774034754.175492, 'last_price_update_time': 1774867483.603531}
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR37837') HTTP/1.1" 204 0
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: CV38607
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV38607%27 HTTP/1.1" 200 None
2026-03-30 10:44:43 [auto1.de] INFO: Scrape type for CV38607: 1
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f09150>
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_d04388bf9325e7c33a4c029542c784dd.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_d04388bf9325e7c33a4c029542c784dd.jpg saved to cache
2026-03-30 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f15c279c-89f1-5a21-8087-0cb21e823b1d
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: DG14752
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: VK28848
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: FW45589
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: DP77092
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: RT97145
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: YM37880
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM37880%27 HTTP/1.1" 200 None
2026-03-30 10:44:43 [auto1.de] INFO: Scrape type for YM37880: 1
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: VL31583
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: JB74437
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB74437%27 HTTP/1.1" 200 None
2026-03-30 10:44:43 [auto1.de] INFO: Scrape type for JB74437: 1
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: BX70852
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: AJ81132
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ81132%27 HTTP/1.1" 200 None
2026-03-30 10:44:43 [auto1.de] INFO: Scrape type for AJ81132: 1
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: UL45474
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: RZ67892
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: WH06926
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: CU85166
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU85166%27 HTTP/1.1" 200 None
2026-03-30 10:44:43 [auto1.de] INFO: Scrape type for CU85166: 1
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: AD23421
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD23421%27 HTTP/1.1" 200 None
2026-03-30 10:44:43 [auto1.de] INFO: Scrape type for AD23421: 1
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: NP43212
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: UV35229
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: JM46671
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM46671%27 HTTP/1.1" 200 None
2026-03-30 10:44:43 [auto1.de] INFO: Scrape type for JM46671: 1
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: YJ94163
2026-03-30 10:44:43 [auto1.de] INFO: Found listing with ID: ZA52966
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA52966%27 HTTP/1.1" 200 None
2026-03-30 10:44:43 [auto1.de] INFO: Scrape type for ZA52966: 1
2026-03-30 10:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DH22433/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE05713/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF15006/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF66532/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU42545/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV69567/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL04476> (referer: https://www.auto1.com/v1/car-details-view/ZL04476/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6afd7d70-4998-54c7-abde-98166f9eb4fc with identifier: ZL04476
2026-03-30 10:44:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6afd7d70-4998-54c7-abde-98166f9eb4fc with scrape type 1
2026-03-30 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6afd7d70-4998-54c7-abde-98166f9eb4fc
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fa2%252F80a2ffc48fa80ae7a48e1863788b7411%252Fpa%252FZL04476_9ce287a6020140b5cc870b1954cef767.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/a2/80a2ffc48fa80ae7a48e1863788b7411/pa/ZL04476_9ce287a6020140b5cc870b1954cef767.jpg already downloaded
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fa2%252F80a2ffc48fa80ae7a48e1863788b7411%252Fpa%252FZL04476_8f6be5a1520e9f1066eaf1f7afdfae94.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/a2/80a2ffc48fa80ae7a48e1863788b7411/pa/ZL04476_8f6be5a1520e9f1066eaf1f7afdfae94.jpg already downloaded
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fa2%252F80a2ffc48fa80ae7a48e1863788b7411%252Fpa%252FZL04476_c820a69dc109460e372100e5a329a319.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/a2/80a2ffc48fa80ae7a48e1863788b7411/pa/ZL04476_c820a69dc109460e372100e5a329a319.jpg already downloaded
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fa2%252F80a2ffc48fa80ae7a48e1863788b7411%252Fpa%252FZL04476_62fab143383df92960b3d0143787332d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/a2/80a2ffc48fa80ae7a48e1863788b7411/pa/ZL04476_62fab143383df92960b3d0143787332d.jpg already downloaded
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fa2%252F80a2ffc48fa80ae7a48e1863788b7411%252Fpa%252FZL04476_8e330b077d619fe9dc1e4507158463da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/a2/80a2ffc48fa80ae7a48e1863788b7411/pa/ZL04476_8e330b077d619fe9dc1e4507158463da.jpg already downloaded
2026-03-30 10:44:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6afd7d70-4998-54c7-abde-98166f9eb4fc, identifier: ZL04476
2026-03-30 10:44:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6afd7d70-4998-54c7-abde-98166f9eb4fc with identifier: ZL04476
2026-03-30 10:44:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6afd7d70-4998-54c7-abde-98166f9eb4fc with identifier: ZL04476
2026-03-30 10:44:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6afd7d70-4998-54c7-abde-98166f9eb4fc with identifier: ZL04476 to the API
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZL04476>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:49:19Z',
 'fuel_type': 'diesel',
 'id': '6afd7d70-4998-54c7-abde-98166f9eb4fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL04476',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'BMW',
 'model': '1er',
 'odometer': 242818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img80/a2/80a2ffc48fa80ae7a48e1863788b7411/pa/ZL04476_9ce287a6020140b5cc870b1954cef767.jpg',
                'https://img-pa.auto1.com/img80/a2/80a2ffc48fa80ae7a48e1863788b7411/pa/ZL04476_8f6be5a1520e9f1066eaf1f7afdfae94.jpg',
                'https://img-pa.auto1.com/img80/a2/80a2ffc48fa80ae7a48e1863788b7411/pa/ZL04476_c820a69dc109460e372100e5a329a319.jpg',
                'https://img-pa.auto1.com/img80/a2/80a2ffc48fa80ae7a48e1863788b7411/pa/ZL04476_62fab143383df92960b3d0143787332d.jpg',
                'https://img-pa.auto1.com/img80/a2/80a2ffc48fa80ae7a48e1863788b7411/pa/ZL04476_8e330b077d619fe9dc1e4507158463da.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afd7d70-4998-54c7-abde-98166f9eb4fc/6afd7d70-4998-54c7-abde-98166f9eb4fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/a2/80a2ffc48fa80ae7a48e1863788b7411/pa/ZL04476_9ce287a6020140b5cc870b1954cef767.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afd7d70-4998-54c7-abde-98166f9eb4fc/6afd7d70-4998-54c7-abde-98166f9eb4fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/a2/80a2ffc48fa80ae7a48e1863788b7411/pa/ZL04476_8f6be5a1520e9f1066eaf1f7afdfae94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afd7d70-4998-54c7-abde-98166f9eb4fc/6afd7d70-4998-54c7-abde-98166f9eb4fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/a2/80a2ffc48fa80ae7a48e1863788b7411/pa/ZL04476_c820a69dc109460e372100e5a329a319.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afd7d70-4998-54c7-abde-98166f9eb4fc/6afd7d70-4998-54c7-abde-98166f9eb4fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/a2/80a2ffc48fa80ae7a48e1863788b7411/pa/ZL04476_62fab143383df92960b3d0143787332d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afd7d70-4998-54c7-abde-98166f9eb4fc/6afd7d70-4998-54c7-abde-98166f9eb4fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/a2/80a2ffc48fa80ae7a48e1863788b7411/pa/ZL04476_8e330b077d619fe9dc1e4507158463da.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL04476%27 HTTP/1.1" 200 None
2026-03-30 10:44:50 [auto1.de] INFO: Saving data for ZL04476: {'created_time': 1774867490.731766, 'last_price_update_time': 1774867490.731776, 'auction_closing_time': 1774972159.0}
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL04476') HTTP/1.1" 204 0
2026-03-30 10:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS16596/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY77162/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG74460> (referer: https://www.auto1.com/v1/car-details-view/UG74460/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd with identifier: UG74460
2026-03-30 10:44:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd with scrape type 1
2026-03-30 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd
2026-03-30 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_c8bf1942b488a0edfa477ac0df7bc1a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_c8bf1942b488a0edfa477ac0df7bc1a8.jpg not downloaded yet
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_f23e0322818351e9f4395ada1b72ebfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_f23e0322818351e9f4395ada1b72ebfc.jpg not downloaded yet
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_03ab63f15bfc46fd8b846cb22a2c7291.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_03ab63f15bfc46fd8b846cb22a2c7291.jpg not downloaded yet
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_021c0f50f8b660901fa74936c3c1d3b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_021c0f50f8b660901fa74936c3c1d3b9.jpg not downloaded yet
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_d74a5cbed90e87aea70d5545089d1c77.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_d74a5cbed90e87aea70d5545089d1c77.jpg not downloaded yet
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_925ce7fb0dc2ab7dadac9634cdcbb6d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_925ce7fb0dc2ab7dadac9634cdcbb6d0.jpg not downloaded yet
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_c1a5913b48938d637639fc308073625e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_c1a5913b48938d637639fc308073625e.jpg not downloaded yet
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_7aa652287c36c33d2ccad35f656a8a1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_7aa652287c36c33d2ccad35f656a8a1b.jpg not downloaded yet
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_1c674e8734d8737f710aa5ef528c1fa6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_1c674e8734d8737f710aa5ef528c1fa6.jpg not downloaded yet
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_c1e2fd0aab431a06336e6e0425084168.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_c1e2fd0aab431a06336e6e0425084168.jpg not downloaded yet
2026-03-30 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL99287> (referer: https://www.auto1.com/v1/car-details-view/NL99287/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1df3cdb7-67b6-57fe-bcc1-36ae42030572 with identifier: NL99287
2026-03-30 10:44:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1df3cdb7-67b6-57fe-bcc1-36ae42030572 with scrape type 1
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1df3cdb7-67b6-57fe-bcc1-36ae42030572
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F16%252F3a1645e78ba98f27759b23d1028cdcb2%252Fpa%252FNL99287_039a4c0260e9d694e9a63212dc4c216f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_039a4c0260e9d694e9a63212dc4c216f.jpg already downloaded
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F16%252F3a1645e78ba98f27759b23d1028cdcb2%252Fpa%252FNL99287_dba22379fe25d5fb117fe50a8b505a07.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_dba22379fe25d5fb117fe50a8b505a07.jpg already downloaded
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F16%252F3a1645e78ba98f27759b23d1028cdcb2%252Fpa%252FNL99287_445c9650a84cb40a0492703e2bb8d4ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_445c9650a84cb40a0492703e2bb8d4ac.jpg already downloaded
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F16%252F3a1645e78ba98f27759b23d1028cdcb2%252Fpa%252FNL99287_c926a510475c43ff5cc16580c6f4ec7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_c926a510475c43ff5cc16580c6f4ec7b.jpg already downloaded
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F16%252F3a1645e78ba98f27759b23d1028cdcb2%252Fpa%252FNL99287_645223f873e1c757e3c97ef72c52f75e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_645223f873e1c757e3c97ef72c52f75e.jpg already downloaded
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F16%252F3a1645e78ba98f27759b23d1028cdcb2%252Fpa%252FNL99287_25282c26d862e246f482539a72a71808.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_25282c26d862e246f482539a72a71808.jpg already downloaded
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F16%252F3a1645e78ba98f27759b23d1028cdcb2%252Fpa%252FNL99287_f334b77e28f86c99ecad97a745dda345.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_f334b77e28f86c99ecad97a745dda345.jpg already downloaded
2026-03-30 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F16%252F3a1645e78ba98f27759b23d1028cdcb2%252Fpa%252FNL99287_f2fff021da0707e7d05a53f6926c79e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_f2fff021da0707e7d05a53f6926c79e8.jpg already downloaded
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F16%252F3a1645e78ba98f27759b23d1028cdcb2%252Fpa%252FNL99287_88974d88657cfe5bdc779818619881de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_88974d88657cfe5bdc779818619881de.jpg already downloaded
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F16%252F3a1645e78ba98f27759b23d1028cdcb2%252Fpa%252FNL99287_f93c700f82e2e65d93fcdf3ef2766e8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_f93c700f82e2e65d93fcdf3ef2766e8a.jpg already downloaded
2026-03-30 10:44:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1df3cdb7-67b6-57fe-bcc1-36ae42030572, identifier: NL99287
2026-03-30 10:44:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1df3cdb7-67b6-57fe-bcc1-36ae42030572 with identifier: NL99287
2026-03-30 10:44:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1df3cdb7-67b6-57fe-bcc1-36ae42030572 with identifier: NL99287
2026-03-30 10:44:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1df3cdb7-67b6-57fe-bcc1-36ae42030572 with identifier: NL99287 to the API
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NL99287>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:04:12Z',
 'fuel_type': 'petrol',
 'id': '1df3cdb7-67b6-57fe-bcc1-36ae42030572',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL99287',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 110182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_039a4c0260e9d694e9a63212dc4c216f.jpg',
                'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_dba22379fe25d5fb117fe50a8b505a07.jpg',
                'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_445c9650a84cb40a0492703e2bb8d4ac.jpg',
                'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_c926a510475c43ff5cc16580c6f4ec7b.jpg',
                'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_645223f873e1c757e3c97ef72c52f75e.jpg',
                'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_25282c26d862e246f482539a72a71808.jpg',
                'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_f334b77e28f86c99ecad97a745dda345.jpg',
                'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_f2fff021da0707e7d05a53f6926c79e8.jpg',
                'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_88974d88657cfe5bdc779818619881de.jpg',
                'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_f93c700f82e2e65d93fcdf3ef2766e8a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df3cdb7-67b6-57fe-bcc1-36ae42030572/1df3cdb7-67b6-57fe-bcc1-36ae42030572_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_039a4c0260e9d694e9a63212dc4c216f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df3cdb7-67b6-57fe-bcc1-36ae42030572/1df3cdb7-67b6-57fe-bcc1-36ae42030572_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_dba22379fe25d5fb117fe50a8b505a07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df3cdb7-67b6-57fe-bcc1-36ae42030572/1df3cdb7-67b6-57fe-bcc1-36ae42030572_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_445c9650a84cb40a0492703e2bb8d4ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df3cdb7-67b6-57fe-bcc1-36ae42030572/1df3cdb7-67b6-57fe-bcc1-36ae42030572_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2959788,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_c926a510475c43ff5cc16580c6f4ec7b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df3cdb7-67b6-57fe-bcc1-36ae42030572/1df3cdb7-67b6-57fe-bcc1-36ae42030572_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_645223f873e1c757e3c97ef72c52f75e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df3cdb7-67b6-57fe-bcc1-36ae42030572/1df3cdb7-67b6-57fe-bcc1-36ae42030572_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_25282c26d862e246f482539a72a71808.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df3cdb7-67b6-57fe-bcc1-36ae42030572/1df3cdb7-67b6-57fe-bcc1-36ae42030572_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2849130,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_f334b77e28f86c99ecad97a745dda345.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df3cdb7-67b6-57fe-bcc1-36ae42030572/1df3cdb7-67b6-57fe-bcc1-36ae42030572_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_f2fff021da0707e7d05a53f6926c79e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df3cdb7-67b6-57fe-bcc1-36ae42030572/1df3cdb7-67b6-57fe-bcc1-36ae42030572_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_88974d88657cfe5bdc779818619881de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df3cdb7-67b6-57fe-bcc1-36ae42030572/1df3cdb7-67b6-57fe-bcc1-36ae42030572_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3169181,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/16/3a1645e78ba98f27759b23d1028cdcb2/pa/NL99287_f93c700f82e2e65d93fcdf3ef2766e8a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL99287%27 HTTP/1.1" 200 None
2026-03-30 10:44:57 [auto1.de] INFO: Saving data for NL99287: {'created_time': 1774867497.640873, 'last_price_update_time': 1774867497.640882, 'auction_closing_time': 1774969452.0}
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL99287') HTTP/1.1" 204 0
2026-03-30 10:44:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_c1e2fd0aab431a06336e6e0425084168.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR40725/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a64f50>
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_c1e2fd0aab431a06336e6e0425084168.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_c1e2fd0aab431a06336e6e0425084168.jpg saved to cache
2026-03-30 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd
2026-03-30 10:44:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_1c674e8734d8737f710aa5ef528c1fa6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_7aa652287c36c33d2ccad35f656a8a1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b091d0>
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_1c674e8734d8737f710aa5ef528c1fa6.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_1c674e8734d8737f710aa5ef528c1fa6.jpg saved to cache
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd
2026-03-30 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_c1a5913b48938d637639fc308073625e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b0b490>
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_7aa652287c36c33d2ccad35f656a8a1b.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_7aa652287c36c33d2ccad35f656a8a1b.jpg saved to cache
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5983c10>
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_c1a5913b48938d637639fc308073625e.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_c1a5913b48938d637639fc308073625e.jpg saved to cache
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd
2026-03-30 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_925ce7fb0dc2ab7dadac9634cdcbb6d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_d74a5cbed90e87aea70d5545089d1c77.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e743d0>
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_925ce7fb0dc2ab7dadac9634cdcbb6d0.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_925ce7fb0dc2ab7dadac9634cdcbb6d0.jpg saved to cache
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e283d0>
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_d74a5cbed90e87aea70d5545089d1c77.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_d74a5cbed90e87aea70d5545089d1c77.jpg saved to cache
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd
2026-03-30 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TL94146> (referer: https://www.auto1.com/v1/car-details-view/TL94146/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:44:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:44:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae1a14ad-38e0-5612-9126-b7b5a7044084 with identifier: TL94146
2026-03-30 10:44:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae1a14ad-38e0-5612-9126-b7b5a7044084 with scrape type 1
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae1a14ad-38e0-5612-9126-b7b5a7044084
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F53%252Fc653776267722f58cce278196a59ce63%252Fpa%252FTL94146_e102646bcbe152957191e20ee3ddad7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_e102646bcbe152957191e20ee3ddad7e.jpg already downloaded
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F53%252Fc653776267722f58cce278196a59ce63%252Fpa%252FTL94146_8566ad6c87f2fc024b059e78c4dbade4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_8566ad6c87f2fc024b059e78c4dbade4.jpg already downloaded
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F53%252Fc653776267722f58cce278196a59ce63%252Fpa%252FTL94146_a26c7d041b8d418e4246f34b4e2b151f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_a26c7d041b8d418e4246f34b4e2b151f.jpg already downloaded
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F53%252Fc653776267722f58cce278196a59ce63%252Fpa%252FTL94146_45fcfe95f5b85feaad62ae1b68a3464c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_45fcfe95f5b85feaad62ae1b68a3464c.jpg already downloaded
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F53%252Fc653776267722f58cce278196a59ce63%252Fpa%252FTL94146_24ecde3cd3544f1d09a80e0f71e794f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_24ecde3cd3544f1d09a80e0f71e794f6.jpg already downloaded
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F53%252Fc653776267722f58cce278196a59ce63%252Fpa%252FTL94146_09f1413a33c2d2790c6910c3bb9eec19.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_09f1413a33c2d2790c6910c3bb9eec19.jpg already downloaded
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F53%252Fc653776267722f58cce278196a59ce63%252Fpa%252FTL94146_28a6699dfb9d1b32a4a2c08c6158c43a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_28a6699dfb9d1b32a4a2c08c6158c43a.jpg already downloaded
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F53%252Fc653776267722f58cce278196a59ce63%252Fpa%252FTL94146_bbb63cd24b97a0e069a2ebb3abd66d5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_bbb63cd24b97a0e069a2ebb3abd66d5b.jpg already downloaded
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F53%252Fc653776267722f58cce278196a59ce63%252Fpa%252FTL94146_633198f8a4d1cebbc5c76083476e827e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_633198f8a4d1cebbc5c76083476e827e.jpg already downloaded
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F53%252Fc653776267722f58cce278196a59ce63%252Fpa%252FTL94146_facd3d0f199c0949518ab502e855e7f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_facd3d0f199c0949518ab502e855e7f3.jpg already downloaded
2026-03-30 10:44:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae1a14ad-38e0-5612-9126-b7b5a7044084, identifier: TL94146
2026-03-30 10:44:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae1a14ad-38e0-5612-9126-b7b5a7044084 with identifier: TL94146
2026-03-30 10:44:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae1a14ad-38e0-5612-9126-b7b5a7044084 with identifier: TL94146
2026-03-30 10:44:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae1a14ad-38e0-5612-9126-b7b5a7044084 with identifier: TL94146 to the API
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:44:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TL94146>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:02:08Z',
 'fuel_type': 'petrol',
 'id': 'ae1a14ad-38e0-5612-9126-b7b5a7044084',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL94146',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 163608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_e102646bcbe152957191e20ee3ddad7e.jpg',
                'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_8566ad6c87f2fc024b059e78c4dbade4.jpg',
                'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_a26c7d041b8d418e4246f34b4e2b151f.jpg',
                'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_45fcfe95f5b85feaad62ae1b68a3464c.jpg',
                'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_24ecde3cd3544f1d09a80e0f71e794f6.jpg',
                'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_09f1413a33c2d2790c6910c3bb9eec19.jpg',
                'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_28a6699dfb9d1b32a4a2c08c6158c43a.jpg',
                'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_bbb63cd24b97a0e069a2ebb3abd66d5b.jpg',
                'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_633198f8a4d1cebbc5c76083476e827e.jpg',
                'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_facd3d0f199c0949518ab502e855e7f3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1a14ad-38e0-5612-9126-b7b5a7044084/ae1a14ad-38e0-5612-9126-b7b5a7044084_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_e102646bcbe152957191e20ee3ddad7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1a14ad-38e0-5612-9126-b7b5a7044084/ae1a14ad-38e0-5612-9126-b7b5a7044084_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_8566ad6c87f2fc024b059e78c4dbade4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1a14ad-38e0-5612-9126-b7b5a7044084/ae1a14ad-38e0-5612-9126-b7b5a7044084_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_a26c7d041b8d418e4246f34b4e2b151f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1a14ad-38e0-5612-9126-b7b5a7044084/ae1a14ad-38e0-5612-9126-b7b5a7044084_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_45fcfe95f5b85feaad62ae1b68a3464c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1a14ad-38e0-5612-9126-b7b5a7044084/ae1a14ad-38e0-5612-9126-b7b5a7044084_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_24ecde3cd3544f1d09a80e0f71e794f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1a14ad-38e0-5612-9126-b7b5a7044084/ae1a14ad-38e0-5612-9126-b7b5a7044084_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_09f1413a33c2d2790c6910c3bb9eec19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1a14ad-38e0-5612-9126-b7b5a7044084/ae1a14ad-38e0-5612-9126-b7b5a7044084_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_28a6699dfb9d1b32a4a2c08c6158c43a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1a14ad-38e0-5612-9126-b7b5a7044084/ae1a14ad-38e0-5612-9126-b7b5a7044084_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_bbb63cd24b97a0e069a2ebb3abd66d5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1a14ad-38e0-5612-9126-b7b5a7044084/ae1a14ad-38e0-5612-9126-b7b5a7044084_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_633198f8a4d1cebbc5c76083476e827e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1a14ad-38e0-5612-9126-b7b5a7044084/ae1a14ad-38e0-5612-9126-b7b5a7044084_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/53/c653776267722f58cce278196a59ce63/pa/TL94146_facd3d0f199c0949518ab502e855e7f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2018}
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL94146%27 HTTP/1.1" 200 None
2026-03-30 10:44:59 [auto1.de] INFO: Saving data for TL94146: {'created_time': 1774867499.541941, 'last_price_update_time': 1774867499.541951, 'auction_closing_time': 1774969328.0}
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL94146') HTTP/1.1" 204 0
2026-03-30 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_03ab63f15bfc46fd8b846cb22a2c7291.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_021c0f50f8b660901fa74936c3c1d3b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_c8bf1942b488a0edfa477ac0df7bc1a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb0e10>
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_03ab63f15bfc46fd8b846cb22a2c7291.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_03ab63f15bfc46fd8b846cb22a2c7291.jpg saved to cache
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd
2026-03-30 10:44:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c4dbd0>
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_021c0f50f8b660901fa74936c3c1d3b9.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_021c0f50f8b660901fa74936c3c1d3b9.jpg saved to cache
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd
2026-03-30 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_f23e0322818351e9f4395ada1b72ebfc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b0a7d0>
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_c8bf1942b488a0edfa477ac0df7bc1a8.jpg') HTTP/1.1" 204 0
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_c8bf1942b488a0edfa477ac0df7bc1a8.jpg saved to cache
2026-03-30 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e6ad10>
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F6a%252F7d6a4accf6f359adf255681cc874b175%252Fpa%252FUG74460_f23e0322818351e9f4395ada1b72ebfc.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_f23e0322818351e9f4395ada1b72ebfc.jpg saved to cache
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd
2026-03-30 10:45:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd, skipping ID generation
2026-03-30 10:45:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd with scrape type 1
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd sending to next pipeline
2026-03-30 10:45:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd, identifier: UG74460
2026-03-30 10:45:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd with identifier: UG74460
2026-03-30 10:45:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd with identifier: UG74460
2026-03-30 10:45:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd with identifier: UG74460 to the API
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_f23e0322818351e9f4395ada1b72ebfc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:03:31Z',
 'fuel_type': 'petrol',
 'id': 'f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG74460',
 'listing': 'auction',
 'location': 'DE, Mülheim an der Ruhr',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 94324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_c8bf1942b488a0edfa477ac0df7bc1a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_f23e0322818351e9f4395ada1b72ebfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_03ab63f15bfc46fd8b846cb22a2c7291.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2977121,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_021c0f50f8b660901fa74936c3c1d3b9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_d74a5cbed90e87aea70d5545089d1c77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3088416,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_925ce7fb0dc2ab7dadac9634cdcbb6d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_c1a5913b48938d637639fc308073625e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3001710,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_7aa652287c36c33d2ccad35f656a8a1b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_1c674e8734d8737f710aa5ef528c1fa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd/f9dc408d-a8cc-5d7e-ac38-ccc62f40e4bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/6a/7d6a4accf6f359adf255681cc874b175/pa/UG74460_c1e2fd0aab431a06336e6e0425084168.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2018}
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG74460%27 HTTP/1.1" 200 None
2026-03-30 10:45:00 [auto1.de] INFO: Saving data for UG74460: {'created_time': 1774867500.640333, 'last_price_update_time': 1774867500.640345, 'auction_closing_time': 1774969411.0}
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG74460') HTTP/1.1" 204 0
2026-03-30 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG83238> (referer: https://www.auto1.com/v1/car-details-view/FG83238/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bedde2f6-e068-5595-bac8-a12c2158f066 with identifier: FG83238
2026-03-30 10:45:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bedde2f6-e068-5595-bac8-a12c2158f066 with scrape type 1
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item bedde2f6-e068-5595-bac8-a12c2158f066
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F5e%252Fbe5ebfafb3fc8f006a549c47a0c763dc%252Fpa%252FFG83238_a0b077639e42d0a55626dfbd85c5652a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/5e/be5ebfafb3fc8f006a549c47a0c763dc/pa/FG83238_a0b077639e42d0a55626dfbd85c5652a.jpg already downloaded
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F5e%252Fbe5ebfafb3fc8f006a549c47a0c763dc%252Fpa%252FFG83238_41518ffcd7d8117c4be0aa9533d6c5e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/5e/be5ebfafb3fc8f006a549c47a0c763dc/pa/FG83238_41518ffcd7d8117c4be0aa9533d6c5e1.jpg already downloaded
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F5e%252Fbe5ebfafb3fc8f006a549c47a0c763dc%252Fpa%252FFG83238_129e00a717d21a57438046eabee800a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/5e/be5ebfafb3fc8f006a549c47a0c763dc/pa/FG83238_129e00a717d21a57438046eabee800a2.jpg already downloaded
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F5e%252Fbe5ebfafb3fc8f006a549c47a0c763dc%252Fpa%252FFG83238_1baa2231b033f2f18f8b3fe4b4d7a19c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/5e/be5ebfafb3fc8f006a549c47a0c763dc/pa/FG83238_1baa2231b033f2f18f8b3fe4b4d7a19c.jpg already downloaded
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F5e%252Fbe5ebfafb3fc8f006a549c47a0c763dc%252Fpa%252FFG83238_90226f8b0c86d62ef378848c62a068e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/5e/be5ebfafb3fc8f006a549c47a0c763dc/pa/FG83238_90226f8b0c86d62ef378848c62a068e2.jpg already downloaded
2026-03-30 10:45:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bedde2f6-e068-5595-bac8-a12c2158f066, identifier: FG83238
2026-03-30 10:45:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bedde2f6-e068-5595-bac8-a12c2158f066 with identifier: FG83238
2026-03-30 10:45:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bedde2f6-e068-5595-bac8-a12c2158f066 with identifier: FG83238
2026-03-30 10:45:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bedde2f6-e068-5595-bac8-a12c2158f066 with identifier: FG83238 to the API
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FG83238>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:52:12Z',
 'fuel_type': 'petrol',
 'id': 'bedde2f6-e068-5595-bac8-a12c2158f066',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG83238',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 118952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/5e/be5ebfafb3fc8f006a549c47a0c763dc/pa/FG83238_a0b077639e42d0a55626dfbd85c5652a.jpg',
                'https://img-pa.auto1.com/imgbe/5e/be5ebfafb3fc8f006a549c47a0c763dc/pa/FG83238_41518ffcd7d8117c4be0aa9533d6c5e1.jpg',
                'https://img-pa.auto1.com/imgbe/5e/be5ebfafb3fc8f006a549c47a0c763dc/pa/FG83238_129e00a717d21a57438046eabee800a2.jpg',
                'https://img-pa.auto1.com/imgbe/5e/be5ebfafb3fc8f006a549c47a0c763dc/pa/FG83238_1baa2231b033f2f18f8b3fe4b4d7a19c.jpg',
                'https://img-pa.auto1.com/imgbe/5e/be5ebfafb3fc8f006a549c47a0c763dc/pa/FG83238_90226f8b0c86d62ef378848c62a068e2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bedde2f6-e068-5595-bac8-a12c2158f066/bedde2f6-e068-5595-bac8-a12c2158f066_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/5e/be5ebfafb3fc8f006a549c47a0c763dc/pa/FG83238_a0b077639e42d0a55626dfbd85c5652a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bedde2f6-e068-5595-bac8-a12c2158f066/bedde2f6-e068-5595-bac8-a12c2158f066_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/5e/be5ebfafb3fc8f006a549c47a0c763dc/pa/FG83238_41518ffcd7d8117c4be0aa9533d6c5e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bedde2f6-e068-5595-bac8-a12c2158f066/bedde2f6-e068-5595-bac8-a12c2158f066_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/5e/be5ebfafb3fc8f006a549c47a0c763dc/pa/FG83238_129e00a717d21a57438046eabee800a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bedde2f6-e068-5595-bac8-a12c2158f066/bedde2f6-e068-5595-bac8-a12c2158f066_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/5e/be5ebfafb3fc8f006a549c47a0c763dc/pa/FG83238_1baa2231b033f2f18f8b3fe4b4d7a19c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bedde2f6-e068-5595-bac8-a12c2158f066/bedde2f6-e068-5595-bac8-a12c2158f066_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/5e/be5ebfafb3fc8f006a549c47a0c763dc/pa/FG83238_90226f8b0c86d62ef378848c62a068e2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-12-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500C 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2010}
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG83238%27 HTTP/1.1" 200 None
2026-03-30 10:45:01 [auto1.de] INFO: Saving data for FG83238: {'created_time': 1774867501.286414, 'last_price_update_time': 1774867501.286426, 'auction_closing_time': 1774972332.0}
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG83238') HTTP/1.1" 204 0
2026-03-30 10:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN14132> (referer: https://www.auto1.com/v1/car-details-view/MN14132/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bd4c213-8e9c-5164-be81-600c722dba3e with identifier: MN14132
2026-03-30 10:45:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bd4c213-8e9c-5164-be81-600c722dba3e with scrape type 1
2026-03-30 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5bd4c213-8e9c-5164-be81-600c722dba3e
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F97%252F36972d9310833f487e5c0eca30fbd599%252Fpa%252FMN14132_f9373a13490dfb9d7682247bdb158a54.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_f9373a13490dfb9d7682247bdb158a54.jpg not downloaded yet
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F97%252F36972d9310833f487e5c0eca30fbd599%252Fpa%252FMN14132_d5dd0233d99b4e321a99e496b56940f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_d5dd0233d99b4e321a99e496b56940f0.jpg not downloaded yet
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F97%252F36972d9310833f487e5c0eca30fbd599%252Fpa%252FMN14132_84ce242c3a4dcafde02acd100e340112.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_84ce242c3a4dcafde02acd100e340112.jpg not downloaded yet
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F97%252F36972d9310833f487e5c0eca30fbd599%252Fpa%252FMN14132_f78d8ea8cf97b73bb557ed12437a351c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_f78d8ea8cf97b73bb557ed12437a351c.jpg not downloaded yet
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F97%252F36972d9310833f487e5c0eca30fbd599%252Fpa%252FMN14132_d84aa0b90b7faf97c1110fbce379db13.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_d84aa0b90b7faf97c1110fbce379db13.jpg not downloaded yet
2026-03-30 10:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV69567> (referer: https://www.auto1.com/v1/car-details-view/DV69567/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_d84aa0b90b7faf97c1110fbce379db13.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30b8ddd0-2e58-5d47-81a7-eccba4137c10 with identifier: DV69567
2026-03-30 10:45:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30b8ddd0-2e58-5d47-81a7-eccba4137c10 with scrape type 1
2026-03-30 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30b8ddd0-2e58-5d47-81a7-eccba4137c10
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F81%252Fcd81c55479d62a759f5006d5891c014c%252Fpa%252FDV69567_21172918d9750f5fde08fd1ee365e82e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_21172918d9750f5fde08fd1ee365e82e.jpg already downloaded
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F81%252Fcd81c55479d62a759f5006d5891c014c%252Fpa%252FDV69567_0c23e224b474455b269d6b5fe121ee94.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_0c23e224b474455b269d6b5fe121ee94.jpg already downloaded
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F81%252Fcd81c55479d62a759f5006d5891c014c%252Fpa%252FDV69567_21d07f704a887593ee4e2dacf39d8a88.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_21d07f704a887593ee4e2dacf39d8a88.jpg already downloaded
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F81%252Fcd81c55479d62a759f5006d5891c014c%252Fpa%252FDV69567_f52eadd7ef0f78f6c485ee18b1876896.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_f52eadd7ef0f78f6c485ee18b1876896.jpg already downloaded
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F81%252Fcd81c55479d62a759f5006d5891c014c%252Fpa%252FDV69567_15c6e6337d6cf9fa7c5f8ca8ca980911.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_15c6e6337d6cf9fa7c5f8ca8ca980911.jpg already downloaded
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F81%252Fcd81c55479d62a759f5006d5891c014c%252Fpa%252FDV69567_08bc1a3f8ffc5fdc3b53f3b647bbbb09.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_08bc1a3f8ffc5fdc3b53f3b647bbbb09.jpg already downloaded
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F81%252Fcd81c55479d62a759f5006d5891c014c%252Fpa%252FDV69567_7309fbc7aaddb69625f25e0a20c9c0e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_7309fbc7aaddb69625f25e0a20c9c0e4.jpg already downloaded
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F81%252Fcd81c55479d62a759f5006d5891c014c%252Fpa%252FDV69567_339750c8420f88d875821d419b70bac7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_339750c8420f88d875821d419b70bac7.jpg already downloaded
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F81%252Fcd81c55479d62a759f5006d5891c014c%252Fpa%252FDV69567_35f9e0de1a404e9fdd8ec94d366ee6c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_35f9e0de1a404e9fdd8ec94d366ee6c9.jpg already downloaded
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F81%252Fcd81c55479d62a759f5006d5891c014c%252Fpa%252FDV69567_b7faabffe95205813542cb284a13ac07.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_b7faabffe95205813542cb284a13ac07.jpg already downloaded
2026-03-30 10:45:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30b8ddd0-2e58-5d47-81a7-eccba4137c10, identifier: DV69567
2026-03-30 10:45:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30b8ddd0-2e58-5d47-81a7-eccba4137c10 with identifier: DV69567
2026-03-30 10:45:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30b8ddd0-2e58-5d47-81a7-eccba4137c10 with identifier: DV69567
2026-03-30 10:45:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30b8ddd0-2e58-5d47-81a7-eccba4137c10 with identifier: DV69567 to the API
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DV69567>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:58:37Z',
 'fuel_type': 'petrol',
 'id': '30b8ddd0-2e58-5d47-81a7-eccba4137c10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV69567',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 20440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_21172918d9750f5fde08fd1ee365e82e.jpg',
                'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_0c23e224b474455b269d6b5fe121ee94.jpg',
                'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_21d07f704a887593ee4e2dacf39d8a88.jpg',
                'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_f52eadd7ef0f78f6c485ee18b1876896.jpg',
                'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_15c6e6337d6cf9fa7c5f8ca8ca980911.jpg',
                'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_08bc1a3f8ffc5fdc3b53f3b647bbbb09.jpg',
                'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_7309fbc7aaddb69625f25e0a20c9c0e4.jpg',
                'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_339750c8420f88d875821d419b70bac7.jpg',
                'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_35f9e0de1a404e9fdd8ec94d366ee6c9.jpg',
                'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_b7faabffe95205813542cb284a13ac07.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b8ddd0-2e58-5d47-81a7-eccba4137c10/30b8ddd0-2e58-5d47-81a7-eccba4137c10_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2274173,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_21172918d9750f5fde08fd1ee365e82e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b8ddd0-2e58-5d47-81a7-eccba4137c10/30b8ddd0-2e58-5d47-81a7-eccba4137c10_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_0c23e224b474455b269d6b5fe121ee94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b8ddd0-2e58-5d47-81a7-eccba4137c10/30b8ddd0-2e58-5d47-81a7-eccba4137c10_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2324403,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_21d07f704a887593ee4e2dacf39d8a88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b8ddd0-2e58-5d47-81a7-eccba4137c10/30b8ddd0-2e58-5d47-81a7-eccba4137c10_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_f52eadd7ef0f78f6c485ee18b1876896.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b8ddd0-2e58-5d47-81a7-eccba4137c10/30b8ddd0-2e58-5d47-81a7-eccba4137c10_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2318227,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_15c6e6337d6cf9fa7c5f8ca8ca980911.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b8ddd0-2e58-5d47-81a7-eccba4137c10/30b8ddd0-2e58-5d47-81a7-eccba4137c10_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2317036,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_08bc1a3f8ffc5fdc3b53f3b647bbbb09.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b8ddd0-2e58-5d47-81a7-eccba4137c10/30b8ddd0-2e58-5d47-81a7-eccba4137c10_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_7309fbc7aaddb69625f25e0a20c9c0e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b8ddd0-2e58-5d47-81a7-eccba4137c10/30b8ddd0-2e58-5d47-81a7-eccba4137c10_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2307168,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_339750c8420f88d875821d419b70bac7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b8ddd0-2e58-5d47-81a7-eccba4137c10/30b8ddd0-2e58-5d47-81a7-eccba4137c10_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_35f9e0de1a404e9fdd8ec94d366ee6c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30b8ddd0-2e58-5d47-81a7-eccba4137c10/30b8ddd0-2e58-5d47-81a7-eccba4137c10_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/81/cd81c55479d62a759f5006d5891c014c/pa/DV69567_b7faabffe95205813542cb284a13ac07.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2021}
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV69567%27 HTTP/1.1" 200 None
2026-03-30 10:45:03 [auto1.de] INFO: Saving data for DV69567: {'created_time': 1774867503.504719, 'last_price_update_time': 1774867503.504732, 'auction_closing_time': 1774972717.0}
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV69567') HTTP/1.1" 204 0
2026-03-30 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_f78d8ea8cf97b73bb557ed12437a351c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a43410>
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd4c213-8e9c-5164-be81-600c722dba3e/5bd4c213-8e9c-5164-be81-600c722dba3e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F97%252F36972d9310833f487e5c0eca30fbd599%252Fpa%252FMN14132_d84aa0b90b7faf97c1110fbce379db13.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_d84aa0b90b7faf97c1110fbce379db13.jpg saved to cache
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5bd4c213-8e9c-5164-be81-600c722dba3e
2026-03-30 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_84ce242c3a4dcafde02acd100e340112.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a776d0>
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd4c213-8e9c-5164-be81-600c722dba3e/5bd4c213-8e9c-5164-be81-600c722dba3e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F97%252F36972d9310833f487e5c0eca30fbd599%252Fpa%252FMN14132_f78d8ea8cf97b73bb557ed12437a351c.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_f78d8ea8cf97b73bb557ed12437a351c.jpg saved to cache
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5bd4c213-8e9c-5164-be81-600c722dba3e
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b33c90>
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd4c213-8e9c-5164-be81-600c722dba3e/5bd4c213-8e9c-5164-be81-600c722dba3e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F97%252F36972d9310833f487e5c0eca30fbd599%252Fpa%252FMN14132_84ce242c3a4dcafde02acd100e340112.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_84ce242c3a4dcafde02acd100e340112.jpg saved to cache
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5bd4c213-8e9c-5164-be81-600c722dba3e
2026-03-30 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_d5dd0233d99b4e321a99e496b56940f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_f9373a13490dfb9d7682247bdb158a54.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eb6310>
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd4c213-8e9c-5164-be81-600c722dba3e/5bd4c213-8e9c-5164-be81-600c722dba3e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F97%252F36972d9310833f487e5c0eca30fbd599%252Fpa%252FMN14132_d5dd0233d99b4e321a99e496b56940f0.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_d5dd0233d99b4e321a99e496b56940f0.jpg saved to cache
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5bd4c213-8e9c-5164-be81-600c722dba3e
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a67350>
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd4c213-8e9c-5164-be81-600c722dba3e/5bd4c213-8e9c-5164-be81-600c722dba3e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F97%252F36972d9310833f487e5c0eca30fbd599%252Fpa%252FMN14132_f9373a13490dfb9d7682247bdb158a54.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_f9373a13490dfb9d7682247bdb158a54.jpg saved to cache
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5bd4c213-8e9c-5164-be81-600c722dba3e
2026-03-30 10:45:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bd4c213-8e9c-5164-be81-600c722dba3e, skipping ID generation
2026-03-30 10:45:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bd4c213-8e9c-5164-be81-600c722dba3e with scrape type 1
2026-03-30 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5bd4c213-8e9c-5164-be81-600c722dba3e sending to next pipeline
2026-03-30 10:45:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bd4c213-8e9c-5164-be81-600c722dba3e, identifier: MN14132
2026-03-30 10:45:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bd4c213-8e9c-5164-be81-600c722dba3e with identifier: MN14132
2026-03-30 10:45:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bd4c213-8e9c-5164-be81-600c722dba3e with identifier: MN14132
2026-03-30 10:45:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bd4c213-8e9c-5164-be81-600c722dba3e with identifier: MN14132 to the API
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_f9373a13490dfb9d7682247bdb158a54.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:53:52Z',
 'fuel_type': 'petrol',
 'id': '5bd4c213-8e9c-5164-be81-600c722dba3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN14132',
 'listing': 'auction',
 'location': 'DE, Oldenburg',
 'make': 'Citroen',
 'model': 'C3 Pluriel',
 'odometer': 108853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd4c213-8e9c-5164-be81-600c722dba3e/5bd4c213-8e9c-5164-be81-600c722dba3e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_f9373a13490dfb9d7682247bdb158a54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd4c213-8e9c-5164-be81-600c722dba3e/5bd4c213-8e9c-5164-be81-600c722dba3e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_d5dd0233d99b4e321a99e496b56940f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd4c213-8e9c-5164-be81-600c722dba3e/5bd4c213-8e9c-5164-be81-600c722dba3e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_84ce242c3a4dcafde02acd100e340112.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd4c213-8e9c-5164-be81-600c722dba3e/5bd4c213-8e9c-5164-be81-600c722dba3e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_f78d8ea8cf97b73bb557ed12437a351c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd4c213-8e9c-5164-be81-600c722dba3e/5bd4c213-8e9c-5164-be81-600c722dba3e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/97/36972d9310833f487e5c0eca30fbd599/pa/MN14132_d84aa0b90b7faf97c1110fbce379db13.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Citroen C3 Pluriel 1.6 Charleston',
 'transmission': 'automatic',
 'trim': 'Charleston',
 'year': 2010}
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN14132%27 HTTP/1.1" 200 None
2026-03-30 10:45:04 [auto1.de] INFO: Saving data for MN14132: {'created_time': 1774867504.608571, 'last_price_update_time': 1774867504.608582, 'auction_closing_time': 1774972432.0}
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN14132') HTTP/1.1" 204 0
2026-03-30 10:45:04 [scrapy.extensions.logstats] INFO: Crawled 386 pages (at 48 pages/min), scraped 297 items (at 40 items/min)
2026-03-30 10:45:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-30 10:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DH22433> (referer: https://www.auto1.com/v1/car-details-view/DH22433/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04e6711c-055f-5bdd-a793-e74499781aab with identifier: DH22433
2026-03-30 10:45:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04e6711c-055f-5bdd-a793-e74499781aab with scrape type 1
2026-03-30 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04e6711c-055f-5bdd-a793-e74499781aab
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_18402ca396d91ae856f0c686e0b1c838.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_18402ca396d91ae856f0c686e0b1c838.jpg not downloaded yet
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_34ebc0edf22013c66fd2696d333cc654.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_34ebc0edf22013c66fd2696d333cc654.jpg not downloaded yet
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_c13003e1ef37a56fb3c227c0d2872f40.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_c13003e1ef37a56fb3c227c0d2872f40.jpg not downloaded yet
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_a825ef605a759b0995f9329fc6530c07.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_a825ef605a759b0995f9329fc6530c07.jpg not downloaded yet
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_bbc1dbe858fd0237681f02622b9a97be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_bbc1dbe858fd0237681f02622b9a97be.jpg not downloaded yet
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_fc96bf8f4fc81936c8b7fd8247e6feb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_fc96bf8f4fc81936c8b7fd8247e6feb5.jpg not downloaded yet
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_46233b2b14d0aba4f921c7632c178655.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_46233b2b14d0aba4f921c7632c178655.jpg not downloaded yet
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_2895d328ef6049e41e1953043713d1cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_2895d328ef6049e41e1953043713d1cc.jpg not downloaded yet
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_a1c4e472a8125a8b4e10cc4d75b45e59.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_a1c4e472a8125a8b4e10cc4d75b45e59.jpg not downloaded yet
2026-03-30 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_03d9b69c6dd2d38e0463f5552fd3392a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_03d9b69c6dd2d38e0463f5552fd3392a.jpg not downloaded yet
2026-03-30 10:45:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU42545> (referer: https://www.auto1.com/v1/car-details-view/EU42545/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_03d9b69c6dd2d38e0463f5552fd3392a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91cf8db3-4db5-5777-a69a-ff3fcba6482d with identifier: EU42545
2026-03-30 10:45:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91cf8db3-4db5-5777-a69a-ff3fcba6482d with scrape type 1
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91cf8db3-4db5-5777-a69a-ff3fcba6482d
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_3851ff8f7290bb4201b04e80fe4a9408.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_3851ff8f7290bb4201b04e80fe4a9408.jpg not downloaded yet
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_5305f95b8f9eb31906827eab834952ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_5305f95b8f9eb31906827eab834952ab.jpg not downloaded yet
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_71cbf99e3fb190ab069b73fde91e2ca5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_71cbf99e3fb190ab069b73fde91e2ca5.jpg not downloaded yet
2026-03-30 10:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_a1c4e472a8125a8b4e10cc4d75b45e59.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_7ddea49a366d9bd690f41766b006dd08.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_7ddea49a366d9bd690f41766b006dd08.jpg not downloaded yet
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_0d77663b62f72f1f5e7237ebcf70a554.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_0d77663b62f72f1f5e7237ebcf70a554.jpg not downloaded yet
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_6ce56391cf9050b4b2f377f403c3c58f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_6ce56391cf9050b4b2f377f403c3c58f.jpg not downloaded yet
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a37b90>
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_03d9b69c6dd2d38e0463f5552fd3392a.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_03d9b69c6dd2d38e0463f5552fd3392a.jpg saved to cache
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 04e6711c-055f-5bdd-a793-e74499781aab
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_5603f72249318bc6f70dd122775139b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_5603f72249318bc6f70dd122775139b8.jpg not downloaded yet
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_bb2a04b49609be0057c649a387370ec7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_bb2a04b49609be0057c649a387370ec7.jpg not downloaded yet
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_b70c73ae6d928df84b1397b9d3621cb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_b70c73ae6d928df84b1397b9d3621cb9.jpg not downloaded yet
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee5d90>
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_a1c4e472a8125a8b4e10cc4d75b45e59.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_a1c4e472a8125a8b4e10cc4d75b45e59.jpg saved to cache
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 04e6711c-055f-5bdd-a793-e74499781aab
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_7c6a563e82c1687786233472a3fd41b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_7c6a563e82c1687786233472a3fd41b7.jpg not downloaded yet
2026-03-30 10:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_5305f95b8f9eb31906827eab834952ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_b70c73ae6d928df84b1397b9d3621cb9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0f990>
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_5305f95b8f9eb31906827eab834952ab.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_5305f95b8f9eb31906827eab834952ab.jpg saved to cache
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91cf8db3-4db5-5777-a69a-ff3fcba6482d
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eb6290>
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_b70c73ae6d928df84b1397b9d3621cb9.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_b70c73ae6d928df84b1397b9d3621cb9.jpg saved to cache
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91cf8db3-4db5-5777-a69a-ff3fcba6482d
2026-03-30 10:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_7c6a563e82c1687786233472a3fd41b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_bb2a04b49609be0057c649a387370ec7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b1e50>
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_7c6a563e82c1687786233472a3fd41b7.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_7c6a563e82c1687786233472a3fd41b7.jpg saved to cache
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91cf8db3-4db5-5777-a69a-ff3fcba6482d
2026-03-30 10:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_5603f72249318bc6f70dd122775139b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dfa890>
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_bb2a04b49609be0057c649a387370ec7.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_bb2a04b49609be0057c649a387370ec7.jpg saved to cache
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91cf8db3-4db5-5777-a69a-ff3fcba6482d
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f09b90>
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_5603f72249318bc6f70dd122775139b8.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_5603f72249318bc6f70dd122775139b8.jpg saved to cache
2026-03-30 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91cf8db3-4db5-5777-a69a-ff3fcba6482d
2026-03-30 10:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_6ce56391cf9050b4b2f377f403c3c58f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_0d77663b62f72f1f5e7237ebcf70a554.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b0a850>
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_6ce56391cf9050b4b2f377f403c3c58f.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_6ce56391cf9050b4b2f377f403c3c58f.jpg saved to cache
2026-03-30 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91cf8db3-4db5-5777-a69a-ff3fcba6482d
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eb49d0>
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_0d77663b62f72f1f5e7237ebcf70a554.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_0d77663b62f72f1f5e7237ebcf70a554.jpg saved to cache
2026-03-30 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91cf8db3-4db5-5777-a69a-ff3fcba6482d
2026-03-30 10:45:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_7ddea49a366d9bd690f41766b006dd08.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a33f50>
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_7ddea49a366d9bd690f41766b006dd08.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_7ddea49a366d9bd690f41766b006dd08.jpg saved to cache
2026-03-30 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91cf8db3-4db5-5777-a69a-ff3fcba6482d
2026-03-30 10:45:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_71cbf99e3fb190ab069b73fde91e2ca5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_3851ff8f7290bb4201b04e80fe4a9408.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5092890>
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_71cbf99e3fb190ab069b73fde91e2ca5.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_71cbf99e3fb190ab069b73fde91e2ca5.jpg saved to cache
2026-03-30 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91cf8db3-4db5-5777-a69a-ff3fcba6482d
2026-03-30 10:45:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_2895d328ef6049e41e1953043713d1cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE05713> (referer: https://www.auto1.com/v1/car-details-view/XE05713/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a30990>
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1e%252Fb71ec60f588964b57cec1451e8593423%252Fpa%252FEU42545_3851ff8f7290bb4201b04e80fe4a9408.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_3851ff8f7290bb4201b04e80fe4a9408.jpg saved to cache
2026-03-30 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91cf8db3-4db5-5777-a69a-ff3fcba6482d
2026-03-30 10:45:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91cf8db3-4db5-5777-a69a-ff3fcba6482d, skipping ID generation
2026-03-30 10:45:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91cf8db3-4db5-5777-a69a-ff3fcba6482d with scrape type 1
2026-03-30 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91cf8db3-4db5-5777-a69a-ff3fcba6482d sending to next pipeline
2026-03-30 10:45:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91cf8db3-4db5-5777-a69a-ff3fcba6482d, identifier: EU42545
2026-03-30 10:45:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91cf8db3-4db5-5777-a69a-ff3fcba6482d with identifier: EU42545
2026-03-30 10:45:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91cf8db3-4db5-5777-a69a-ff3fcba6482d with identifier: EU42545
2026-03-30 10:45:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91cf8db3-4db5-5777-a69a-ff3fcba6482d with identifier: EU42545 to the API
2026-03-30 10:45:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_3851ff8f7290bb4201b04e80fe4a9408.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:31:24Z',
 'fuel_type': 'petrol',
 'id': '91cf8db3-4db5-5777-a69a-ff3fcba6482d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU42545',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'BMW',
 'model': '1er',
 'odometer': 97456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_3851ff8f7290bb4201b04e80fe4a9408.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_5305f95b8f9eb31906827eab834952ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_71cbf99e3fb190ab069b73fde91e2ca5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_7ddea49a366d9bd690f41766b006dd08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_0d77663b62f72f1f5e7237ebcf70a554.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_6ce56391cf9050b4b2f377f403c3c58f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_5603f72249318bc6f70dd122775139b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_bb2a04b49609be0057c649a387370ec7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_b70c73ae6d928df84b1397b9d3621cb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cf8db3-4db5-5777-a69a-ff3fcba6482d/91cf8db3-4db5-5777-a69a-ff3fcba6482d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1e/b71ec60f588964b57cec1451e8593423/pa/EU42545_7c6a563e82c1687786233472a3fd41b7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU42545%27 HTTP/1.1" 200 None
2026-03-30 10:45:10 [auto1.de] INFO: Saving data for EU42545: {'created_time': 1774867510.144798, 'last_price_update_time': 1774867510.14481, 'auction_closing_time': 1774971084.0}
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU42545') HTTP/1.1" 204 0
2026-03-30 10:45:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_fc96bf8f4fc81936c8b7fd8247e6feb5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_46233b2b14d0aba4f921c7632c178655.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2f010>
2026-03-30 10:45:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_2895d328ef6049e41e1953043713d1cc.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_2895d328ef6049e41e1953043713d1cc.jpg saved to cache
2026-03-30 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 04e6711c-055f-5bdd-a793-e74499781aab
2026-03-30 10:45:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89ca2d81-96e3-5037-9957-f0bfda6b8ba3 with identifier: XE05713
2026-03-30 10:45:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89ca2d81-96e3-5037-9957-f0bfda6b8ba3 with scrape type 1
2026-03-30 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89ca2d81-96e3-5037-9957-f0bfda6b8ba3
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F59%252F1b59bea03a1a8f4eab83698ae4dffbdb%252Fpa%252FXE05713_0f1773d0216373d66e86ff25fc5ed537.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_0f1773d0216373d66e86ff25fc5ed537.jpg already downloaded
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F59%252F1b59bea03a1a8f4eab83698ae4dffbdb%252Fpa%252FXE05713_15afc0a35a18ba1322ab404b729596b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_15afc0a35a18ba1322ab404b729596b2.jpg already downloaded
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F59%252F1b59bea03a1a8f4eab83698ae4dffbdb%252Fpa%252FXE05713_bef1250a222e5c1e6934d00423d9a1d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_bef1250a222e5c1e6934d00423d9a1d2.jpg already downloaded
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F59%252F1b59bea03a1a8f4eab83698ae4dffbdb%252Fpa%252FXE05713_218baea02aa8b9932060676cb98a2fa7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_218baea02aa8b9932060676cb98a2fa7.jpg already downloaded
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F59%252F1b59bea03a1a8f4eab83698ae4dffbdb%252Fpa%252FXE05713_c7e7ee5e70e1b976eea8fdb1458119fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_c7e7ee5e70e1b976eea8fdb1458119fe.jpg already downloaded
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F59%252F1b59bea03a1a8f4eab83698ae4dffbdb%252Fpa%252FXE05713_4ff2fff23a954983e9a7b91eb1f0833d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_4ff2fff23a954983e9a7b91eb1f0833d.jpg already downloaded
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F59%252F1b59bea03a1a8f4eab83698ae4dffbdb%252Fpa%252FXE05713_ea4bd935c55a42d6051620dda8869a79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_ea4bd935c55a42d6051620dda8869a79.jpg already downloaded
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F59%252F1b59bea03a1a8f4eab83698ae4dffbdb%252Fpa%252FXE05713_bd9953920187d886983bcd0641d1b8eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_bd9953920187d886983bcd0641d1b8eb.jpg already downloaded
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F59%252F1b59bea03a1a8f4eab83698ae4dffbdb%252Fpa%252FXE05713_267574e0baf054dcd642f097a8ba201c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_267574e0baf054dcd642f097a8ba201c.jpg already downloaded
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F59%252F1b59bea03a1a8f4eab83698ae4dffbdb%252Fpa%252FXE05713_89a8dc449d1d7e7822172d9dc63ca6d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_89a8dc449d1d7e7822172d9dc63ca6d3.jpg already downloaded
2026-03-30 10:45:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89ca2d81-96e3-5037-9957-f0bfda6b8ba3, identifier: XE05713
2026-03-30 10:45:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89ca2d81-96e3-5037-9957-f0bfda6b8ba3 with identifier: XE05713
2026-03-30 10:45:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89ca2d81-96e3-5037-9957-f0bfda6b8ba3 with identifier: XE05713
2026-03-30 10:45:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89ca2d81-96e3-5037-9957-f0bfda6b8ba3 with identifier: XE05713 to the API
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XE05713>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:53:28Z',
 'fuel_type': 'petrol',
 'id': '89ca2d81-96e3-5037-9957-f0bfda6b8ba3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE05713',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 59130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_0f1773d0216373d66e86ff25fc5ed537.jpg',
                'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_15afc0a35a18ba1322ab404b729596b2.jpg',
                'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_bef1250a222e5c1e6934d00423d9a1d2.jpg',
                'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_218baea02aa8b9932060676cb98a2fa7.jpg',
                'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_c7e7ee5e70e1b976eea8fdb1458119fe.jpg',
                'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_4ff2fff23a954983e9a7b91eb1f0833d.jpg',
                'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_ea4bd935c55a42d6051620dda8869a79.jpg',
                'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_bd9953920187d886983bcd0641d1b8eb.jpg',
                'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_267574e0baf054dcd642f097a8ba201c.jpg',
                'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_89a8dc449d1d7e7822172d9dc63ca6d3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89ca2d81-96e3-5037-9957-f0bfda6b8ba3/89ca2d81-96e3-5037-9957-f0bfda6b8ba3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2526340,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_0f1773d0216373d66e86ff25fc5ed537.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89ca2d81-96e3-5037-9957-f0bfda6b8ba3/89ca2d81-96e3-5037-9957-f0bfda6b8ba3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_15afc0a35a18ba1322ab404b729596b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89ca2d81-96e3-5037-9957-f0bfda6b8ba3/89ca2d81-96e3-5037-9957-f0bfda6b8ba3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2507975,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_bef1250a222e5c1e6934d00423d9a1d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89ca2d81-96e3-5037-9957-f0bfda6b8ba3/89ca2d81-96e3-5037-9957-f0bfda6b8ba3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2343965,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_218baea02aa8b9932060676cb98a2fa7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89ca2d81-96e3-5037-9957-f0bfda6b8ba3/89ca2d81-96e3-5037-9957-f0bfda6b8ba3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_c7e7ee5e70e1b976eea8fdb1458119fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89ca2d81-96e3-5037-9957-f0bfda6b8ba3/89ca2d81-96e3-5037-9957-f0bfda6b8ba3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_4ff2fff23a954983e9a7b91eb1f0833d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89ca2d81-96e3-5037-9957-f0bfda6b8ba3/89ca2d81-96e3-5037-9957-f0bfda6b8ba3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_ea4bd935c55a42d6051620dda8869a79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89ca2d81-96e3-5037-9957-f0bfda6b8ba3/89ca2d81-96e3-5037-9957-f0bfda6b8ba3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_bd9953920187d886983bcd0641d1b8eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89ca2d81-96e3-5037-9957-f0bfda6b8ba3/89ca2d81-96e3-5037-9957-f0bfda6b8ba3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2522081,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_267574e0baf054dcd642f097a8ba201c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89ca2d81-96e3-5037-9957-f0bfda6b8ba3/89ca2d81-96e3-5037-9957-f0bfda6b8ba3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/59/1b59bea03a1a8f4eab83698ae4dffbdb/pa/XE05713_89a8dc449d1d7e7822172d9dc63ca6d3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05713%27 HTTP/1.1" 200 None
2026-03-30 10:45:11 [auto1.de] INFO: Saving data for XE05713: {'created_time': 1774867511.040516, 'last_price_update_time': 1774867511.040526, 'auction_closing_time': 1774972408.0}
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE05713') HTTP/1.1" 204 0
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da1890>
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_fc96bf8f4fc81936c8b7fd8247e6feb5.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_fc96bf8f4fc81936c8b7fd8247e6feb5.jpg saved to cache
2026-03-30 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 04e6711c-055f-5bdd-a793-e74499781aab
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b0bc50>
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_46233b2b14d0aba4f921c7632c178655.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_46233b2b14d0aba4f921c7632c178655.jpg saved to cache
2026-03-30 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 04e6711c-055f-5bdd-a793-e74499781aab
2026-03-30 10:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_a825ef605a759b0995f9329fc6530c07.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b1450>
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_a825ef605a759b0995f9329fc6530c07.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_a825ef605a759b0995f9329fc6530c07.jpg saved to cache
2026-03-30 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 04e6711c-055f-5bdd-a793-e74499781aab
2026-03-30 10:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_bbc1dbe858fd0237681f02622b9a97be.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_c13003e1ef37a56fb3c227c0d2872f40.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f2490>
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_bbc1dbe858fd0237681f02622b9a97be.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_bbc1dbe858fd0237681f02622b9a97be.jpg saved to cache
2026-03-30 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 04e6711c-055f-5bdd-a793-e74499781aab
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f1610>
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_c13003e1ef37a56fb3c227c0d2872f40.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_c13003e1ef37a56fb3c227c0d2872f40.jpg saved to cache
2026-03-30 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04e6711c-055f-5bdd-a793-e74499781aab
2026-03-30 10:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_34ebc0edf22013c66fd2696d333cc654.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_18402ca396d91ae856f0c686e0b1c838.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e44750>
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_34ebc0edf22013c66fd2696d333cc654.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_34ebc0edf22013c66fd2696d333cc654.jpg saved to cache
2026-03-30 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 04e6711c-055f-5bdd-a793-e74499781aab
2026-03-30 10:45:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 10:45:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00\xd8\x00\x00\x00\x01'
2026-03-30 10:45:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00\xd8\x00\x00\x00\x01'
2026-03-30 10:45:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 10:45:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8dc10>
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fdb%252Ffbdb9e6c6663332655f6a99bc2c99be7%252Fpa%252FDH22433_18402ca396d91ae856f0c686e0b1c838.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_18402ca396d91ae856f0c686e0b1c838.jpg saved to cache
2026-03-30 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04e6711c-055f-5bdd-a793-e74499781aab
2026-03-30 10:45:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04e6711c-055f-5bdd-a793-e74499781aab, skipping ID generation
2026-03-30 10:45:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04e6711c-055f-5bdd-a793-e74499781aab with scrape type 1
2026-03-30 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 04e6711c-055f-5bdd-a793-e74499781aab sending to next pipeline
2026-03-30 10:45:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04e6711c-055f-5bdd-a793-e74499781aab, identifier: DH22433
2026-03-30 10:45:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04e6711c-055f-5bdd-a793-e74499781aab with identifier: DH22433
2026-03-30 10:45:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04e6711c-055f-5bdd-a793-e74499781aab with identifier: DH22433
2026-03-30 10:45:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04e6711c-055f-5bdd-a793-e74499781aab with identifier: DH22433 to the API
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_18402ca396d91ae856f0c686e0b1c838.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:35:37Z',
 'fuel_type': 'diesel',
 'id': '04e6711c-055f-5bdd-a793-e74499781aab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH22433',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 72251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1279986,
             'Height': 885,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_18402ca396d91ae856f0c686e0b1c838.jpg',
             'Width': 1179},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_34ebc0edf22013c66fd2696d333cc654.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_c13003e1ef37a56fb3c227c0d2872f40.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_a825ef605a759b0995f9329fc6530c07.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_bbc1dbe858fd0237681f02622b9a97be.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_fc96bf8f4fc81936c8b7fd8247e6feb5.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_46233b2b14d0aba4f921c7632c178655.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_2895d328ef6049e41e1953043713d1cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_a1c4e472a8125a8b4e10cc4d75b45e59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e6711c-055f-5bdd-a793-e74499781aab/04e6711c-055f-5bdd-a793-e74499781aab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/db/fbdb9e6c6663332655f6a99bc2c99be7/pa/DH22433_03d9b69c6dd2d38e0463f5552fd3392a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 109 CDI Extralang',
 'transmission': 'manual',
 'trim': 'Extralang',
 'year': 2020}
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH22433%27 HTTP/1.1" 200 None
2026-03-30 10:45:12 [auto1.de] INFO: Saving data for DH22433: {'created_time': 1774867512.248427, 'last_price_update_time': 1774867512.248438, 'auction_closing_time': 1774971337.0}
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH22433') HTTP/1.1" 204 0
2026-03-30 10:45:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF66532> (referer: https://www.auto1.com/v1/car-details-view/AF66532/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcffda4e-d562-5026-ac4b-223f948a7b7c with identifier: AF66532
2026-03-30 10:45:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcffda4e-d562-5026-ac4b-223f948a7b7c with scrape type 1
2026-03-30 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcffda4e-d562-5026-ac4b-223f948a7b7c
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_ecb632bf9ac640bb829fa1cb97a99f71.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_ecb632bf9ac640bb829fa1cb97a99f71.jpg not downloaded yet
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_8d9d400713c7da7a76d8168f2d8abf26.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_8d9d400713c7da7a76d8168f2d8abf26.jpg not downloaded yet
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_7b1561d4ffce364f4ea478259768a1ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_7b1561d4ffce364f4ea478259768a1ea.jpg not downloaded yet
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_c5164f292821dcf3bf93a09e4118c294.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_c5164f292821dcf3bf93a09e4118c294.jpg not downloaded yet
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_9e339151bcbed317b6f9cd2669081f20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_9e339151bcbed317b6f9cd2669081f20.jpg not downloaded yet
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_ee2f4dd088b5e5132420db49b972df39.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_ee2f4dd088b5e5132420db49b972df39.jpg not downloaded yet
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_9ec14cd1454f3e7ae00efa985dcb3dca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_9ec14cd1454f3e7ae00efa985dcb3dca.jpg not downloaded yet
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_1b436506e2e5b124797f11abc12171ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_1b436506e2e5b124797f11abc12171ee.jpg not downloaded yet
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_5c44d8b89872f43e64e0458f914292bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_5c44d8b89872f43e64e0458f914292bf.jpg not downloaded yet
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_3336010a0aa46736fb3116af16f2ca0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_3336010a0aa46736fb3116af16f2ca0d.jpg not downloaded yet
2026-03-30 10:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS16596> (referer: https://www.auto1.com/v1/car-details-view/WS16596/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a0fef32-1278-50e7-9b7a-d968eb54f2c0 with identifier: WS16596
2026-03-30 10:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a0fef32-1278-50e7-9b7a-d968eb54f2c0 with scrape type 1
2026-03-30 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a0fef32-1278-50e7-9b7a-d968eb54f2c0
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F20%252F2920b4587004d1e0a11a055e9ff132fa%252Fpa%252FWS16596_a7a58df615c9e1d0160412dccd092e56.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_a7a58df615c9e1d0160412dccd092e56.jpg already downloaded
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F20%252F2920b4587004d1e0a11a055e9ff132fa%252Fpa%252FWS16596_bdc4527dc894395664ba8fb09bfd83d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_bdc4527dc894395664ba8fb09bfd83d4.jpg already downloaded
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F20%252F2920b4587004d1e0a11a055e9ff132fa%252Fpa%252FWS16596_ab891d3d31614b30c0fb214b555bcaed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_ab891d3d31614b30c0fb214b555bcaed.jpg already downloaded
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F20%252F2920b4587004d1e0a11a055e9ff132fa%252Fpa%252FWS16596_40ec3f4d7310ce437c6dcd8e9d64f539.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_40ec3f4d7310ce437c6dcd8e9d64f539.jpg already downloaded
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F20%252F2920b4587004d1e0a11a055e9ff132fa%252Fpa%252FWS16596_3894f39e013addc0ff6bc03d7601807e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_3894f39e013addc0ff6bc03d7601807e.jpg already downloaded
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F20%252F2920b4587004d1e0a11a055e9ff132fa%252Fpa%252FWS16596_be7c4e0d159d80ab98c500ef02ac8778.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_be7c4e0d159d80ab98c500ef02ac8778.jpg already downloaded
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F20%252F2920b4587004d1e0a11a055e9ff132fa%252Fpa%252FWS16596_ff162b680cb91ef6953a1e4d2eb8a6db.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_ff162b680cb91ef6953a1e4d2eb8a6db.jpg already downloaded
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F20%252F2920b4587004d1e0a11a055e9ff132fa%252Fpa%252FWS16596_28d6242e53ce07a18270eafa5c2ce9dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_28d6242e53ce07a18270eafa5c2ce9dd.jpg already downloaded
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F20%252F2920b4587004d1e0a11a055e9ff132fa%252Fpa%252FWS16596_d0df2080b3f88438adb581bc2a452dc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_d0df2080b3f88438adb581bc2a452dc3.jpg already downloaded
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F20%252F2920b4587004d1e0a11a055e9ff132fa%252Fpa%252FWS16596_2da015bae495f8993513ff08ed740981.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_2da015bae495f8993513ff08ed740981.jpg already downloaded
2026-03-30 10:45:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a0fef32-1278-50e7-9b7a-d968eb54f2c0, identifier: WS16596
2026-03-30 10:45:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a0fef32-1278-50e7-9b7a-d968eb54f2c0 with identifier: WS16596
2026-03-30 10:45:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a0fef32-1278-50e7-9b7a-d968eb54f2c0 with identifier: WS16596
2026-03-30 10:45:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a0fef32-1278-50e7-9b7a-d968eb54f2c0 with identifier: WS16596 to the API
2026-03-30 10:45:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WS16596>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:16:05Z',
 'fuel_type': 'petrol',
 'id': '5a0fef32-1278-50e7-9b7a-d968eb54f2c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS16596',
 'listing': 'auction',
 'location': 'DE, Kippenheim',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 184322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_a7a58df615c9e1d0160412dccd092e56.jpg',
                'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_bdc4527dc894395664ba8fb09bfd83d4.jpg',
                'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_ab891d3d31614b30c0fb214b555bcaed.jpg',
                'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_40ec3f4d7310ce437c6dcd8e9d64f539.jpg',
                'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_3894f39e013addc0ff6bc03d7601807e.jpg',
                'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_be7c4e0d159d80ab98c500ef02ac8778.jpg',
                'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_ff162b680cb91ef6953a1e4d2eb8a6db.jpg',
                'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_28d6242e53ce07a18270eafa5c2ce9dd.jpg',
                'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_d0df2080b3f88438adb581bc2a452dc3.jpg',
                'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_2da015bae495f8993513ff08ed740981.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0fef32-1278-50e7-9b7a-d968eb54f2c0/5a0fef32-1278-50e7-9b7a-d968eb54f2c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_a7a58df615c9e1d0160412dccd092e56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0fef32-1278-50e7-9b7a-d968eb54f2c0/5a0fef32-1278-50e7-9b7a-d968eb54f2c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_bdc4527dc894395664ba8fb09bfd83d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0fef32-1278-50e7-9b7a-d968eb54f2c0/5a0fef32-1278-50e7-9b7a-d968eb54f2c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_ab891d3d31614b30c0fb214b555bcaed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0fef32-1278-50e7-9b7a-d968eb54f2c0/5a0fef32-1278-50e7-9b7a-d968eb54f2c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_40ec3f4d7310ce437c6dcd8e9d64f539.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0fef32-1278-50e7-9b7a-d968eb54f2c0/5a0fef32-1278-50e7-9b7a-d968eb54f2c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_3894f39e013addc0ff6bc03d7601807e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0fef32-1278-50e7-9b7a-d968eb54f2c0/5a0fef32-1278-50e7-9b7a-d968eb54f2c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_be7c4e0d159d80ab98c500ef02ac8778.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0fef32-1278-50e7-9b7a-d968eb54f2c0/5a0fef32-1278-50e7-9b7a-d968eb54f2c0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_ff162b680cb91ef6953a1e4d2eb8a6db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0fef32-1278-50e7-9b7a-d968eb54f2c0/5a0fef32-1278-50e7-9b7a-d968eb54f2c0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_28d6242e53ce07a18270eafa5c2ce9dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0fef32-1278-50e7-9b7a-d968eb54f2c0/5a0fef32-1278-50e7-9b7a-d968eb54f2c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_d0df2080b3f88438adb581bc2a452dc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0fef32-1278-50e7-9b7a-d968eb54f2c0/5a0fef32-1278-50e7-9b7a-d968eb54f2c0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/20/2920b4587004d1e0a11a055e9ff132fa/pa/WS16596_2da015bae495f8993513ff08ed740981.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Active Start/Stop',
 'transmission': 'automatic',
 'trim': 'Active Start/Stop',
 'year': 2018}
2026-03-30 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS16596%27 HTTP/1.1" 200 None
2026-03-30 10:45:14 [auto1.de] INFO: Saving data for WS16596: {'created_time': 1774867514.195124, 'last_price_update_time': 1774867514.195134, 'auction_closing_time': 1774970165.0}
2026-03-30 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS16596') HTTP/1.1" 204 0
2026-03-30 10:45:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_3336010a0aa46736fb3116af16f2ca0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef501ced0>
2026-03-30 10:45:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_3336010a0aa46736fb3116af16f2ca0d.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_3336010a0aa46736fb3116af16f2ca0d.jpg saved to cache
2026-03-30 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcffda4e-d562-5026-ac4b-223f948a7b7c
2026-03-30 10:45:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_5c44d8b89872f43e64e0458f914292bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c4750>
2026-03-30 10:45:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_5c44d8b89872f43e64e0458f914292bf.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_5c44d8b89872f43e64e0458f914292bf.jpg saved to cache
2026-03-30 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcffda4e-d562-5026-ac4b-223f948a7b7c
2026-03-30 10:45:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_1b436506e2e5b124797f11abc12171ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b22810>
2026-03-30 10:45:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_1b436506e2e5b124797f11abc12171ee.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_1b436506e2e5b124797f11abc12171ee.jpg saved to cache
2026-03-30 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcffda4e-d562-5026-ac4b-223f948a7b7c
2026-03-30 10:45:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_9ec14cd1454f3e7ae00efa985dcb3dca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508ce90>
2026-03-30 10:45:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_9ec14cd1454f3e7ae00efa985dcb3dca.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_9ec14cd1454f3e7ae00efa985dcb3dca.jpg saved to cache
2026-03-30 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcffda4e-d562-5026-ac4b-223f948a7b7c
2026-03-30 10:45:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_ee2f4dd088b5e5132420db49b972df39.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea8990>
2026-03-30 10:45:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_ee2f4dd088b5e5132420db49b972df39.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_ee2f4dd088b5e5132420db49b972df39.jpg saved to cache
2026-03-30 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcffda4e-d562-5026-ac4b-223f948a7b7c
2026-03-30 10:45:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_9e339151bcbed317b6f9cd2669081f20.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5acabd0>
2026-03-30 10:45:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_9e339151bcbed317b6f9cd2669081f20.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_9e339151bcbed317b6f9cd2669081f20.jpg saved to cache
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcffda4e-d562-5026-ac4b-223f948a7b7c
2026-03-30 10:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_c5164f292821dcf3bf93a09e4118c294.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d79c50>
2026-03-30 10:45:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_c5164f292821dcf3bf93a09e4118c294.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_c5164f292821dcf3bf93a09e4118c294.jpg saved to cache
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcffda4e-d562-5026-ac4b-223f948a7b7c
2026-03-30 10:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_7b1561d4ffce364f4ea478259768a1ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595ccd0>
2026-03-30 10:45:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_7b1561d4ffce364f4ea478259768a1ea.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_7b1561d4ffce364f4ea478259768a1ea.jpg saved to cache
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcffda4e-d562-5026-ac4b-223f948a7b7c
2026-03-30 10:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_8d9d400713c7da7a76d8168f2d8abf26.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY77162> (referer: https://www.auto1.com/v1/car-details-view/UY77162/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da3290>
2026-03-30 10:45:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_8d9d400713c7da7a76d8168f2d8abf26.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_8d9d400713c7da7a76d8168f2d8abf26.jpg saved to cache
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcffda4e-d562-5026-ac4b-223f948a7b7c
2026-03-30 10:45:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc1258cf-f7ab-589e-9076-1f676b175d7f with identifier: UY77162
2026-03-30 10:45:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc1258cf-f7ab-589e-9076-1f676b175d7f with scrape type 1
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc1258cf-f7ab-589e-9076-1f676b175d7f
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_62986c43631ed850650ccd35a26a8845.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_62986c43631ed850650ccd35a26a8845.jpg not downloaded yet
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_5428ff27a727a81ed062bd5ff8898ce4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_5428ff27a727a81ed062bd5ff8898ce4.jpg not downloaded yet
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_82c44c4512ee4ba7267063028471fb01.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_82c44c4512ee4ba7267063028471fb01.jpg not downloaded yet
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_9b73d5fd34d1503d404991ad3ffaee09.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_9b73d5fd34d1503d404991ad3ffaee09.jpg not downloaded yet
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_97e4b2615768848ca71c040c3932cc5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_97e4b2615768848ca71c040c3932cc5e.jpg not downloaded yet
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_35f1fa90403be94337bf0fe68565fc46.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_35f1fa90403be94337bf0fe68565fc46.jpg not downloaded yet
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_68627742b858133986e1ed98568a5ee2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_68627742b858133986e1ed98568a5ee2.jpg not downloaded yet
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_b14c1f34eff74a5e1bb6a61e5358ccc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_b14c1f34eff74a5e1bb6a61e5358ccc2.jpg not downloaded yet
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_bd630d796b7a219008ce91fc890cb84b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_bd630d796b7a219008ce91fc890cb84b.jpg not downloaded yet
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_df9c5b4746c2ac1166ed8d079689a5c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_df9c5b4746c2ac1166ed8d079689a5c1.jpg not downloaded yet
2026-03-30 10:45:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_ecb632bf9ac640bb829fa1cb97a99f71.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_df9c5b4746c2ac1166ed8d079689a5c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe1c10>
2026-03-30 10:45:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F81%252Ff98177b31d3b68dd1592c77f799c5a46%252Fpa%252FAF66532_ecb632bf9ac640bb829fa1cb97a99f71.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_ecb632bf9ac640bb829fa1cb97a99f71.jpg saved to cache
2026-03-30 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcffda4e-d562-5026-ac4b-223f948a7b7c
2026-03-30 10:45:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcffda4e-d562-5026-ac4b-223f948a7b7c, skipping ID generation
2026-03-30 10:45:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcffda4e-d562-5026-ac4b-223f948a7b7c with scrape type 1
2026-03-30 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcffda4e-d562-5026-ac4b-223f948a7b7c sending to next pipeline
2026-03-30 10:45:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcffda4e-d562-5026-ac4b-223f948a7b7c, identifier: AF66532
2026-03-30 10:45:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcffda4e-d562-5026-ac4b-223f948a7b7c with identifier: AF66532
2026-03-30 10:45:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcffda4e-d562-5026-ac4b-223f948a7b7c with identifier: AF66532
2026-03-30 10:45:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcffda4e-d562-5026-ac4b-223f948a7b7c with identifier: AF66532 to the API
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_ecb632bf9ac640bb829fa1cb97a99f71.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.4L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:24:10Z',
 'fuel_type': 'diesel',
 'id': 'fcffda4e-d562-5026-ac4b-223f948a7b7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF66532',
 'listing': 'auction',
 'location': 'DE, Aschaffenburg',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 161689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3160986,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_ecb632bf9ac640bb829fa1cb97a99f71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_8d9d400713c7da7a76d8168f2d8abf26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3096329,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_7b1561d4ffce364f4ea478259768a1ea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_c5164f292821dcf3bf93a09e4118c294.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_9e339151bcbed317b6f9cd2669081f20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_ee2f4dd088b5e5132420db49b972df39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3197644,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_9ec14cd1454f3e7ae00efa985dcb3dca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2968298,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_1b436506e2e5b124797f11abc12171ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3135524,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_5c44d8b89872f43e64e0458f914292bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcffda4e-d562-5026-ac4b-223f948a7b7c/fcffda4e-d562-5026-ac4b-223f948a7b7c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/81/f98177b31d3b68dd1592c77f799c5a46/pa/AF66532_3336010a0aa46736fb3116af16f2ca0d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D4 Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2010}
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF66532%27 HTTP/1.1" 200 None
2026-03-30 10:45:17 [auto1.de] INFO: Saving data for AF66532: {'created_time': 1774867517.969904, 'last_price_update_time': 1774867517.969914, 'auction_closing_time': 1774970650.0}
2026-03-30 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF66532') HTTP/1.1" 204 0
2026-03-30 10:45:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595c190>
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_df9c5b4746c2ac1166ed8d079689a5c1.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_df9c5b4746c2ac1166ed8d079689a5c1.jpg saved to cache
2026-03-30 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc1258cf-f7ab-589e-9076-1f676b175d7f
2026-03-30 10:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_bd630d796b7a219008ce91fc890cb84b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5011150>
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_bd630d796b7a219008ce91fc890cb84b.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_bd630d796b7a219008ce91fc890cb84b.jpg saved to cache
2026-03-30 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc1258cf-f7ab-589e-9076-1f676b175d7f
2026-03-30 10:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_b14c1f34eff74a5e1bb6a61e5358ccc2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b35d10>
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_b14c1f34eff74a5e1bb6a61e5358ccc2.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_b14c1f34eff74a5e1bb6a61e5358ccc2.jpg saved to cache
2026-03-30 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc1258cf-f7ab-589e-9076-1f676b175d7f
2026-03-30 10:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_68627742b858133986e1ed98568a5ee2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_35f1fa90403be94337bf0fe68565fc46.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b23150>
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_68627742b858133986e1ed98568a5ee2.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_68627742b858133986e1ed98568a5ee2.jpg saved to cache
2026-03-30 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc1258cf-f7ab-589e-9076-1f676b175d7f
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5acafd0>
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_35f1fa90403be94337bf0fe68565fc46.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_35f1fa90403be94337bf0fe68565fc46.jpg saved to cache
2026-03-30 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc1258cf-f7ab-589e-9076-1f676b175d7f
2026-03-30 10:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_97e4b2615768848ca71c040c3932cc5e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU85166/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe3550>
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_97e4b2615768848ca71c040c3932cc5e.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_97e4b2615768848ca71c040c3932cc5e.jpg saved to cache
2026-03-30 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc1258cf-f7ab-589e-9076-1f676b175d7f
2026-03-30 10:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_9b73d5fd34d1503d404991ad3ffaee09.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_82c44c4512ee4ba7267063028471fb01.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_5428ff27a727a81ed062bd5ff8898ce4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a21c50>
2026-03-30 10:45:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_9b73d5fd34d1503d404991ad3ffaee09.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_9b73d5fd34d1503d404991ad3ffaee09.jpg saved to cache
2026-03-30 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc1258cf-f7ab-589e-9076-1f676b175d7f
2026-03-30 10:45:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a75250>
2026-03-30 10:45:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_82c44c4512ee4ba7267063028471fb01.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_82c44c4512ee4ba7267063028471fb01.jpg saved to cache
2026-03-30 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc1258cf-f7ab-589e-9076-1f676b175d7f
2026-03-30 10:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM46671/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7c10690>
2026-03-30 10:45:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_5428ff27a727a81ed062bd5ff8898ce4.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_5428ff27a727a81ed062bd5ff8898ce4.jpg saved to cache
2026-03-30 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc1258cf-f7ab-589e-9076-1f676b175d7f
2026-03-30 10:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_62986c43631ed850650ccd35a26a8845.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:45:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a751d0>
2026-03-30 10:45:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F34%252F22348e98227478f9937b0e7802a9f69a%252Fpa%252FUY77162_62986c43631ed850650ccd35a26a8845.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_62986c43631ed850650ccd35a26a8845.jpg saved to cache
2026-03-30 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc1258cf-f7ab-589e-9076-1f676b175d7f
2026-03-30 10:45:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc1258cf-f7ab-589e-9076-1f676b175d7f, skipping ID generation
2026-03-30 10:45:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc1258cf-f7ab-589e-9076-1f676b175d7f with scrape type 1
2026-03-30 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc1258cf-f7ab-589e-9076-1f676b175d7f sending to next pipeline
2026-03-30 10:45:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc1258cf-f7ab-589e-9076-1f676b175d7f, identifier: UY77162
2026-03-30 10:45:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc1258cf-f7ab-589e-9076-1f676b175d7f with identifier: UY77162
2026-03-30 10:45:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc1258cf-f7ab-589e-9076-1f676b175d7f with identifier: UY77162
2026-03-30 10:45:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc1258cf-f7ab-589e-9076-1f676b175d7f with identifier: UY77162 to the API
2026-03-30 10:45:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:45:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:45:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_62986c43631ed850650ccd35a26a8845.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:36:11Z',
 'fuel_type': 'petrol',
 'id': 'fc1258cf-f7ab-589e-9076-1f676b175d7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY77162',
 'listing': 'auction',
 'location': 'DE, Gunzenhausen',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 48368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252059,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_62986c43631ed850650ccd35a26a8845.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277310,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_5428ff27a727a81ed062bd5ff8898ce4.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268292,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_82c44c4512ee4ba7267063028471fb01.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_9b73d5fd34d1503d404991ad3ffaee09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239742,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_97e4b2615768848ca71c040c3932cc5e.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_35f1fa90403be94337bf0fe68565fc46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_68627742b858133986e1ed98568a5ee2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_b14c1f34eff74a5e1bb6a61e5358ccc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277656,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_bd630d796b7a219008ce91fc890cb84b.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1258cf-f7ab-589e-9076-1f676b175d7f/fc1258cf-f7ab-589e-9076-1f676b175d7f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240438,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img22/34/22348e98227478f9937b0e7802a9f69a/pa/UY77162_df9c5b4746c2ac1166ed8d079689a5c1.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Picanto 1.2 GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2019}
2026-03-30 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY77162%27 HTTP/1.1" 200 None
2026-03-30 10:45:20 [auto1.de] INFO: Saving data for UY77162: {'created_time': 1774867520.210486, 'last_price_update_time': 1774867520.210496, 'auction_closing_time': 1774971371.0}
2026-03-30 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY77162') HTTP/1.1" 204 0
2026-03-30 10:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AJ81132/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD23421/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB74437/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:23 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.127(s), this was the 1st time calling it.
2026-03-30 10:45:23 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.347401095406071 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PJ55478/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW88873/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RP65650/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE83879> (referer: https://www.auto1.com/v1/car-details-view/GE83879/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a8290f7-3a9c-5662-a12b-e81d3bf919c0 with identifier: GE83879
2026-03-30 10:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a8290f7-3a9c-5662-a12b-e81d3bf919c0 with scrape type 1
2026-03-30 10:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3a8290f7-3a9c-5662-a12b-e81d3bf919c0
2026-03-30 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F0b%252Fc20b0c68b61328d6869f44110df0fdaf%252Fpa%252FGE83879_d00ccd67f6a980e52c8da3ac009fba0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_d00ccd67f6a980e52c8da3ac009fba0a.jpg not downloaded yet
2026-03-30 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F0b%252Fc20b0c68b61328d6869f44110df0fdaf%252Fpa%252FGE83879_2b0f2460e8e22b23c570160c64f91d3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_2b0f2460e8e22b23c570160c64f91d3b.jpg not downloaded yet
2026-03-30 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F0b%252Fc20b0c68b61328d6869f44110df0fdaf%252Fpa%252FGE83879_03d3fffce7f950396d57bec9a7f750d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_03d3fffce7f950396d57bec9a7f750d3.jpg not downloaded yet
2026-03-30 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F0b%252Fc20b0c68b61328d6869f44110df0fdaf%252Fpa%252FGE83879_49d06506e7212093cd9cccce92c1888c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_49d06506e7212093cd9cccce92c1888c.jpg not downloaded yet
2026-03-30 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F0b%252Fc20b0c68b61328d6869f44110df0fdaf%252Fpa%252FGE83879_c8336833f6f48fbc08696aad3898572a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_c8336833f6f48fbc08696aad3898572a.jpg not downloaded yet
2026-03-30 10:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN68320/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_c8336833f6f48fbc08696aad3898572a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0dc10>
2026-03-30 10:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a8290f7-3a9c-5662-a12b-e81d3bf919c0/3a8290f7-3a9c-5662-a12b-e81d3bf919c0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F0b%252Fc20b0c68b61328d6869f44110df0fdaf%252Fpa%252FGE83879_c8336833f6f48fbc08696aad3898572a.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_c8336833f6f48fbc08696aad3898572a.jpg saved to cache
2026-03-30 10:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a8290f7-3a9c-5662-a12b-e81d3bf919c0
2026-03-30 10:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR54418/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:45:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_49d06506e7212093cd9cccce92c1888c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e76990>
2026-03-30 10:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a8290f7-3a9c-5662-a12b-e81d3bf919c0/3a8290f7-3a9c-5662-a12b-e81d3bf919c0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F0b%252Fc20b0c68b61328d6869f44110df0fdaf%252Fpa%252FGE83879_49d06506e7212093cd9cccce92c1888c.jpg') HTTP/1.1" 204 0
2026-03-30 10:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_49d06506e7212093cd9cccce92c1888c.jpg saved to cache
2026-03-30 10:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a8290f7-3a9c-5662-a12b-e81d3bf919c0
2026-03-30 10:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM46671> (referer: https://www.auto1.com/v1/car-details-view/JM46671/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dc094a6-3f66-5d50-bc78-b6c9c05c5565 with identifier: JM46671
2026-03-30 10:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dc094a6-3f66-5d50-bc78-b6c9c05c5565 with scrape type 1
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5dc094a6-3f66-5d50-bc78-b6c9c05c5565
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F22%252Ff522beb29772b129fea774750cebaa72%252Fpa%252FJM46671_11e4711ef06b686a490a299240f63ad2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_11e4711ef06b686a490a299240f63ad2.jpg not downloaded yet
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F22%252Ff522beb29772b129fea774750cebaa72%252Fpa%252FJM46671_e63969cadd55f62cf007209cc8492823.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_e63969cadd55f62cf007209cc8492823.jpg not downloaded yet
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F22%252Ff522beb29772b129fea774750cebaa72%252Fpa%252FJM46671_b30cedfba17002be67a5267561115249.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_b30cedfba17002be67a5267561115249.jpg not downloaded yet
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F22%252Ff522beb29772b129fea774750cebaa72%252Fpa%252FJM46671_66af4698e25375cfa36e8c6bcd27a18a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_66af4698e25375cfa36e8c6bcd27a18a.jpg not downloaded yet
2026-03-30 10:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_03d3fffce7f950396d57bec9a7f750d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F22%252Ff522beb29772b129fea774750cebaa72%252Fpa%252FJM46671_fcf37174c185a1bcea7eb03f145aa119.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_fcf37174c185a1bcea7eb03f145aa119.jpg not downloaded yet
2026-03-30 10:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_66af4698e25375cfa36e8c6bcd27a18a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea9590>
2026-03-30 10:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a8290f7-3a9c-5662-a12b-e81d3bf919c0/3a8290f7-3a9c-5662-a12b-e81d3bf919c0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F0b%252Fc20b0c68b61328d6869f44110df0fdaf%252Fpa%252FGE83879_03d3fffce7f950396d57bec9a7f750d3.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_03d3fffce7f950396d57bec9a7f750d3.jpg saved to cache
2026-03-30 10:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a8290f7-3a9c-5662-a12b-e81d3bf919c0
2026-03-30 10:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_fcf37174c185a1bcea7eb03f145aa119.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe0f90>
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dc094a6-3f66-5d50-bc78-b6c9c05c5565/5dc094a6-3f66-5d50-bc78-b6c9c05c5565_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F22%252Ff522beb29772b129fea774750cebaa72%252Fpa%252FJM46671_66af4698e25375cfa36e8c6bcd27a18a.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_66af4698e25375cfa36e8c6bcd27a18a.jpg saved to cache
2026-03-30 10:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5dc094a6-3f66-5d50-bc78-b6c9c05c5565
2026-03-30 10:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_b30cedfba17002be67a5267561115249.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a77450>
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dc094a6-3f66-5d50-bc78-b6c9c05c5565/5dc094a6-3f66-5d50-bc78-b6c9c05c5565_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F22%252Ff522beb29772b129fea774750cebaa72%252Fpa%252FJM46671_fcf37174c185a1bcea7eb03f145aa119.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_fcf37174c185a1bcea7eb03f145aa119.jpg saved to cache
2026-03-30 10:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5dc094a6-3f66-5d50-bc78-b6c9c05c5565
2026-03-30 10:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_e63969cadd55f62cf007209cc8492823.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a210d0>
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dc094a6-3f66-5d50-bc78-b6c9c05c5565/5dc094a6-3f66-5d50-bc78-b6c9c05c5565_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F22%252Ff522beb29772b129fea774750cebaa72%252Fpa%252FJM46671_b30cedfba17002be67a5267561115249.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_b30cedfba17002be67a5267561115249.jpg saved to cache
2026-03-30 10:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5dc094a6-3f66-5d50-bc78-b6c9c05c5565
2026-03-30 10:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_11e4711ef06b686a490a299240f63ad2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5106a50>
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dc094a6-3f66-5d50-bc78-b6c9c05c5565/5dc094a6-3f66-5d50-bc78-b6c9c05c5565_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F22%252Ff522beb29772b129fea774750cebaa72%252Fpa%252FJM46671_e63969cadd55f62cf007209cc8492823.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_e63969cadd55f62cf007209cc8492823.jpg saved to cache
2026-03-30 10:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5dc094a6-3f66-5d50-bc78-b6c9c05c5565
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e77550>
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dc094a6-3f66-5d50-bc78-b6c9c05c5565/5dc094a6-3f66-5d50-bc78-b6c9c05c5565_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F22%252Ff522beb29772b129fea774750cebaa72%252Fpa%252FJM46671_11e4711ef06b686a490a299240f63ad2.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_11e4711ef06b686a490a299240f63ad2.jpg saved to cache
2026-03-30 10:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5dc094a6-3f66-5d50-bc78-b6c9c05c5565
2026-03-30 10:46:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5dc094a6-3f66-5d50-bc78-b6c9c05c5565, skipping ID generation
2026-03-30 10:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dc094a6-3f66-5d50-bc78-b6c9c05c5565 with scrape type 1
2026-03-30 10:46:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5dc094a6-3f66-5d50-bc78-b6c9c05c5565 sending to next pipeline
2026-03-30 10:46:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5dc094a6-3f66-5d50-bc78-b6c9c05c5565, identifier: JM46671
2026-03-30 10:46:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5dc094a6-3f66-5d50-bc78-b6c9c05c5565 with identifier: JM46671
2026-03-30 10:46:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5dc094a6-3f66-5d50-bc78-b6c9c05c5565 with identifier: JM46671
2026-03-30 10:46:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5dc094a6-3f66-5d50-bc78-b6c9c05c5565 with identifier: JM46671 to the API
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_11e4711ef06b686a490a299240f63ad2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:19:06Z',
 'fuel_type': 'petrol',
 'id': '5dc094a6-3f66-5d50-bc78-b6c9c05c5565',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM46671',
 'listing': 'auction',
 'location': 'DE, Stuttgart',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 109369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dc094a6-3f66-5d50-bc78-b6c9c05c5565/5dc094a6-3f66-5d50-bc78-b6c9c05c5565_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_11e4711ef06b686a490a299240f63ad2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dc094a6-3f66-5d50-bc78-b6c9c05c5565/5dc094a6-3f66-5d50-bc78-b6c9c05c5565_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_e63969cadd55f62cf007209cc8492823.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dc094a6-3f66-5d50-bc78-b6c9c05c5565/5dc094a6-3f66-5d50-bc78-b6c9c05c5565_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_b30cedfba17002be67a5267561115249.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dc094a6-3f66-5d50-bc78-b6c9c05c5565/5dc094a6-3f66-5d50-bc78-b6c9c05c5565_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_66af4698e25375cfa36e8c6bcd27a18a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dc094a6-3f66-5d50-bc78-b6c9c05c5565/5dc094a6-3f66-5d50-bc78-b6c9c05c5565_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/22/f522beb29772b129fea774750cebaa72/pa/JM46671_fcf37174c185a1bcea7eb03f145aa119.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 THP Intensive',
 'transmission': 'manual',
 'trim': 'Intensive',
 'year': 2014}
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM46671%27 HTTP/1.1" 200 None
2026-03-30 10:46:03 [auto1.de] INFO: Saving data for JM46671: {'created_time': 1774867563.917757, 'last_price_update_time': 1774867563.917766, 'auction_closing_time': 1774970346.0}
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM46671') HTTP/1.1" 204 0
2026-03-30 10:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_2b0f2460e8e22b23c570160c64f91d3b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:03 [scrapy.extensions.logstats] INFO: Crawled 405 pages (at 19 pages/min), scraped 304 items (at 7 items/min)
2026-03-30 10:46:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-30 10:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_d00ccd67f6a980e52c8da3ac009fba0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eabed0>
2026-03-30 10:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a8290f7-3a9c-5662-a12b-e81d3bf919c0/3a8290f7-3a9c-5662-a12b-e81d3bf919c0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F0b%252Fc20b0c68b61328d6869f44110df0fdaf%252Fpa%252FGE83879_2b0f2460e8e22b23c570160c64f91d3b.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_2b0f2460e8e22b23c570160c64f91d3b.jpg saved to cache
2026-03-30 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a8290f7-3a9c-5662-a12b-e81d3bf919c0
2026-03-30 10:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5012310>
2026-03-30 10:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a8290f7-3a9c-5662-a12b-e81d3bf919c0/3a8290f7-3a9c-5662-a12b-e81d3bf919c0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F0b%252Fc20b0c68b61328d6869f44110df0fdaf%252Fpa%252FGE83879_d00ccd67f6a980e52c8da3ac009fba0a.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_d00ccd67f6a980e52c8da3ac009fba0a.jpg saved to cache
2026-03-30 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a8290f7-3a9c-5662-a12b-e81d3bf919c0
2026-03-30 10:46:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a8290f7-3a9c-5662-a12b-e81d3bf919c0, skipping ID generation
2026-03-30 10:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a8290f7-3a9c-5662-a12b-e81d3bf919c0 with scrape type 1
2026-03-30 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a8290f7-3a9c-5662-a12b-e81d3bf919c0 sending to next pipeline
2026-03-30 10:46:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a8290f7-3a9c-5662-a12b-e81d3bf919c0, identifier: GE83879
2026-03-30 10:46:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a8290f7-3a9c-5662-a12b-e81d3bf919c0 with identifier: GE83879
2026-03-30 10:46:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a8290f7-3a9c-5662-a12b-e81d3bf919c0 with identifier: GE83879
2026-03-30 10:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a8290f7-3a9c-5662-a12b-e81d3bf919c0 with identifier: GE83879 to the API
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_d00ccd67f6a980e52c8da3ac009fba0a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:14:07Z',
 'fuel_type': 'petrol',
 'id': '3a8290f7-3a9c-5662-a12b-e81d3bf919c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE83879',
 'listing': 'auction',
 'location': 'DE, Offenbach am Main',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 90201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a8290f7-3a9c-5662-a12b-e81d3bf919c0/3a8290f7-3a9c-5662-a12b-e81d3bf919c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_d00ccd67f6a980e52c8da3ac009fba0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a8290f7-3a9c-5662-a12b-e81d3bf919c0/3a8290f7-3a9c-5662-a12b-e81d3bf919c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_2b0f2460e8e22b23c570160c64f91d3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a8290f7-3a9c-5662-a12b-e81d3bf919c0/3a8290f7-3a9c-5662-a12b-e81d3bf919c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_03d3fffce7f950396d57bec9a7f750d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a8290f7-3a9c-5662-a12b-e81d3bf919c0/3a8290f7-3a9c-5662-a12b-e81d3bf919c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_49d06506e7212093cd9cccce92c1888c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a8290f7-3a9c-5662-a12b-e81d3bf919c0/3a8290f7-3a9c-5662-a12b-e81d3bf919c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/0b/c20b0c68b61328d6869f44110df0fdaf/pa/GE83879_c8336833f6f48fbc08696aad3898572a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Meriva 1.8 Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2006}
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE83879%27 HTTP/1.1" 200 None
2026-03-30 10:46:04 [auto1.de] INFO: Saving data for GE83879: {'created_time': 1774867564.650023, 'last_price_update_time': 1774867564.650036, 'auction_closing_time': 1774970047.0}
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE83879') HTTP/1.1" 204 0
2026-03-30 10:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AJ81132> (referer: https://www.auto1.com/v1/car-details-view/AJ81132/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17a35f91-622d-5bcb-ba53-cd0869c6f9e6 with identifier: AJ81132
2026-03-30 10:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17a35f91-622d-5bcb-ba53-cd0869c6f9e6 with scrape type 1
2026-03-30 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17a35f91-622d-5bcb-ba53-cd0869c6f9e6
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_2a6d4b7582a059f6ea34f63af7143a4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_2a6d4b7582a059f6ea34f63af7143a4a.jpg not downloaded yet
2026-03-30 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_8fb2012ab1e695af45ffe2312a800874.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_8fb2012ab1e695af45ffe2312a800874.jpg not downloaded yet
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_09c05e1d2a8a8acdd6a4ba8364ee7a13.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_09c05e1d2a8a8acdd6a4ba8364ee7a13.jpg not downloaded yet
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_43889e667469b0afa5f1ed1a1cb5fc11.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_43889e667469b0afa5f1ed1a1cb5fc11.jpg not downloaded yet
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_720e5672edd017f5b258cf353e3e47bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_720e5672edd017f5b258cf353e3e47bb.jpg not downloaded yet
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_529f89673556c94f6ebf14c0493d8398.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_529f89673556c94f6ebf14c0493d8398.jpg not downloaded yet
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_4f36e033c0a7dc5799c3bf867031976e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_4f36e033c0a7dc5799c3bf867031976e.jpg not downloaded yet
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_fbc60cdea97f3c43acf151b7325d1a91.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_fbc60cdea97f3c43acf151b7325d1a91.jpg not downloaded yet
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_d632cf8f103f3c5736318c32ca979ffe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_d632cf8f103f3c5736318c32ca979ffe.jpg not downloaded yet
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_1292f0bc5d929c0b25a5df66c23b59eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_1292f0bc5d929c0b25a5df66c23b59eb.jpg not downloaded yet
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR40725> (referer: https://www.auto1.com/v1/car-details-view/TR40725/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b666b420-9377-5417-9bd2-b04b4c7f9d79 with identifier: TR40725
2026-03-30 10:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b666b420-9377-5417-9bd2-b04b4c7f9d79 with scrape type 1
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b666b420-9377-5417-9bd2-b04b4c7f9d79
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_a1f82d6907dedbba49ced086d55afb22.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_a1f82d6907dedbba49ced086d55afb22.jpg not downloaded yet
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_96ffb91296194851f7664db17e0077d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_96ffb91296194851f7664db17e0077d3.jpg not downloaded yet
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_1292f0bc5d929c0b25a5df66c23b59eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_0f5d9730bd0d9e02e51105a1e02abef8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_0f5d9730bd0d9e02e51105a1e02abef8.jpg not downloaded yet
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_932ff0ac3ebbbdcb9adc9e83b7145260.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_932ff0ac3ebbbdcb9adc9e83b7145260.jpg not downloaded yet
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_2a9330e42f79c3cf9a256d571683be1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_2a9330e42f79c3cf9a256d571683be1f.jpg not downloaded yet
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_78a0276f911fc77d5e207361da44bb80.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_78a0276f911fc77d5e207361da44bb80.jpg not downloaded yet
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_57b0a3c2251530a97ffb7960929148e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_57b0a3c2251530a97ffb7960929148e2.jpg not downloaded yet
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_96ffb91296194851f7664db17e0077d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_462877a52f76701e083a73809c65f78c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_462877a52f76701e083a73809c65f78c.jpg not downloaded yet
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b0b50>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_1292f0bc5d929c0b25a5df66c23b59eb.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_1292f0bc5d929c0b25a5df66c23b59eb.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17a35f91-622d-5bcb-ba53-cd0869c6f9e6
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_c58b1ca5317558e23650852d69a53a8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_c58b1ca5317558e23650852d69a53a8d.jpg not downloaded yet
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_c7d7deed62e76117bd6fb5bdf0bae2f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_c7d7deed62e76117bd6fb5bdf0bae2f6.jpg not downloaded yet
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e66650>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_96ffb91296194851f7664db17e0077d3.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_96ffb91296194851f7664db17e0077d3.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b666b420-9377-5417-9bd2-b04b4c7f9d79
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_57b0a3c2251530a97ffb7960929148e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_c7d7deed62e76117bd6fb5bdf0bae2f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6c410>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_57b0a3c2251530a97ffb7960929148e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_57b0a3c2251530a97ffb7960929148e2.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b666b420-9377-5417-9bd2-b04b4c7f9d79
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_c58b1ca5317558e23650852d69a53a8d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a32bd0>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_c7d7deed62e76117bd6fb5bdf0bae2f6.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_c7d7deed62e76117bd6fb5bdf0bae2f6.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b666b420-9377-5417-9bd2-b04b4c7f9d79
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_462877a52f76701e083a73809c65f78c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6d610>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_c58b1ca5317558e23650852d69a53a8d.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_c58b1ca5317558e23650852d69a53a8d.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b666b420-9377-5417-9bd2-b04b4c7f9d79
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5104310>
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_462877a52f76701e083a73809c65f78c.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_462877a52f76701e083a73809c65f78c.jpg saved to cache
2026-03-30 10:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b666b420-9377-5417-9bd2-b04b4c7f9d79
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_78a0276f911fc77d5e207361da44bb80.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_2a9330e42f79c3cf9a256d571683be1f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a33f90>
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_78a0276f911fc77d5e207361da44bb80.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_78a0276f911fc77d5e207361da44bb80.jpg saved to cache
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b666b420-9377-5417-9bd2-b04b4c7f9d79
2026-03-30 10:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_932ff0ac3ebbbdcb9adc9e83b7145260.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a30150>
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_2a9330e42f79c3cf9a256d571683be1f.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_2a9330e42f79c3cf9a256d571683be1f.jpg saved to cache
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b666b420-9377-5417-9bd2-b04b4c7f9d79
2026-03-30 10:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD23421> (referer: https://www.auto1.com/v1/car-details-view/AD23421/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_0f5d9730bd0d9e02e51105a1e02abef8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB74437> (referer: https://www.auto1.com/v1/car-details-view/JB74437/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d7ad50>
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_932ff0ac3ebbbdcb9adc9e83b7145260.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_932ff0ac3ebbbdcb9adc9e83b7145260.jpg saved to cache
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b666b420-9377-5417-9bd2-b04b4c7f9d79
2026-03-30 10:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_a1f82d6907dedbba49ced086d55afb22.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce1870ea-2433-5e3a-9128-239689f91571 with identifier: AD23421
2026-03-30 10:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce1870ea-2433-5e3a-9128-239689f91571 with scrape type 1
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce1870ea-2433-5e3a-9128-239689f91571
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcc%252F5acc6b00d78f83bd35df38f151b2ca31%252Fpa%252FAD23421_cf8d359298abcfc4a7f13c5ef6fd906d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_cf8d359298abcfc4a7f13c5ef6fd906d.jpg already downloaded
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcc%252F5acc6b00d78f83bd35df38f151b2ca31%252Fpa%252FAD23421_5c52ae0b7cc60e6d8ba67ada062fefcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_5c52ae0b7cc60e6d8ba67ada062fefcc.jpg already downloaded
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcc%252F5acc6b00d78f83bd35df38f151b2ca31%252Fpa%252FAD23421_64d133f887c48ee91d15bb63aa250777.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_64d133f887c48ee91d15bb63aa250777.jpg already downloaded
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcc%252F5acc6b00d78f83bd35df38f151b2ca31%252Fpa%252FAD23421_1885dc2257e1be4acb08d26222d3c7c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_1885dc2257e1be4acb08d26222d3c7c2.jpg already downloaded
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcc%252F5acc6b00d78f83bd35df38f151b2ca31%252Fpa%252FAD23421_1d105ccdb6fed286c1eb19eb2cb209a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_1d105ccdb6fed286c1eb19eb2cb209a8.jpg already downloaded
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcc%252F5acc6b00d78f83bd35df38f151b2ca31%252Fpa%252FAD23421_737f7e360de21b11c1b917e8dcc734cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_737f7e360de21b11c1b917e8dcc734cb.jpg already downloaded
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcc%252F5acc6b00d78f83bd35df38f151b2ca31%252Fpa%252FAD23421_7376ee7fdbef50f2724d2ca7b73c655a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_7376ee7fdbef50f2724d2ca7b73c655a.jpg already downloaded
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcc%252F5acc6b00d78f83bd35df38f151b2ca31%252Fpa%252FAD23421_47c6734af95418d3b035c6fad76423b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_47c6734af95418d3b035c6fad76423b9.jpg already downloaded
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcc%252F5acc6b00d78f83bd35df38f151b2ca31%252Fpa%252FAD23421_37b26202a03c36f8387f103903aaba55.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_37b26202a03c36f8387f103903aaba55.jpg already downloaded
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fcc%252F5acc6b00d78f83bd35df38f151b2ca31%252Fpa%252FAD23421_97062dccdef7be513615b562793bdd3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_97062dccdef7be513615b562793bdd3f.jpg already downloaded
2026-03-30 10:46:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce1870ea-2433-5e3a-9128-239689f91571, identifier: AD23421
2026-03-30 10:46:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce1870ea-2433-5e3a-9128-239689f91571 with identifier: AD23421
2026-03-30 10:46:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce1870ea-2433-5e3a-9128-239689f91571 with identifier: AD23421
2026-03-30 10:46:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce1870ea-2433-5e3a-9128-239689f91571 with identifier: AD23421 to the API
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AD23421>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:15:15Z',
 'fuel_type': 'petrol',
 'id': 'ce1870ea-2433-5e3a-9128-239689f91571',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD23421',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 156705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_cf8d359298abcfc4a7f13c5ef6fd906d.jpg',
                'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_5c52ae0b7cc60e6d8ba67ada062fefcc.jpg',
                'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_64d133f887c48ee91d15bb63aa250777.jpg',
                'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_1885dc2257e1be4acb08d26222d3c7c2.jpg',
                'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_1d105ccdb6fed286c1eb19eb2cb209a8.jpg',
                'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_737f7e360de21b11c1b917e8dcc734cb.jpg',
                'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_7376ee7fdbef50f2724d2ca7b73c655a.jpg',
                'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_47c6734af95418d3b035c6fad76423b9.jpg',
                'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_37b26202a03c36f8387f103903aaba55.jpg',
                'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_97062dccdef7be513615b562793bdd3f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1870ea-2433-5e3a-9128-239689f91571/ce1870ea-2433-5e3a-9128-239689f91571_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_cf8d359298abcfc4a7f13c5ef6fd906d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1870ea-2433-5e3a-9128-239689f91571/ce1870ea-2433-5e3a-9128-239689f91571_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_5c52ae0b7cc60e6d8ba67ada062fefcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1870ea-2433-5e3a-9128-239689f91571/ce1870ea-2433-5e3a-9128-239689f91571_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_64d133f887c48ee91d15bb63aa250777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1870ea-2433-5e3a-9128-239689f91571/ce1870ea-2433-5e3a-9128-239689f91571_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_1885dc2257e1be4acb08d26222d3c7c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1870ea-2433-5e3a-9128-239689f91571/ce1870ea-2433-5e3a-9128-239689f91571_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_1d105ccdb6fed286c1eb19eb2cb209a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1870ea-2433-5e3a-9128-239689f91571/ce1870ea-2433-5e3a-9128-239689f91571_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_737f7e360de21b11c1b917e8dcc734cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1870ea-2433-5e3a-9128-239689f91571/ce1870ea-2433-5e3a-9128-239689f91571_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_7376ee7fdbef50f2724d2ca7b73c655a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1870ea-2433-5e3a-9128-239689f91571/ce1870ea-2433-5e3a-9128-239689f91571_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_47c6734af95418d3b035c6fad76423b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1870ea-2433-5e3a-9128-239689f91571/ce1870ea-2433-5e3a-9128-239689f91571_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_37b26202a03c36f8387f103903aaba55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce1870ea-2433-5e3a-9128-239689f91571/ce1870ea-2433-5e3a-9128-239689f91571_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/cc/5acc6b00d78f83bd35df38f151b2ca31/pa/AD23421_97062dccdef7be513615b562793bdd3f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2014}
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD23421%27 HTTP/1.1" 200 None
2026-03-30 10:46:18 [auto1.de] INFO: Saving data for AD23421: {'created_time': 1774867578.889764, 'last_price_update_time': 1774867578.889773, 'auction_closing_time': 1774970115.0}
2026-03-30 10:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD23421') HTTP/1.1" 204 0
2026-03-30 10:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_fbc60cdea97f3c43acf151b7325d1a91.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_d632cf8f103f3c5736318c32ca979ffe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a23550>
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_0f5d9730bd0d9e02e51105a1e02abef8.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_0f5d9730bd0d9e02e51105a1e02abef8.jpg saved to cache
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b666b420-9377-5417-9bd2-b04b4c7f9d79
2026-03-30 10:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82611297-0771-5422-9fad-e32b9ca0423e with identifier: JB74437
2026-03-30 10:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82611297-0771-5422-9fad-e32b9ca0423e with scrape type 1
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82611297-0771-5422-9fad-e32b9ca0423e
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_b8fbe905e07282c4733ff80086a75d29.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_b8fbe905e07282c4733ff80086a75d29.jpg not downloaded yet
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef500a550>
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa6%252Fc0a6bf66677987b8d9786892d1aa081e%252Fpa%252FTR40725_a1f82d6907dedbba49ced086d55afb22.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_a1f82d6907dedbba49ced086d55afb22.jpg saved to cache
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b666b420-9377-5417-9bd2-b04b4c7f9d79
2026-03-30 10:46:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b666b420-9377-5417-9bd2-b04b4c7f9d79, skipping ID generation
2026-03-30 10:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b666b420-9377-5417-9bd2-b04b4c7f9d79 with scrape type 1
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b666b420-9377-5417-9bd2-b04b4c7f9d79 sending to next pipeline
2026-03-30 10:46:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b666b420-9377-5417-9bd2-b04b4c7f9d79, identifier: TR40725
2026-03-30 10:46:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b666b420-9377-5417-9bd2-b04b4c7f9d79 with identifier: TR40725
2026-03-30 10:46:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b666b420-9377-5417-9bd2-b04b4c7f9d79 with identifier: TR40725
2026-03-30 10:46:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b666b420-9377-5417-9bd2-b04b4c7f9d79 with identifier: TR40725 to the API
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_a1f82d6907dedbba49ced086d55afb22.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:05:34Z',
 'fuel_type': 'diesel',
 'id': 'b666b420-9377-5417-9bd2-b04b4c7f9d79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR40725',
 'listing': 'auction',
 'location': 'DE, Zwickau',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 246276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_a1f82d6907dedbba49ced086d55afb22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_96ffb91296194851f7664db17e0077d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_0f5d9730bd0d9e02e51105a1e02abef8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_932ff0ac3ebbbdcb9adc9e83b7145260.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_2a9330e42f79c3cf9a256d571683be1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_78a0276f911fc77d5e207361da44bb80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_57b0a3c2251530a97ffb7960929148e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_462877a52f76701e083a73809c65f78c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_c58b1ca5317558e23650852d69a53a8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b666b420-9377-5417-9bd2-b04b4c7f9d79/b666b420-9377-5417-9bd2-b04b4c7f9d79_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a6/c0a6bf66677987b8d9786892d1aa081e/pa/TR40725_c7d7deed62e76117bd6fb5bdf0bae2f6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR40725%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [auto1.de] INFO: Saving data for TR40725: {'created_time': 1774867579.687307, 'last_price_update_time': 1774867579.687317, 'auction_closing_time': 1774969534.0}
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR40725') HTTP/1.1" 204 0
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_325dc43b673bb75804a26815bc64b6ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_325dc43b673bb75804a26815bc64b6ad.jpg not downloaded yet
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eb7210>
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_fbc60cdea97f3c43acf151b7325d1a91.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_fbc60cdea97f3c43acf151b7325d1a91.jpg saved to cache
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17a35f91-622d-5bcb-ba53-cd0869c6f9e6
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5013390>
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_d632cf8f103f3c5736318c32ca979ffe.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_d632cf8f103f3c5736318c32ca979ffe.jpg saved to cache
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17a35f91-622d-5bcb-ba53-cd0869c6f9e6
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_78fc4ba5d6cb274e483d7addeeae503b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_78fc4ba5d6cb274e483d7addeeae503b.jpg not downloaded yet
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_3914b6cd7ac1f973612b3ae2f5f091ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_3914b6cd7ac1f973612b3ae2f5f091ec.jpg not downloaded yet
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_6aadfdfb22f1a891d6cc96b16dd3ba89.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_6aadfdfb22f1a891d6cc96b16dd3ba89.jpg not downloaded yet
2026-03-30 10:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_720e5672edd017f5b258cf353e3e47bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_529f89673556c94f6ebf14c0493d8398.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_f5654066adfd2bff8aff3615d946b641.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_f5654066adfd2bff8aff3615d946b641.jpg not downloaded yet
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_d590972b4b35ff9e002e7fdd7235bfb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_d590972b4b35ff9e002e7fdd7235bfb9.jpg not downloaded yet
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_2426c0e631a36f6954372948dba863f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_2426c0e631a36f6954372948dba863f7.jpg not downloaded yet
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_febdaf8ef3e8ece51937b640b0397192.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_febdaf8ef3e8ece51937b640b0397192.jpg not downloaded yet
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_7ee9f121701441eee1013fba88703497.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_7ee9f121701441eee1013fba88703497.jpg not downloaded yet
2026-03-30 10:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_4f36e033c0a7dc5799c3bf867031976e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef502b610>
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_720e5672edd017f5b258cf353e3e47bb.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_720e5672edd017f5b258cf353e3e47bb.jpg saved to cache
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17a35f91-622d-5bcb-ba53-cd0869c6f9e6
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7c002d0>
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_529f89673556c94f6ebf14c0493d8398.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_529f89673556c94f6ebf14c0493d8398.jpg saved to cache
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17a35f91-622d-5bcb-ba53-cd0869c6f9e6
2026-03-30 10:46:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9f06484890>
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_4f36e033c0a7dc5799c3bf867031976e.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_4f36e033c0a7dc5799c3bf867031976e.jpg saved to cache
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17a35f91-622d-5bcb-ba53-cd0869c6f9e6
2026-03-30 10:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_6aadfdfb22f1a891d6cc96b16dd3ba89.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_7ee9f121701441eee1013fba88703497.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_3914b6cd7ac1f973612b3ae2f5f091ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b2b210>
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_6aadfdfb22f1a891d6cc96b16dd3ba89.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_6aadfdfb22f1a891d6cc96b16dd3ba89.jpg saved to cache
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82611297-0771-5422-9fad-e32b9ca0423e
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5994790>
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_7ee9f121701441eee1013fba88703497.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_7ee9f121701441eee1013fba88703497.jpg saved to cache
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82611297-0771-5422-9fad-e32b9ca0423e
2026-03-30 10:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_d590972b4b35ff9e002e7fdd7235bfb9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e47d90>
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_3914b6cd7ac1f973612b3ae2f5f091ec.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_3914b6cd7ac1f973612b3ae2f5f091ec.jpg saved to cache
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82611297-0771-5422-9fad-e32b9ca0423e
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e51050>
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_d590972b4b35ff9e002e7fdd7235bfb9.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_d590972b4b35ff9e002e7fdd7235bfb9.jpg saved to cache
2026-03-30 10:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82611297-0771-5422-9fad-e32b9ca0423e
2026-03-30 10:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_febdaf8ef3e8ece51937b640b0397192.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_f5654066adfd2bff8aff3615d946b641.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_2426c0e631a36f6954372948dba863f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5aca810>
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_febdaf8ef3e8ece51937b640b0397192.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_febdaf8ef3e8ece51937b640b0397192.jpg saved to cache
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82611297-0771-5422-9fad-e32b9ca0423e
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eab610>
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_f5654066adfd2bff8aff3615d946b641.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_f5654066adfd2bff8aff3615d946b641.jpg saved to cache
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82611297-0771-5422-9fad-e32b9ca0423e
2026-03-30 10:46:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c6210>
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_2426c0e631a36f6954372948dba863f7.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_2426c0e631a36f6954372948dba863f7.jpg saved to cache
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82611297-0771-5422-9fad-e32b9ca0423e
2026-03-30 10:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_325dc43b673bb75804a26815bc64b6ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_b8fbe905e07282c4733ff80086a75d29.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_78fc4ba5d6cb274e483d7addeeae503b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dbab10>
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_325dc43b673bb75804a26815bc64b6ad.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_325dc43b673bb75804a26815bc64b6ad.jpg saved to cache
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82611297-0771-5422-9fad-e32b9ca0423e
2026-03-30 10:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_43889e667469b0afa5f1ed1a1cb5fc11.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_09c05e1d2a8a8acdd6a4ba8364ee7a13.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db8190>
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_b8fbe905e07282c4733ff80086a75d29.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_b8fbe905e07282c4733ff80086a75d29.jpg saved to cache
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82611297-0771-5422-9fad-e32b9ca0423e
2026-03-30 10:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_8fb2012ab1e695af45ffe2312a800874.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9f0402bc90>
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F8a%252F0c8ace8479601ba4079abb19a0c642c6%252Fpa%252FJB74437_78fc4ba5d6cb274e483d7addeeae503b.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_78fc4ba5d6cb274e483d7addeeae503b.jpg saved to cache
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82611297-0771-5422-9fad-e32b9ca0423e
2026-03-30 10:46:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82611297-0771-5422-9fad-e32b9ca0423e, skipping ID generation
2026-03-30 10:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82611297-0771-5422-9fad-e32b9ca0423e with scrape type 1
2026-03-30 10:46:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82611297-0771-5422-9fad-e32b9ca0423e sending to next pipeline
2026-03-30 10:46:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82611297-0771-5422-9fad-e32b9ca0423e, identifier: JB74437
2026-03-30 10:46:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82611297-0771-5422-9fad-e32b9ca0423e with identifier: JB74437
2026-03-30 10:46:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82611297-0771-5422-9fad-e32b9ca0423e with identifier: JB74437
2026-03-30 10:46:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82611297-0771-5422-9fad-e32b9ca0423e with identifier: JB74437 to the API
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_78fc4ba5d6cb274e483d7addeeae503b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:40:11Z',
 'fuel_type': 'petrol',
 'id': '82611297-0771-5422-9fad-e32b9ca0423e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB74437',
 'listing': 'auction',
 'location': 'DE, Bonn',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 69035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_b8fbe905e07282c4733ff80086a75d29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_325dc43b673bb75804a26815bc64b6ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3072970,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_78fc4ba5d6cb274e483d7addeeae503b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3168944,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_3914b6cd7ac1f973612b3ae2f5f091ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_6aadfdfb22f1a891d6cc96b16dd3ba89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_f5654066adfd2bff8aff3615d946b641.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_d590972b4b35ff9e002e7fdd7235bfb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3106783,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_2426c0e631a36f6954372948dba863f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2940310,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_febdaf8ef3e8ece51937b640b0397192.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82611297-0771-5422-9fad-e32b9ca0423e/82611297-0771-5422-9fad-e32b9ca0423e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/8a/0c8ace8479601ba4079abb19a0c642c6/pa/JB74437_7ee9f121701441eee1013fba88703497.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Design BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Design BlueMotion Tech',
 'year': 2013}
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB74437%27 HTTP/1.1" 200 None
2026-03-30 10:46:22 [auto1.de] INFO: Saving data for JB74437: {'created_time': 1774867582.679334, 'last_price_update_time': 1774867582.679346, 'auction_closing_time': 1774971611.0}
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB74437') HTTP/1.1" 204 0
2026-03-30 10:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_2a6d4b7582a059f6ea34f63af7143a4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e23c10>
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_43889e667469b0afa5f1ed1a1cb5fc11.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_43889e667469b0afa5f1ed1a1cb5fc11.jpg saved to cache
2026-03-30 10:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17a35f91-622d-5bcb-ba53-cd0869c6f9e6
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0e450>
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_09c05e1d2a8a8acdd6a4ba8364ee7a13.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_09c05e1d2a8a8acdd6a4ba8364ee7a13.jpg saved to cache
2026-03-30 10:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17a35f91-622d-5bcb-ba53-cd0869c6f9e6
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8c590>
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_8fb2012ab1e695af45ffe2312a800874.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_8fb2012ab1e695af45ffe2312a800874.jpg saved to cache
2026-03-30 10:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17a35f91-622d-5bcb-ba53-cd0869c6f9e6
2026-03-30 10:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_6d850c0707d7451316e6aa8ec2de3d76.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0c950>
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fb3%252Fe1b3c5150f2c347814fb8c9392522467%252Fpa%252FAJ81132_2a6d4b7582a059f6ea34f63af7143a4a.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_2a6d4b7582a059f6ea34f63af7143a4a.jpg saved to cache
2026-03-30 10:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17a35f91-622d-5bcb-ba53-cd0869c6f9e6
2026-03-30 10:46:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17a35f91-622d-5bcb-ba53-cd0869c6f9e6, skipping ID generation
2026-03-30 10:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17a35f91-622d-5bcb-ba53-cd0869c6f9e6 with scrape type 1
2026-03-30 10:46:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17a35f91-622d-5bcb-ba53-cd0869c6f9e6 sending to next pipeline
2026-03-30 10:46:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17a35f91-622d-5bcb-ba53-cd0869c6f9e6, identifier: AJ81132
2026-03-30 10:46:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17a35f91-622d-5bcb-ba53-cd0869c6f9e6 with identifier: AJ81132
2026-03-30 10:46:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17a35f91-622d-5bcb-ba53-cd0869c6f9e6 with identifier: AJ81132
2026-03-30 10:46:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17a35f91-622d-5bcb-ba53-cd0869c6f9e6 with identifier: AJ81132 to the API
2026-03-30 10:46:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_2a6d4b7582a059f6ea34f63af7143a4a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:34:53Z',
 'fuel_type': 'petrol',
 'id': '17a35f91-622d-5bcb-ba53-cd0869c6f9e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ81132',
 'listing': 'auction',
 'location': 'DE, Donaueschingen',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 203485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_2a6d4b7582a059f6ea34f63af7143a4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_8fb2012ab1e695af45ffe2312a800874.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_09c05e1d2a8a8acdd6a4ba8364ee7a13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_43889e667469b0afa5f1ed1a1cb5fc11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_720e5672edd017f5b258cf353e3e47bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_529f89673556c94f6ebf14c0493d8398.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1898657,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_4f36e033c0a7dc5799c3bf867031976e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_fbc60cdea97f3c43acf151b7325d1a91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_d632cf8f103f3c5736318c32ca979ffe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a35f91-622d-5bcb-ba53-cd0869c6f9e6/17a35f91-622d-5bcb-ba53-cd0869c6f9e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/b3/e1b3c5150f2c347814fb8c9392522467/pa/AJ81132_1292f0bc5d929c0b25a5df66c23b59eb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation Start/Stop 4x4',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop 4x4',
 'year': 2018}
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ81132%27 HTTP/1.1" 200 None
2026-03-30 10:46:24 [auto1.de] INFO: Saving data for AJ81132: {'created_time': 1774867584.458599, 'last_price_update_time': 1774867584.458612, 'auction_closing_time': 1774971293.0}
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ81132') HTTP/1.1" 204 0
2026-03-30 10:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_fa49aeb847fe91d3e842bc54786c41b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f1150>
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_6d850c0707d7451316e6aa8ec2de3d76.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_6d850c0707d7451316e6aa8ec2de3d76.jpg saved to cache
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f15c279c-89f1-5a21-8087-0cb21e823b1d
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8a650>
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_fa49aeb847fe91d3e842bc54786c41b5.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_fa49aeb847fe91d3e842bc54786c41b5.jpg saved to cache
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f15c279c-89f1-5a21-8087-0cb21e823b1d
2026-03-30 10:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_45f297e7db2d4a98e4d2ebfa95a21c98.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_372c04e9c6e7cc34cc2fff432c116a3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_b0346df68affcadaaff73b6d21187ac4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6de50>
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_45f297e7db2d4a98e4d2ebfa95a21c98.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_45f297e7db2d4a98e4d2ebfa95a21c98.jpg saved to cache
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f15c279c-89f1-5a21-8087-0cb21e823b1d
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0c290>
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_372c04e9c6e7cc34cc2fff432c116a3d.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_372c04e9c6e7cc34cc2fff432c116a3d.jpg saved to cache
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f15c279c-89f1-5a21-8087-0cb21e823b1d
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ec2310>
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F20%252F0f200d9833d96436dff9eaf2b18107a6%252Fpa%252FJG35280_b0346df68affcadaaff73b6d21187ac4.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_b0346df68affcadaaff73b6d21187ac4.jpg saved to cache
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f15c279c-89f1-5a21-8087-0cb21e823b1d
2026-03-30 10:46:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f15c279c-89f1-5a21-8087-0cb21e823b1d, skipping ID generation
2026-03-30 10:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f15c279c-89f1-5a21-8087-0cb21e823b1d with scrape type 1
2026-03-30 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f15c279c-89f1-5a21-8087-0cb21e823b1d sending to next pipeline
2026-03-30 10:46:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f15c279c-89f1-5a21-8087-0cb21e823b1d, identifier: JG35280
2026-03-30 10:46:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f15c279c-89f1-5a21-8087-0cb21e823b1d with identifier: JG35280
2026-03-30 10:46:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f15c279c-89f1-5a21-8087-0cb21e823b1d with identifier: JG35280
2026-03-30 10:46:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f15c279c-89f1-5a21-8087-0cb21e823b1d with identifier: JG35280 to the API
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_b0346df68affcadaaff73b6d21187ac4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:16:40Z',
 'fuel_type': 'petrol',
 'id': 'f15c279c-89f1-5a21-8087-0cb21e823b1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG35280',
 'listing': 'auction',
 'location': 'DE, Dornach',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 36633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_b0346df68affcadaaff73b6d21187ac4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_45f297e7db2d4a98e4d2ebfa95a21c98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_372c04e9c6e7cc34cc2fff432c116a3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_fa49aeb847fe91d3e842bc54786c41b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_6d850c0707d7451316e6aa8ec2de3d76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_d04388bf9325e7c33a4c029542c784dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_4b51f88ead9a661227fd5612cbfccfe8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_bff000090ab0ecb8bbbdb6d028f4c0d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_34c097a8692be1b1010ab3f24fe914e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f15c279c-89f1-5a21-8087-0cb21e823b1d/f15c279c-89f1-5a21-8087-0cb21e823b1d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/20/0f200d9833d96436dff9eaf2b18107a6/pa/JG35280_33babbb6e682b9c93340671825018cac.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 1.4 TFSI ACT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35280%27 HTTP/1.1" 200 None
2026-03-30 10:46:25 [auto1.de] INFO: Saving data for JG35280: {'created_time': 1774867585.327351, 'last_price_update_time': 1774867585.327362, 'auction_closing_time': 1774970200.0}
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG35280') HTTP/1.1" 204 0
2026-03-30 10:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW88873> (referer: https://www.auto1.com/v1/car-details-view/AW88873/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3af45961-ab12-5015-a64d-b48385a2b0e5 with identifier: AW88873
2026-03-30 10:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3af45961-ab12-5015-a64d-b48385a2b0e5 with scrape type 1
2026-03-30 10:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3af45961-ab12-5015-a64d-b48385a2b0e5
2026-03-30 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd8%252Fc5d85ebcd9e53061396cc0610a85f4f6%252Fpa%252FAW88873_3f18086e6d4001e055f0f512c4cb90eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d8/c5d85ebcd9e53061396cc0610a85f4f6/pa/AW88873_3f18086e6d4001e055f0f512c4cb90eb.jpg already downloaded
2026-03-30 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd8%252Fc5d85ebcd9e53061396cc0610a85f4f6%252Fpa%252FAW88873_ca1d7d9b319d229fe66ffc52d3683c28.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d8/c5d85ebcd9e53061396cc0610a85f4f6/pa/AW88873_ca1d7d9b319d229fe66ffc52d3683c28.jpg already downloaded
2026-03-30 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd8%252Fc5d85ebcd9e53061396cc0610a85f4f6%252Fpa%252FAW88873_8fe393e23cac33b05380070d81b2eb6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d8/c5d85ebcd9e53061396cc0610a85f4f6/pa/AW88873_8fe393e23cac33b05380070d81b2eb6a.jpg already downloaded
2026-03-30 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd8%252Fc5d85ebcd9e53061396cc0610a85f4f6%252Fpa%252FAW88873_204ca8392ae08c64654b76cc87ca1f7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d8/c5d85ebcd9e53061396cc0610a85f4f6/pa/AW88873_204ca8392ae08c64654b76cc87ca1f7b.jpg already downloaded
2026-03-30 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd8%252Fc5d85ebcd9e53061396cc0610a85f4f6%252Fpa%252FAW88873_73ca26cc6da22a7d346aca1569c0e6a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d8/c5d85ebcd9e53061396cc0610a85f4f6/pa/AW88873_73ca26cc6da22a7d346aca1569c0e6a3.jpg already downloaded
2026-03-30 10:46:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3af45961-ab12-5015-a64d-b48385a2b0e5, identifier: AW88873
2026-03-30 10:46:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3af45961-ab12-5015-a64d-b48385a2b0e5 with identifier: AW88873
2026-03-30 10:46:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3af45961-ab12-5015-a64d-b48385a2b0e5 with identifier: AW88873
2026-03-30 10:46:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3af45961-ab12-5015-a64d-b48385a2b0e5 with identifier: AW88873 to the API
2026-03-30 10:46:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AW88873>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:35:43Z',
 'fuel_type': 'petrol',
 'id': '3af45961-ab12-5015-a64d-b48385a2b0e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW88873',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Opel',
 'model': 'Agila',
 'odometer': 94310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgc5/d8/c5d85ebcd9e53061396cc0610a85f4f6/pa/AW88873_3f18086e6d4001e055f0f512c4cb90eb.jpg',
                'https://img-pa.auto1.com/imgc5/d8/c5d85ebcd9e53061396cc0610a85f4f6/pa/AW88873_ca1d7d9b319d229fe66ffc52d3683c28.jpg',
                'https://img-pa.auto1.com/imgc5/d8/c5d85ebcd9e53061396cc0610a85f4f6/pa/AW88873_8fe393e23cac33b05380070d81b2eb6a.jpg',
                'https://img-pa.auto1.com/imgc5/d8/c5d85ebcd9e53061396cc0610a85f4f6/pa/AW88873_204ca8392ae08c64654b76cc87ca1f7b.jpg',
                'https://img-pa.auto1.com/imgc5/d8/c5d85ebcd9e53061396cc0610a85f4f6/pa/AW88873_73ca26cc6da22a7d346aca1569c0e6a3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af45961-ab12-5015-a64d-b48385a2b0e5/3af45961-ab12-5015-a64d-b48385a2b0e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/d8/c5d85ebcd9e53061396cc0610a85f4f6/pa/AW88873_3f18086e6d4001e055f0f512c4cb90eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af45961-ab12-5015-a64d-b48385a2b0e5/3af45961-ab12-5015-a64d-b48385a2b0e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/d8/c5d85ebcd9e53061396cc0610a85f4f6/pa/AW88873_ca1d7d9b319d229fe66ffc52d3683c28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af45961-ab12-5015-a64d-b48385a2b0e5/3af45961-ab12-5015-a64d-b48385a2b0e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/d8/c5d85ebcd9e53061396cc0610a85f4f6/pa/AW88873_8fe393e23cac33b05380070d81b2eb6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af45961-ab12-5015-a64d-b48385a2b0e5/3af45961-ab12-5015-a64d-b48385a2b0e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/d8/c5d85ebcd9e53061396cc0610a85f4f6/pa/AW88873_204ca8392ae08c64654b76cc87ca1f7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af45961-ab12-5015-a64d-b48385a2b0e5/3af45961-ab12-5015-a64d-b48385a2b0e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/d8/c5d85ebcd9e53061396cc0610a85f4f6/pa/AW88873_73ca26cc6da22a7d346aca1569c0e6a3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Agila 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-03-30 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW88873%27 HTTP/1.1" 200 None
2026-03-30 10:46:27 [auto1.de] INFO: Saving data for AW88873: {'created_time': 1774867587.969309, 'last_price_update_time': 1774867587.969319, 'auction_closing_time': 1774971343.0}
2026-03-30 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW88873') HTTP/1.1" 204 0
2026-03-30 10:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JK85727/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM37880/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR54418> (referer: https://www.auto1.com/v1/car-details-view/AR54418/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f746f55f-9aaa-5066-80f5-c7221e116eee with identifier: AR54418
2026-03-30 10:46:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f746f55f-9aaa-5066-80f5-c7221e116eee with scrape type 1
2026-03-30 10:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f746f55f-9aaa-5066-80f5-c7221e116eee
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_6eb92a8338c7bae00d94566d42677527.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_6eb92a8338c7bae00d94566d42677527.jpg not downloaded yet
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_9e0d1dc26bee37bbe16a070987509deb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_9e0d1dc26bee37bbe16a070987509deb.jpg not downloaded yet
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_d1351996e1533a570b63af99c0973b78.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_d1351996e1533a570b63af99c0973b78.jpg not downloaded yet
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_d93b504684b857a74c6b73f8cc507565.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_d93b504684b857a74c6b73f8cc507565.jpg not downloaded yet
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_54fd1b5076e7dd0ec2b4bb4e162ff917.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_54fd1b5076e7dd0ec2b4bb4e162ff917.jpg not downloaded yet
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_23b96fe68f9ee5df66f82d07a7e7309d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_23b96fe68f9ee5df66f82d07a7e7309d.jpg not downloaded yet
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_34c40da6a0b5d907c5205cedfaa2d81f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_34c40da6a0b5d907c5205cedfaa2d81f.jpg not downloaded yet
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_dc432d21f78bef0d7c12aa58082de663.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_dc432d21f78bef0d7c12aa58082de663.jpg not downloaded yet
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_d7daccf01a134d22602b4706be41da9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_d7daccf01a134d22602b4706be41da9e.jpg not downloaded yet
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_1347a6cf0b8d0ab4c3bd0d330ffb8816.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_1347a6cf0b8d0ab4c3bd0d330ffb8816.jpg not downloaded yet
2026-03-30 10:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RP65650> (referer: https://www.auto1.com/v1/car-details-view/RP65650/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_1347a6cf0b8d0ab4c3bd0d330ffb8816.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32880f06-fdc6-5d18-9b71-2b3824d7ea65 with identifier: RP65650
2026-03-30 10:46:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32880f06-fdc6-5d18-9b71-2b3824d7ea65 with scrape type 1
2026-03-30 10:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 32880f06-fdc6-5d18-9b71-2b3824d7ea65
2026-03-30 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F61%252Ff661141a08ce6485b0581601aa79cc84%252Fpa%252FRP65650_8e966085c0414147fa172d971bda0af0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/61/f661141a08ce6485b0581601aa79cc84/pa/RP65650_8e966085c0414147fa172d971bda0af0.jpg already downloaded
2026-03-30 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F61%252Ff661141a08ce6485b0581601aa79cc84%252Fpa%252FRP65650_c45941b29c166e8d0a1e7a9179444847.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/61/f661141a08ce6485b0581601aa79cc84/pa/RP65650_c45941b29c166e8d0a1e7a9179444847.jpg already downloaded
2026-03-30 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F61%252Ff661141a08ce6485b0581601aa79cc84%252Fpa%252FRP65650_aa9d1ed8c490d2e4d13ccdae701c292f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/61/f661141a08ce6485b0581601aa79cc84/pa/RP65650_aa9d1ed8c490d2e4d13ccdae701c292f.jpg already downloaded
2026-03-30 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F61%252Ff661141a08ce6485b0581601aa79cc84%252Fpa%252FRP65650_47b8c453aae4da3e047d4d2f6432cba9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/61/f661141a08ce6485b0581601aa79cc84/pa/RP65650_47b8c453aae4da3e047d4d2f6432cba9.jpg already downloaded
2026-03-30 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F61%252Ff661141a08ce6485b0581601aa79cc84%252Fpa%252FRP65650_78c408628f7dc39a52611bf9894eae7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/61/f661141a08ce6485b0581601aa79cc84/pa/RP65650_78c408628f7dc39a52611bf9894eae7a.jpg already downloaded
2026-03-30 10:46:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32880f06-fdc6-5d18-9b71-2b3824d7ea65, identifier: RP65650
2026-03-30 10:46:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32880f06-fdc6-5d18-9b71-2b3824d7ea65 with identifier: RP65650
2026-03-30 10:46:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32880f06-fdc6-5d18-9b71-2b3824d7ea65 with identifier: RP65650
2026-03-30 10:46:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32880f06-fdc6-5d18-9b71-2b3824d7ea65 with identifier: RP65650 to the API
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RP65650>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.2L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:33:02Z',
 'fuel_type': 'diesel',
 'id': '32880f06-fdc6-5d18-9b71-2b3824d7ea65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP65650',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 299462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgf6/61/f661141a08ce6485b0581601aa79cc84/pa/RP65650_8e966085c0414147fa172d971bda0af0.jpg',
                'https://img-pa.auto1.com/imgf6/61/f661141a08ce6485b0581601aa79cc84/pa/RP65650_c45941b29c166e8d0a1e7a9179444847.jpg',
                'https://img-pa.auto1.com/imgf6/61/f661141a08ce6485b0581601aa79cc84/pa/RP65650_aa9d1ed8c490d2e4d13ccdae701c292f.jpg',
                'https://img-pa.auto1.com/imgf6/61/f661141a08ce6485b0581601aa79cc84/pa/RP65650_47b8c453aae4da3e047d4d2f6432cba9.jpg',
                'https://img-pa.auto1.com/imgf6/61/f661141a08ce6485b0581601aa79cc84/pa/RP65650_78c408628f7dc39a52611bf9894eae7a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32880f06-fdc6-5d18-9b71-2b3824d7ea65/32880f06-fdc6-5d18-9b71-2b3824d7ea65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/61/f661141a08ce6485b0581601aa79cc84/pa/RP65650_8e966085c0414147fa172d971bda0af0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32880f06-fdc6-5d18-9b71-2b3824d7ea65/32880f06-fdc6-5d18-9b71-2b3824d7ea65_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/61/f661141a08ce6485b0581601aa79cc84/pa/RP65650_c45941b29c166e8d0a1e7a9179444847.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32880f06-fdc6-5d18-9b71-2b3824d7ea65/32880f06-fdc6-5d18-9b71-2b3824d7ea65_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/61/f661141a08ce6485b0581601aa79cc84/pa/RP65650_aa9d1ed8c490d2e4d13ccdae701c292f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32880f06-fdc6-5d18-9b71-2b3824d7ea65/32880f06-fdc6-5d18-9b71-2b3824d7ea65_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/61/f661141a08ce6485b0581601aa79cc84/pa/RP65650_47b8c453aae4da3e047d4d2f6432cba9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32880f06-fdc6-5d18-9b71-2b3824d7ea65/32880f06-fdc6-5d18-9b71-2b3824d7ea65_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/61/f661141a08ce6485b0581601aa79cc84/pa/RP65650_78c408628f7dc39a52611bf9894eae7a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.2 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP65650%27 HTTP/1.1" 200 None
2026-03-30 10:46:32 [auto1.de] INFO: Saving data for RP65650: {'created_time': 1774867592.843314, 'last_price_update_time': 1774867592.843331, 'auction_closing_time': 1774971182.0}
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP65650') HTTP/1.1" 204 0
2026-03-30 10:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_d7daccf01a134d22602b4706be41da9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS27830/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a31350>
2026-03-30 10:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_1347a6cf0b8d0ab4c3bd0d330ffb8816.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_1347a6cf0b8d0ab4c3bd0d330ffb8816.jpg saved to cache
2026-03-30 10:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f746f55f-9aaa-5066-80f5-c7221e116eee
2026-03-30 10:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e776d0>
2026-03-30 10:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_d7daccf01a134d22602b4706be41da9e.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_d7daccf01a134d22602b4706be41da9e.jpg saved to cache
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f746f55f-9aaa-5066-80f5-c7221e116eee
2026-03-30 10:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_34c40da6a0b5d907c5205cedfaa2d81f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_23b96fe68f9ee5df66f82d07a7e7309d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0a310>
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_34c40da6a0b5d907c5205cedfaa2d81f.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_34c40da6a0b5d907c5205cedfaa2d81f.jpg saved to cache
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f746f55f-9aaa-5066-80f5-c7221e116eee
2026-03-30 10:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_dc432d21f78bef0d7c12aa58082de663.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5074990>
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_23b96fe68f9ee5df66f82d07a7e7309d.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_23b96fe68f9ee5df66f82d07a7e7309d.jpg saved to cache
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f746f55f-9aaa-5066-80f5-c7221e116eee
2026-03-30 10:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_54fd1b5076e7dd0ec2b4bb4e162ff917.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da1d50>
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_dc432d21f78bef0d7c12aa58082de663.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_dc432d21f78bef0d7c12aa58082de663.jpg saved to cache
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f746f55f-9aaa-5066-80f5-c7221e116eee
2026-03-30 10:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_d93b504684b857a74c6b73f8cc507565.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fee6d0>
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_54fd1b5076e7dd0ec2b4bb4e162ff917.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_54fd1b5076e7dd0ec2b4bb4e162ff917.jpg saved to cache
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f746f55f-9aaa-5066-80f5-c7221e116eee
2026-03-30 10:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_d1351996e1533a570b63af99c0973b78.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea08d0>
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_d93b504684b857a74c6b73f8cc507565.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_d93b504684b857a74c6b73f8cc507565.jpg saved to cache
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f746f55f-9aaa-5066-80f5-c7221e116eee
2026-03-30 10:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_9e0d1dc26bee37bbe16a070987509deb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4feec10>
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_d1351996e1533a570b63af99c0973b78.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_d1351996e1533a570b63af99c0973b78.jpg saved to cache
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f746f55f-9aaa-5066-80f5-c7221e116eee
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6ee10>
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_9e0d1dc26bee37bbe16a070987509deb.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_9e0d1dc26bee37bbe16a070987509deb.jpg saved to cache
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f746f55f-9aaa-5066-80f5-c7221e116eee
2026-03-30 10:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_6eb92a8338c7bae00d94566d42677527.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5107bd0>
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F6e%252Fe96e5d265591d46381401a035a4a8bc2%252Fpa%252FAR54418_6eb92a8338c7bae00d94566d42677527.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_6eb92a8338c7bae00d94566d42677527.jpg saved to cache
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f746f55f-9aaa-5066-80f5-c7221e116eee
2026-03-30 10:46:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f746f55f-9aaa-5066-80f5-c7221e116eee, skipping ID generation
2026-03-30 10:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f746f55f-9aaa-5066-80f5-c7221e116eee with scrape type 1
2026-03-30 10:46:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f746f55f-9aaa-5066-80f5-c7221e116eee sending to next pipeline
2026-03-30 10:46:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f746f55f-9aaa-5066-80f5-c7221e116eee, identifier: AR54418
2026-03-30 10:46:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f746f55f-9aaa-5066-80f5-c7221e116eee with identifier: AR54418
2026-03-30 10:46:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f746f55f-9aaa-5066-80f5-c7221e116eee with identifier: AR54418
2026-03-30 10:46:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f746f55f-9aaa-5066-80f5-c7221e116eee with identifier: AR54418 to the API
2026-03-30 10:46:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_6eb92a8338c7bae00d94566d42677527.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:57:16Z',
 'fuel_type': 'petrol',
 'id': 'f746f55f-9aaa-5066-80f5-c7221e116eee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR54418',
 'listing': 'auction',
 'location': 'DE, Bayreuth',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 108412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_6eb92a8338c7bae00d94566d42677527.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_9e0d1dc26bee37bbe16a070987509deb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_d1351996e1533a570b63af99c0973b78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_d93b504684b857a74c6b73f8cc507565.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_54fd1b5076e7dd0ec2b4bb4e162ff917.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_23b96fe68f9ee5df66f82d07a7e7309d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_34c40da6a0b5d907c5205cedfaa2d81f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_dc432d21f78bef0d7c12aa58082de663.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_d7daccf01a134d22602b4706be41da9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f746f55f-9aaa-5066-80f5-c7221e116eee/f746f55f-9aaa-5066-80f5-c7221e116eee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/6e/e96e5d265591d46381401a035a4a8bc2/pa/AR54418_1347a6cf0b8d0ab4c3bd0d330ffb8816.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 White up!',
 'transmission': 'manual',
 'trim': 'White',
 'year': 2012}
2026-03-30 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR54418%27 HTTP/1.1" 200 None
2026-03-30 10:46:34 [auto1.de] INFO: Saving data for AR54418: {'created_time': 1774867594.367476, 'last_price_update_time': 1774867594.367487, 'auction_closing_time': 1774972636.0}
2026-03-30 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR54418') HTTP/1.1" 204 0
2026-03-30 10:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PJ55478> (referer: https://www.auto1.com/v1/car-details-view/PJ55478/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b35d727-e19b-57da-9afd-7a473c5872da with identifier: PJ55478
2026-03-30 10:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b35d727-e19b-57da-9afd-7a473c5872da with scrape type 1
2026-03-30 10:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3b35d727-e19b-57da-9afd-7a473c5872da
2026-03-30 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa8%252Fe4a8bf3e35e49eda00736b9db433ed39%252Fpa%252FPJ55478_09b8678c4efa60100724af29d34744b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_09b8678c4efa60100724af29d34744b3.jpg not downloaded yet
2026-03-30 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa8%252Fe4a8bf3e35e49eda00736b9db433ed39%252Fpa%252FPJ55478_706386d26938218b3bc430eac37bb81d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_706386d26938218b3bc430eac37bb81d.jpg not downloaded yet
2026-03-30 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa8%252Fe4a8bf3e35e49eda00736b9db433ed39%252Fpa%252FPJ55478_392955865138a58b3f0d0ae92c845b47.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_392955865138a58b3f0d0ae92c845b47.jpg not downloaded yet
2026-03-30 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa8%252Fe4a8bf3e35e49eda00736b9db433ed39%252Fpa%252FPJ55478_162322ee2ecdd3524aabcd6d64f0f938.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_162322ee2ecdd3524aabcd6d64f0f938.jpg not downloaded yet
2026-03-30 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa8%252Fe4a8bf3e35e49eda00736b9db433ed39%252Fpa%252FPJ55478_c0e9b384274652c5f46fabeac8d245f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_c0e9b384274652c5f46fabeac8d245f9.jpg not downloaded yet
2026-03-30 10:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL20348/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_c0e9b384274652c5f46fabeac8d245f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6eb90>
2026-03-30 10:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b35d727-e19b-57da-9afd-7a473c5872da/3b35d727-e19b-57da-9afd-7a473c5872da_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa8%252Fe4a8bf3e35e49eda00736b9db433ed39%252Fpa%252FPJ55478_c0e9b384274652c5f46fabeac8d245f9.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_c0e9b384274652c5f46fabeac8d245f9.jpg saved to cache
2026-03-30 10:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b35d727-e19b-57da-9afd-7a473c5872da
2026-03-30 10:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_162322ee2ecdd3524aabcd6d64f0f938.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0b590>
2026-03-30 10:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b35d727-e19b-57da-9afd-7a473c5872da/3b35d727-e19b-57da-9afd-7a473c5872da_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa8%252Fe4a8bf3e35e49eda00736b9db433ed39%252Fpa%252FPJ55478_162322ee2ecdd3524aabcd6d64f0f938.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_162322ee2ecdd3524aabcd6d64f0f938.jpg saved to cache
2026-03-30 10:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b35d727-e19b-57da-9afd-7a473c5872da
2026-03-30 10:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:38 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 9476 | hits on page: 40
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: RT97145
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: YM37880
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: VL31583
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: JB74437
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB74437%27 HTTP/1.1" 200 None
2026-03-30 10:46:38 [auto1.de] INFO: Scrape type for JB74437: 0
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: BX70852
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: AJ81132
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ81132%27 HTTP/1.1" 200 None
2026-03-30 10:46:38 [auto1.de] INFO: Scrape type for AJ81132: 0
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: UL45474
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: RZ67892
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: WH06926
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: CU85166
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: AD23421
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD23421%27 HTTP/1.1" 200 None
2026-03-30 10:46:38 [auto1.de] INFO: Scrape type for AD23421: 0
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: NP43212
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: UV35229
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: JM46671
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM46671%27 HTTP/1.1" 200 None
2026-03-30 10:46:38 [auto1.de] INFO: Scrape type for JM46671: 0
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: YJ94163
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: ZA52966
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: PK53394
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK53394%27 HTTP/1.1" 200 None
2026-03-30 10:46:38 [auto1.de] INFO: Scrape type for PK53394: 1
2026-03-30 10:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_392955865138a58b3f0d0ae92c845b47.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: UV59286
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: WT13361
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: DL10324
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: JK71664
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK71664%27 HTTP/1.1" 200 None
2026-03-30 10:46:38 [auto1.de] INFO: Scrape type for JK71664: 1
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: YV49543
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: SX45825
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX45825%27 HTTP/1.1" 200 None
2026-03-30 10:46:38 [auto1.de] INFO: Scrape type for SX45825: 1
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: MD17781
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: XM95043
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: BX85596
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: SV41161
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV41161%27 HTTP/1.1" 200 None
2026-03-30 10:46:38 [auto1.de] INFO: Scrape type for SV41161: 1
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: US50096
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US50096%27 HTTP/1.1" 200 None
2026-03-30 10:46:38 [auto1.de] INFO: Scrape type for US50096: 1
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: HU25132
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: WL29620
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: ME10410
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME10410%27 HTTP/1.1" 200 None
2026-03-30 10:46:38 [auto1.de] INFO: Scrape type for ME10410: 2
2026-03-30 10:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bd6aa29-6d52-5110-8803-24501a0b85ac with identifier: ME10410
2026-03-30 10:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bd6aa29-6d52-5110-8803-24501a0b85ac with scrape type 2
2026-03-30 10:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bd6aa29-6d52-5110-8803-24501a0b85ac with scrape type 2
2026-03-30 10:46:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bd6aa29-6d52-5110-8803-24501a0b85ac, identifier: ME10410
2026-03-30 10:46:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bd6aa29-6d52-5110-8803-24501a0b85ac with identifier: ME10410
2026-03-30 10:46:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bd6aa29-6d52-5110-8803-24501a0b85ac with identifier: ME10410
2026-03-30 10:46:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bd6aa29-6d52-5110-8803-24501a0b85ac with identifier: ME10410 to the API
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:49:20Z',
 'fuel_type': 'diesel',
 'id': '8bd6aa29-6d52-5110-8803-24501a0b85ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME10410',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 71019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-28',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2018}
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME10410%27 HTTP/1.1" 200 None
2026-03-30 10:46:38 [auto1.de] INFO: Saving data for ME10410: {'auction_closing_time': 1774972160.0, 'created_time': 1773307875.783377, 'last_price_update_time': 1774867598.676042}
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME10410') HTTP/1.1" 204 0
2026-03-30 10:46:38 [auto1.de] INFO: Found listing with ID: JW10834
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW10834%27 HTTP/1.1" 200 None
2026-03-30 10:46:38 [auto1.de] INFO: Scrape type for JW10834: 2
2026-03-30 10:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a9545b8-258b-5db1-9228-c764c3951722 with identifier: JW10834
2026-03-30 10:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a9545b8-258b-5db1-9228-c764c3951722 with scrape type 2
2026-03-30 10:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a9545b8-258b-5db1-9228-c764c3951722 with scrape type 2
2026-03-30 10:46:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a9545b8-258b-5db1-9228-c764c3951722, identifier: JW10834
2026-03-30 10:46:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a9545b8-258b-5db1-9228-c764c3951722 with identifier: JW10834
2026-03-30 10:46:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a9545b8-258b-5db1-9228-c764c3951722 with identifier: JW10834
2026-03-30 10:46:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a9545b8-258b-5db1-9228-c764c3951722 with identifier: JW10834 to the API
2026-03-30 10:46:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-31T15:51:41Z',
 'fuel_type': 'diesel',
 'id': '6a9545b8-258b-5db1-9228-c764c3951722',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW10834',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 141046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-19',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI 4Matic BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic BlueTEC Avantgarde',
 'year': 2013}
2026-03-30 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW10834%27 HTTP/1.1" 200 None
2026-03-30 10:46:39 [auto1.de] INFO: Saving data for JW10834: {'auction_closing_time': 1774972301.0, 'created_time': 1773225973.519337, 'last_price_update_time': 1774867599.261525}
2026-03-30 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW10834') HTTP/1.1" 204 0
2026-03-30 10:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da3f90>
2026-03-30 10:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b35d727-e19b-57da-9afd-7a473c5872da/3b35d727-e19b-57da-9afd-7a473c5872da_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa8%252Fe4a8bf3e35e49eda00736b9db433ed39%252Fpa%252FPJ55478_392955865138a58b3f0d0ae92c845b47.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_392955865138a58b3f0d0ae92c845b47.jpg saved to cache
2026-03-30 10:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b35d727-e19b-57da-9afd-7a473c5872da
2026-03-30 10:46:39 [auto1.de] INFO: Found listing with ID: LM07761
2026-03-30 10:46:39 [auto1.de] INFO: Found listing with ID: YV90191
2026-03-30 10:46:39 [auto1.de] INFO: Found listing with ID: NK05047
2026-03-30 10:46:39 [auto1.de] INFO: Found listing with ID: AG32992
2026-03-30 10:46:39 [auto1.de] INFO: Found listing with ID: BL26241
2026-03-30 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL26241%27 HTTP/1.1" 200 None
2026-03-30 10:46:39 [auto1.de] INFO: Scrape type for BL26241: 1
2026-03-30 10:46:39 [auto1.de] INFO: Found listing with ID: BV02154
2026-03-30 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV02154%27 HTTP/1.1" 200 None
2026-03-30 10:46:39 [auto1.de] INFO: Scrape type for BV02154: 1
2026-03-30 10:46:39 [auto1.de] INFO: Found listing with ID: JL60015
2026-03-30 10:46:39 [auto1.de] INFO: Found listing with ID: TC70677
2026-03-30 10:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS24409> (referer: https://www.auto1.com/v1/car-details-view/TS24409/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 226ae44f-4615-5815-a3b0-42a8d57d126e with identifier: TS24409
2026-03-30 10:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 226ae44f-4615-5815-a3b0-42a8d57d126e with scrape type 1
2026-03-30 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 226ae44f-4615-5815-a3b0-42a8d57d126e
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_a56db187176c6b5bb28007cc89051747.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_a56db187176c6b5bb28007cc89051747.jpg not downloaded yet
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_9018797169dc1cbf17c5d7409dd7c21e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_9018797169dc1cbf17c5d7409dd7c21e.jpg not downloaded yet
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_1d18ba4d57efe529246d0d68b889195c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_1d18ba4d57efe529246d0d68b889195c.jpg not downloaded yet
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_dc2fca97ed6d7bb940d631b772af8cdd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_dc2fca97ed6d7bb940d631b772af8cdd.jpg not downloaded yet
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_80897540c90bf1607bae620b6b38e9f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_80897540c90bf1607bae620b6b38e9f0.jpg not downloaded yet
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_5ba9ba864f2861f83b8e0dcf2809db5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_5ba9ba864f2861f83b8e0dcf2809db5d.jpg not downloaded yet
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_e05a4b391a512b9c4c539bbf10e7f388.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_e05a4b391a512b9c4c539bbf10e7f388.jpg not downloaded yet
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_24b3687957ac765ea48a7526c2a0f447.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_24b3687957ac765ea48a7526c2a0f447.jpg not downloaded yet
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_e0cae18ebeaae53e0bd49fe32908d25c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_e0cae18ebeaae53e0bd49fe32908d25c.jpg not downloaded yet
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_ccba83e32c7c0629ec45e73077be3fa6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_ccba83e32c7c0629ec45e73077be3fa6.jpg not downloaded yet
2026-03-30 10:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK17732/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_ccba83e32c7c0629ec45e73077be3fa6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef79fae90>
2026-03-30 10:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_ccba83e32c7c0629ec45e73077be3fa6.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_ccba83e32c7c0629ec45e73077be3fa6.jpg saved to cache
2026-03-30 10:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 226ae44f-4615-5815-a3b0-42a8d57d126e
2026-03-30 10:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR67128/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_e0cae18ebeaae53e0bd49fe32908d25c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee1d10>
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_e0cae18ebeaae53e0bd49fe32908d25c.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_e0cae18ebeaae53e0bd49fe32908d25c.jpg saved to cache
2026-03-30 10:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 226ae44f-4615-5815-a3b0-42a8d57d126e
2026-03-30 10:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_24b3687957ac765ea48a7526c2a0f447.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6f2d0>
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_24b3687957ac765ea48a7526c2a0f447.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_24b3687957ac765ea48a7526c2a0f447.jpg saved to cache
2026-03-30 10:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 226ae44f-4615-5815-a3b0-42a8d57d126e
2026-03-30 10:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JK85727> (referer: https://www.auto1.com/v1/car-details-view/JK85727/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_e05a4b391a512b9c4c539bbf10e7f388.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a3b987f-8f3c-5472-8c49-8144c7d84da8 with identifier: JK85727
2026-03-30 10:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a3b987f-8f3c-5472-8c49-8144c7d84da8 with scrape type 1
2026-03-30 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a3b987f-8f3c-5472-8c49-8144c7d84da8
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F86%252Ff6860a5ff1830bbcf7e92d79d0f9a281%252Fpa%252FJK85727_2dc0c54bcb16ce9113ed48e42f80d574.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_2dc0c54bcb16ce9113ed48e42f80d574.jpg already downloaded
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F86%252Ff6860a5ff1830bbcf7e92d79d0f9a281%252Fpa%252FJK85727_7b9aa804ac27ee082cf76eceb590bfba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_7b9aa804ac27ee082cf76eceb590bfba.jpg already downloaded
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F86%252Ff6860a5ff1830bbcf7e92d79d0f9a281%252Fpa%252FJK85727_74f0cae47c09d4879279331431d9abd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_74f0cae47c09d4879279331431d9abd7.jpg already downloaded
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F86%252Ff6860a5ff1830bbcf7e92d79d0f9a281%252Fpa%252FJK85727_19ba23f6f355aa46160c8ae3b76fb43a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_19ba23f6f355aa46160c8ae3b76fb43a.jpg already downloaded
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F86%252Ff6860a5ff1830bbcf7e92d79d0f9a281%252Fpa%252FJK85727_bb027400e682bf6b386489cd6167a292.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_bb027400e682bf6b386489cd6167a292.jpg already downloaded
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F86%252Ff6860a5ff1830bbcf7e92d79d0f9a281%252Fpa%252FJK85727_fab7252f995c410ad87ca29fb95b1bbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_fab7252f995c410ad87ca29fb95b1bbb.jpg already downloaded
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F86%252Ff6860a5ff1830bbcf7e92d79d0f9a281%252Fpa%252FJK85727_fd2c4caed6b35ccba358568f55a8cc9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_fd2c4caed6b35ccba358568f55a8cc9d.jpg already downloaded
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F86%252Ff6860a5ff1830bbcf7e92d79d0f9a281%252Fpa%252FJK85727_93c4fc3880aca7e99ec753872df832be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_93c4fc3880aca7e99ec753872df832be.jpg already downloaded
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F86%252Ff6860a5ff1830bbcf7e92d79d0f9a281%252Fpa%252FJK85727_127aa95cf959b1cee52e8ac15da08642.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_127aa95cf959b1cee52e8ac15da08642.jpg already downloaded
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F86%252Ff6860a5ff1830bbcf7e92d79d0f9a281%252Fpa%252FJK85727_28a6dfbc9a3f869e855fd962d9560059.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_28a6dfbc9a3f869e855fd962d9560059.jpg already downloaded
2026-03-30 10:46:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a3b987f-8f3c-5472-8c49-8144c7d84da8, identifier: JK85727
2026-03-30 10:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a3b987f-8f3c-5472-8c49-8144c7d84da8 with identifier: JK85727
2026-03-30 10:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a3b987f-8f3c-5472-8c49-8144c7d84da8 with identifier: JK85727
2026-03-30 10:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a3b987f-8f3c-5472-8c49-8144c7d84da8 with identifier: JK85727 to the API
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JK85727>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 286,
 'expiration_date': '2026-03-31T15:00:06Z',
 'fuel_type': 'diesel',
 'id': '9a3b987f-8f3c-5472-8c49-8144c7d84da8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK85727',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 93024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_2dc0c54bcb16ce9113ed48e42f80d574.jpg',
                'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_7b9aa804ac27ee082cf76eceb590bfba.jpg',
                'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_74f0cae47c09d4879279331431d9abd7.jpg',
                'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_19ba23f6f355aa46160c8ae3b76fb43a.jpg',
                'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_bb027400e682bf6b386489cd6167a292.jpg',
                'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_fab7252f995c410ad87ca29fb95b1bbb.jpg',
                'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_fd2c4caed6b35ccba358568f55a8cc9d.jpg',
                'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_93c4fc3880aca7e99ec753872df832be.jpg',
                'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_127aa95cf959b1cee52e8ac15da08642.jpg',
                'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_28a6dfbc9a3f869e855fd962d9560059.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3b987f-8f3c-5472-8c49-8144c7d84da8/9a3b987f-8f3c-5472-8c49-8144c7d84da8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2678098,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_2dc0c54bcb16ce9113ed48e42f80d574.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3b987f-8f3c-5472-8c49-8144c7d84da8/9a3b987f-8f3c-5472-8c49-8144c7d84da8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_7b9aa804ac27ee082cf76eceb590bfba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3b987f-8f3c-5472-8c49-8144c7d84da8/9a3b987f-8f3c-5472-8c49-8144c7d84da8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_74f0cae47c09d4879279331431d9abd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3b987f-8f3c-5472-8c49-8144c7d84da8/9a3b987f-8f3c-5472-8c49-8144c7d84da8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2926672,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_19ba23f6f355aa46160c8ae3b76fb43a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3b987f-8f3c-5472-8c49-8144c7d84da8/9a3b987f-8f3c-5472-8c49-8144c7d84da8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2656245,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_bb027400e682bf6b386489cd6167a292.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3b987f-8f3c-5472-8c49-8144c7d84da8/9a3b987f-8f3c-5472-8c49-8144c7d84da8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2878593,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_fab7252f995c410ad87ca29fb95b1bbb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3b987f-8f3c-5472-8c49-8144c7d84da8/9a3b987f-8f3c-5472-8c49-8144c7d84da8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2883766,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_fd2c4caed6b35ccba358568f55a8cc9d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3b987f-8f3c-5472-8c49-8144c7d84da8/9a3b987f-8f3c-5472-8c49-8144c7d84da8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_93c4fc3880aca7e99ec753872df832be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3b987f-8f3c-5472-8c49-8144c7d84da8/9a3b987f-8f3c-5472-8c49-8144c7d84da8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2757386,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_127aa95cf959b1cee52e8ac15da08642.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a3b987f-8f3c-5472-8c49-8144c7d84da8/9a3b987f-8f3c-5472-8c49-8144c7d84da8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/86/f6860a5ff1830bbcf7e92d79d0f9a281/pa/JK85727_28a6dfbc9a3f869e855fd962d9560059.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A7 Sportback 50 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK85727%27 HTTP/1.1" 200 None
2026-03-30 10:46:45 [auto1.de] INFO: Saving data for JK85727: {'created_time': 1774867605.949308, 'last_price_update_time': 1774867605.949319, 'auction_closing_time': 1774969206.0}
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK85727') HTTP/1.1" 204 0
2026-03-30 10:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_5ba9ba864f2861f83b8e0dcf2809db5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da1690>
2026-03-30 10:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_e05a4b391a512b9c4c539bbf10e7f388.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_e05a4b391a512b9c4c539bbf10e7f388.jpg saved to cache
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 226ae44f-4615-5815-a3b0-42a8d57d126e
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c6750>
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_5ba9ba864f2861f83b8e0dcf2809db5d.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_5ba9ba864f2861f83b8e0dcf2809db5d.jpg saved to cache
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 226ae44f-4615-5815-a3b0-42a8d57d126e
2026-03-30 10:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_80897540c90bf1607bae620b6b38e9f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_dc2fca97ed6d7bb940d631b772af8cdd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef502b950>
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_80897540c90bf1607bae620b6b38e9f0.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_80897540c90bf1607bae620b6b38e9f0.jpg saved to cache
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 226ae44f-4615-5815-a3b0-42a8d57d126e
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5028810>
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_dc2fca97ed6d7bb940d631b772af8cdd.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_dc2fca97ed6d7bb940d631b772af8cdd.jpg saved to cache
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 226ae44f-4615-5815-a3b0-42a8d57d126e
2026-03-30 10:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_1d18ba4d57efe529246d0d68b889195c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd16d0>
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_1d18ba4d57efe529246d0d68b889195c.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_1d18ba4d57efe529246d0d68b889195c.jpg saved to cache
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 226ae44f-4615-5815-a3b0-42a8d57d126e
2026-03-30 10:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_9018797169dc1cbf17c5d7409dd7c21e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_a56db187176c6b5bb28007cc89051747.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5105e10>
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_9018797169dc1cbf17c5d7409dd7c21e.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_9018797169dc1cbf17c5d7409dd7c21e.jpg saved to cache
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 226ae44f-4615-5815-a3b0-42a8d57d126e
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da10d0>
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F67%252F4c67008a0f35116b0e7b38c63ebd9403%252Fpa%252FTS24409_a56db187176c6b5bb28007cc89051747.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_a56db187176c6b5bb28007cc89051747.jpg saved to cache
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 226ae44f-4615-5815-a3b0-42a8d57d126e
2026-03-30 10:46:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 226ae44f-4615-5815-a3b0-42a8d57d126e, skipping ID generation
2026-03-30 10:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 226ae44f-4615-5815-a3b0-42a8d57d126e with scrape type 1
2026-03-30 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 226ae44f-4615-5815-a3b0-42a8d57d126e sending to next pipeline
2026-03-30 10:46:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 226ae44f-4615-5815-a3b0-42a8d57d126e, identifier: TS24409
2026-03-30 10:46:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 226ae44f-4615-5815-a3b0-42a8d57d126e with identifier: TS24409
2026-03-30 10:46:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 226ae44f-4615-5815-a3b0-42a8d57d126e with identifier: TS24409
2026-03-30 10:46:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 226ae44f-4615-5815-a3b0-42a8d57d126e with identifier: TS24409 to the API
2026-03-30 10:46:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_a56db187176c6b5bb28007cc89051747.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:22:28Z',
 'fuel_type': 'diesel',
 'id': '226ae44f-4615-5815-a3b0-42a8d57d126e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS24409',
 'listing': 'auction',
 'location': 'DE, Reutlingen',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 138552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_a56db187176c6b5bb28007cc89051747.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_9018797169dc1cbf17c5d7409dd7c21e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_1d18ba4d57efe529246d0d68b889195c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_dc2fca97ed6d7bb940d631b772af8cdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_80897540c90bf1607bae620b6b38e9f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_5ba9ba864f2861f83b8e0dcf2809db5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_e05a4b391a512b9c4c539bbf10e7f388.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_24b3687957ac765ea48a7526c2a0f447.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_e0cae18ebeaae53e0bd49fe32908d25c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_226ae44f-4615-5815-a3b0-42a8d57d126e/226ae44f-4615-5815-a3b0-42a8d57d126e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/67/4c67008a0f35116b0e7b38c63ebd9403/pa/TS24409_ccba83e32c7c0629ec45e73077be3fa6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen DS3 1.6 Blue-HDi SportChic',
 'transmission': 'manual',
 'trim': 'SportChic',
 'year': 2015}
2026-03-30 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS24409%27 HTTP/1.1" 200 None
2026-03-30 10:46:47 [auto1.de] INFO: Saving data for TS24409: {'created_time': 1774867607.482491, 'last_price_update_time': 1774867607.482504, 'auction_closing_time': 1774970548.0}
2026-03-30 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS24409') HTTP/1.1" 204 0
2026-03-30 10:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS27830> (referer: https://www.auto1.com/v1/car-details-view/NS27830/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e47533a-c28f-5ee8-ac1e-8a75a21290cf with identifier: NS27830
2026-03-30 10:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e47533a-c28f-5ee8-ac1e-8a75a21290cf with scrape type 1
2026-03-30 10:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e47533a-c28f-5ee8-ac1e-8a75a21290cf
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_e5d760632a809fd57ec6bc6cabaa05bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_e5d760632a809fd57ec6bc6cabaa05bc.jpg not downloaded yet
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_f98c263057caad3dfd4624f58929c564.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_f98c263057caad3dfd4624f58929c564.jpg not downloaded yet
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_60daf649a59e3163a4c517cab665f807.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_60daf649a59e3163a4c517cab665f807.jpg not downloaded yet
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_e235a68d0f3647538a0a71876a710cac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_e235a68d0f3647538a0a71876a710cac.jpg not downloaded yet
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_58fb2533833dccc05e7f85ff662d7e1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_58fb2533833dccc05e7f85ff662d7e1a.jpg not downloaded yet
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_86ba1a07df382d9f8e60e80fe333c51e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_86ba1a07df382d9f8e60e80fe333c51e.jpg not downloaded yet
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_0ff75b5a7020c6fd07778b7e8454e8ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_0ff75b5a7020c6fd07778b7e8454e8ea.jpg not downloaded yet
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_c8d8e31c109e58438441593b75b9107b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_c8d8e31c109e58438441593b75b9107b.jpg not downloaded yet
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_78f3d044ce5b9ccb8ae726c508d61121.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_78f3d044ce5b9ccb8ae726c508d61121.jpg not downloaded yet
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_e09ec21b91e0255ce788620d2ed303c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_e09ec21b91e0255ce788620d2ed303c2.jpg not downloaded yet
2026-03-30 10:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM37880> (referer: https://www.auto1.com/v1/car-details-view/YM37880/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_e09ec21b91e0255ce788620d2ed303c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fada02cb-789b-5bd4-978c-9271329c2d72 with identifier: YM37880
2026-03-30 10:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fada02cb-789b-5bd4-978c-9271329c2d72 with scrape type 1
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fada02cb-789b-5bd4-978c-9271329c2d72
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F08%252Fd408ddbde029a046272fdb40c2607cf8%252Fpa%252FYM37880_a7c3fb12c6b7db67ac9a9de58e2744cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_a7c3fb12c6b7db67ac9a9de58e2744cc.jpg already downloaded
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F08%252Fd408ddbde029a046272fdb40c2607cf8%252Fpa%252FYM37880_999caff7f193c2324894ed509ad83ffc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_999caff7f193c2324894ed509ad83ffc.jpg already downloaded
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F08%252Fd408ddbde029a046272fdb40c2607cf8%252Fpa%252FYM37880_13cbada6c693f8b86ebb971844b846a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_13cbada6c693f8b86ebb971844b846a1.jpg already downloaded
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F08%252Fd408ddbde029a046272fdb40c2607cf8%252Fpa%252FYM37880_d21dde677ae78f09136db07e67eb57cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_d21dde677ae78f09136db07e67eb57cb.jpg already downloaded
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F08%252Fd408ddbde029a046272fdb40c2607cf8%252Fpa%252FYM37880_658bf6bd7946361df99ddbee9e2a49a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_658bf6bd7946361df99ddbee9e2a49a6.jpg already downloaded
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F08%252Fd408ddbde029a046272fdb40c2607cf8%252Fpa%252FYM37880_634346264226c552f51602c1f75dd40f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_634346264226c552f51602c1f75dd40f.jpg already downloaded
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F08%252Fd408ddbde029a046272fdb40c2607cf8%252Fpa%252FYM37880_1b2ad7a20f8b9a8dfc9af4ee94690015.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_1b2ad7a20f8b9a8dfc9af4ee94690015.jpg already downloaded
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F08%252Fd408ddbde029a046272fdb40c2607cf8%252Fpa%252FYM37880_fcb74c36f46c6c040f5f4b763bc96f5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_fcb74c36f46c6c040f5f4b763bc96f5a.jpg already downloaded
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F08%252Fd408ddbde029a046272fdb40c2607cf8%252Fpa%252FYM37880_1b289aaa1d4f59583aa861f26ff8f8fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_1b289aaa1d4f59583aa861f26ff8f8fe.jpg already downloaded
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F08%252Fd408ddbde029a046272fdb40c2607cf8%252Fpa%252FYM37880_bab96e1d9b22aaf09d65b732ebe8f82c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_bab96e1d9b22aaf09d65b732ebe8f82c.jpg already downloaded
2026-03-30 10:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fada02cb-789b-5bd4-978c-9271329c2d72, identifier: YM37880
2026-03-30 10:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fada02cb-789b-5bd4-978c-9271329c2d72 with identifier: YM37880
2026-03-30 10:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fada02cb-789b-5bd4-978c-9271329c2d72 with identifier: YM37880
2026-03-30 10:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fada02cb-789b-5bd4-978c-9271329c2d72 with identifier: YM37880 to the API
2026-03-30 10:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YM37880>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:34:35Z',
 'fuel_type': 'diesel',
 'id': 'fada02cb-789b-5bd4-978c-9271329c2d72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM37880',
 'listing': 'auction',
 'location': 'DE, Fockbek',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 191944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_a7c3fb12c6b7db67ac9a9de58e2744cc.jpg',
                'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_999caff7f193c2324894ed509ad83ffc.jpg',
                'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_13cbada6c693f8b86ebb971844b846a1.jpg',
                'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_d21dde677ae78f09136db07e67eb57cb.jpg',
                'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_658bf6bd7946361df99ddbee9e2a49a6.jpg',
                'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_634346264226c552f51602c1f75dd40f.jpg',
                'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_1b2ad7a20f8b9a8dfc9af4ee94690015.jpg',
                'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_fcb74c36f46c6c040f5f4b763bc96f5a.jpg',
                'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_1b289aaa1d4f59583aa861f26ff8f8fe.jpg',
                'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_bab96e1d9b22aaf09d65b732ebe8f82c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fada02cb-789b-5bd4-978c-9271329c2d72/fada02cb-789b-5bd4-978c-9271329c2d72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2774302,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_a7c3fb12c6b7db67ac9a9de58e2744cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fada02cb-789b-5bd4-978c-9271329c2d72/fada02cb-789b-5bd4-978c-9271329c2d72_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_999caff7f193c2324894ed509ad83ffc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fada02cb-789b-5bd4-978c-9271329c2d72/fada02cb-789b-5bd4-978c-9271329c2d72_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2631080,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_13cbada6c693f8b86ebb971844b846a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fada02cb-789b-5bd4-978c-9271329c2d72/fada02cb-789b-5bd4-978c-9271329c2d72_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2653224,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_d21dde677ae78f09136db07e67eb57cb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fada02cb-789b-5bd4-978c-9271329c2d72/fada02cb-789b-5bd4-978c-9271329c2d72_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2585500,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_658bf6bd7946361df99ddbee9e2a49a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fada02cb-789b-5bd4-978c-9271329c2d72/fada02cb-789b-5bd4-978c-9271329c2d72_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2304108,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_634346264226c552f51602c1f75dd40f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fada02cb-789b-5bd4-978c-9271329c2d72/fada02cb-789b-5bd4-978c-9271329c2d72_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_1b2ad7a20f8b9a8dfc9af4ee94690015.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fada02cb-789b-5bd4-978c-9271329c2d72/fada02cb-789b-5bd4-978c-9271329c2d72_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_fcb74c36f46c6c040f5f4b763bc96f5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fada02cb-789b-5bd4-978c-9271329c2d72/fada02cb-789b-5bd4-978c-9271329c2d72_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2719108,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_1b289aaa1d4f59583aa861f26ff8f8fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fada02cb-789b-5bd4-978c-9271329c2d72/fada02cb-789b-5bd4-978c-9271329c2d72_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2775334,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/08/d408ddbde029a046272fdb40c2607cf8/pa/YM37880_bab96e1d9b22aaf09d65b732ebe8f82c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2013}
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM37880%27 HTTP/1.1" 200 None
2026-03-30 10:46:52 [auto1.de] INFO: Saving data for YM37880: {'created_time': 1774867612.172669, 'last_price_update_time': 1774867612.172678, 'auction_closing_time': 1774971275.0}
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM37880') HTTP/1.1" 204 0
2026-03-30 10:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_78f3d044ce5b9ccb8ae726c508d61121.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da0ed0>
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_e09ec21b91e0255ce788620d2ed303c2.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_e09ec21b91e0255ce788620d2ed303c2.jpg saved to cache
2026-03-30 10:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e47533a-c28f-5ee8-ac1e-8a75a21290cf
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d78d90>
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_78f3d044ce5b9ccb8ae726c508d61121.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_78f3d044ce5b9ccb8ae726c508d61121.jpg saved to cache
2026-03-30 10:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e47533a-c28f-5ee8-ac1e-8a75a21290cf
2026-03-30 10:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_c8d8e31c109e58438441593b75b9107b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_0ff75b5a7020c6fd07778b7e8454e8ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da2990>
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_c8d8e31c109e58438441593b75b9107b.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_c8d8e31c109e58438441593b75b9107b.jpg saved to cache
2026-03-30 10:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e47533a-c28f-5ee8-ac1e-8a75a21290cf
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2de90>
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_0ff75b5a7020c6fd07778b7e8454e8ea.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_0ff75b5a7020c6fd07778b7e8454e8ea.jpg saved to cache
2026-03-30 10:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e47533a-c28f-5ee8-ac1e-8a75a21290cf
2026-03-30 10:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_86ba1a07df382d9f8e60e80fe333c51e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e50910>
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_86ba1a07df382d9f8e60e80fe333c51e.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_86ba1a07df382d9f8e60e80fe333c51e.jpg saved to cache
2026-03-30 10:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e47533a-c28f-5ee8-ac1e-8a75a21290cf
2026-03-30 10:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_58fb2533833dccc05e7f85ff662d7e1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_e235a68d0f3647538a0a71876a710cac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595c190>
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_58fb2533833dccc05e7f85ff662d7e1a.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_58fb2533833dccc05e7f85ff662d7e1a.jpg saved to cache
2026-03-30 10:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e47533a-c28f-5ee8-ac1e-8a75a21290cf
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e50210>
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_e235a68d0f3647538a0a71876a710cac.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_e235a68d0f3647538a0a71876a710cac.jpg saved to cache
2026-03-30 10:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e47533a-c28f-5ee8-ac1e-8a75a21290cf
2026-03-30 10:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_60daf649a59e3163a4c517cab665f807.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_f98c263057caad3dfd4624f58929c564.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c62d0>
2026-03-30 10:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_60daf649a59e3163a4c517cab665f807.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_60daf649a59e3163a4c517cab665f807.jpg saved to cache
2026-03-30 10:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e47533a-c28f-5ee8-ac1e-8a75a21290cf
2026-03-30 10:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_e5d760632a809fd57ec6bc6cabaa05bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d78310>
2026-03-30 10:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_f98c263057caad3dfd4624f58929c564.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_f98c263057caad3dfd4624f58929c564.jpg saved to cache
2026-03-30 10:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e47533a-c28f-5ee8-ac1e-8a75a21290cf
2026-03-30 10:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c5f10>
2026-03-30 10:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F15%252Ffd152385267989d908186250acc7ee3b%252Fpa%252FNS27830_e5d760632a809fd57ec6bc6cabaa05bc.jpg') HTTP/1.1" 204 0
2026-03-30 10:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_e5d760632a809fd57ec6bc6cabaa05bc.jpg saved to cache
2026-03-30 10:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e47533a-c28f-5ee8-ac1e-8a75a21290cf
2026-03-30 10:46:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e47533a-c28f-5ee8-ac1e-8a75a21290cf, skipping ID generation
2026-03-30 10:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e47533a-c28f-5ee8-ac1e-8a75a21290cf with scrape type 1
2026-03-30 10:46:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e47533a-c28f-5ee8-ac1e-8a75a21290cf sending to next pipeline
2026-03-30 10:46:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e47533a-c28f-5ee8-ac1e-8a75a21290cf, identifier: NS27830
2026-03-30 10:46:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e47533a-c28f-5ee8-ac1e-8a75a21290cf with identifier: NS27830
2026-03-30 10:46:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e47533a-c28f-5ee8-ac1e-8a75a21290cf with identifier: NS27830
2026-03-30 10:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e47533a-c28f-5ee8-ac1e-8a75a21290cf with identifier: NS27830 to the API
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:46:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_e5d760632a809fd57ec6bc6cabaa05bc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:28:56Z',
 'fuel_type': 'diesel',
 'id': '1e47533a-c28f-5ee8-ac1e-8a75a21290cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS27830',
 'listing': 'auction',
 'location': 'DE, Saarlouis',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 339453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_e5d760632a809fd57ec6bc6cabaa05bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_f98c263057caad3dfd4624f58929c564.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_60daf649a59e3163a4c517cab665f807.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_e235a68d0f3647538a0a71876a710cac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_58fb2533833dccc05e7f85ff662d7e1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_86ba1a07df382d9f8e60e80fe333c51e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_0ff75b5a7020c6fd07778b7e8454e8ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_c8d8e31c109e58438441593b75b9107b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_78f3d044ce5b9ccb8ae726c508d61121.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e47533a-c28f-5ee8-ac1e-8a75a21290cf/1e47533a-c28f-5ee8-ac1e-8a75a21290cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/15/fd152385267989d908186250acc7ee3b/pa/NS27830_e09ec21b91e0255ce788620d2ed303c2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Team 4Motion',
 'transmission': 'manual',
 'trim': 'Team 4Motion',
 'year': 2010}
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS27830%27 HTTP/1.1" 200 None
2026-03-30 10:46:53 [auto1.de] INFO: Saving data for NS27830: {'created_time': 1774867613.902303, 'last_price_update_time': 1774867613.902314, 'auction_closing_time': 1774970936.0}
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS27830') HTTP/1.1" 204 0
2026-03-30 10:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB68583/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS39773/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:46:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:03 [scrapy.extensions.logstats] INFO: Crawled 425 pages (at 20 pages/min), scraped 319 items (at 15 items/min)
2026-03-30 10:47:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-30 10:47:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.633(s), this was the 1st time calling it.
2026-03-30 10:47:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.880940608761026 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:47:07 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.769(s), this was the 1st time calling it.
2026-03-30 10:47:07 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.982208893709153 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH14903/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV02154/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:47:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZA52966/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK17732> (referer: https://www.auto1.com/v1/car-details-view/DK17732/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a338d389-3c81-5b34-ae4f-64498a2f12a9 with identifier: DK17732
2026-03-30 10:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a338d389-3c81-5b34-ae4f-64498a2f12a9 with scrape type 1
2026-03-30 10:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a338d389-3c81-5b34-ae4f-64498a2f12a9
2026-03-30 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F84%252F3484bc2c8a89c8554f87bcb5c73c3549%252Fpa%252FDK17732_bf85dbe14b7a095e5d9c3a4b3232f1e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/84/3484bc2c8a89c8554f87bcb5c73c3549/pa/DK17732_bf85dbe14b7a095e5d9c3a4b3232f1e8.jpg already downloaded
2026-03-30 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F84%252F3484bc2c8a89c8554f87bcb5c73c3549%252Fpa%252FDK17732_b471612f8ece3e13a68dc3c6a66d72f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/84/3484bc2c8a89c8554f87bcb5c73c3549/pa/DK17732_b471612f8ece3e13a68dc3c6a66d72f5.jpg already downloaded
2026-03-30 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F84%252F3484bc2c8a89c8554f87bcb5c73c3549%252Fpa%252FDK17732_5d64c1608f07daf1f67ab38fca78fac1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/84/3484bc2c8a89c8554f87bcb5c73c3549/pa/DK17732_5d64c1608f07daf1f67ab38fca78fac1.jpg already downloaded
2026-03-30 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F84%252F3484bc2c8a89c8554f87bcb5c73c3549%252Fpa%252FDK17732_688e86732702df00756da03caf4d4c2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/84/3484bc2c8a89c8554f87bcb5c73c3549/pa/DK17732_688e86732702df00756da03caf4d4c2e.jpg already downloaded
2026-03-30 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F84%252F3484bc2c8a89c8554f87bcb5c73c3549%252Fpa%252FDK17732_adc68f131119acad0de54eda6462e398.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/84/3484bc2c8a89c8554f87bcb5c73c3549/pa/DK17732_adc68f131119acad0de54eda6462e398.jpg already downloaded
2026-03-30 10:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a338d389-3c81-5b34-ae4f-64498a2f12a9, identifier: DK17732
2026-03-30 10:47:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a338d389-3c81-5b34-ae4f-64498a2f12a9 with identifier: DK17732
2026-03-30 10:47:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a338d389-3c81-5b34-ae4f-64498a2f12a9 with identifier: DK17732
2026-03-30 10:47:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a338d389-3c81-5b34-ae4f-64498a2f12a9 with identifier: DK17732 to the API
2026-03-30 10:47:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DK17732>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:16:54Z',
 'fuel_type': 'petrol',
 'id': 'a338d389-3c81-5b34-ae4f-64498a2f12a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK17732',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img34/84/3484bc2c8a89c8554f87bcb5c73c3549/pa/DK17732_bf85dbe14b7a095e5d9c3a4b3232f1e8.jpg',
                'https://img-pa.auto1.com/img34/84/3484bc2c8a89c8554f87bcb5c73c3549/pa/DK17732_b471612f8ece3e13a68dc3c6a66d72f5.jpg',
                'https://img-pa.auto1.com/img34/84/3484bc2c8a89c8554f87bcb5c73c3549/pa/DK17732_5d64c1608f07daf1f67ab38fca78fac1.jpg',
                'https://img-pa.auto1.com/img34/84/3484bc2c8a89c8554f87bcb5c73c3549/pa/DK17732_688e86732702df00756da03caf4d4c2e.jpg',
                'https://img-pa.auto1.com/img34/84/3484bc2c8a89c8554f87bcb5c73c3549/pa/DK17732_adc68f131119acad0de54eda6462e398.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a338d389-3c81-5b34-ae4f-64498a2f12a9/a338d389-3c81-5b34-ae4f-64498a2f12a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/84/3484bc2c8a89c8554f87bcb5c73c3549/pa/DK17732_bf85dbe14b7a095e5d9c3a4b3232f1e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a338d389-3c81-5b34-ae4f-64498a2f12a9/a338d389-3c81-5b34-ae4f-64498a2f12a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/84/3484bc2c8a89c8554f87bcb5c73c3549/pa/DK17732_b471612f8ece3e13a68dc3c6a66d72f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a338d389-3c81-5b34-ae4f-64498a2f12a9/a338d389-3c81-5b34-ae4f-64498a2f12a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/84/3484bc2c8a89c8554f87bcb5c73c3549/pa/DK17732_5d64c1608f07daf1f67ab38fca78fac1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a338d389-3c81-5b34-ae4f-64498a2f12a9/a338d389-3c81-5b34-ae4f-64498a2f12a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/84/3484bc2c8a89c8554f87bcb5c73c3549/pa/DK17732_688e86732702df00756da03caf4d4c2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a338d389-3c81-5b34-ae4f-64498a2f12a9/a338d389-3c81-5b34-ae4f-64498a2f12a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/84/3484bc2c8a89c8554f87bcb5c73c3549/pa/DK17732_adc68f131119acad0de54eda6462e398.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Rip Curl',
 'transmission': 'manual',
 'trim': 'Rip Curl',
 'year': 2010}
2026-03-30 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK17732%27 HTTP/1.1" 200 None
2026-03-30 10:47:15 [auto1.de] INFO: Saving data for DK17732: {'created_time': 1774867635.464095, 'last_price_update_time': 1774867635.464106, 'auction_closing_time': 1774970214.0}
2026-03-30 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK17732') HTTP/1.1" 204 0
2026-03-30 10:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL26241/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US50096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR67128> (referer: https://www.auto1.com/v1/car-details-view/XR67128/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f93aa51-25c7-505b-aee1-c50fcbf2c34c with identifier: XR67128
2026-03-30 10:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f93aa51-25c7-505b-aee1-c50fcbf2c34c with scrape type 1
2026-03-30 10:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f93aa51-25c7-505b-aee1-c50fcbf2c34c
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_82fef0be9126959eac00b00884db65bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_82fef0be9126959eac00b00884db65bc.jpg not downloaded yet
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_c9021cd0e4ed957b7a3f7c1c01e8254c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_c9021cd0e4ed957b7a3f7c1c01e8254c.jpg not downloaded yet
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_0ec6388c83483d43f9d198e57eb7ba2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_0ec6388c83483d43f9d198e57eb7ba2d.jpg not downloaded yet
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_23a13132b78f2d9767501cb068960e15.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_23a13132b78f2d9767501cb068960e15.jpg not downloaded yet
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_3586b77e3c537684bc22a2525f7cdf1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_3586b77e3c537684bc22a2525f7cdf1e.jpg not downloaded yet
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_1917650a52ebdf1656e94d013fa0c2b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_1917650a52ebdf1656e94d013fa0c2b8.jpg not downloaded yet
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_236a3940d8e73955a1fa4098113e6ebb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_236a3940d8e73955a1fa4098113e6ebb.jpg not downloaded yet
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_87f7cfaf3cd4a6f5bb87665a037fb51c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_87f7cfaf3cd4a6f5bb87665a037fb51c.jpg not downloaded yet
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_57863ea770bc003e4bf7fc99bd98314c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_57863ea770bc003e4bf7fc99bd98314c.jpg not downloaded yet
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_4547287504994eb7932f48e178e79886.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_4547287504994eb7932f48e178e79886.jpg not downloaded yet
2026-03-30 10:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX45825/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_4547287504994eb7932f48e178e79886.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595db10>
2026-03-30 10:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_4547287504994eb7932f48e178e79886.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_4547287504994eb7932f48e178e79886.jpg saved to cache
2026-03-30 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f93aa51-25c7-505b-aee1-c50fcbf2c34c
2026-03-30 10:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF15006> (referer: https://www.auto1.com/v1/car-details-view/GF15006/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b8d598e-b530-5a49-882d-ad4f82976dba with identifier: GF15006
2026-03-30 10:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b8d598e-b530-5a49-882d-ad4f82976dba with scrape type 1
2026-03-30 10:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4b8d598e-b530-5a49-882d-ad4f82976dba
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fd0%252F23d0c012eb443259f768f2657cc9ef52%252Fpa%252FGF15006_d8ff73e604bbd3629a45add78c0546f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/d0/23d0c012eb443259f768f2657cc9ef52/pa/GF15006_d8ff73e604bbd3629a45add78c0546f2.jpg already downloaded
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fd0%252F23d0c012eb443259f768f2657cc9ef52%252Fpa%252FGF15006_36843a597e519b30de61f06c693e1944.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/d0/23d0c012eb443259f768f2657cc9ef52/pa/GF15006_36843a597e519b30de61f06c693e1944.jpg already downloaded
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fd0%252F23d0c012eb443259f768f2657cc9ef52%252Fpa%252FGF15006_2c1ddeaa4a8698ba9080284ab78508a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/d0/23d0c012eb443259f768f2657cc9ef52/pa/GF15006_2c1ddeaa4a8698ba9080284ab78508a9.jpg already downloaded
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fd0%252F23d0c012eb443259f768f2657cc9ef52%252Fpa%252FGF15006_64a9881b214a44622809ff69b7379511.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/d0/23d0c012eb443259f768f2657cc9ef52/pa/GF15006_64a9881b214a44622809ff69b7379511.jpg already downloaded
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fd0%252F23d0c012eb443259f768f2657cc9ef52%252Fpa%252FGF15006_321990536a61127516c202c2e3d62205.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/d0/23d0c012eb443259f768f2657cc9ef52/pa/GF15006_321990536a61127516c202c2e3d62205.jpg already downloaded
2026-03-30 10:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b8d598e-b530-5a49-882d-ad4f82976dba, identifier: GF15006
2026-03-30 10:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b8d598e-b530-5a49-882d-ad4f82976dba with identifier: GF15006
2026-03-30 10:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b8d598e-b530-5a49-882d-ad4f82976dba with identifier: GF15006
2026-03-30 10:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b8d598e-b530-5a49-882d-ad4f82976dba with identifier: GF15006 to the API
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GF15006>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-31T15:21:32Z',
 'fuel_type': 'petrol',
 'id': '4b8d598e-b530-5a49-882d-ad4f82976dba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF15006',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 131650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img23/d0/23d0c012eb443259f768f2657cc9ef52/pa/GF15006_d8ff73e604bbd3629a45add78c0546f2.jpg',
                'https://img-pa.auto1.com/img23/d0/23d0c012eb443259f768f2657cc9ef52/pa/GF15006_36843a597e519b30de61f06c693e1944.jpg',
                'https://img-pa.auto1.com/img23/d0/23d0c012eb443259f768f2657cc9ef52/pa/GF15006_2c1ddeaa4a8698ba9080284ab78508a9.jpg',
                'https://img-pa.auto1.com/img23/d0/23d0c012eb443259f768f2657cc9ef52/pa/GF15006_64a9881b214a44622809ff69b7379511.jpg',
                'https://img-pa.auto1.com/img23/d0/23d0c012eb443259f768f2657cc9ef52/pa/GF15006_321990536a61127516c202c2e3d62205.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8d598e-b530-5a49-882d-ad4f82976dba/4b8d598e-b530-5a49-882d-ad4f82976dba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/d0/23d0c012eb443259f768f2657cc9ef52/pa/GF15006_d8ff73e604bbd3629a45add78c0546f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8d598e-b530-5a49-882d-ad4f82976dba/4b8d598e-b530-5a49-882d-ad4f82976dba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/d0/23d0c012eb443259f768f2657cc9ef52/pa/GF15006_36843a597e519b30de61f06c693e1944.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8d598e-b530-5a49-882d-ad4f82976dba/4b8d598e-b530-5a49-882d-ad4f82976dba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/d0/23d0c012eb443259f768f2657cc9ef52/pa/GF15006_2c1ddeaa4a8698ba9080284ab78508a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8d598e-b530-5a49-882d-ad4f82976dba/4b8d598e-b530-5a49-882d-ad4f82976dba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/d0/23d0c012eb443259f768f2657cc9ef52/pa/GF15006_64a9881b214a44622809ff69b7379511.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8d598e-b530-5a49-882d-ad4f82976dba/4b8d598e-b530-5a49-882d-ad4f82976dba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/d0/23d0c012eb443259f768f2657cc9ef52/pa/GF15006_321990536a61127516c202c2e3d62205.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.3 VVT-i Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2008}
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF15006%27 HTTP/1.1" 200 None
2026-03-30 10:47:23 [auto1.de] INFO: Saving data for GF15006: {'created_time': 1774867643.906558, 'last_price_update_time': 1774867643.906569, 'auction_closing_time': 1774970492.0}
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF15006') HTTP/1.1" 204 0
2026-03-30 10:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_57863ea770bc003e4bf7fc99bd98314c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a64190>
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_57863ea770bc003e4bf7fc99bd98314c.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_57863ea770bc003e4bf7fc99bd98314c.jpg saved to cache
2026-03-30 10:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f93aa51-25c7-505b-aee1-c50fcbf2c34c
2026-03-30 10:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_87f7cfaf3cd4a6f5bb87665a037fb51c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c1650>
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_87f7cfaf3cd4a6f5bb87665a037fb51c.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_87f7cfaf3cd4a6f5bb87665a037fb51c.jpg saved to cache
2026-03-30 10:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f93aa51-25c7-505b-aee1-c50fcbf2c34c
2026-03-30 10:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_236a3940d8e73955a1fa4098113e6ebb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e77490>
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_236a3940d8e73955a1fa4098113e6ebb.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_236a3940d8e73955a1fa4098113e6ebb.jpg saved to cache
2026-03-30 10:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f93aa51-25c7-505b-aee1-c50fcbf2c34c
2026-03-30 10:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_1917650a52ebdf1656e94d013fa0c2b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c11d0>
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_1917650a52ebdf1656e94d013fa0c2b8.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_1917650a52ebdf1656e94d013fa0c2b8.jpg saved to cache
2026-03-30 10:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f93aa51-25c7-505b-aee1-c50fcbf2c34c
2026-03-30 10:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_3586b77e3c537684bc22a2525f7cdf1e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV41161/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595c150>
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_3586b77e3c537684bc22a2525f7cdf1e.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_3586b77e3c537684bc22a2525f7cdf1e.jpg saved to cache
2026-03-30 10:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f93aa51-25c7-505b-aee1-c50fcbf2c34c
2026-03-30 10:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_23a13132b78f2d9767501cb068960e15.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_0ec6388c83483d43f9d198e57eb7ba2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b22b90>
2026-03-30 10:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_23a13132b78f2d9767501cb068960e15.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_23a13132b78f2d9767501cb068960e15.jpg saved to cache
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f93aa51-25c7-505b-aee1-c50fcbf2c34c
2026-03-30 10:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595e8d0>
2026-03-30 10:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_0ec6388c83483d43f9d198e57eb7ba2d.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_0ec6388c83483d43f9d198e57eb7ba2d.jpg saved to cache
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f93aa51-25c7-505b-aee1-c50fcbf2c34c
2026-03-30 10:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_c9021cd0e4ed957b7a3f7c1c01e8254c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d78fd0>
2026-03-30 10:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_c9021cd0e4ed957b7a3f7c1c01e8254c.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_c9021cd0e4ed957b7a3f7c1c01e8254c.jpg saved to cache
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f93aa51-25c7-505b-aee1-c50fcbf2c34c
2026-03-30 10:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS39773> (referer: https://www.auto1.com/v1/car-details-view/SS39773/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_82fef0be9126959eac00b00884db65bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3505560-4275-57ca-8922-183f71e07eec with identifier: SS39773
2026-03-30 10:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3505560-4275-57ca-8922-183f71e07eec with scrape type 1
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3505560-4275-57ca-8922-183f71e07eec
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F6c%252F576c5ec5bd987cf2871213ac7bb0caba%252Fpa%252FSS39773_d4e29fd6d301b7311e7ba80cf0fab84a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_d4e29fd6d301b7311e7ba80cf0fab84a.jpg already downloaded
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F6c%252F576c5ec5bd987cf2871213ac7bb0caba%252Fpa%252FSS39773_7580eb821c539b288ac2d253feccde98.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_7580eb821c539b288ac2d253feccde98.jpg already downloaded
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F6c%252F576c5ec5bd987cf2871213ac7bb0caba%252Fpa%252FSS39773_853cc16e10aa0cd221497f1fafbde9f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_853cc16e10aa0cd221497f1fafbde9f5.jpg already downloaded
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F6c%252F576c5ec5bd987cf2871213ac7bb0caba%252Fpa%252FSS39773_b26e1721ba017bd7e8297d78cf626bd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_b26e1721ba017bd7e8297d78cf626bd6.jpg already downloaded
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F6c%252F576c5ec5bd987cf2871213ac7bb0caba%252Fpa%252FSS39773_a30d8d9e57a1ecaf1d65b1436599130c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_a30d8d9e57a1ecaf1d65b1436599130c.jpg already downloaded
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F6c%252F576c5ec5bd987cf2871213ac7bb0caba%252Fpa%252FSS39773_c169530e56c341f6c505d633b06099b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_c169530e56c341f6c505d633b06099b9.jpg already downloaded
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F6c%252F576c5ec5bd987cf2871213ac7bb0caba%252Fpa%252FSS39773_54720e20b0628cea22000a78c0492de3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_54720e20b0628cea22000a78c0492de3.jpg already downloaded
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F6c%252F576c5ec5bd987cf2871213ac7bb0caba%252Fpa%252FSS39773_622b3f6188a5573a621351dc2a05d82f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_622b3f6188a5573a621351dc2a05d82f.jpg already downloaded
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F6c%252F576c5ec5bd987cf2871213ac7bb0caba%252Fpa%252FSS39773_c4c08c54c19b530b529a9c10a89befdd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_c4c08c54c19b530b529a9c10a89befdd.jpg already downloaded
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F6c%252F576c5ec5bd987cf2871213ac7bb0caba%252Fpa%252FSS39773_5daded0551fe3a18bc006e7fe9e0306f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_5daded0551fe3a18bc006e7fe9e0306f.jpg already downloaded
2026-03-30 10:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3505560-4275-57ca-8922-183f71e07eec, identifier: SS39773
2026-03-30 10:47:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3505560-4275-57ca-8922-183f71e07eec with identifier: SS39773
2026-03-30 10:47:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3505560-4275-57ca-8922-183f71e07eec with identifier: SS39773
2026-03-30 10:47:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3505560-4275-57ca-8922-183f71e07eec with identifier: SS39773 to the API
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SS39773>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:00:10Z',
 'fuel_type': 'petrol',
 'id': 'a3505560-4275-57ca-8922-183f71e07eec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS39773',
 'listing': 'auction',
 'location': 'DE, Kitzingen',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 41444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_d4e29fd6d301b7311e7ba80cf0fab84a.jpg',
                'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_7580eb821c539b288ac2d253feccde98.jpg',
                'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_853cc16e10aa0cd221497f1fafbde9f5.jpg',
                'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_b26e1721ba017bd7e8297d78cf626bd6.jpg',
                'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_a30d8d9e57a1ecaf1d65b1436599130c.jpg',
                'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_c169530e56c341f6c505d633b06099b9.jpg',
                'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_54720e20b0628cea22000a78c0492de3.jpg',
                'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_622b3f6188a5573a621351dc2a05d82f.jpg',
                'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_c4c08c54c19b530b529a9c10a89befdd.jpg',
                'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_5daded0551fe3a18bc006e7fe9e0306f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3505560-4275-57ca-8922-183f71e07eec/a3505560-4275-57ca-8922-183f71e07eec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_d4e29fd6d301b7311e7ba80cf0fab84a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3505560-4275-57ca-8922-183f71e07eec/a3505560-4275-57ca-8922-183f71e07eec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_7580eb821c539b288ac2d253feccde98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3505560-4275-57ca-8922-183f71e07eec/a3505560-4275-57ca-8922-183f71e07eec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_853cc16e10aa0cd221497f1fafbde9f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3505560-4275-57ca-8922-183f71e07eec/a3505560-4275-57ca-8922-183f71e07eec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_b26e1721ba017bd7e8297d78cf626bd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3505560-4275-57ca-8922-183f71e07eec/a3505560-4275-57ca-8922-183f71e07eec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_a30d8d9e57a1ecaf1d65b1436599130c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3505560-4275-57ca-8922-183f71e07eec/a3505560-4275-57ca-8922-183f71e07eec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_c169530e56c341f6c505d633b06099b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3505560-4275-57ca-8922-183f71e07eec/a3505560-4275-57ca-8922-183f71e07eec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_54720e20b0628cea22000a78c0492de3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3505560-4275-57ca-8922-183f71e07eec/a3505560-4275-57ca-8922-183f71e07eec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_622b3f6188a5573a621351dc2a05d82f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3505560-4275-57ca-8922-183f71e07eec/a3505560-4275-57ca-8922-183f71e07eec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_c4c08c54c19b530b529a9c10a89befdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3505560-4275-57ca-8922-183f71e07eec/a3505560-4275-57ca-8922-183f71e07eec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/6c/576c5ec5bd987cf2871213ac7bb0caba/pa/SS39773_5daded0551fe3a18bc006e7fe9e0306f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.2 Color',
 'transmission': 'manual',
 'trim': 'Color',
 'year': 2015}
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS39773%27 HTTP/1.1" 200 None
2026-03-30 10:47:26 [auto1.de] INFO: Saving data for SS39773: {'created_time': 1774867646.292249, 'last_price_update_time': 1774867646.292264, 'auction_closing_time': 1774969210.0}
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS39773') HTTP/1.1" 204 0
2026-03-30 10:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_706386d26938218b3bc430eac37bb81d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a764d0>
2026-03-30 10:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F3b%252F253b7caf8fa5a79cc35d406e9963e8d8%252Fpa%252FXR67128_82fef0be9126959eac00b00884db65bc.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_82fef0be9126959eac00b00884db65bc.jpg saved to cache
2026-03-30 10:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f93aa51-25c7-505b-aee1-c50fcbf2c34c
2026-03-30 10:47:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f93aa51-25c7-505b-aee1-c50fcbf2c34c, skipping ID generation
2026-03-30 10:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f93aa51-25c7-505b-aee1-c50fcbf2c34c with scrape type 1
2026-03-30 10:47:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f93aa51-25c7-505b-aee1-c50fcbf2c34c sending to next pipeline
2026-03-30 10:47:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f93aa51-25c7-505b-aee1-c50fcbf2c34c, identifier: XR67128
2026-03-30 10:47:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f93aa51-25c7-505b-aee1-c50fcbf2c34c with identifier: XR67128
2026-03-30 10:47:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f93aa51-25c7-505b-aee1-c50fcbf2c34c with identifier: XR67128
2026-03-30 10:47:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f93aa51-25c7-505b-aee1-c50fcbf2c34c with identifier: XR67128 to the API
2026-03-30 10:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_82fef0be9126959eac00b00884db65bc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 261,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '4.8L',
 'engine_horse_power': 520,
 'expiration_date': '2026-03-31T15:10:07Z',
 'fuel_type': 'petrol',
 'id': '7f93aa51-25c7-505b-aee1-c50fcbf2c34c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR67128',
 'listing': 'auction',
 'location': 'DE, Duisburg',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 180482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1995692,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_82fef0be9126959eac00b00884db65bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1946066,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_c9021cd0e4ed957b7a3f7c1c01e8254c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_0ec6388c83483d43f9d198e57eb7ba2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1934562,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_23a13132b78f2d9767501cb068960e15.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_3586b77e3c537684bc22a2525f7cdf1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2236782,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_1917650a52ebdf1656e94d013fa0c2b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_236a3940d8e73955a1fa4098113e6ebb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_87f7cfaf3cd4a6f5bb87665a037fb51c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1972172,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_57863ea770bc003e4bf7fc99bd98314c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f93aa51-25c7-505b-aee1-c50fcbf2c34c/7f93aa51-25c7-505b-aee1-c50fcbf2c34c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2033159,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/3b/253b7caf8fa5a79cc35d406e9963e8d8/pa/XR67128_4547287504994eb7932f48e178e79886.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Cayenne Turbo',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR67128%27 HTTP/1.1" 200 None
2026-03-30 10:47:27 [auto1.de] INFO: Saving data for XR67128: {'created_time': 1774867647.456979, 'last_price_update_time': 1774867647.456993, 'auction_closing_time': 1774969807.0}
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR67128') HTTP/1.1" 204 0
2026-03-30 10:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5028ad0>
2026-03-30 10:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b35d727-e19b-57da-9afd-7a473c5872da/3b35d727-e19b-57da-9afd-7a473c5872da_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa8%252Fe4a8bf3e35e49eda00736b9db433ed39%252Fpa%252FPJ55478_706386d26938218b3bc430eac37bb81d.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_706386d26938218b3bc430eac37bb81d.jpg saved to cache
2026-03-30 10:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b35d727-e19b-57da-9afd-7a473c5872da
2026-03-30 10:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_09b8678c4efa60100724af29d34744b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6e750>
2026-03-30 10:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b35d727-e19b-57da-9afd-7a473c5872da/3b35d727-e19b-57da-9afd-7a473c5872da_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa8%252Fe4a8bf3e35e49eda00736b9db433ed39%252Fpa%252FPJ55478_09b8678c4efa60100724af29d34744b3.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_09b8678c4efa60100724af29d34744b3.jpg saved to cache
2026-03-30 10:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b35d727-e19b-57da-9afd-7a473c5872da
2026-03-30 10:47:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b35d727-e19b-57da-9afd-7a473c5872da, skipping ID generation
2026-03-30 10:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b35d727-e19b-57da-9afd-7a473c5872da with scrape type 1
2026-03-30 10:47:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b35d727-e19b-57da-9afd-7a473c5872da sending to next pipeline
2026-03-30 10:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b35d727-e19b-57da-9afd-7a473c5872da, identifier: PJ55478
2026-03-30 10:47:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b35d727-e19b-57da-9afd-7a473c5872da with identifier: PJ55478
2026-03-30 10:47:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b35d727-e19b-57da-9afd-7a473c5872da with identifier: PJ55478
2026-03-30 10:47:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b35d727-e19b-57da-9afd-7a473c5872da with identifier: PJ55478 to the API
2026-03-30 10:47:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_09b8678c4efa60100724af29d34744b3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:16:41Z',
 'fuel_type': 'petrol',
 'id': '3b35d727-e19b-57da-9afd-7a473c5872da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ55478',
 'listing': 'auction',
 'location': 'DE, Hilden',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 133165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b35d727-e19b-57da-9afd-7a473c5872da/3b35d727-e19b-57da-9afd-7a473c5872da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_09b8678c4efa60100724af29d34744b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b35d727-e19b-57da-9afd-7a473c5872da/3b35d727-e19b-57da-9afd-7a473c5872da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_706386d26938218b3bc430eac37bb81d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b35d727-e19b-57da-9afd-7a473c5872da/3b35d727-e19b-57da-9afd-7a473c5872da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_392955865138a58b3f0d0ae92c845b47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b35d727-e19b-57da-9afd-7a473c5872da/3b35d727-e19b-57da-9afd-7a473c5872da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_162322ee2ecdd3524aabcd6d64f0f938.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b35d727-e19b-57da-9afd-7a473c5872da/3b35d727-e19b-57da-9afd-7a473c5872da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/a8/e4a8bf3e35e49eda00736b9db433ed39/pa/PJ55478_c0e9b384274652c5f46fabeac8d245f9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2008}
2026-03-30 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ55478%27 HTTP/1.1" 200 None
2026-03-30 10:47:28 [auto1.de] INFO: Saving data for PJ55478: {'created_time': 1774867648.151252, 'last_price_update_time': 1774867648.151267, 'auction_closing_time': 1774970201.0}
2026-03-30 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ55478') HTTP/1.1" 204 0
2026-03-30 10:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV02154> (referer: https://www.auto1.com/v1/car-details-view/BV02154/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL20348> (referer: https://www.auto1.com/v1/car-details-view/YL20348/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1e4cd53-49da-5f97-8466-5dc8118f5bf1 with identifier: BV02154
2026-03-30 10:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1e4cd53-49da-5f97-8466-5dc8118f5bf1 with scrape type 1
2026-03-30 10:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f1e4cd53-49da-5f97-8466-5dc8118f5bf1
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_3ae3ee03224a4423c0d7cb01d085484c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_3ae3ee03224a4423c0d7cb01d085484c.jpg not downloaded yet
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_fb9417307626be2f4c880931bf39f068.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_fb9417307626be2f4c880931bf39f068.jpg not downloaded yet
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_6b99a93f44d72bf37563555a6f3e28de.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_6b99a93f44d72bf37563555a6f3e28de.jpg not downloaded yet
2026-03-30 10:47:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c604b0a-038f-5be8-877f-e80a029d6b9b with identifier: YL20348
2026-03-30 10:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c604b0a-038f-5be8-877f-e80a029d6b9b with scrape type 1
2026-03-30 10:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c604b0a-038f-5be8-877f-e80a029d6b9b
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F37%252F4837e1e0906fc26406d68d99dbc6130d%252Fpa%252FYL20348_2258c89f8f6e5dcd8ca38a1f43b6fb98.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_2258c89f8f6e5dcd8ca38a1f43b6fb98.jpg already downloaded
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F37%252F4837e1e0906fc26406d68d99dbc6130d%252Fpa%252FYL20348_8060780a786d02b144e466151aefa2df.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_8060780a786d02b144e466151aefa2df.jpg already downloaded
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F37%252F4837e1e0906fc26406d68d99dbc6130d%252Fpa%252FYL20348_fbb412347c69d35c4680b63226450f4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_fbb412347c69d35c4680b63226450f4f.jpg already downloaded
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F37%252F4837e1e0906fc26406d68d99dbc6130d%252Fpa%252FYL20348_51a98d8b915e9266f1e8b6c195ce16cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_51a98d8b915e9266f1e8b6c195ce16cf.jpg already downloaded
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F37%252F4837e1e0906fc26406d68d99dbc6130d%252Fpa%252FYL20348_c917a7294550e06d98f151e20dfc2062.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_c917a7294550e06d98f151e20dfc2062.jpg already downloaded
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F37%252F4837e1e0906fc26406d68d99dbc6130d%252Fpa%252FYL20348_10287b5e4348775648b847adfd4f2e23.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_10287b5e4348775648b847adfd4f2e23.jpg already downloaded
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F37%252F4837e1e0906fc26406d68d99dbc6130d%252Fpa%252FYL20348_d122ceb031285e3e78ef785a9b1d5f97.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_d122ceb031285e3e78ef785a9b1d5f97.jpg already downloaded
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F37%252F4837e1e0906fc26406d68d99dbc6130d%252Fpa%252FYL20348_04bc716ff499a80adbed5cae103bb062.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_04bc716ff499a80adbed5cae103bb062.jpg already downloaded
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F37%252F4837e1e0906fc26406d68d99dbc6130d%252Fpa%252FYL20348_52e35561fbbee99d5358372e88041149.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_52e35561fbbee99d5358372e88041149.jpg already downloaded
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F37%252F4837e1e0906fc26406d68d99dbc6130d%252Fpa%252FYL20348_2f6830ab5c9e76b41de7afb109ae46a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_2f6830ab5c9e76b41de7afb109ae46a4.jpg already downloaded
2026-03-30 10:47:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c604b0a-038f-5be8-877f-e80a029d6b9b, identifier: YL20348
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_fe8c407afa942591459f193f4c94181a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_fe8c407afa942591459f193f4c94181a.jpg not downloaded yet
2026-03-30 10:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c604b0a-038f-5be8-877f-e80a029d6b9b with identifier: YL20348
2026-03-30 10:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c604b0a-038f-5be8-877f-e80a029d6b9b with identifier: YL20348
2026-03-30 10:47:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c604b0a-038f-5be8-877f-e80a029d6b9b with identifier: YL20348 to the API
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YL20348>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:47:52Z',
 'fuel_type': 'petrol',
 'id': '4c604b0a-038f-5be8-877f-e80a029d6b9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL20348',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 99508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_2258c89f8f6e5dcd8ca38a1f43b6fb98.jpg',
                'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_8060780a786d02b144e466151aefa2df.jpg',
                'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_fbb412347c69d35c4680b63226450f4f.jpg',
                'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_51a98d8b915e9266f1e8b6c195ce16cf.jpg',
                'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_c917a7294550e06d98f151e20dfc2062.jpg',
                'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_10287b5e4348775648b847adfd4f2e23.jpg',
                'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_d122ceb031285e3e78ef785a9b1d5f97.jpg',
                'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_04bc716ff499a80adbed5cae103bb062.jpg',
                'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_52e35561fbbee99d5358372e88041149.jpg',
                'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_2f6830ab5c9e76b41de7afb109ae46a4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c604b0a-038f-5be8-877f-e80a029d6b9b/4c604b0a-038f-5be8-877f-e80a029d6b9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_2258c89f8f6e5dcd8ca38a1f43b6fb98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c604b0a-038f-5be8-877f-e80a029d6b9b/4c604b0a-038f-5be8-877f-e80a029d6b9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2625503,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_8060780a786d02b144e466151aefa2df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c604b0a-038f-5be8-877f-e80a029d6b9b/4c604b0a-038f-5be8-877f-e80a029d6b9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2437587,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_fbb412347c69d35c4680b63226450f4f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c604b0a-038f-5be8-877f-e80a029d6b9b/4c604b0a-038f-5be8-877f-e80a029d6b9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_51a98d8b915e9266f1e8b6c195ce16cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c604b0a-038f-5be8-877f-e80a029d6b9b/4c604b0a-038f-5be8-877f-e80a029d6b9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2397040,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_c917a7294550e06d98f151e20dfc2062.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c604b0a-038f-5be8-877f-e80a029d6b9b/4c604b0a-038f-5be8-877f-e80a029d6b9b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_10287b5e4348775648b847adfd4f2e23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c604b0a-038f-5be8-877f-e80a029d6b9b/4c604b0a-038f-5be8-877f-e80a029d6b9b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2485314,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_d122ceb031285e3e78ef785a9b1d5f97.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c604b0a-038f-5be8-877f-e80a029d6b9b/4c604b0a-038f-5be8-877f-e80a029d6b9b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2695957,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_04bc716ff499a80adbed5cae103bb062.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c604b0a-038f-5be8-877f-e80a029d6b9b/4c604b0a-038f-5be8-877f-e80a029d6b9b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_52e35561fbbee99d5358372e88041149.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c604b0a-038f-5be8-877f-e80a029d6b9b/4c604b0a-038f-5be8-877f-e80a029d6b9b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/37/4837e1e0906fc26406d68d99dbc6130d/pa/YL20348_2f6830ab5c9e76b41de7afb109ae46a4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i40 1.6 Trend Blue',
 'transmission': 'manual',
 'trim': 'Trend Blue',
 'year': 2017}
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL20348%27 HTTP/1.1" 200 None
2026-03-30 10:47:30 [auto1.de] INFO: Saving data for YL20348: {'created_time': 1774867650.413135, 'last_price_update_time': 1774867650.413145, 'auction_closing_time': 1774972072.0}
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL20348') HTTP/1.1" 204 0
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_141df092f012f094188a5677c713dc9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_141df092f012f094188a5677c713dc9a.jpg not downloaded yet
2026-03-30 10:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK53394/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_ff972aeb1689733024ce7eb2dbc34e17.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_ff972aeb1689733024ce7eb2dbc34e17.jpg not downloaded yet
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_6a7faf3d3bb8292bce629b937b75243e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_6a7faf3d3bb8292bce629b937b75243e.jpg not downloaded yet
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_a4d2d24c444dc8d31ce60661a46013c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_a4d2d24c444dc8d31ce60661a46013c6.jpg not downloaded yet
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_be2dd98a9b9fa587337c869c8d8de827.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_be2dd98a9b9fa587337c869c8d8de827.jpg not downloaded yet
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_1eaeeecc020b94ad9a0192acc9574b08.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_1eaeeecc020b94ad9a0192acc9574b08.jpg not downloaded yet
2026-03-30 10:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_fe8c407afa942591459f193f4c94181a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_1eaeeecc020b94ad9a0192acc9574b08.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2f450>
2026-03-30 10:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_fe8c407afa942591459f193f4c94181a.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_fe8c407afa942591459f193f4c94181a.jpg saved to cache
2026-03-30 10:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f1e4cd53-49da-5f97-8466-5dc8118f5bf1
2026-03-30 10:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50724d0>
2026-03-30 10:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_1eaeeecc020b94ad9a0192acc9574b08.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_1eaeeecc020b94ad9a0192acc9574b08.jpg saved to cache
2026-03-30 10:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f1e4cd53-49da-5f97-8466-5dc8118f5bf1
2026-03-30 10:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL26241> (referer: https://www.auto1.com/v1/car-details-view/BL26241/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_be2dd98a9b9fa587337c869c8d8de827.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0463e7ee-dcec-5097-a6eb-bdff99311bc2 with identifier: BL26241
2026-03-30 10:47:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0463e7ee-dcec-5097-a6eb-bdff99311bc2 with scrape type 1
2026-03-30 10:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0463e7ee-dcec-5097-a6eb-bdff99311bc2
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9aba3a4b91a14703921ab088efe73772%252Fpa%252FBL26241_69f3acd9be3bbcccbcea5620918fba11.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_69f3acd9be3bbcccbcea5620918fba11.jpg not downloaded yet
2026-03-30 10:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_a4d2d24c444dc8d31ce60661a46013c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9aba3a4b91a14703921ab088efe73772%252Fpa%252FBL26241_4b47f5f38cc46ee980b5035f535eb61a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_4b47f5f38cc46ee980b5035f535eb61a.jpg not downloaded yet
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9aba3a4b91a14703921ab088efe73772%252Fpa%252FBL26241_cb85652f59ba4dfe2e121c62cef2f86c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_cb85652f59ba4dfe2e121c62cef2f86c.jpg not downloaded yet
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9aba3a4b91a14703921ab088efe73772%252Fpa%252FBL26241_a91edf638ac303892504f7d26c0b97ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_a91edf638ac303892504f7d26c0b97ac.jpg not downloaded yet
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9aba3a4b91a14703921ab088efe73772%252Fpa%252FBL26241_56289ac91c4d0a70e859f7e4d9966a01.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_56289ac91c4d0a70e859f7e4d9966a01.jpg not downloaded yet
2026-03-30 10:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e77a10>
2026-03-30 10:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_be2dd98a9b9fa587337c869c8d8de827.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_be2dd98a9b9fa587337c869c8d8de827.jpg saved to cache
2026-03-30 10:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f1e4cd53-49da-5f97-8466-5dc8118f5bf1
2026-03-30 10:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_69f3acd9be3bbcccbcea5620918fba11.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a221d0>
2026-03-30 10:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_a4d2d24c444dc8d31ce60661a46013c6.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_a4d2d24c444dc8d31ce60661a46013c6.jpg saved to cache
2026-03-30 10:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f1e4cd53-49da-5f97-8466-5dc8118f5bf1
2026-03-30 10:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a33110>
2026-03-30 10:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0463e7ee-dcec-5097-a6eb-bdff99311bc2/0463e7ee-dcec-5097-a6eb-bdff99311bc2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9aba3a4b91a14703921ab088efe73772%252Fpa%252FBL26241_69f3acd9be3bbcccbcea5620918fba11.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_69f3acd9be3bbcccbcea5620918fba11.jpg saved to cache
2026-03-30 10:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0463e7ee-dcec-5097-a6eb-bdff99311bc2
2026-03-30 10:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_56289ac91c4d0a70e859f7e4d9966a01.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee6790>
2026-03-30 10:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0463e7ee-dcec-5097-a6eb-bdff99311bc2/0463e7ee-dcec-5097-a6eb-bdff99311bc2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9aba3a4b91a14703921ab088efe73772%252Fpa%252FBL26241_56289ac91c4d0a70e859f7e4d9966a01.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_56289ac91c4d0a70e859f7e4d9966a01.jpg saved to cache
2026-03-30 10:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0463e7ee-dcec-5097-a6eb-bdff99311bc2
2026-03-30 10:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_a91edf638ac303892504f7d26c0b97ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.028(s), this was the 1st time calling it.
2026-03-30 10:47:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.859385905163834 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd3510>
2026-03-30 10:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0463e7ee-dcec-5097-a6eb-bdff99311bc2/0463e7ee-dcec-5097-a6eb-bdff99311bc2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9aba3a4b91a14703921ab088efe73772%252Fpa%252FBL26241_a91edf638ac303892504f7d26c0b97ac.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_a91edf638ac303892504f7d26c0b97ac.jpg saved to cache
2026-03-30 10:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0463e7ee-dcec-5097-a6eb-bdff99311bc2
2026-03-30 10:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_cb85652f59ba4dfe2e121c62cef2f86c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_4b47f5f38cc46ee980b5035f535eb61a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c4d1d0>
2026-03-30 10:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0463e7ee-dcec-5097-a6eb-bdff99311bc2/0463e7ee-dcec-5097-a6eb-bdff99311bc2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9aba3a4b91a14703921ab088efe73772%252Fpa%252FBL26241_cb85652f59ba4dfe2e121c62cef2f86c.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_cb85652f59ba4dfe2e121c62cef2f86c.jpg saved to cache
2026-03-30 10:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0463e7ee-dcec-5097-a6eb-bdff99311bc2
2026-03-30 10:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c4d050>
2026-03-30 10:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0463e7ee-dcec-5097-a6eb-bdff99311bc2/0463e7ee-dcec-5097-a6eb-bdff99311bc2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fba%252F9aba3a4b91a14703921ab088efe73772%252Fpa%252FBL26241_4b47f5f38cc46ee980b5035f535eb61a.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_4b47f5f38cc46ee980b5035f535eb61a.jpg saved to cache
2026-03-30 10:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0463e7ee-dcec-5097-a6eb-bdff99311bc2
2026-03-30 10:47:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0463e7ee-dcec-5097-a6eb-bdff99311bc2, skipping ID generation
2026-03-30 10:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0463e7ee-dcec-5097-a6eb-bdff99311bc2 with scrape type 1
2026-03-30 10:47:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0463e7ee-dcec-5097-a6eb-bdff99311bc2 sending to next pipeline
2026-03-30 10:47:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0463e7ee-dcec-5097-a6eb-bdff99311bc2, identifier: BL26241
2026-03-30 10:47:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0463e7ee-dcec-5097-a6eb-bdff99311bc2 with identifier: BL26241
2026-03-30 10:47:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0463e7ee-dcec-5097-a6eb-bdff99311bc2 with identifier: BL26241
2026-03-30 10:47:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0463e7ee-dcec-5097-a6eb-bdff99311bc2 with identifier: BL26241 to the API
2026-03-30 10:47:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_4b47f5f38cc46ee980b5035f535eb61a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:02:44Z',
 'fuel_type': 'petrol',
 'id': '0463e7ee-dcec-5097-a6eb-bdff99311bc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL26241',
 'listing': 'auction',
 'location': 'DE, Dornach',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 182852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0463e7ee-dcec-5097-a6eb-bdff99311bc2/0463e7ee-dcec-5097-a6eb-bdff99311bc2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_69f3acd9be3bbcccbcea5620918fba11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0463e7ee-dcec-5097-a6eb-bdff99311bc2/0463e7ee-dcec-5097-a6eb-bdff99311bc2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_4b47f5f38cc46ee980b5035f535eb61a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0463e7ee-dcec-5097-a6eb-bdff99311bc2/0463e7ee-dcec-5097-a6eb-bdff99311bc2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_cb85652f59ba4dfe2e121c62cef2f86c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0463e7ee-dcec-5097-a6eb-bdff99311bc2/0463e7ee-dcec-5097-a6eb-bdff99311bc2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_a91edf638ac303892504f7d26c0b97ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0463e7ee-dcec-5097-a6eb-bdff99311bc2/0463e7ee-dcec-5097-a6eb-bdff99311bc2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/ba/9aba3a4b91a14703921ab088efe73772/pa/BL26241_56289ac91c4d0a70e859f7e4d9966a01.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.2 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL26241%27 HTTP/1.1" 200 None
2026-03-30 10:47:33 [auto1.de] INFO: Saving data for BL26241: {'created_time': 1774867653.379217, 'last_price_update_time': 1774867653.379229, 'auction_closing_time': 1774969364.0}
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL26241') HTTP/1.1" 204 0
2026-03-30 10:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_6a7faf3d3bb8292bce629b937b75243e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_ff972aeb1689733024ce7eb2dbc34e17.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5104190>
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_6a7faf3d3bb8292bce629b937b75243e.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_6a7faf3d3bb8292bce629b937b75243e.jpg saved to cache
2026-03-30 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f1e4cd53-49da-5f97-8466-5dc8118f5bf1
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5104b90>
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_ff972aeb1689733024ce7eb2dbc34e17.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_ff972aeb1689733024ce7eb2dbc34e17.jpg saved to cache
2026-03-30 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f1e4cd53-49da-5f97-8466-5dc8118f5bf1
2026-03-30 10:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_141df092f012f094188a5677c713dc9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_6b99a93f44d72bf37563555a6f3e28de.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a36ad0>
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_141df092f012f094188a5677c713dc9a.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_141df092f012f094188a5677c713dc9a.jpg saved to cache
2026-03-30 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f1e4cd53-49da-5f97-8466-5dc8118f5bf1
2026-03-30 10:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_fb9417307626be2f4c880931bf39f068.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e74510>
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_6b99a93f44d72bf37563555a6f3e28de.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_6b99a93f44d72bf37563555a6f3e28de.jpg saved to cache
2026-03-30 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f1e4cd53-49da-5f97-8466-5dc8118f5bf1
2026-03-30 10:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_3ae3ee03224a4423c0d7cb01d085484c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef79f9c50>
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_fb9417307626be2f4c880931bf39f068.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_fb9417307626be2f4c880931bf39f068.jpg saved to cache
2026-03-30 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f1e4cd53-49da-5f97-8466-5dc8118f5bf1
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5071810>
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F51%252F8f5146d102f93ebf10b1e2b0150249a6%252Fpa%252FBV02154_3ae3ee03224a4423c0d7cb01d085484c.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_3ae3ee03224a4423c0d7cb01d085484c.jpg saved to cache
2026-03-30 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f1e4cd53-49da-5f97-8466-5dc8118f5bf1
2026-03-30 10:47:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1e4cd53-49da-5f97-8466-5dc8118f5bf1, skipping ID generation
2026-03-30 10:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1e4cd53-49da-5f97-8466-5dc8118f5bf1 with scrape type 1
2026-03-30 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f1e4cd53-49da-5f97-8466-5dc8118f5bf1 sending to next pipeline
2026-03-30 10:47:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1e4cd53-49da-5f97-8466-5dc8118f5bf1, identifier: BV02154
2026-03-30 10:47:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1e4cd53-49da-5f97-8466-5dc8118f5bf1 with identifier: BV02154
2026-03-30 10:47:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1e4cd53-49da-5f97-8466-5dc8118f5bf1 with identifier: BV02154
2026-03-30 10:47:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1e4cd53-49da-5f97-8466-5dc8118f5bf1 with identifier: BV02154 to the API
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_3ae3ee03224a4423c0d7cb01d085484c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:24:09Z',
 'fuel_type': 'diesel',
 'id': 'f1e4cd53-49da-5f97-8466-5dc8118f5bf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV02154',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 189048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_3ae3ee03224a4423c0d7cb01d085484c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_fb9417307626be2f4c880931bf39f068.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_6b99a93f44d72bf37563555a6f3e28de.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_fe8c407afa942591459f193f4c94181a.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_141df092f012f094188a5677c713dc9a.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_ff972aeb1689733024ce7eb2dbc34e17.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_6a7faf3d3bb8292bce629b937b75243e.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_a4d2d24c444dc8d31ce60661a46013c6.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_be2dd98a9b9fa587337c869c8d8de827.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4cd53-49da-5f97-8466-5dc8118f5bf1/f1e4cd53-49da-5f97-8466-5dc8118f5bf1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/51/8f5146d102f93ebf10b1e2b0150249a6/pa/BV02154_1eaeeecc020b94ad9a0192acc9574b08.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-08-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV02154%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [auto1.de] INFO: Saving data for BV02154: {'created_time': 1774867654.4578, 'last_price_update_time': 1774867654.457811, 'auction_closing_time': 1774970649.0}
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV02154') HTTP/1.1" 204 0
2026-03-30 10:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN68320> (referer: https://www.auto1.com/v1/car-details-view/JN68320/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZA52966> (referer: https://www.auto1.com/v1/car-details-view/ZA52966/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97639686-5fe4-55a9-a7bb-57650f6bffcd with identifier: JN68320
2026-03-30 10:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97639686-5fe4-55a9-a7bb-57650f6bffcd with scrape type 1
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97639686-5fe4-55a9-a7bb-57650f6bffcd
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_e769c9ca1445848599d3f54d515d19db.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_e769c9ca1445848599d3f54d515d19db.jpg not downloaded yet
2026-03-30 10:47:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f64ebd7-09fc-5d89-8b07-6f39e60b875c with identifier: ZA52966
2026-03-30 10:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f64ebd7-09fc-5d89-8b07-6f39e60b875c with scrape type 1
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f64ebd7-09fc-5d89-8b07-6f39e60b875c
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_3700f44dc1203b1765c87d5cd3616a8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_3700f44dc1203b1765c87d5cd3616a8e.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_4803a8e2da13797a9436158a070440ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_4803a8e2da13797a9436158a070440ca.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_93586e63885bc39dacaa57ffe56f67dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_93586e63885bc39dacaa57ffe56f67dc.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_28153dff8d2160c8c1604b1424c20871.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_28153dff8d2160c8c1604b1424c20871.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_2523c51a3b32333444a95dec5dbdc1b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_2523c51a3b32333444a95dec5dbdc1b9.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_2808cd15ce6e0adb510a05ae3cc5ecb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_2808cd15ce6e0adb510a05ae3cc5ecb2.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_0aa3a0fa367bf9ef9ea989cca5389369.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_0aa3a0fa367bf9ef9ea989cca5389369.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_a1d236ccb18843c1dbf942d45d677e57.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_a1d236ccb18843c1dbf942d45d677e57.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_3386a47267dcf7fb0e505f0e7793b78e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_3386a47267dcf7fb0e505f0e7793b78e.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_a7ba811b4b698eaed949c824f94fec11.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_a7ba811b4b698eaed949c824f94fec11.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_bebfe44b5ec98577cb7900e173809a20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_bebfe44b5ec98577cb7900e173809a20.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_2118d4efe62d1ac84c3c32b05e4a728d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_2118d4efe62d1ac84c3c32b05e4a728d.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_af5800d8e24eeed85df1fb357d4455e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_af5800d8e24eeed85df1fb357d4455e4.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_11efdc9d8bce823136a50f77739a8c0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_11efdc9d8bce823136a50f77739a8c0c.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_3e95dc1de0089a85047b0f35591d4c60.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_3e95dc1de0089a85047b0f35591d4c60.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_23738001d75f07330fb91e57ceb1323c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_23738001d75f07330fb91e57ceb1323c.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_fa00b5918c5ac0f438204ca6805dae6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_fa00b5918c5ac0f438204ca6805dae6a.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_c2c0a824f03f24389cc0e2f723d2bd2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_c2c0a824f03f24389cc0e2f723d2bd2d.jpg not downloaded yet
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_a80fd01c270c09784c619f766fa1930e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_a80fd01c270c09784c619f766fa1930e.jpg not downloaded yet
2026-03-30 10:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB68583> (referer: https://www.auto1.com/v1/car-details-view/LB68583/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b8dc683-8e54-528c-b942-3493846d4278 with identifier: LB68583
2026-03-30 10:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b8dc683-8e54-528c-b942-3493846d4278 with scrape type 1
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4b8dc683-8e54-528c-b942-3493846d4278
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F43%252Fca4358f45dcd2fcdef57e856fa3b3001%252Fpa%252FLB68583_a42b10017497beb91b708162a72d708b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_a42b10017497beb91b708162a72d708b.jpg not downloaded yet
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F43%252Fca4358f45dcd2fcdef57e856fa3b3001%252Fpa%252FLB68583_ca047908d21e4a2dc760bc61faa3d8dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_ca047908d21e4a2dc760bc61faa3d8dd.jpg not downloaded yet
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F43%252Fca4358f45dcd2fcdef57e856fa3b3001%252Fpa%252FLB68583_00c80c065d65acf0369bf65eeb856239.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_00c80c065d65acf0369bf65eeb856239.jpg not downloaded yet
2026-03-30 10:47:36 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.277(s), this was the 1st time calling it.
2026-03-30 10:47:36 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.225050870685618 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F43%252Fca4358f45dcd2fcdef57e856fa3b3001%252Fpa%252FLB68583_513883cf275ddfe386c7ad1525232759.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_513883cf275ddfe386c7ad1525232759.jpg not downloaded yet
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F43%252Fca4358f45dcd2fcdef57e856fa3b3001%252Fpa%252FLB68583_cfd475611c1bfb74ee910cd1867da0d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_cfd475611c1bfb74ee910cd1867da0d1.jpg not downloaded yet
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F43%252Fca4358f45dcd2fcdef57e856fa3b3001%252Fpa%252FLB68583_59cd7c44a7e383c5ebb2f72882f7d923.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_59cd7c44a7e383c5ebb2f72882f7d923.jpg not downloaded yet
2026-03-30 10:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_a80fd01c270c09784c619f766fa1930e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_59cd7c44a7e383c5ebb2f72882f7d923.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f16d0>
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_a80fd01c270c09784c619f766fa1930e.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_a80fd01c270c09784c619f766fa1930e.jpg saved to cache
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f64ebd7-09fc-5d89-8b07-6f39e60b875c
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6cb10>
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8dc683-8e54-528c-b942-3493846d4278/4b8dc683-8e54-528c-b942-3493846d4278_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F43%252Fca4358f45dcd2fcdef57e856fa3b3001%252Fpa%252FLB68583_59cd7c44a7e383c5ebb2f72882f7d923.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_59cd7c44a7e383c5ebb2f72882f7d923.jpg saved to cache
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b8dc683-8e54-528c-b942-3493846d4278
2026-03-30 10:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_cfd475611c1bfb74ee910cd1867da0d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_513883cf275ddfe386c7ad1525232759.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea8890>
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8dc683-8e54-528c-b942-3493846d4278/4b8dc683-8e54-528c-b942-3493846d4278_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F43%252Fca4358f45dcd2fcdef57e856fa3b3001%252Fpa%252FLB68583_cfd475611c1bfb74ee910cd1867da0d1.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_cfd475611c1bfb74ee910cd1867da0d1.jpg saved to cache
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b8dc683-8e54-528c-b942-3493846d4278
2026-03-30 10:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_00c80c065d65acf0369bf65eeb856239.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a76150>
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8dc683-8e54-528c-b942-3493846d4278/4b8dc683-8e54-528c-b942-3493846d4278_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F43%252Fca4358f45dcd2fcdef57e856fa3b3001%252Fpa%252FLB68583_513883cf275ddfe386c7ad1525232759.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_513883cf275ddfe386c7ad1525232759.jpg saved to cache
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b8dc683-8e54-528c-b942-3493846d4278
2026-03-30 10:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_ca047908d21e4a2dc760bc61faa3d8dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e455d0>
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8dc683-8e54-528c-b942-3493846d4278/4b8dc683-8e54-528c-b942-3493846d4278_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F43%252Fca4358f45dcd2fcdef57e856fa3b3001%252Fpa%252FLB68583_00c80c065d65acf0369bf65eeb856239.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_00c80c065d65acf0369bf65eeb856239.jpg saved to cache
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b8dc683-8e54-528c-b942-3493846d4278
2026-03-30 10:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_a42b10017497beb91b708162a72d708b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee6ad0>
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8dc683-8e54-528c-b942-3493846d4278/4b8dc683-8e54-528c-b942-3493846d4278_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F43%252Fca4358f45dcd2fcdef57e856fa3b3001%252Fpa%252FLB68583_ca047908d21e4a2dc760bc61faa3d8dd.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_ca047908d21e4a2dc760bc61faa3d8dd.jpg saved to cache
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b8dc683-8e54-528c-b942-3493846d4278
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b22690>
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8dc683-8e54-528c-b942-3493846d4278/4b8dc683-8e54-528c-b942-3493846d4278_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F43%252Fca4358f45dcd2fcdef57e856fa3b3001%252Fpa%252FLB68583_a42b10017497beb91b708162a72d708b.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_a42b10017497beb91b708162a72d708b.jpg saved to cache
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b8dc683-8e54-528c-b942-3493846d4278
2026-03-30 10:47:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b8dc683-8e54-528c-b942-3493846d4278, skipping ID generation
2026-03-30 10:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b8dc683-8e54-528c-b942-3493846d4278 with scrape type 1
2026-03-30 10:47:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b8dc683-8e54-528c-b942-3493846d4278 sending to next pipeline
2026-03-30 10:47:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b8dc683-8e54-528c-b942-3493846d4278, identifier: LB68583
2026-03-30 10:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b8dc683-8e54-528c-b942-3493846d4278 with identifier: LB68583
2026-03-30 10:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b8dc683-8e54-528c-b942-3493846d4278 with identifier: LB68583
2026-03-30 10:47:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b8dc683-8e54-528c-b942-3493846d4278 with identifier: LB68583 to the API
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_a42b10017497beb91b708162a72d708b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:41:25Z',
 'fuel_type': 'diesel',
 'id': '4b8dc683-8e54-528c-b942-3493846d4278',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB68583',
 'listing': 'auction',
 'location': 'DE, Euskirchen',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 254573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8dc683-8e54-528c-b942-3493846d4278/4b8dc683-8e54-528c-b942-3493846d4278_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_a42b10017497beb91b708162a72d708b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8dc683-8e54-528c-b942-3493846d4278/4b8dc683-8e54-528c-b942-3493846d4278_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_ca047908d21e4a2dc760bc61faa3d8dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8dc683-8e54-528c-b942-3493846d4278/4b8dc683-8e54-528c-b942-3493846d4278_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_00c80c065d65acf0369bf65eeb856239.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8dc683-8e54-528c-b942-3493846d4278/4b8dc683-8e54-528c-b942-3493846d4278_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_513883cf275ddfe386c7ad1525232759.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8dc683-8e54-528c-b942-3493846d4278/4b8dc683-8e54-528c-b942-3493846d4278_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_cfd475611c1bfb74ee910cd1867da0d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8dc683-8e54-528c-b942-3493846d4278/4b8dc683-8e54-528c-b942-3493846d4278_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/43/ca4358f45dcd2fcdef57e856fa3b3001/pa/LB68583_59cd7c44a7e383c5ebb2f72882f7d923.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2011}
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB68583%27 HTTP/1.1" 200 None
2026-03-30 10:47:37 [auto1.de] INFO: Saving data for LB68583: {'created_time': 1774867657.459078, 'last_price_update_time': 1774867657.459092, 'auction_closing_time': 1774971685.0}
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB68583') HTTP/1.1" 204 0
2026-03-30 10:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_c2c0a824f03f24389cc0e2f723d2bd2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd0bd0>
2026-03-30 10:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_c2c0a824f03f24389cc0e2f723d2bd2d.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_c2c0a824f03f24389cc0e2f723d2bd2d.jpg saved to cache
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97639686-5fe4-55a9-a7bb-57650f6bffcd
2026-03-30 10:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH14903> (referer: https://www.auto1.com/v1/car-details-view/JH14903/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_fa00b5918c5ac0f438204ca6805dae6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1 with identifier: JH14903
2026-03-30 10:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1 with scrape type 1
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa7%252F63a7fce50bdf298cc48f40b635083f6c%252Fpa%252FJH14903_e9a5b952a26501c3cc1e6f5335313053.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_e9a5b952a26501c3cc1e6f5335313053.jpg not downloaded yet
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa7%252F63a7fce50bdf298cc48f40b635083f6c%252Fpa%252FJH14903_1610b05096c31e14723db6dd7de0498f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_1610b05096c31e14723db6dd7de0498f.jpg not downloaded yet
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa7%252F63a7fce50bdf298cc48f40b635083f6c%252Fpa%252FJH14903_61f5291cda8886ec1494cd52a88af9df.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_61f5291cda8886ec1494cd52a88af9df.jpg not downloaded yet
2026-03-30 10:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6fb90>
2026-03-30 10:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_fa00b5918c5ac0f438204ca6805dae6a.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_fa00b5918c5ac0f438204ca6805dae6a.jpg saved to cache
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f64ebd7-09fc-5d89-8b07-6f39e60b875c
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa7%252F63a7fce50bdf298cc48f40b635083f6c%252Fpa%252FJH14903_879936012d25ba430aed933907cdd02b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_879936012d25ba430aed933907cdd02b.jpg not downloaded yet
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa7%252F63a7fce50bdf298cc48f40b635083f6c%252Fpa%252FJH14903_49a220ae1dcd0504694fef431c09f581.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_49a220ae1dcd0504694fef431c09f581.jpg not downloaded yet
2026-03-30 10:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_3e95dc1de0089a85047b0f35591d4c60.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_23738001d75f07330fb91e57ceb1323c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_49a220ae1dcd0504694fef431c09f581.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b349d0>
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_3e95dc1de0089a85047b0f35591d4c60.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_3e95dc1de0089a85047b0f35591d4c60.jpg saved to cache
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f64ebd7-09fc-5d89-8b07-6f39e60b875c
2026-03-30 10:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_61f5291cda8886ec1494cd52a88af9df.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c1c50>
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_23738001d75f07330fb91e57ceb1323c.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_23738001d75f07330fb91e57ceb1323c.jpg saved to cache
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97639686-5fe4-55a9-a7bb-57650f6bffcd
2026-03-30 10:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_879936012d25ba430aed933907cdd02b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b37710>
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1/2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa7%252F63a7fce50bdf298cc48f40b635083f6c%252Fpa%252FJH14903_49a220ae1dcd0504694fef431c09f581.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_49a220ae1dcd0504694fef431c09f581.jpg saved to cache
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e21910>
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1/2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa7%252F63a7fce50bdf298cc48f40b635083f6c%252Fpa%252FJH14903_61f5291cda8886ec1494cd52a88af9df.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_61f5291cda8886ec1494cd52a88af9df.jpg saved to cache
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1
2026-03-30 10:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_1610b05096c31e14723db6dd7de0498f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c4f490>
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1/2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa7%252F63a7fce50bdf298cc48f40b635083f6c%252Fpa%252FJH14903_879936012d25ba430aed933907cdd02b.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_879936012d25ba430aed933907cdd02b.jpg saved to cache
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1
2026-03-30 10:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_11efdc9d8bce823136a50f77739a8c0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_e9a5b952a26501c3cc1e6f5335313053.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e969d0>
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1/2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa7%252F63a7fce50bdf298cc48f40b635083f6c%252Fpa%252FJH14903_1610b05096c31e14723db6dd7de0498f.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_1610b05096c31e14723db6dd7de0498f.jpg saved to cache
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b200d0>
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_11efdc9d8bce823136a50f77739a8c0c.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_11efdc9d8bce823136a50f77739a8c0c.jpg saved to cache
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97639686-5fe4-55a9-a7bb-57650f6bffcd
2026-03-30 10:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_af5800d8e24eeed85df1fb357d4455e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b20c10>
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1/2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fa7%252F63a7fce50bdf298cc48f40b635083f6c%252Fpa%252FJH14903_e9a5b952a26501c3cc1e6f5335313053.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_e9a5b952a26501c3cc1e6f5335313053.jpg saved to cache
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1
2026-03-30 10:47:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1, skipping ID generation
2026-03-30 10:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1 with scrape type 1
2026-03-30 10:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1 sending to next pipeline
2026-03-30 10:47:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1, identifier: JH14903
2026-03-30 10:47:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1 with identifier: JH14903
2026-03-30 10:47:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1 with identifier: JH14903
2026-03-30 10:47:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1 with identifier: JH14903 to the API
2026-03-30 10:47:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_e9a5b952a26501c3cc1e6f5335313053.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:25:31Z',
 'fuel_type': 'petrol',
 'id': '2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH14903',
 'listing': 'auction',
 'location': 'DE, Mönchengladbach',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 146701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1/2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_e9a5b952a26501c3cc1e6f5335313053.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1/2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_1610b05096c31e14723db6dd7de0498f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1/2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_61f5291cda8886ec1494cd52a88af9df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1/2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_879936012d25ba430aed933907cdd02b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1/2443b5e1-9be9-5ede-82a9-4a9f79fc9cf1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/a7/63a7fce50bdf298cc48f40b635083f6c/pa/JH14903_49a220ae1dcd0504694fef431c09f581.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 CrossPolo',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2006}
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH14903%27 HTTP/1.1" 200 None
2026-03-30 10:47:39 [auto1.de] INFO: Saving data for JH14903: {'created_time': 1774867659.163464, 'last_price_update_time': 1774867659.163476, 'auction_closing_time': 1774970731.0}
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH14903') HTTP/1.1" 204 0
2026-03-30 10:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_2118d4efe62d1ac84c3c32b05e4a728d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV57732/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JK71664/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:47:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c4fd90>
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_af5800d8e24eeed85df1fb357d4455e4.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_af5800d8e24eeed85df1fb357d4455e4.jpg saved to cache
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f64ebd7-09fc-5d89-8b07-6f39e60b875c
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6ed50>
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_2118d4efe62d1ac84c3c32b05e4a728d.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_2118d4efe62d1ac84c3c32b05e4a728d.jpg saved to cache
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97639686-5fe4-55a9-a7bb-57650f6bffcd
2026-03-30 10:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_bebfe44b5ec98577cb7900e173809a20.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_3386a47267dcf7fb0e505f0e7793b78e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_a7ba811b4b698eaed949c824f94fec11.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a64950>
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_bebfe44b5ec98577cb7900e173809a20.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_bebfe44b5ec98577cb7900e173809a20.jpg saved to cache
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f64ebd7-09fc-5d89-8b07-6f39e60b875c
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd1850>
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_3386a47267dcf7fb0e505f0e7793b78e.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_3386a47267dcf7fb0e505f0e7793b78e.jpg saved to cache
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f64ebd7-09fc-5d89-8b07-6f39e60b875c
2026-03-30 10:47:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fedf90>
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_a7ba811b4b698eaed949c824f94fec11.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_a7ba811b4b698eaed949c824f94fec11.jpg saved to cache
2026-03-30 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97639686-5fe4-55a9-a7bb-57650f6bffcd
2026-03-30 10:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_0aa3a0fa367bf9ef9ea989cca5389369.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_a1d236ccb18843c1dbf942d45d677e57.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f10250>
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_0aa3a0fa367bf9ef9ea989cca5389369.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_0aa3a0fa367bf9ef9ea989cca5389369.jpg saved to cache
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f64ebd7-09fc-5d89-8b07-6f39e60b875c
2026-03-30 10:47:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a67ad0>
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_a1d236ccb18843c1dbf942d45d677e57.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_a1d236ccb18843c1dbf942d45d677e57.jpg saved to cache
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97639686-5fe4-55a9-a7bb-57650f6bffcd
2026-03-30 10:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_2808cd15ce6e0adb510a05ae3cc5ecb2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_2523c51a3b32333444a95dec5dbdc1b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL22398/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b1c90>
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_2808cd15ce6e0adb510a05ae3cc5ecb2.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_2808cd15ce6e0adb510a05ae3cc5ecb2.jpg saved to cache
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97639686-5fe4-55a9-a7bb-57650f6bffcd
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b03b10>
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_2523c51a3b32333444a95dec5dbdc1b9.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_2523c51a3b32333444a95dec5dbdc1b9.jpg saved to cache
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f64ebd7-09fc-5d89-8b07-6f39e60b875c
2026-03-30 10:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_93586e63885bc39dacaa57ffe56f67dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_4803a8e2da13797a9436158a070440ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_28153dff8d2160c8c1604b1424c20871.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a43010>
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_93586e63885bc39dacaa57ffe56f67dc.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_93586e63885bc39dacaa57ffe56f67dc.jpg saved to cache
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f64ebd7-09fc-5d89-8b07-6f39e60b875c
2026-03-30 10:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_e769c9ca1445848599d3f54d515d19db.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a65bd0>
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_4803a8e2da13797a9436158a070440ca.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_4803a8e2da13797a9436158a070440ca.jpg saved to cache
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97639686-5fe4-55a9-a7bb-57650f6bffcd
2026-03-30 10:47:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c3610>
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_28153dff8d2160c8c1604b1424c20871.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_28153dff8d2160c8c1604b1424c20871.jpg saved to cache
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97639686-5fe4-55a9-a7bb-57650f6bffcd
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2ef90>
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fc6%252F6fc6de4c8cce406fa4840b4efaf3305f%252Fpa%252FJN68320_e769c9ca1445848599d3f54d515d19db.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_e769c9ca1445848599d3f54d515d19db.jpg saved to cache
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97639686-5fe4-55a9-a7bb-57650f6bffcd
2026-03-30 10:47:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97639686-5fe4-55a9-a7bb-57650f6bffcd, skipping ID generation
2026-03-30 10:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97639686-5fe4-55a9-a7bb-57650f6bffcd with scrape type 1
2026-03-30 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97639686-5fe4-55a9-a7bb-57650f6bffcd sending to next pipeline
2026-03-30 10:47:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97639686-5fe4-55a9-a7bb-57650f6bffcd, identifier: JN68320
2026-03-30 10:47:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97639686-5fe4-55a9-a7bb-57650f6bffcd with identifier: JN68320
2026-03-30 10:47:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97639686-5fe4-55a9-a7bb-57650f6bffcd with identifier: JN68320
2026-03-30 10:47:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97639686-5fe4-55a9-a7bb-57650f6bffcd with identifier: JN68320 to the API
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_e769c9ca1445848599d3f54d515d19db.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 265,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:32:58Z',
 'fuel_type': 'diesel',
 'id': '97639686-5fe4-55a9-a7bb-57650f6bffcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN68320',
 'listing': 'auction',
 'location': 'DE, Gummersbach',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 97437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_e769c9ca1445848599d3f54d515d19db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_4803a8e2da13797a9436158a070440ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2152476,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_28153dff8d2160c8c1604b1424c20871.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_2808cd15ce6e0adb510a05ae3cc5ecb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2118594,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_a1d236ccb18843c1dbf942d45d677e57.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2089160,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_a7ba811b4b698eaed949c824f94fec11.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_2118d4efe62d1ac84c3c32b05e4a728d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_11efdc9d8bce823136a50f77739a8c0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2573711,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_23738001d75f07330fb91e57ceb1323c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97639686-5fe4-55a9-a7bb-57650f6bffcd/97639686-5fe4-55a9-a7bb-57650f6bffcd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/c6/6fc6de4c8cce406fa4840b4efaf3305f/pa/JN68320_c2c0a824f03f24389cc0e2f723d2bd2d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 3.2 TDCi Doppelkabine Limited 4x4',
 'transmission': 'automatic',
 'trim': 'Doppelkabine Limited 4x4',
 'year': 2016}
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN68320%27 HTTP/1.1" 200 None
2026-03-30 10:47:41 [auto1.de] INFO: Saving data for JN68320: {'created_time': 1774867661.38029, 'last_price_update_time': 1774867661.380302, 'auction_closing_time': 1774971178.0}
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN68320') HTTP/1.1" 204 0
2026-03-30 10:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_3700f44dc1203b1765c87d5cd3616a8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da2990>
2026-03-30 10:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F17%252F2f176ea21e26469c49f9f4580da4ea3c%252Fpa%252FZA52966_3700f44dc1203b1765c87d5cd3616a8e.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_3700f44dc1203b1765c87d5cd3616a8e.jpg saved to cache
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f64ebd7-09fc-5d89-8b07-6f39e60b875c
2026-03-30 10:47:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f64ebd7-09fc-5d89-8b07-6f39e60b875c, skipping ID generation
2026-03-30 10:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f64ebd7-09fc-5d89-8b07-6f39e60b875c with scrape type 1
2026-03-30 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f64ebd7-09fc-5d89-8b07-6f39e60b875c sending to next pipeline
2026-03-30 10:47:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f64ebd7-09fc-5d89-8b07-6f39e60b875c, identifier: ZA52966
2026-03-30 10:47:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f64ebd7-09fc-5d89-8b07-6f39e60b875c with identifier: ZA52966
2026-03-30 10:47:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f64ebd7-09fc-5d89-8b07-6f39e60b875c with identifier: ZA52966
2026-03-30 10:47:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f64ebd7-09fc-5d89-8b07-6f39e60b875c with identifier: ZA52966 to the API
2026-03-30 10:47:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_3700f44dc1203b1765c87d5cd3616a8e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:56:06Z',
 'fuel_type': 'petrol',
 'id': '6f64ebd7-09fc-5d89-8b07-6f39e60b875c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA52966',
 'listing': 'auction',
 'location': 'DE, Fürth',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 51326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2353557,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_3700f44dc1203b1765c87d5cd3616a8e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2347226,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_93586e63885bc39dacaa57ffe56f67dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_2523c51a3b32333444a95dec5dbdc1b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_0aa3a0fa367bf9ef9ea989cca5389369.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_3386a47267dcf7fb0e505f0e7793b78e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2409485,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_bebfe44b5ec98577cb7900e173809a20.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_af5800d8e24eeed85df1fb357d4455e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_3e95dc1de0089a85047b0f35591d4c60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_fa00b5918c5ac0f438204ca6805dae6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f64ebd7-09fc-5d89-8b07-6f39e60b875c/6f64ebd7-09fc-5d89-8b07-6f39e60b875c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/17/2f176ea21e26469c49f9f4580da4ea3c/pa/ZA52966_a80fd01c270c09784c619f766fa1930e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA52966%27 HTTP/1.1" 200 None
2026-03-30 10:47:42 [auto1.de] INFO: Saving data for ZA52966: {'created_time': 1774867662.378922, 'last_price_update_time': 1774867662.378935, 'auction_closing_time': 1774972566.0}
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA52966') HTTP/1.1" 204 0
2026-03-30 10:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX45825> (referer: https://www.auto1.com/v1/car-details-view/SX45825/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6 with identifier: SX45825
2026-03-30 10:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6 with scrape type 1
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F2f%252F772f6d5b82a6c2f84bd797abfd263745%252Fpa%252FSX45825_4601d4f5df67ad771ab52f40721438bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_4601d4f5df67ad771ab52f40721438bb.jpg not downloaded yet
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F2f%252F772f6d5b82a6c2f84bd797abfd263745%252Fpa%252FSX45825_9765be31087804c980df7867b6e536a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_9765be31087804c980df7867b6e536a9.jpg not downloaded yet
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F2f%252F772f6d5b82a6c2f84bd797abfd263745%252Fpa%252FSX45825_158458f0d54761487f456821895bc9ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_158458f0d54761487f456821895bc9ea.jpg not downloaded yet
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F2f%252F772f6d5b82a6c2f84bd797abfd263745%252Fpa%252FSX45825_3ec2b17ab6b6a4182107fce8b4648495.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_3ec2b17ab6b6a4182107fce8b4648495.jpg not downloaded yet
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F2f%252F772f6d5b82a6c2f84bd797abfd263745%252Fpa%252FSX45825_e941ec5b051ba10a0eaae5b5ecc86e1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_e941ec5b051ba10a0eaae5b5ecc86e1b.jpg not downloaded yet
2026-03-30 10:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_4601d4f5df67ad771ab52f40721438bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b22790>
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6/5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F2f%252F772f6d5b82a6c2f84bd797abfd263745%252Fpa%252FSX45825_4601d4f5df67ad771ab52f40721438bb.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_4601d4f5df67ad771ab52f40721438bb.jpg saved to cache
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6
2026-03-30 10:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_9765be31087804c980df7867b6e536a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_e941ec5b051ba10a0eaae5b5ecc86e1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_3ec2b17ab6b6a4182107fce8b4648495.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e65ed0>
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6/5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F2f%252F772f6d5b82a6c2f84bd797abfd263745%252Fpa%252FSX45825_9765be31087804c980df7867b6e536a9.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_9765be31087804c980df7867b6e536a9.jpg saved to cache
2026-03-30 10:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b22690>
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6/5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F2f%252F772f6d5b82a6c2f84bd797abfd263745%252Fpa%252FSX45825_e941ec5b051ba10a0eaae5b5ecc86e1b.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_e941ec5b051ba10a0eaae5b5ecc86e1b.jpg saved to cache
2026-03-30 10:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6
2026-03-30 10:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2e410>
2026-03-30 10:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6/5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F2f%252F772f6d5b82a6c2f84bd797abfd263745%252Fpa%252FSX45825_3ec2b17ab6b6a4182107fce8b4648495.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_3ec2b17ab6b6a4182107fce8b4648495.jpg saved to cache
2026-03-30 10:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6
2026-03-30 10:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_158458f0d54761487f456821895bc9ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea8810>
2026-03-30 10:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6/5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F2f%252F772f6d5b82a6c2f84bd797abfd263745%252Fpa%252FSX45825_158458f0d54761487f456821895bc9ea.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_158458f0d54761487f456821895bc9ea.jpg saved to cache
2026-03-30 10:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6
2026-03-30 10:47:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6, skipping ID generation
2026-03-30 10:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6 with scrape type 1
2026-03-30 10:47:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6 sending to next pipeline
2026-03-30 10:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6, identifier: SX45825
2026-03-30 10:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6 with identifier: SX45825
2026-03-30 10:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6 with identifier: SX45825
2026-03-30 10:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6 with identifier: SX45825 to the API
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_158458f0d54761487f456821895bc9ea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:18:10Z',
 'fuel_type': 'petrol',
 'id': '5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX45825',
 'listing': 'auction',
 'location': 'DE, Bretzenheim',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 130040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6/5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_4601d4f5df67ad771ab52f40721438bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6/5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_9765be31087804c980df7867b6e536a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6/5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_158458f0d54761487f456821895bc9ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6/5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_3ec2b17ab6b6a4182107fce8b4648495.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6/5d5dbc4a-5df4-5c61-9fa0-82eb62bd11b6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/2f/772f6d5b82a6c2f84bd797abfd263745/pa/SX45825_e941ec5b051ba10a0eaae5b5ecc86e1b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX45825%27 HTTP/1.1" 200 None
2026-03-30 10:47:44 [auto1.de] INFO: Saving data for SX45825: {'created_time': 1774867664.734024, 'last_price_update_time': 1774867664.734036, 'auction_closing_time': 1774970290.0}
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX45825') HTTP/1.1" 204 0
2026-03-30 10:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS06409/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK53394> (referer: https://www.auto1.com/v1/car-details-view/PK53394/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58f3a68f-bda8-5545-aae6-099e8b85532a with identifier: PK53394
2026-03-30 10:47:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58f3a68f-bda8-5545-aae6-099e8b85532a with scrape type 1
2026-03-30 10:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 58f3a68f-bda8-5545-aae6-099e8b85532a
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F78%252F7c784b720d72950a2a131f68154e3c7d%252Fpa%252FPK53394_02e9edd4425e1e18c7ae82113522456c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_02e9edd4425e1e18c7ae82113522456c.jpg not downloaded yet
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F78%252F7c784b720d72950a2a131f68154e3c7d%252Fpa%252FPK53394_fea59bab2f4c839f59aa8c87b4e83f27.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_fea59bab2f4c839f59aa8c87b4e83f27.jpg not downloaded yet
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F78%252F7c784b720d72950a2a131f68154e3c7d%252Fpa%252FPK53394_8ac755c275593fa96225a4703d5889bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_8ac755c275593fa96225a4703d5889bd.jpg not downloaded yet
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F78%252F7c784b720d72950a2a131f68154e3c7d%252Fpa%252FPK53394_e10c62c1411c5b54582f596871878a30.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_e10c62c1411c5b54582f596871878a30.jpg not downloaded yet
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F78%252F7c784b720d72950a2a131f68154e3c7d%252Fpa%252FPK53394_dd54ba2826cc17ac013041c703ed5078.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_dd54ba2826cc17ac013041c703ed5078.jpg not downloaded yet
2026-03-30 10:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_02e9edd4425e1e18c7ae82113522456c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_8ac755c275593fa96225a4703d5889bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50112d0>
2026-03-30 10:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f3a68f-bda8-5545-aae6-099e8b85532a/58f3a68f-bda8-5545-aae6-099e8b85532a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F78%252F7c784b720d72950a2a131f68154e3c7d%252Fpa%252FPK53394_02e9edd4425e1e18c7ae82113522456c.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_02e9edd4425e1e18c7ae82113522456c.jpg saved to cache
2026-03-30 10:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58f3a68f-bda8-5545-aae6-099e8b85532a
2026-03-30 10:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea8c10>
2026-03-30 10:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f3a68f-bda8-5545-aae6-099e8b85532a/58f3a68f-bda8-5545-aae6-099e8b85532a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F78%252F7c784b720d72950a2a131f68154e3c7d%252Fpa%252FPK53394_8ac755c275593fa96225a4703d5889bd.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_8ac755c275593fa96225a4703d5889bd.jpg saved to cache
2026-03-30 10:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58f3a68f-bda8-5545-aae6-099e8b85532a
2026-03-30 10:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_fea59bab2f4c839f59aa8c87b4e83f27.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_dd54ba2826cc17ac013041c703ed5078.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_e10c62c1411c5b54582f596871878a30.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59616d0>
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f3a68f-bda8-5545-aae6-099e8b85532a/58f3a68f-bda8-5545-aae6-099e8b85532a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F78%252F7c784b720d72950a2a131f68154e3c7d%252Fpa%252FPK53394_fea59bab2f4c839f59aa8c87b4e83f27.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_fea59bab2f4c839f59aa8c87b4e83f27.jpg saved to cache
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58f3a68f-bda8-5545-aae6-099e8b85532a
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5962290>
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f3a68f-bda8-5545-aae6-099e8b85532a/58f3a68f-bda8-5545-aae6-099e8b85532a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F78%252F7c784b720d72950a2a131f68154e3c7d%252Fpa%252FPK53394_dd54ba2826cc17ac013041c703ed5078.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_dd54ba2826cc17ac013041c703ed5078.jpg saved to cache
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58f3a68f-bda8-5545-aae6-099e8b85532a
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5963f10>
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f3a68f-bda8-5545-aae6-099e8b85532a/58f3a68f-bda8-5545-aae6-099e8b85532a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F78%252F7c784b720d72950a2a131f68154e3c7d%252Fpa%252FPK53394_e10c62c1411c5b54582f596871878a30.jpg') HTTP/1.1" 204 0
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_e10c62c1411c5b54582f596871878a30.jpg saved to cache
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58f3a68f-bda8-5545-aae6-099e8b85532a
2026-03-30 10:47:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58f3a68f-bda8-5545-aae6-099e8b85532a, skipping ID generation
2026-03-30 10:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58f3a68f-bda8-5545-aae6-099e8b85532a with scrape type 1
2026-03-30 10:47:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58f3a68f-bda8-5545-aae6-099e8b85532a sending to next pipeline
2026-03-30 10:47:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58f3a68f-bda8-5545-aae6-099e8b85532a, identifier: PK53394
2026-03-30 10:47:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58f3a68f-bda8-5545-aae6-099e8b85532a with identifier: PK53394
2026-03-30 10:47:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58f3a68f-bda8-5545-aae6-099e8b85532a with identifier: PK53394
2026-03-30 10:47:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58f3a68f-bda8-5545-aae6-099e8b85532a with identifier: PK53394 to the API
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_e10c62c1411c5b54582f596871878a30.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:59:28Z',
 'fuel_type': 'petrol',
 'id': '58f3a68f-bda8-5545-aae6-099e8b85532a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK53394',
 'listing': 'auction',
 'location': 'DE, Neufahrn',
 'make': 'BMW',
 'model': '1er',
 'odometer': 205425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58f3a68f-bda8-5545-aae6-099e8b85532a/58f3a68f-bda8-5545-aae6-099e8b85532a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_02e9edd4425e1e18c7ae82113522456c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58f3a68f-bda8-5545-aae6-099e8b85532a/58f3a68f-bda8-5545-aae6-099e8b85532a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_fea59bab2f4c839f59aa8c87b4e83f27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58f3a68f-bda8-5545-aae6-099e8b85532a/58f3a68f-bda8-5545-aae6-099e8b85532a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_8ac755c275593fa96225a4703d5889bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58f3a68f-bda8-5545-aae6-099e8b85532a/58f3a68f-bda8-5545-aae6-099e8b85532a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_e10c62c1411c5b54582f596871878a30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58f3a68f-bda8-5545-aae6-099e8b85532a/58f3a68f-bda8-5545-aae6-099e8b85532a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 150591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/78/7c784b720d72950a2a131f68154e3c7d/pa/PK53394_dd54ba2826cc17ac013041c703ed5078.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK53394%27 HTTP/1.1" 200 None
2026-03-30 10:47:49 [auto1.de] INFO: Saving data for PK53394: {'created_time': 1774867669.709645, 'last_price_update_time': 1774867669.709656, 'auction_closing_time': 1774972768.0}
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK53394') HTTP/1.1" 204 0
2026-03-30 10:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV38607/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU85166> (referer: https://www.auto1.com/v1/car-details-view/CU85166/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50a34218-9f91-5ced-af8f-b706bac513dc with identifier: CU85166
2026-03-30 10:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50a34218-9f91-5ced-af8f-b706bac513dc with scrape type 1
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 50a34218-9f91-5ced-af8f-b706bac513dc
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fbe%252F03be84901e65b71f07c58d302ef946c4%252Fpa%252FCU85166_b588bcc21ab0c854b238267e91948add.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_b588bcc21ab0c854b238267e91948add.jpg already downloaded
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fbe%252F03be84901e65b71f07c58d302ef946c4%252Fpa%252FCU85166_b7a62eab89f5e369b9d8ef9809baae5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_b7a62eab89f5e369b9d8ef9809baae5d.jpg already downloaded
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fbe%252F03be84901e65b71f07c58d302ef946c4%252Fpa%252FCU85166_40d272e04e251ff38104db2e9ea7c5cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_40d272e04e251ff38104db2e9ea7c5cb.jpg already downloaded
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fbe%252F03be84901e65b71f07c58d302ef946c4%252Fpa%252FCU85166_3f90b891d000af6aa8da08f252acd155.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_3f90b891d000af6aa8da08f252acd155.jpg already downloaded
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fbe%252F03be84901e65b71f07c58d302ef946c4%252Fpa%252FCU85166_71e57f80dec72ff3f3e93457091d8a3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_71e57f80dec72ff3f3e93457091d8a3f.jpg already downloaded
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fbe%252F03be84901e65b71f07c58d302ef946c4%252Fpa%252FCU85166_e5332eb7e00f2544ce8fd0bda4f89990.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_e5332eb7e00f2544ce8fd0bda4f89990.jpg already downloaded
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fbe%252F03be84901e65b71f07c58d302ef946c4%252Fpa%252FCU85166_9f2d66d437dc41358ae2fc5758ad8b81.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_9f2d66d437dc41358ae2fc5758ad8b81.jpg already downloaded
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fbe%252F03be84901e65b71f07c58d302ef946c4%252Fpa%252FCU85166_72a7eca490d0c2cbaf7f80dcec1f0e68.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_72a7eca490d0c2cbaf7f80dcec1f0e68.jpg already downloaded
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fbe%252F03be84901e65b71f07c58d302ef946c4%252Fpa%252FCU85166_de9dddb7beaa7980aad439fd9cf6a85f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_de9dddb7beaa7980aad439fd9cf6a85f.jpg already downloaded
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fbe%252F03be84901e65b71f07c58d302ef946c4%252Fpa%252FCU85166_70a36b1c51f731afdaf78279ad980911.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_70a36b1c51f731afdaf78279ad980911.jpg already downloaded
2026-03-30 10:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50a34218-9f91-5ced-af8f-b706bac513dc, identifier: CU85166
2026-03-30 10:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50a34218-9f91-5ced-af8f-b706bac513dc with identifier: CU85166
2026-03-30 10:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50a34218-9f91-5ced-af8f-b706bac513dc with identifier: CU85166
2026-03-30 10:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50a34218-9f91-5ced-af8f-b706bac513dc with identifier: CU85166 to the API
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CU85166>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:43:35Z',
 'fuel_type': 'diesel',
 'id': '50a34218-9f91-5ced-af8f-b706bac513dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU85166',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 149983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_b588bcc21ab0c854b238267e91948add.jpg',
                'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_b7a62eab89f5e369b9d8ef9809baae5d.jpg',
                'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_40d272e04e251ff38104db2e9ea7c5cb.jpg',
                'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_3f90b891d000af6aa8da08f252acd155.jpg',
                'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_71e57f80dec72ff3f3e93457091d8a3f.jpg',
                'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_e5332eb7e00f2544ce8fd0bda4f89990.jpg',
                'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_9f2d66d437dc41358ae2fc5758ad8b81.jpg',
                'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_72a7eca490d0c2cbaf7f80dcec1f0e68.jpg',
                'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_de9dddb7beaa7980aad439fd9cf6a85f.jpg',
                'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_70a36b1c51f731afdaf78279ad980911.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50a34218-9f91-5ced-af8f-b706bac513dc/50a34218-9f91-5ced-af8f-b706bac513dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_b588bcc21ab0c854b238267e91948add.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50a34218-9f91-5ced-af8f-b706bac513dc/50a34218-9f91-5ced-af8f-b706bac513dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_b7a62eab89f5e369b9d8ef9809baae5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50a34218-9f91-5ced-af8f-b706bac513dc/50a34218-9f91-5ced-af8f-b706bac513dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_40d272e04e251ff38104db2e9ea7c5cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50a34218-9f91-5ced-af8f-b706bac513dc/50a34218-9f91-5ced-af8f-b706bac513dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_3f90b891d000af6aa8da08f252acd155.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50a34218-9f91-5ced-af8f-b706bac513dc/50a34218-9f91-5ced-af8f-b706bac513dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_71e57f80dec72ff3f3e93457091d8a3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50a34218-9f91-5ced-af8f-b706bac513dc/50a34218-9f91-5ced-af8f-b706bac513dc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_e5332eb7e00f2544ce8fd0bda4f89990.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50a34218-9f91-5ced-af8f-b706bac513dc/50a34218-9f91-5ced-af8f-b706bac513dc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_9f2d66d437dc41358ae2fc5758ad8b81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50a34218-9f91-5ced-af8f-b706bac513dc/50a34218-9f91-5ced-af8f-b706bac513dc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_72a7eca490d0c2cbaf7f80dcec1f0e68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50a34218-9f91-5ced-af8f-b706bac513dc/50a34218-9f91-5ced-af8f-b706bac513dc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_de9dddb7beaa7980aad439fd9cf6a85f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50a34218-9f91-5ced-af8f-b706bac513dc/50a34218-9f91-5ced-af8f-b706bac513dc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/be/03be84901e65b71f07c58d302ef946c4/pa/CU85166_70a36b1c51f731afdaf78279ad980911.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 Biturbo CDTI Business Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Start/Stop',
 'year': 2018}
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU85166%27 HTTP/1.1" 200 None
2026-03-30 10:47:53 [auto1.de] INFO: Saving data for CU85166: {'created_time': 1774867673.865645, 'last_price_update_time': 1774867673.865658, 'auction_closing_time': 1774971815.0}
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU85166') HTTP/1.1" 204 0
2026-03-30 10:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV41161> (referer: https://www.auto1.com/v1/car-details-view/SV41161/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31b55ee1-51af-5caa-af64-42fce8fbe9b3 with identifier: SV41161
2026-03-30 10:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31b55ee1-51af-5caa-af64-42fce8fbe9b3 with scrape type 1
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31b55ee1-51af-5caa-af64-42fce8fbe9b3
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F17%252F9a1740a8f7950eb4322c78066e2f3363%252Fpa%252FSV41161_18175e3fc8dd65d281964d02a0c41a06.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_18175e3fc8dd65d281964d02a0c41a06.jpg already downloaded
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F17%252F9a1740a8f7950eb4322c78066e2f3363%252Fpa%252FSV41161_6f03b83baaa038ea6a42f7ec03806303.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_6f03b83baaa038ea6a42f7ec03806303.jpg already downloaded
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F17%252F9a1740a8f7950eb4322c78066e2f3363%252Fpa%252FSV41161_056192f54a0ae60c414f899cc6e8f223.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_056192f54a0ae60c414f899cc6e8f223.jpg already downloaded
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F17%252F9a1740a8f7950eb4322c78066e2f3363%252Fpa%252FSV41161_5468be1f2401886bb9f5ad3edba612dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_5468be1f2401886bb9f5ad3edba612dd.jpg already downloaded
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F17%252F9a1740a8f7950eb4322c78066e2f3363%252Fpa%252FSV41161_d2a02b885fe5b0cfa0c746f69966b0a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_d2a02b885fe5b0cfa0c746f69966b0a8.jpg already downloaded
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F17%252F9a1740a8f7950eb4322c78066e2f3363%252Fpa%252FSV41161_078d61517c5eecdc424aec6f7bc82ac4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_078d61517c5eecdc424aec6f7bc82ac4.jpg already downloaded
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F17%252F9a1740a8f7950eb4322c78066e2f3363%252Fpa%252FSV41161_00df1abca2233a3dee295f2e47105238.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_00df1abca2233a3dee295f2e47105238.jpg already downloaded
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F17%252F9a1740a8f7950eb4322c78066e2f3363%252Fpa%252FSV41161_c2c85f02ef963a4a8b9ab96671f1f1ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_c2c85f02ef963a4a8b9ab96671f1f1ac.jpg already downloaded
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F17%252F9a1740a8f7950eb4322c78066e2f3363%252Fpa%252FSV41161_543ce0ef6b3711948eed83ac2ef892ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_543ce0ef6b3711948eed83ac2ef892ba.jpg already downloaded
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F17%252F9a1740a8f7950eb4322c78066e2f3363%252Fpa%252FSV41161_78db52ba4d38693318d70d218eea67d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_78db52ba4d38693318d70d218eea67d0.jpg already downloaded
2026-03-30 10:47:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31b55ee1-51af-5caa-af64-42fce8fbe9b3, identifier: SV41161
2026-03-30 10:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31b55ee1-51af-5caa-af64-42fce8fbe9b3 with identifier: SV41161
2026-03-30 10:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31b55ee1-51af-5caa-af64-42fce8fbe9b3 with identifier: SV41161
2026-03-30 10:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31b55ee1-51af-5caa-af64-42fce8fbe9b3 with identifier: SV41161 to the API
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SV41161>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:37:35Z',
 'fuel_type': 'petrol',
 'id': '31b55ee1-51af-5caa-af64-42fce8fbe9b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV41161',
 'listing': 'auction',
 'location': 'DE, Kippenheim',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 137049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_18175e3fc8dd65d281964d02a0c41a06.jpg',
                'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_6f03b83baaa038ea6a42f7ec03806303.jpg',
                'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_056192f54a0ae60c414f899cc6e8f223.jpg',
                'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_5468be1f2401886bb9f5ad3edba612dd.jpg',
                'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_d2a02b885fe5b0cfa0c746f69966b0a8.jpg',
                'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_078d61517c5eecdc424aec6f7bc82ac4.jpg',
                'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_00df1abca2233a3dee295f2e47105238.jpg',
                'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_c2c85f02ef963a4a8b9ab96671f1f1ac.jpg',
                'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_543ce0ef6b3711948eed83ac2ef892ba.jpg',
                'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_78db52ba4d38693318d70d218eea67d0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b55ee1-51af-5caa-af64-42fce8fbe9b3/31b55ee1-51af-5caa-af64-42fce8fbe9b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_18175e3fc8dd65d281964d02a0c41a06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b55ee1-51af-5caa-af64-42fce8fbe9b3/31b55ee1-51af-5caa-af64-42fce8fbe9b3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_6f03b83baaa038ea6a42f7ec03806303.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b55ee1-51af-5caa-af64-42fce8fbe9b3/31b55ee1-51af-5caa-af64-42fce8fbe9b3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_056192f54a0ae60c414f899cc6e8f223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b55ee1-51af-5caa-af64-42fce8fbe9b3/31b55ee1-51af-5caa-af64-42fce8fbe9b3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_5468be1f2401886bb9f5ad3edba612dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b55ee1-51af-5caa-af64-42fce8fbe9b3/31b55ee1-51af-5caa-af64-42fce8fbe9b3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_d2a02b885fe5b0cfa0c746f69966b0a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b55ee1-51af-5caa-af64-42fce8fbe9b3/31b55ee1-51af-5caa-af64-42fce8fbe9b3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_078d61517c5eecdc424aec6f7bc82ac4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b55ee1-51af-5caa-af64-42fce8fbe9b3/31b55ee1-51af-5caa-af64-42fce8fbe9b3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_00df1abca2233a3dee295f2e47105238.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b55ee1-51af-5caa-af64-42fce8fbe9b3/31b55ee1-51af-5caa-af64-42fce8fbe9b3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_c2c85f02ef963a4a8b9ab96671f1f1ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b55ee1-51af-5caa-af64-42fce8fbe9b3/31b55ee1-51af-5caa-af64-42fce8fbe9b3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_543ce0ef6b3711948eed83ac2ef892ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b55ee1-51af-5caa-af64-42fce8fbe9b3/31b55ee1-51af-5caa-af64-42fce8fbe9b3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/17/9a1740a8f7950eb4322c78066e2f3363/pa/SV41161_78db52ba4d38693318d70d218eea67d0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV41161%27 HTTP/1.1" 200 None
2026-03-30 10:47:55 [auto1.de] INFO: Saving data for SV41161: {'created_time': 1774867675.686597, 'last_price_update_time': 1774867675.686608, 'auction_closing_time': 1774971455.0}
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV41161') HTTP/1.1" 204 0
2026-03-30 10:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MR77046/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL22398> (referer: https://www.auto1.com/v1/car-details-view/EL22398/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eaae192-4ca4-510c-9bb5-633b132c79e6 with identifier: EL22398
2026-03-30 10:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eaae192-4ca4-510c-9bb5-633b132c79e6 with scrape type 1
2026-03-30 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9eaae192-4ca4-510c-9bb5-633b132c79e6
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F83%252Fdf83278f3f10f26a81977b24fe3d160f%252Fpa%252FEL22398_32194932a85d91ba74372187f03c7159.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_32194932a85d91ba74372187f03c7159.jpg already downloaded
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F83%252Fdf83278f3f10f26a81977b24fe3d160f%252Fpa%252FEL22398_3f3c5b75d4228e751245aa29ed87254b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_3f3c5b75d4228e751245aa29ed87254b.jpg already downloaded
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F83%252Fdf83278f3f10f26a81977b24fe3d160f%252Fpa%252FEL22398_4991814e1056384d0647edf3ffc0ad52.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_4991814e1056384d0647edf3ffc0ad52.jpg already downloaded
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F83%252Fdf83278f3f10f26a81977b24fe3d160f%252Fpa%252FEL22398_687ae2a62bb7e16020743def690b7abb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_687ae2a62bb7e16020743def690b7abb.jpg already downloaded
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F83%252Fdf83278f3f10f26a81977b24fe3d160f%252Fpa%252FEL22398_5792a43c6ba68c9d0134abcc06908bd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_5792a43c6ba68c9d0134abcc06908bd5.jpg already downloaded
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F83%252Fdf83278f3f10f26a81977b24fe3d160f%252Fpa%252FEL22398_2fd014f37990780d0a6962819ae4ef6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_2fd014f37990780d0a6962819ae4ef6f.jpg already downloaded
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F83%252Fdf83278f3f10f26a81977b24fe3d160f%252Fpa%252FEL22398_283859044c1dd26a1f1b1a1429c8aa94.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_283859044c1dd26a1f1b1a1429c8aa94.jpg already downloaded
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F83%252Fdf83278f3f10f26a81977b24fe3d160f%252Fpa%252FEL22398_501e33f8b7d5a212eff1f404f2b4206a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_501e33f8b7d5a212eff1f404f2b4206a.jpg already downloaded
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F83%252Fdf83278f3f10f26a81977b24fe3d160f%252Fpa%252FEL22398_9744f00cb7b767ddd5b85aef5d7d4bde.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_9744f00cb7b767ddd5b85aef5d7d4bde.jpg already downloaded
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F83%252Fdf83278f3f10f26a81977b24fe3d160f%252Fpa%252FEL22398_c2b360ce2522a5155d4d8f185b5c8219.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_c2b360ce2522a5155d4d8f185b5c8219.jpg already downloaded
2026-03-30 10:47:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9eaae192-4ca4-510c-9bb5-633b132c79e6, identifier: EL22398
2026-03-30 10:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9eaae192-4ca4-510c-9bb5-633b132c79e6 with identifier: EL22398
2026-03-30 10:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9eaae192-4ca4-510c-9bb5-633b132c79e6 with identifier: EL22398
2026-03-30 10:47:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9eaae192-4ca4-510c-9bb5-633b132c79e6 with identifier: EL22398 to the API
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:47:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EL22398>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:08:02Z',
 'fuel_type': 'petrol',
 'id': '9eaae192-4ca4-510c-9bb5-633b132c79e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL22398',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 144539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_32194932a85d91ba74372187f03c7159.jpg',
                'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_3f3c5b75d4228e751245aa29ed87254b.jpg',
                'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_4991814e1056384d0647edf3ffc0ad52.jpg',
                'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_687ae2a62bb7e16020743def690b7abb.jpg',
                'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_5792a43c6ba68c9d0134abcc06908bd5.jpg',
                'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_2fd014f37990780d0a6962819ae4ef6f.jpg',
                'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_283859044c1dd26a1f1b1a1429c8aa94.jpg',
                'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_501e33f8b7d5a212eff1f404f2b4206a.jpg',
                'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_9744f00cb7b767ddd5b85aef5d7d4bde.jpg',
                'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_c2b360ce2522a5155d4d8f185b5c8219.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eaae192-4ca4-510c-9bb5-633b132c79e6/9eaae192-4ca4-510c-9bb5-633b132c79e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3215438,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_32194932a85d91ba74372187f03c7159.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eaae192-4ca4-510c-9bb5-633b132c79e6/9eaae192-4ca4-510c-9bb5-633b132c79e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_3f3c5b75d4228e751245aa29ed87254b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eaae192-4ca4-510c-9bb5-633b132c79e6/9eaae192-4ca4-510c-9bb5-633b132c79e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3148972,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_4991814e1056384d0647edf3ffc0ad52.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eaae192-4ca4-510c-9bb5-633b132c79e6/9eaae192-4ca4-510c-9bb5-633b132c79e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_687ae2a62bb7e16020743def690b7abb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eaae192-4ca4-510c-9bb5-633b132c79e6/9eaae192-4ca4-510c-9bb5-633b132c79e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2967523,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_5792a43c6ba68c9d0134abcc06908bd5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eaae192-4ca4-510c-9bb5-633b132c79e6/9eaae192-4ca4-510c-9bb5-633b132c79e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_2fd014f37990780d0a6962819ae4ef6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eaae192-4ca4-510c-9bb5-633b132c79e6/9eaae192-4ca4-510c-9bb5-633b132c79e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_283859044c1dd26a1f1b1a1429c8aa94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eaae192-4ca4-510c-9bb5-633b132c79e6/9eaae192-4ca4-510c-9bb5-633b132c79e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_501e33f8b7d5a212eff1f404f2b4206a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eaae192-4ca4-510c-9bb5-633b132c79e6/9eaae192-4ca4-510c-9bb5-633b132c79e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3003806,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_9744f00cb7b767ddd5b85aef5d7d4bde.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eaae192-4ca4-510c-9bb5-633b132c79e6/9eaae192-4ca4-510c-9bb5-633b132c79e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/83/df83278f3f10f26a81977b24fe3d160f/pa/EL22398_c2b360ce2522a5155d4d8f185b5c8219.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2017}
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL22398%27 HTTP/1.1" 200 None
2026-03-30 10:47:57 [auto1.de] INFO: Saving data for EL22398: {'created_time': 1774867677.861843, 'last_price_update_time': 1774867677.861856, 'auction_closing_time': 1774969682.0}
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL22398') HTTP/1.1" 204 0
2026-03-30 10:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS06409> (referer: https://www.auto1.com/v1/car-details-view/WS06409/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:47:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:47:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 705cb9a7-f18a-55cf-9831-9b2991042239 with identifier: WS06409
2026-03-30 10:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 705cb9a7-f18a-55cf-9831-9b2991042239 with scrape type 1
2026-03-30 10:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 705cb9a7-f18a-55cf-9831-9b2991042239
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fe8%252F1ae80ae48799f7c7d9dcf8b894bd5ec6%252Fpa%252FWS06409_0cec7a777b45b5ed3162edb42c0c3b23.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_0cec7a777b45b5ed3162edb42c0c3b23.jpg already downloaded
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fe8%252F1ae80ae48799f7c7d9dcf8b894bd5ec6%252Fpa%252FWS06409_82b9e0e1878636d76fd875507207ceae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_82b9e0e1878636d76fd875507207ceae.jpg already downloaded
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fe8%252F1ae80ae48799f7c7d9dcf8b894bd5ec6%252Fpa%252FWS06409_6a7d61d74a7cc7cb37aeac67e3e53924.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_6a7d61d74a7cc7cb37aeac67e3e53924.jpg already downloaded
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fe8%252F1ae80ae48799f7c7d9dcf8b894bd5ec6%252Fpa%252FWS06409_624f9de9da6a03b215b93aab9e27f674.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_624f9de9da6a03b215b93aab9e27f674.jpg already downloaded
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fe8%252F1ae80ae48799f7c7d9dcf8b894bd5ec6%252Fpa%252FWS06409_19622dbba90568613a9698c8365ddc63.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_19622dbba90568613a9698c8365ddc63.jpg already downloaded
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fe8%252F1ae80ae48799f7c7d9dcf8b894bd5ec6%252Fpa%252FWS06409_25e86e71071f814f516dcd5c7f84d060.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_25e86e71071f814f516dcd5c7f84d060.jpg already downloaded
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fe8%252F1ae80ae48799f7c7d9dcf8b894bd5ec6%252Fpa%252FWS06409_2699aaaefc0b9e001d805c463c990167.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_2699aaaefc0b9e001d805c463c990167.jpg already downloaded
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fe8%252F1ae80ae48799f7c7d9dcf8b894bd5ec6%252Fpa%252FWS06409_f3932a9eff92fa4c842aa0d2e73d45c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_f3932a9eff92fa4c842aa0d2e73d45c4.jpg already downloaded
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fe8%252F1ae80ae48799f7c7d9dcf8b894bd5ec6%252Fpa%252FWS06409_0d34462f0d2f014f7a20b2f61572db39.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_0d34462f0d2f014f7a20b2f61572db39.jpg already downloaded
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fe8%252F1ae80ae48799f7c7d9dcf8b894bd5ec6%252Fpa%252FWS06409_1f5fa06e7a891fc1cbca3919080b33b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_1f5fa06e7a891fc1cbca3919080b33b6.jpg already downloaded
2026-03-30 10:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 705cb9a7-f18a-55cf-9831-9b2991042239, identifier: WS06409
2026-03-30 10:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 705cb9a7-f18a-55cf-9831-9b2991042239 with identifier: WS06409
2026-03-30 10:47:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 705cb9a7-f18a-55cf-9831-9b2991042239 with identifier: WS06409
2026-03-30 10:47:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 705cb9a7-f18a-55cf-9831-9b2991042239 with identifier: WS06409 to the API
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:47:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WS06409>
{'auction_title': '',
 'c_o_2_emission_value': 212,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:33:14Z',
 'fuel_type': 'petrol',
 'id': '705cb9a7-f18a-55cf-9831-9b2991042239',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS06409',
 'listing': 'auction',
 'location': 'DE, Oberding',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 69631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_0cec7a777b45b5ed3162edb42c0c3b23.jpg',
                'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_82b9e0e1878636d76fd875507207ceae.jpg',
                'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_6a7d61d74a7cc7cb37aeac67e3e53924.jpg',
                'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_624f9de9da6a03b215b93aab9e27f674.jpg',
                'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_19622dbba90568613a9698c8365ddc63.jpg',
                'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_25e86e71071f814f516dcd5c7f84d060.jpg',
                'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_2699aaaefc0b9e001d805c463c990167.jpg',
                'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_f3932a9eff92fa4c842aa0d2e73d45c4.jpg',
                'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_0d34462f0d2f014f7a20b2f61572db39.jpg',
                'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_1f5fa06e7a891fc1cbca3919080b33b6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705cb9a7-f18a-55cf-9831-9b2991042239/705cb9a7-f18a-55cf-9831-9b2991042239_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2776188,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_0cec7a777b45b5ed3162edb42c0c3b23.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705cb9a7-f18a-55cf-9831-9b2991042239/705cb9a7-f18a-55cf-9831-9b2991042239_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_82b9e0e1878636d76fd875507207ceae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705cb9a7-f18a-55cf-9831-9b2991042239/705cb9a7-f18a-55cf-9831-9b2991042239_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2842531,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_6a7d61d74a7cc7cb37aeac67e3e53924.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705cb9a7-f18a-55cf-9831-9b2991042239/705cb9a7-f18a-55cf-9831-9b2991042239_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2818051,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_624f9de9da6a03b215b93aab9e27f674.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705cb9a7-f18a-55cf-9831-9b2991042239/705cb9a7-f18a-55cf-9831-9b2991042239_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_19622dbba90568613a9698c8365ddc63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705cb9a7-f18a-55cf-9831-9b2991042239/705cb9a7-f18a-55cf-9831-9b2991042239_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_25e86e71071f814f516dcd5c7f84d060.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705cb9a7-f18a-55cf-9831-9b2991042239/705cb9a7-f18a-55cf-9831-9b2991042239_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2707357,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_2699aaaefc0b9e001d805c463c990167.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705cb9a7-f18a-55cf-9831-9b2991042239/705cb9a7-f18a-55cf-9831-9b2991042239_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2868055,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_f3932a9eff92fa4c842aa0d2e73d45c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705cb9a7-f18a-55cf-9831-9b2991042239/705cb9a7-f18a-55cf-9831-9b2991042239_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_0d34462f0d2f014f7a20b2f61572db39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705cb9a7-f18a-55cf-9831-9b2991042239/705cb9a7-f18a-55cf-9831-9b2991042239_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/e8/1ae80ae48799f7c7d9dcf8b894bd5ec6/pa/WS06409_1f5fa06e7a891fc1cbca3919080b33b6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI OFFROAD Start-Stopp 4Motion',
 'transmission': 'automatic',
 'trim': 'OFFROAD Start-Stopp 4Motion',
 'year': 2019}
2026-03-30 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS06409%27 HTTP/1.1" 200 None
2026-03-30 10:48:00 [auto1.de] INFO: Saving data for WS06409: {'created_time': 1774867680.04953, 'last_price_update_time': 1774867680.049542, 'auction_closing_time': 1774971194.0}
2026-03-30 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS06409') HTTP/1.1" 204 0
2026-03-30 10:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MU06450/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JK71664> (referer: https://www.auto1.com/v1/car-details-view/JK71664/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PJ15817/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f703d25f-8194-5aeb-87fb-334279236935 with identifier: JK71664
2026-03-30 10:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f703d25f-8194-5aeb-87fb-334279236935 with scrape type 1
2026-03-30 10:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f703d25f-8194-5aeb-87fb-334279236935
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fc8%252Fa4c8f1f149174f8cbb14cc617b7acaaa%252Fpa%252FJK71664_b7cfda75d00ac97229393465614766f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_b7cfda75d00ac97229393465614766f6.jpg already downloaded
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fc8%252Fa4c8f1f149174f8cbb14cc617b7acaaa%252Fpa%252FJK71664_4d5fd5483177d9f521b6e953a6a1485d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_4d5fd5483177d9f521b6e953a6a1485d.jpg already downloaded
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fc8%252Fa4c8f1f149174f8cbb14cc617b7acaaa%252Fpa%252FJK71664_43191f7f20906391ec40797d394f8a9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_43191f7f20906391ec40797d394f8a9d.jpg already downloaded
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fc8%252Fa4c8f1f149174f8cbb14cc617b7acaaa%252Fpa%252FJK71664_0fb440c8ada9acd845cde3d4a3f70203.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_0fb440c8ada9acd845cde3d4a3f70203.jpg already downloaded
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fc8%252Fa4c8f1f149174f8cbb14cc617b7acaaa%252Fpa%252FJK71664_61d7612f0a925753a41ac896c70177ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_61d7612f0a925753a41ac896c70177ae.jpg already downloaded
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fc8%252Fa4c8f1f149174f8cbb14cc617b7acaaa%252Fpa%252FJK71664_a5ef15190a2e92ab83da116cfe881f6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_a5ef15190a2e92ab83da116cfe881f6e.jpg already downloaded
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fc8%252Fa4c8f1f149174f8cbb14cc617b7acaaa%252Fpa%252FJK71664_d01c2b65cde7d697a0c9a676fbf2c059.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_d01c2b65cde7d697a0c9a676fbf2c059.jpg already downloaded
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fc8%252Fa4c8f1f149174f8cbb14cc617b7acaaa%252Fpa%252FJK71664_a7ab2c8104616067441b71720615a1d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_a7ab2c8104616067441b71720615a1d3.jpg already downloaded
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fc8%252Fa4c8f1f149174f8cbb14cc617b7acaaa%252Fpa%252FJK71664_f6ef56f9c41d8d7750932e74d734d069.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_f6ef56f9c41d8d7750932e74d734d069.jpg already downloaded
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fc8%252Fa4c8f1f149174f8cbb14cc617b7acaaa%252Fpa%252FJK71664_50a0ffc7bd8455ede8c7051b69af0d2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_50a0ffc7bd8455ede8c7051b69af0d2c.jpg already downloaded
2026-03-30 10:48:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f703d25f-8194-5aeb-87fb-334279236935, identifier: JK71664
2026-03-30 10:48:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f703d25f-8194-5aeb-87fb-334279236935 with identifier: JK71664
2026-03-30 10:48:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f703d25f-8194-5aeb-87fb-334279236935 with identifier: JK71664
2026-03-30 10:48:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f703d25f-8194-5aeb-87fb-334279236935 with identifier: JK71664 to the API
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JK71664>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:12:29Z',
 'fuel_type': 'diesel',
 'id': 'f703d25f-8194-5aeb-87fb-334279236935',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK71664',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 167787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_b7cfda75d00ac97229393465614766f6.jpg',
                'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_4d5fd5483177d9f521b6e953a6a1485d.jpg',
                'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_43191f7f20906391ec40797d394f8a9d.jpg',
                'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_0fb440c8ada9acd845cde3d4a3f70203.jpg',
                'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_61d7612f0a925753a41ac896c70177ae.jpg',
                'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_a5ef15190a2e92ab83da116cfe881f6e.jpg',
                'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_d01c2b65cde7d697a0c9a676fbf2c059.jpg',
                'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_a7ab2c8104616067441b71720615a1d3.jpg',
                'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_f6ef56f9c41d8d7750932e74d734d069.jpg',
                'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_50a0ffc7bd8455ede8c7051b69af0d2c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f703d25f-8194-5aeb-87fb-334279236935/f703d25f-8194-5aeb-87fb-334279236935_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_b7cfda75d00ac97229393465614766f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f703d25f-8194-5aeb-87fb-334279236935/f703d25f-8194-5aeb-87fb-334279236935_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3329192,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_4d5fd5483177d9f521b6e953a6a1485d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f703d25f-8194-5aeb-87fb-334279236935/f703d25f-8194-5aeb-87fb-334279236935_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3228921,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_43191f7f20906391ec40797d394f8a9d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f703d25f-8194-5aeb-87fb-334279236935/f703d25f-8194-5aeb-87fb-334279236935_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3321311,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_0fb440c8ada9acd845cde3d4a3f70203.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f703d25f-8194-5aeb-87fb-334279236935/f703d25f-8194-5aeb-87fb-334279236935_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_61d7612f0a925753a41ac896c70177ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f703d25f-8194-5aeb-87fb-334279236935/f703d25f-8194-5aeb-87fb-334279236935_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_a5ef15190a2e92ab83da116cfe881f6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f703d25f-8194-5aeb-87fb-334279236935/f703d25f-8194-5aeb-87fb-334279236935_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3162023,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_d01c2b65cde7d697a0c9a676fbf2c059.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f703d25f-8194-5aeb-87fb-334279236935/f703d25f-8194-5aeb-87fb-334279236935_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_a7ab2c8104616067441b71720615a1d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f703d25f-8194-5aeb-87fb-334279236935/f703d25f-8194-5aeb-87fb-334279236935_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3026222,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_f6ef56f9c41d8d7750932e74d734d069.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f703d25f-8194-5aeb-87fb-334279236935/f703d25f-8194-5aeb-87fb-334279236935_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/c8/a4c8f1f149174f8cbb14cc617b7acaaa/pa/JK71664_50a0ffc7bd8455ede8c7051b69af0d2c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2011}
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK71664%27 HTTP/1.1" 200 None
2026-03-30 10:48:01 [auto1.de] INFO: Saving data for JK71664: {'created_time': 1774867681.849823, 'last_price_update_time': 1774867681.849833, 'auction_closing_time': 1774969949.0}
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK71664') HTTP/1.1" 204 0
2026-03-30 10:48:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:03 [scrapy.extensions.logstats] INFO: Crawled 459 pages (at 34 pages/min), scraped 338 items (at 19 items/min)
2026-03-30 10:48:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-30 10:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MR77046> (referer: https://www.auto1.com/v1/car-details-view/MR77046/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 763c6024-32ea-5288-b411-1bc2df7d55f9 with identifier: MR77046
2026-03-30 10:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 763c6024-32ea-5288-b411-1bc2df7d55f9 with scrape type 1
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 763c6024-32ea-5288-b411-1bc2df7d55f9
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_3b1ef376557871f4c22380bc40cd9543.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_3b1ef376557871f4c22380bc40cd9543.jpg not downloaded yet
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_21665aef32ee4bc419b0fb1bb9e9dbcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_21665aef32ee4bc419b0fb1bb9e9dbcd.jpg not downloaded yet
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_7f95913c789bf9bd252a1f0bb2291c3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_7f95913c789bf9bd252a1f0bb2291c3a.jpg not downloaded yet
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_cd748c71d329f602c07eee7921ec466f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_cd748c71d329f602c07eee7921ec466f.jpg not downloaded yet
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_358a6e729f3e66688d30fd0f95b7b823.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_358a6e729f3e66688d30fd0f95b7b823.jpg not downloaded yet
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_0fa48a7bd9fd307aa3628c311ee6ef21.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_0fa48a7bd9fd307aa3628c311ee6ef21.jpg not downloaded yet
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_5965bd73128dbface02d6a9ce323b1cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_5965bd73128dbface02d6a9ce323b1cd.jpg not downloaded yet
2026-03-30 10:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_3b1ef376557871f4c22380bc40cd9543.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_99686bed7e9bef0b56161669d26dd1ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_99686bed7e9bef0b56161669d26dd1ba.jpg not downloaded yet
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_11fe6d6bd723399399d4565b8c5aa95c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_11fe6d6bd723399399d4565b8c5aa95c.jpg not downloaded yet
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_68063b72e959bc5be5a33145218a8053.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_68063b72e959bc5be5a33145218a8053.jpg not downloaded yet
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef502b590>
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_3b1ef376557871f4c22380bc40cd9543.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_3b1ef376557871f4c22380bc40cd9543.jpg saved to cache
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 763c6024-32ea-5288-b411-1bc2df7d55f9
2026-03-30 10:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_7f95913c789bf9bd252a1f0bb2291c3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_21665aef32ee4bc419b0fb1bb9e9dbcd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_99686bed7e9bef0b56161669d26dd1ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_11fe6d6bd723399399d4565b8c5aa95c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_0fa48a7bd9fd307aa3628c311ee6ef21.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a74f10>
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_7f95913c789bf9bd252a1f0bb2291c3a.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_7f95913c789bf9bd252a1f0bb2291c3a.jpg saved to cache
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 763c6024-32ea-5288-b411-1bc2df7d55f9
2026-03-30 10:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_358a6e729f3e66688d30fd0f95b7b823.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_68063b72e959bc5be5a33145218a8053.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a23890>
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_21665aef32ee4bc419b0fb1bb9e9dbcd.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_21665aef32ee4bc419b0fb1bb9e9dbcd.jpg saved to cache
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 763c6024-32ea-5288-b411-1bc2df7d55f9
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe3e50>
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_99686bed7e9bef0b56161669d26dd1ba.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_99686bed7e9bef0b56161669d26dd1ba.jpg saved to cache
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 763c6024-32ea-5288-b411-1bc2df7d55f9
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e68cd0>
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_11fe6d6bd723399399d4565b8c5aa95c.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_11fe6d6bd723399399d4565b8c5aa95c.jpg saved to cache
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 763c6024-32ea-5288-b411-1bc2df7d55f9
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e69950>
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_0fa48a7bd9fd307aa3628c311ee6ef21.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_0fa48a7bd9fd307aa3628c311ee6ef21.jpg saved to cache
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 763c6024-32ea-5288-b411-1bc2df7d55f9
2026-03-30 10:48:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fed010>
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_358a6e729f3e66688d30fd0f95b7b823.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_358a6e729f3e66688d30fd0f95b7b823.jpg saved to cache
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 763c6024-32ea-5288-b411-1bc2df7d55f9
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e22e10>
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_68063b72e959bc5be5a33145218a8053.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_68063b72e959bc5be5a33145218a8053.jpg saved to cache
2026-03-30 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 763c6024-32ea-5288-b411-1bc2df7d55f9
2026-03-30 10:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_cd748c71d329f602c07eee7921ec466f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_5965bd73128dbface02d6a9ce323b1cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5997550>
2026-03-30 10:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_cd748c71d329f602c07eee7921ec466f.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_cd748c71d329f602c07eee7921ec466f.jpg saved to cache
2026-03-30 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 763c6024-32ea-5288-b411-1bc2df7d55f9
2026-03-30 10:48:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee4650>
2026-03-30 10:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F50%252Fb6507423d6754f8b8bf96369cf462c6c%252Fpa%252FMR77046_5965bd73128dbface02d6a9ce323b1cd.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_5965bd73128dbface02d6a9ce323b1cd.jpg saved to cache
2026-03-30 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 763c6024-32ea-5288-b411-1bc2df7d55f9
2026-03-30 10:48:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 763c6024-32ea-5288-b411-1bc2df7d55f9, skipping ID generation
2026-03-30 10:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 763c6024-32ea-5288-b411-1bc2df7d55f9 with scrape type 1
2026-03-30 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 763c6024-32ea-5288-b411-1bc2df7d55f9 sending to next pipeline
2026-03-30 10:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 763c6024-32ea-5288-b411-1bc2df7d55f9, identifier: MR77046
2026-03-30 10:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 763c6024-32ea-5288-b411-1bc2df7d55f9 with identifier: MR77046
2026-03-30 10:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 763c6024-32ea-5288-b411-1bc2df7d55f9 with identifier: MR77046
2026-03-30 10:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 763c6024-32ea-5288-b411-1bc2df7d55f9 with identifier: MR77046 to the API
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_5965bd73128dbface02d6a9ce323b1cd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:01:01Z',
 'fuel_type': 'diesel',
 'id': '763c6024-32ea-5288-b411-1bc2df7d55f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR77046',
 'listing': 'auction',
 'location': 'DE, Tradein',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 133785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_3b1ef376557871f4c22380bc40cd9543.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2583757,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_21665aef32ee4bc419b0fb1bb9e9dbcd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_7f95913c789bf9bd252a1f0bb2291c3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2633661,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_cd748c71d329f602c07eee7921ec466f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2561442,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_358a6e729f3e66688d30fd0f95b7b823.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_0fa48a7bd9fd307aa3628c311ee6ef21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2895347,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_5965bd73128dbface02d6a9ce323b1cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_99686bed7e9bef0b56161669d26dd1ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_11fe6d6bd723399399d4565b8c5aa95c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_763c6024-32ea-5288-b411-1bc2df7d55f9/763c6024-32ea-5288-b411-1bc2df7d55f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/50/b6507423d6754f8b8bf96369cf462c6c/pa/MR77046_68063b72e959bc5be5a33145218a8053.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR77046%27 HTTP/1.1" 200 None
2026-03-30 10:48:18 [auto1.de] INFO: Saving data for MR77046: {'created_time': 1774867698.812638, 'last_price_update_time': 1774867698.812652, 'auction_closing_time': 1774969261.0}
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR77046') HTTP/1.1" 204 0
2026-03-30 10:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PJ15817> (referer: https://www.auto1.com/v1/car-details-view/PJ15817/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dd68a4a-b81d-590c-9730-f88aaa32ecc4 with identifier: PJ15817
2026-03-30 10:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dd68a4a-b81d-590c-9730-f88aaa32ecc4 with scrape type 1
2026-03-30 10:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6dd68a4a-b81d-590c-9730-f88aaa32ecc4
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_bd34db2e1b4133982b8b742ac13b00b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_bd34db2e1b4133982b8b742ac13b00b7.jpg not downloaded yet
2026-03-30 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_5b490f442ba9deb3c15848ba4a5b4522.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_5b490f442ba9deb3c15848ba4a5b4522.jpg not downloaded yet
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_f687299ecaca0997e6bb2f96828da6fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_f687299ecaca0997e6bb2f96828da6fd.jpg not downloaded yet
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_421e861e70f7c66d6e6509af21082370.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_421e861e70f7c66d6e6509af21082370.jpg not downloaded yet
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_1995be578ee8d5945e5c2f01bfd443be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_1995be578ee8d5945e5c2f01bfd443be.jpg not downloaded yet
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_6c0bc6d94c7084984f9ac4a7b861b42b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_6c0bc6d94c7084984f9ac4a7b861b42b.jpg not downloaded yet
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_cb87a03a3cde76d50ae4fb90432cd016.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_cb87a03a3cde76d50ae4fb90432cd016.jpg not downloaded yet
2026-03-30 10:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_bd34db2e1b4133982b8b742ac13b00b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_56866c4408bc24dac99e720423816e6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_56866c4408bc24dac99e720423816e6b.jpg not downloaded yet
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_6446ef1612275f1e29b467644f5ad791.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_6446ef1612275f1e29b467644f5ad791.jpg not downloaded yet
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_ab5c1e286b363502268514a3930e95a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_ab5c1e286b363502268514a3930e95a8.jpg not downloaded yet
2026-03-30 10:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_1995be578ee8d5945e5c2f01bfd443be.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_6446ef1612275f1e29b467644f5ad791.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_56866c4408bc24dac99e720423816e6b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_cb87a03a3cde76d50ae4fb90432cd016.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef79fa010>
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_bd34db2e1b4133982b8b742ac13b00b7.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_bd34db2e1b4133982b8b742ac13b00b7.jpg saved to cache
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6dd68a4a-b81d-590c-9730-f88aaa32ecc4
2026-03-30 10:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_ab5c1e286b363502268514a3930e95a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_f687299ecaca0997e6bb2f96828da6fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_5b490f442ba9deb3c15848ba4a5b4522.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_6c0bc6d94c7084984f9ac4a7b861b42b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef79f9e50>
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_1995be578ee8d5945e5c2f01bfd443be.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_1995be578ee8d5945e5c2f01bfd443be.jpg saved to cache
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6dd68a4a-b81d-590c-9730-f88aaa32ecc4
2026-03-30 10:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_421e861e70f7c66d6e6509af21082370.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ec2610>
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_6446ef1612275f1e29b467644f5ad791.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_6446ef1612275f1e29b467644f5ad791.jpg saved to cache
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6dd68a4a-b81d-590c-9730-f88aaa32ecc4
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5092490>
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_56866c4408bc24dac99e720423816e6b.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_56866c4408bc24dac99e720423816e6b.jpg saved to cache
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6dd68a4a-b81d-590c-9730-f88aaa32ecc4
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef502b110>
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_cb87a03a3cde76d50ae4fb90432cd016.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_cb87a03a3cde76d50ae4fb90432cd016.jpg saved to cache
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6dd68a4a-b81d-590c-9730-f88aaa32ecc4
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b03650>
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_ab5c1e286b363502268514a3930e95a8.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_ab5c1e286b363502268514a3930e95a8.jpg saved to cache
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6dd68a4a-b81d-590c-9730-f88aaa32ecc4
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f15c90>
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_f687299ecaca0997e6bb2f96828da6fd.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_f687299ecaca0997e6bb2f96828da6fd.jpg saved to cache
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6dd68a4a-b81d-590c-9730-f88aaa32ecc4
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef500ab50>
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_5b490f442ba9deb3c15848ba4a5b4522.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_5b490f442ba9deb3c15848ba4a5b4522.jpg saved to cache
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6dd68a4a-b81d-590c-9730-f88aaa32ecc4
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50099d0>
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_6c0bc6d94c7084984f9ac4a7b861b42b.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_6c0bc6d94c7084984f9ac4a7b861b42b.jpg saved to cache
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6dd68a4a-b81d-590c-9730-f88aaa32ecc4
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7885e10>
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F87%252F4e87d79c23f75a0195a4a95248f9e9cc%252Fpa%252FPJ15817_421e861e70f7c66d6e6509af21082370.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_421e861e70f7c66d6e6509af21082370.jpg saved to cache
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6dd68a4a-b81d-590c-9730-f88aaa32ecc4
2026-03-30 10:48:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6dd68a4a-b81d-590c-9730-f88aaa32ecc4, skipping ID generation
2026-03-30 10:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dd68a4a-b81d-590c-9730-f88aaa32ecc4 with scrape type 1
2026-03-30 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6dd68a4a-b81d-590c-9730-f88aaa32ecc4 sending to next pipeline
2026-03-30 10:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6dd68a4a-b81d-590c-9730-f88aaa32ecc4, identifier: PJ15817
2026-03-30 10:48:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6dd68a4a-b81d-590c-9730-f88aaa32ecc4 with identifier: PJ15817
2026-03-30 10:48:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6dd68a4a-b81d-590c-9730-f88aaa32ecc4 with identifier: PJ15817
2026-03-30 10:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6dd68a4a-b81d-590c-9730-f88aaa32ecc4 with identifier: PJ15817 to the API
2026-03-30 10:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_421e861e70f7c66d6e6509af21082370.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:38:44Z',
 'fuel_type': 'petrol',
 'id': '6dd68a4a-b81d-590c-9730-f88aaa32ecc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ15817',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 115849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_bd34db2e1b4133982b8b742ac13b00b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_5b490f442ba9deb3c15848ba4a5b4522.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_f687299ecaca0997e6bb2f96828da6fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_421e861e70f7c66d6e6509af21082370.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_1995be578ee8d5945e5c2f01bfd443be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_6c0bc6d94c7084984f9ac4a7b861b42b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_cb87a03a3cde76d50ae4fb90432cd016.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_56866c4408bc24dac99e720423816e6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_6446ef1612275f1e29b467644f5ad791.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6dd68a4a-b81d-590c-9730-f88aaa32ecc4/6dd68a4a-b81d-590c-9730-f88aaa32ecc4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/87/4e87d79c23f75a0195a4a95248f9e9cc/pa/PJ15817_ab5c1e286b363502268514a3930e95a8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-01',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.4 Edition 7",
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2017}
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ15817%27 HTTP/1.1" 200 None
2026-03-30 10:48:21 [auto1.de] INFO: Saving data for PJ15817: {'created_time': 1774867701.213291, 'last_price_update_time': 1774867701.2133, 'auction_closing_time': 1774971524.0}
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ15817') HTTP/1.1" 204 0
2026-03-30 10:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV38607> (referer: https://www.auto1.com/v1/car-details-view/CV38607/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c71d83ce-60fa-5686-b1e4-a86b9e41e85b with identifier: CV38607
2026-03-30 10:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c71d83ce-60fa-5686-b1e4-a86b9e41e85b with scrape type 1
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c71d83ce-60fa-5686-b1e4-a86b9e41e85b
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2b%252F0f2b56e4439eef4e6243aaa265908cd3%252Fpa%252FCV38607_522d46e1ecf789a544c62b7b7b40d249.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_522d46e1ecf789a544c62b7b7b40d249.jpg not downloaded yet
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2b%252F0f2b56e4439eef4e6243aaa265908cd3%252Fpa%252FCV38607_3cd5c63ad4c59b7e0f10913f380e22bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_3cd5c63ad4c59b7e0f10913f380e22bc.jpg not downloaded yet
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2b%252F0f2b56e4439eef4e6243aaa265908cd3%252Fpa%252FCV38607_f078de780e2f683b308a61654191a4d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_f078de780e2f683b308a61654191a4d5.jpg not downloaded yet
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2b%252F0f2b56e4439eef4e6243aaa265908cd3%252Fpa%252FCV38607_067920f37eaaba6d5df4af1dd0ea516b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_067920f37eaaba6d5df4af1dd0ea516b.jpg not downloaded yet
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2b%252F0f2b56e4439eef4e6243aaa265908cd3%252Fpa%252FCV38607_bd82c5b8ad161fff6a8a23ac9404e5eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_bd82c5b8ad161fff6a8a23ac9404e5eb.jpg not downloaded yet
2026-03-30 10:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_522d46e1ecf789a544c62b7b7b40d249.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_3cd5c63ad4c59b7e0f10913f380e22bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_f078de780e2f683b308a61654191a4d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_067920f37eaaba6d5df4af1dd0ea516b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_bd82c5b8ad161fff6a8a23ac9404e5eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c6990>
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c71d83ce-60fa-5686-b1e4-a86b9e41e85b/c71d83ce-60fa-5686-b1e4-a86b9e41e85b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2b%252F0f2b56e4439eef4e6243aaa265908cd3%252Fpa%252FCV38607_522d46e1ecf789a544c62b7b7b40d249.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_522d46e1ecf789a544c62b7b7b40d249.jpg saved to cache
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c71d83ce-60fa-5686-b1e4-a86b9e41e85b
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee0a50>
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c71d83ce-60fa-5686-b1e4-a86b9e41e85b/c71d83ce-60fa-5686-b1e4-a86b9e41e85b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2b%252F0f2b56e4439eef4e6243aaa265908cd3%252Fpa%252FCV38607_3cd5c63ad4c59b7e0f10913f380e22bc.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_3cd5c63ad4c59b7e0f10913f380e22bc.jpg saved to cache
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c71d83ce-60fa-5686-b1e4-a86b9e41e85b
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee5050>
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c71d83ce-60fa-5686-b1e4-a86b9e41e85b/c71d83ce-60fa-5686-b1e4-a86b9e41e85b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2b%252F0f2b56e4439eef4e6243aaa265908cd3%252Fpa%252FCV38607_f078de780e2f683b308a61654191a4d5.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_f078de780e2f683b308a61654191a4d5.jpg saved to cache
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c71d83ce-60fa-5686-b1e4-a86b9e41e85b
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd3050>
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c71d83ce-60fa-5686-b1e4-a86b9e41e85b/c71d83ce-60fa-5686-b1e4-a86b9e41e85b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2b%252F0f2b56e4439eef4e6243aaa265908cd3%252Fpa%252FCV38607_067920f37eaaba6d5df4af1dd0ea516b.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_067920f37eaaba6d5df4af1dd0ea516b.jpg saved to cache
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c71d83ce-60fa-5686-b1e4-a86b9e41e85b
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c4d750>
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c71d83ce-60fa-5686-b1e4-a86b9e41e85b/c71d83ce-60fa-5686-b1e4-a86b9e41e85b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2b%252F0f2b56e4439eef4e6243aaa265908cd3%252Fpa%252FCV38607_bd82c5b8ad161fff6a8a23ac9404e5eb.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_bd82c5b8ad161fff6a8a23ac9404e5eb.jpg saved to cache
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c71d83ce-60fa-5686-b1e4-a86b9e41e85b
2026-03-30 10:48:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c71d83ce-60fa-5686-b1e4-a86b9e41e85b, skipping ID generation
2026-03-30 10:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c71d83ce-60fa-5686-b1e4-a86b9e41e85b with scrape type 1
2026-03-30 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c71d83ce-60fa-5686-b1e4-a86b9e41e85b sending to next pipeline
2026-03-30 10:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c71d83ce-60fa-5686-b1e4-a86b9e41e85b, identifier: CV38607
2026-03-30 10:48:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c71d83ce-60fa-5686-b1e4-a86b9e41e85b with identifier: CV38607
2026-03-30 10:48:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c71d83ce-60fa-5686-b1e4-a86b9e41e85b with identifier: CV38607
2026-03-30 10:48:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c71d83ce-60fa-5686-b1e4-a86b9e41e85b with identifier: CV38607 to the API
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_bd82c5b8ad161fff6a8a23ac9404e5eb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:09:27Z',
 'fuel_type': 'diesel',
 'id': 'c71d83ce-60fa-5686-b1e4-a86b9e41e85b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV38607',
 'listing': 'auction',
 'location': 'DE, Kaiserslautern',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 157837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c71d83ce-60fa-5686-b1e4-a86b9e41e85b/c71d83ce-60fa-5686-b1e4-a86b9e41e85b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_522d46e1ecf789a544c62b7b7b40d249.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c71d83ce-60fa-5686-b1e4-a86b9e41e85b/c71d83ce-60fa-5686-b1e4-a86b9e41e85b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_3cd5c63ad4c59b7e0f10913f380e22bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c71d83ce-60fa-5686-b1e4-a86b9e41e85b/c71d83ce-60fa-5686-b1e4-a86b9e41e85b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_f078de780e2f683b308a61654191a4d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c71d83ce-60fa-5686-b1e4-a86b9e41e85b/c71d83ce-60fa-5686-b1e4-a86b9e41e85b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_067920f37eaaba6d5df4af1dd0ea516b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c71d83ce-60fa-5686-b1e4-a86b9e41e85b/c71d83ce-60fa-5686-b1e4-a86b9e41e85b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/2b/0f2b56e4439eef4e6243aaa265908cd3/pa/CV38607_bd82c5b8ad161fff6a8a23ac9404e5eb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV38607%27 HTTP/1.1" 200 None
2026-03-30 10:48:22 [auto1.de] INFO: Saving data for CV38607: {'created_time': 1774867702.521316, 'last_price_update_time': 1774867702.521326, 'auction_closing_time': 1774969767.0}
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV38607') HTTP/1.1" 204 0
2026-03-30 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV57732> (referer: https://www.auto1.com/v1/car-details-view/DV57732/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cb681f5-2b3f-520b-a2ce-dfc52912d20a with identifier: DV57732
2026-03-30 10:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cb681f5-2b3f-520b-a2ce-dfc52912d20a with scrape type 1
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4cb681f5-2b3f-520b-a2ce-dfc52912d20a
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_52297407e8e96d5f66d22209de3027c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_52297407e8e96d5f66d22209de3027c2.jpg not downloaded yet
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_7ea9e30bd80423f4a3622b3da2891d83.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_7ea9e30bd80423f4a3622b3da2891d83.jpg not downloaded yet
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_9e7c5bf71611d1be64037ef9659581f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_9e7c5bf71611d1be64037ef9659581f3.jpg not downloaded yet
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_362ea4db6bdb18513fdb89760103d07f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_362ea4db6bdb18513fdb89760103d07f.jpg not downloaded yet
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_20824a8a57294e21fbdf8999d31ae58e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_20824a8a57294e21fbdf8999d31ae58e.jpg not downloaded yet
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_396f3160265c5613a73b9455aaa1026f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_396f3160265c5613a73b9455aaa1026f.jpg not downloaded yet
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_a1ff43518d4d9a8e6894ecd59e6bd8ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_a1ff43518d4d9a8e6894ecd59e6bd8ff.jpg not downloaded yet
2026-03-30 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_52297407e8e96d5f66d22209de3027c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_385bebbab2fdee19671ab3176745b1ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_385bebbab2fdee19671ab3176745b1ba.jpg not downloaded yet
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_ed5d646bacfe8284d441e328c54bc214.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_ed5d646bacfe8284d441e328c54bc214.jpg not downloaded yet
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_a05791ae970da1ed4281fff2e7c1975b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_a05791ae970da1ed4281fff2e7c1975b.jpg not downloaded yet
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595c690>
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_52297407e8e96d5f66d22209de3027c2.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_52297407e8e96d5f66d22209de3027c2.jpg saved to cache
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cb681f5-2b3f-520b-a2ce-dfc52912d20a
2026-03-30 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_7ea9e30bd80423f4a3622b3da2891d83.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_362ea4db6bdb18513fdb89760103d07f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_385bebbab2fdee19671ab3176745b1ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_9e7c5bf71611d1be64037ef9659581f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e69cd0>
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_7ea9e30bd80423f4a3622b3da2891d83.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_7ea9e30bd80423f4a3622b3da2891d83.jpg saved to cache
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cb681f5-2b3f-520b-a2ce-dfc52912d20a
2026-03-30 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_ed5d646bacfe8284d441e328c54bc214.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_a05791ae970da1ed4281fff2e7c1975b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e75310>
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_362ea4db6bdb18513fdb89760103d07f.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_362ea4db6bdb18513fdb89760103d07f.jpg saved to cache
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cb681f5-2b3f-520b-a2ce-dfc52912d20a
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c43710>
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_385bebbab2fdee19671ab3176745b1ba.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_385bebbab2fdee19671ab3176745b1ba.jpg saved to cache
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4cb681f5-2b3f-520b-a2ce-dfc52912d20a
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e65c90>
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_9e7c5bf71611d1be64037ef9659581f3.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_9e7c5bf71611d1be64037ef9659581f3.jpg saved to cache
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cb681f5-2b3f-520b-a2ce-dfc52912d20a
2026-03-30 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_396f3160265c5613a73b9455aaa1026f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7dffad0>
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_ed5d646bacfe8284d441e328c54bc214.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_ed5d646bacfe8284d441e328c54bc214.jpg saved to cache
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4cb681f5-2b3f-520b-a2ce-dfc52912d20a
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a36dd0>
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_a05791ae970da1ed4281fff2e7c1975b.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_a05791ae970da1ed4281fff2e7c1975b.jpg saved to cache
2026-03-30 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4cb681f5-2b3f-520b-a2ce-dfc52912d20a
2026-03-30 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_a1ff43518d4d9a8e6894ecd59e6bd8ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_20824a8a57294e21fbdf8999d31ae58e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f2b50>
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_396f3160265c5613a73b9455aaa1026f.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_396f3160265c5613a73b9455aaa1026f.jpg saved to cache
2026-03-30 10:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4cb681f5-2b3f-520b-a2ce-dfc52912d20a
2026-03-30 10:48:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e77250>
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_a1ff43518d4d9a8e6894ecd59e6bd8ff.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_a1ff43518d4d9a8e6894ecd59e6bd8ff.jpg saved to cache
2026-03-30 10:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4cb681f5-2b3f-520b-a2ce-dfc52912d20a
2026-03-30 10:48:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b18d0>
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fa4%252Ff9a4b8de4d8b793ac0bbca2fc720330f%252Fpa%252FDV57732_20824a8a57294e21fbdf8999d31ae58e.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_20824a8a57294e21fbdf8999d31ae58e.jpg saved to cache
2026-03-30 10:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cb681f5-2b3f-520b-a2ce-dfc52912d20a
2026-03-30 10:48:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cb681f5-2b3f-520b-a2ce-dfc52912d20a, skipping ID generation
2026-03-30 10:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cb681f5-2b3f-520b-a2ce-dfc52912d20a with scrape type 1
2026-03-30 10:48:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cb681f5-2b3f-520b-a2ce-dfc52912d20a sending to next pipeline
2026-03-30 10:48:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cb681f5-2b3f-520b-a2ce-dfc52912d20a, identifier: DV57732
2026-03-30 10:48:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cb681f5-2b3f-520b-a2ce-dfc52912d20a with identifier: DV57732
2026-03-30 10:48:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cb681f5-2b3f-520b-a2ce-dfc52912d20a with identifier: DV57732
2026-03-30 10:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cb681f5-2b3f-520b-a2ce-dfc52912d20a with identifier: DV57732 to the API
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_20824a8a57294e21fbdf8999d31ae58e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:07:18Z',
 'fuel_type': 'petrol',
 'id': '4cb681f5-2b3f-520b-a2ce-dfc52912d20a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV57732',
 'listing': 'auction',
 'location': 'DE, Schwäbisch Gmünd',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 72269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_52297407e8e96d5f66d22209de3027c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_7ea9e30bd80423f4a3622b3da2891d83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_9e7c5bf71611d1be64037ef9659581f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3069823,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_362ea4db6bdb18513fdb89760103d07f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3008476,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_20824a8a57294e21fbdf8999d31ae58e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2920848,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_396f3160265c5613a73b9455aaa1026f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2759142,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_a1ff43518d4d9a8e6894ecd59e6bd8ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_385bebbab2fdee19671ab3176745b1ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_ed5d646bacfe8284d441e328c54bc214.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb681f5-2b3f-520b-a2ce-dfc52912d20a/4cb681f5-2b3f-520b-a2ce-dfc52912d20a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/a4/f9a4b8de4d8b793ac0bbca2fc720330f/pa/DV57732_a05791ae970da1ed4281fff2e7c1975b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Roadster',
 'transmission': 'manual',
 'trim': 'Roadster',
 'year': 2016}
2026-03-30 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV57732%27 HTTP/1.1" 200 None
2026-03-30 10:48:29 [auto1.de] INFO: Saving data for DV57732: {'created_time': 1774867709.042595, 'last_price_update_time': 1774867709.04261, 'auction_closing_time': 1774969638.0}
2026-03-30 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV57732') HTTP/1.1" 204 0
2026-03-30 10:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MU06450> (referer: https://www.auto1.com/v1/car-details-view/MU06450/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e2922d5-4b6a-5073-ae19-21d30b8247cc with identifier: MU06450
2026-03-30 10:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e2922d5-4b6a-5073-ae19-21d30b8247cc with scrape type 1
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e2922d5-4b6a-5073-ae19-21d30b8247cc
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_f4a42e082922ecbbd5b2b3867b62d6fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_f4a42e082922ecbbd5b2b3867b62d6fd.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_da80cecdfad57c733c7e085d1299fe6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_da80cecdfad57c733c7e085d1299fe6b.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_dd679ed516eb94ea2211e035d962f3f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_dd679ed516eb94ea2211e035d962f3f9.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_b317d1d16a1c2b4e4336057b2cb891c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_b317d1d16a1c2b4e4336057b2cb891c1.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_9ce57904cd064e6a1bf888d6acfb028f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_9ce57904cd064e6a1bf888d6acfb028f.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_171ef5b49fabe4df198aee6fcd71aa42.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_171ef5b49fabe4df198aee6fcd71aa42.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_b54421a8feadde060f39820346c1947c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_b54421a8feadde060f39820346c1947c.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_916b0c7ffa6e20a2a7d143e9b2764967.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_916b0c7ffa6e20a2a7d143e9b2764967.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_01ee6d4f9ace8d68377368ba27806a2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_01ee6d4f9ace8d68377368ba27806a2f.jpg not downloaded yet
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_b5f911c304f3cf866f957a7f68c3b634.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_b5f911c304f3cf866f957a7f68c3b634.jpg not downloaded yet
2026-03-30 10:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_da80cecdfad57c733c7e085d1299fe6b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_b317d1d16a1c2b4e4336057b2cb891c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_f4a42e082922ecbbd5b2b3867b62d6fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_dd679ed516eb94ea2211e035d962f3f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_9ce57904cd064e6a1bf888d6acfb028f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50759d0>
2026-03-30 10:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_da80cecdfad57c733c7e085d1299fe6b.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_da80cecdfad57c733c7e085d1299fe6b.jpg saved to cache
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e2922d5-4b6a-5073-ae19-21d30b8247cc
2026-03-30 10:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_b5f911c304f3cf866f957a7f68c3b634.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6de90>
2026-03-30 10:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_b317d1d16a1c2b4e4336057b2cb891c1.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_b317d1d16a1c2b4e4336057b2cb891c1.jpg saved to cache
2026-03-30 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e2922d5-4b6a-5073-ae19-21d30b8247cc
2026-03-30 10:48:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f2450>
2026-03-30 10:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_f4a42e082922ecbbd5b2b3867b62d6fd.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_f4a42e082922ecbbd5b2b3867b62d6fd.jpg saved to cache
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e2922d5-4b6a-5073-ae19-21d30b8247cc
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da3e10>
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_dd679ed516eb94ea2211e035d962f3f9.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_dd679ed516eb94ea2211e035d962f3f9.jpg saved to cache
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e2922d5-4b6a-5073-ae19-21d30b8247cc
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eb53d0>
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_9ce57904cd064e6a1bf888d6acfb028f.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_9ce57904cd064e6a1bf888d6acfb028f.jpg saved to cache
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e2922d5-4b6a-5073-ae19-21d30b8247cc
2026-03-30 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_01ee6d4f9ace8d68377368ba27806a2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_171ef5b49fabe4df198aee6fcd71aa42.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dfa7d0>
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_b5f911c304f3cf866f957a7f68c3b634.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_b5f911c304f3cf866f957a7f68c3b634.jpg saved to cache
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e2922d5-4b6a-5073-ae19-21d30b8247cc
2026-03-30 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_b54421a8feadde060f39820346c1947c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_916b0c7ffa6e20a2a7d143e9b2764967.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef51057d0>
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_01ee6d4f9ace8d68377368ba27806a2f.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_01ee6d4f9ace8d68377368ba27806a2f.jpg saved to cache
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e2922d5-4b6a-5073-ae19-21d30b8247cc
2026-03-30 10:48:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee28d0>
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_171ef5b49fabe4df198aee6fcd71aa42.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_171ef5b49fabe4df198aee6fcd71aa42.jpg saved to cache
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e2922d5-4b6a-5073-ae19-21d30b8247cc
2026-03-30 10:48:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e69450>
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_b54421a8feadde060f39820346c1947c.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_b54421a8feadde060f39820346c1947c.jpg saved to cache
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e2922d5-4b6a-5073-ae19-21d30b8247cc
2026-03-30 10:48:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b324d0>
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F24%252F2024823dc22fe4852f860b0807668bf3%252Fpa%252FMU06450_916b0c7ffa6e20a2a7d143e9b2764967.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_916b0c7ffa6e20a2a7d143e9b2764967.jpg saved to cache
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e2922d5-4b6a-5073-ae19-21d30b8247cc
2026-03-30 10:48:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e2922d5-4b6a-5073-ae19-21d30b8247cc, skipping ID generation
2026-03-30 10:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e2922d5-4b6a-5073-ae19-21d30b8247cc with scrape type 1
2026-03-30 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e2922d5-4b6a-5073-ae19-21d30b8247cc sending to next pipeline
2026-03-30 10:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e2922d5-4b6a-5073-ae19-21d30b8247cc, identifier: MU06450
2026-03-30 10:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e2922d5-4b6a-5073-ae19-21d30b8247cc with identifier: MU06450
2026-03-30 10:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e2922d5-4b6a-5073-ae19-21d30b8247cc with identifier: MU06450
2026-03-30 10:48:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e2922d5-4b6a-5073-ae19-21d30b8247cc with identifier: MU06450 to the API
2026-03-30 10:48:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_916b0c7ffa6e20a2a7d143e9b2764967.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 84,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 455,
 'expiration_date': '2026-03-31T15:42:23Z',
 'fuel_type': 'hybrid',
 'id': '0e2922d5-4b6a-5073-ae19-21d30b8247cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU06450',
 'listing': 'auction',
 'location': 'DE, Regensburg',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 142446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2544161,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_f4a42e082922ecbbd5b2b3867b62d6fd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_da80cecdfad57c733c7e085d1299fe6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_dd679ed516eb94ea2211e035d962f3f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_b317d1d16a1c2b4e4336057b2cb891c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_9ce57904cd064e6a1bf888d6acfb028f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2554365,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_171ef5b49fabe4df198aee6fcd71aa42.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2309550,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_b54421a8feadde060f39820346c1947c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2626299,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_916b0c7ffa6e20a2a7d143e9b2764967.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_01ee6d4f9ace8d68377368ba27806a2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e2922d5-4b6a-5073-ae19-21d30b8247cc/0e2922d5-4b6a-5073-ae19-21d30b8247cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/24/2024823dc22fe4852f860b0807668bf3/pa/MU06450_b5f911c304f3cf866f957a7f68c3b634.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q7 60 TFSIe quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2020}
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06450%27 HTTP/1.1" 200 None
2026-03-30 10:48:37 [auto1.de] INFO: Saving data for MU06450: {'created_time': 1774867717.177258, 'last_price_update_time': 1774867717.177269, 'auction_closing_time': 1774971743.0}
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU06450') HTTP/1.1" 204 0
2026-03-30 10:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US50096> (referer: https://www.auto1.com/v1/car-details-view/US50096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47611764-5a82-56f0-84d2-896068ecc59b with identifier: US50096
2026-03-30 10:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47611764-5a82-56f0-84d2-896068ecc59b with scrape type 1
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 47611764-5a82-56f0-84d2-896068ecc59b
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fcc%252F62cc8b0fb44ea75a667f63ecd47596f1%252Fpa%252FUS50096_87f0178dd75438ba31e73ab918056bff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_87f0178dd75438ba31e73ab918056bff.jpg not downloaded yet
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fcc%252F62cc8b0fb44ea75a667f63ecd47596f1%252Fpa%252FUS50096_66fd4f420c841060dfdd4db5684ea43e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_66fd4f420c841060dfdd4db5684ea43e.jpg not downloaded yet
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fcc%252F62cc8b0fb44ea75a667f63ecd47596f1%252Fpa%252FUS50096_f2e63d07bd2323117dd422722200eabe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_f2e63d07bd2323117dd422722200eabe.jpg not downloaded yet
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fcc%252F62cc8b0fb44ea75a667f63ecd47596f1%252Fpa%252FUS50096_906af4717d4621d9762dd60815fc2d16.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_906af4717d4621d9762dd60815fc2d16.jpg not downloaded yet
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fcc%252F62cc8b0fb44ea75a667f63ecd47596f1%252Fpa%252FUS50096_597f3dc4f9eb17139d47d70a81825e4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_597f3dc4f9eb17139d47d70a81825e4d.jpg not downloaded yet
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fcc%252F62cc8b0fb44ea75a667f63ecd47596f1%252Fpa%252FUS50096_9a3c02dbcba9e4eaae9da1fb81dbba94.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_9a3c02dbcba9e4eaae9da1fb81dbba94.jpg not downloaded yet
2026-03-30 10:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_66fd4f420c841060dfdd4db5684ea43e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_87f0178dd75438ba31e73ab918056bff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_906af4717d4621d9762dd60815fc2d16.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_f2e63d07bd2323117dd422722200eabe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_597f3dc4f9eb17139d47d70a81825e4d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_9a3c02dbcba9e4eaae9da1fb81dbba94.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eb6190>
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47611764-5a82-56f0-84d2-896068ecc59b/47611764-5a82-56f0-84d2-896068ecc59b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fcc%252F62cc8b0fb44ea75a667f63ecd47596f1%252Fpa%252FUS50096_66fd4f420c841060dfdd4db5684ea43e.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_66fd4f420c841060dfdd4db5684ea43e.jpg saved to cache
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47611764-5a82-56f0-84d2-896068ecc59b
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e68650>
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47611764-5a82-56f0-84d2-896068ecc59b/47611764-5a82-56f0-84d2-896068ecc59b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fcc%252F62cc8b0fb44ea75a667f63ecd47596f1%252Fpa%252FUS50096_87f0178dd75438ba31e73ab918056bff.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_87f0178dd75438ba31e73ab918056bff.jpg saved to cache
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47611764-5a82-56f0-84d2-896068ecc59b
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5028490>
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47611764-5a82-56f0-84d2-896068ecc59b/47611764-5a82-56f0-84d2-896068ecc59b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fcc%252F62cc8b0fb44ea75a667f63ecd47596f1%252Fpa%252FUS50096_906af4717d4621d9762dd60815fc2d16.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_906af4717d4621d9762dd60815fc2d16.jpg saved to cache
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47611764-5a82-56f0-84d2-896068ecc59b
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c4f5d0>
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47611764-5a82-56f0-84d2-896068ecc59b/47611764-5a82-56f0-84d2-896068ecc59b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fcc%252F62cc8b0fb44ea75a667f63ecd47596f1%252Fpa%252FUS50096_f2e63d07bd2323117dd422722200eabe.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_f2e63d07bd2323117dd422722200eabe.jpg saved to cache
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47611764-5a82-56f0-84d2-896068ecc59b
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef79fbc10>
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47611764-5a82-56f0-84d2-896068ecc59b/47611764-5a82-56f0-84d2-896068ecc59b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fcc%252F62cc8b0fb44ea75a667f63ecd47596f1%252Fpa%252FUS50096_597f3dc4f9eb17139d47d70a81825e4d.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_597f3dc4f9eb17139d47d70a81825e4d.jpg saved to cache
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47611764-5a82-56f0-84d2-896068ecc59b
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c01d0>
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47611764-5a82-56f0-84d2-896068ecc59b/47611764-5a82-56f0-84d2-896068ecc59b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fcc%252F62cc8b0fb44ea75a667f63ecd47596f1%252Fpa%252FUS50096_9a3c02dbcba9e4eaae9da1fb81dbba94.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_9a3c02dbcba9e4eaae9da1fb81dbba94.jpg saved to cache
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47611764-5a82-56f0-84d2-896068ecc59b
2026-03-30 10:48:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47611764-5a82-56f0-84d2-896068ecc59b, skipping ID generation
2026-03-30 10:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47611764-5a82-56f0-84d2-896068ecc59b with scrape type 1
2026-03-30 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47611764-5a82-56f0-84d2-896068ecc59b sending to next pipeline
2026-03-30 10:48:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47611764-5a82-56f0-84d2-896068ecc59b, identifier: US50096
2026-03-30 10:48:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47611764-5a82-56f0-84d2-896068ecc59b with identifier: US50096
2026-03-30 10:48:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47611764-5a82-56f0-84d2-896068ecc59b with identifier: US50096
2026-03-30 10:48:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47611764-5a82-56f0-84d2-896068ecc59b with identifier: US50096 to the API
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_9a3c02dbcba9e4eaae9da1fb81dbba94.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:58:24Z',
 'fuel_type': 'petrol',
 'id': '47611764-5a82-56f0-84d2-896068ecc59b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US50096',
 'listing': 'auction',
 'location': 'DE, Düren',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 132636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47611764-5a82-56f0-84d2-896068ecc59b/47611764-5a82-56f0-84d2-896068ecc59b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_87f0178dd75438ba31e73ab918056bff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47611764-5a82-56f0-84d2-896068ecc59b/47611764-5a82-56f0-84d2-896068ecc59b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_66fd4f420c841060dfdd4db5684ea43e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47611764-5a82-56f0-84d2-896068ecc59b/47611764-5a82-56f0-84d2-896068ecc59b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_f2e63d07bd2323117dd422722200eabe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47611764-5a82-56f0-84d2-896068ecc59b/47611764-5a82-56f0-84d2-896068ecc59b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_906af4717d4621d9762dd60815fc2d16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47611764-5a82-56f0-84d2-896068ecc59b/47611764-5a82-56f0-84d2-896068ecc59b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_597f3dc4f9eb17139d47d70a81825e4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47611764-5a82-56f0-84d2-896068ecc59b/47611764-5a82-56f0-84d2-896068ecc59b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/cc/62cc8b0fb44ea75a667f63ecd47596f1/pa/US50096_9a3c02dbcba9e4eaae9da1fb81dbba94.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US50096%27 HTTP/1.1" 200 None
2026-03-30 10:48:38 [auto1.de] INFO: Saving data for US50096: {'created_time': 1774867718.33638, 'last_price_update_time': 1774867718.336392, 'auction_closing_time': 1774972704.0}
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US50096') HTTP/1.1" 204 0
2026-03-30 10:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:43 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 9492 | hits on page: 40
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: XM95043
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: BX85596
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: SV41161
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV41161%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [auto1.de] INFO: Scrape type for SV41161: 0
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: US50096
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US50096%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [auto1.de] INFO: Scrape type for US50096: 0
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: HU25132
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: WL29620
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: ME10410
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME10410%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [auto1.de] INFO: Scrape type for ME10410: 0
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: JW10834
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW10834%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [auto1.de] INFO: Scrape type for JW10834: 0
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: LM07761
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: YV90191
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: NK05047
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: AG32992
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: BL26241
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL26241%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [auto1.de] INFO: Scrape type for BL26241: 0
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: BV02154
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV02154%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [auto1.de] INFO: Scrape type for BV02154: 0
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: JL60015
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: TC70677
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: TU86287
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU86287%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [auto1.de] INFO: Scrape type for TU86287: 1
2026-03-30 10:48:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: PJ48616
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ48616%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [auto1.de] INFO: Scrape type for PJ48616: 1
2026-03-30 10:48:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: VV80524
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV80524%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [auto1.de] INFO: Scrape type for VV80524: 1
2026-03-30 10:48:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:43 [auto1.de] INFO: Found listing with ID: YJ94181
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ94181%27 HTTP/1.1" 200 None
2026-03-30 10:48:43 [auto1.de] INFO: Scrape type for YJ94181: 2
2026-03-30 10:48:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 119e4db3-a0aa-5b2a-87d8-f4ef47b58ebd with identifier: YJ94181
2026-03-30 10:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 119e4db3-a0aa-5b2a-87d8-f4ef47b58ebd with scrape type 2
2026-03-30 10:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 119e4db3-a0aa-5b2a-87d8-f4ef47b58ebd with scrape type 2
2026-03-30 10:48:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 119e4db3-a0aa-5b2a-87d8-f4ef47b58ebd, identifier: YJ94181
2026-03-30 10:48:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 119e4db3-a0aa-5b2a-87d8-f4ef47b58ebd with identifier: YJ94181
2026-03-30 10:48:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 119e4db3-a0aa-5b2a-87d8-f4ef47b58ebd with identifier: YJ94181
2026-03-30 10:48:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 119e4db3-a0aa-5b2a-87d8-f4ef47b58ebd with identifier: YJ94181 to the API
2026-03-30 10:48:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:36:06Z',
 'fuel_type': 'petrol',
 'id': '119e4db3-a0aa-5b2a-87d8-f4ef47b58ebd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ94181',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 305751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-08-31',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 114',
 'transmission': 'automatic',
 'trim': '',
 'year': 1998}
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ94181%27 HTTP/1.1" 200 None
2026-03-30 10:48:44 [auto1.de] INFO: Saving data for YJ94181: {'auction_closing_time': 1774971366.0, 'created_time': 1773776111.073276, 'last_price_update_time': 1774867724.153401}
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ94181') HTTP/1.1" 204 0
2026-03-30 10:48:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:44 [auto1.de] INFO: Found listing with ID: MJ25324
2026-03-30 10:48:44 [auto1.de] INFO: Found listing with ID: PG46559
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG46559%27 HTTP/1.1" 200 None
2026-03-30 10:48:44 [auto1.de] INFO: Scrape type for PG46559: 1
2026-03-30 10:48:44 [auto1.de] INFO: Found listing with ID: PT79001
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT79001%27 HTTP/1.1" 200 None
2026-03-30 10:48:44 [auto1.de] INFO: Scrape type for PT79001: 2
2026-03-30 10:48:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f56d18bc-966e-5c90-9840-0d09e6f3cec3 with identifier: PT79001
2026-03-30 10:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f56d18bc-966e-5c90-9840-0d09e6f3cec3 with scrape type 2
2026-03-30 10:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f56d18bc-966e-5c90-9840-0d09e6f3cec3 with scrape type 2
2026-03-30 10:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f56d18bc-966e-5c90-9840-0d09e6f3cec3, identifier: PT79001
2026-03-30 10:48:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f56d18bc-966e-5c90-9840-0d09e6f3cec3 with identifier: PT79001
2026-03-30 10:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f56d18bc-966e-5c90-9840-0d09e6f3cec3 with identifier: PT79001
2026-03-30 10:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f56d18bc-966e-5c90-9840-0d09e6f3cec3 with identifier: PT79001 to the API
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:34:13Z',
 'fuel_type': 'diesel',
 'id': 'f56d18bc-966e-5c90-9840-0d09e6f3cec3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT79001',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 146200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-12',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT79001%27 HTTP/1.1" 200 None
2026-03-30 10:48:44 [auto1.de] INFO: Saving data for PT79001: {'auction_closing_time': 1774971253.0, 'created_time': 1773741256.974849, 'last_price_update_time': 1774867724.763502}
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT79001') HTTP/1.1" 204 0
2026-03-30 10:48:44 [auto1.de] INFO: Found listing with ID: AD74925
2026-03-30 10:48:44 [auto1.de] INFO: Found listing with ID: SM01610
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM01610%27 HTTP/1.1" 200 None
2026-03-30 10:48:44 [auto1.de] INFO: Scrape type for SM01610: 2
2026-03-30 10:48:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62d6301a-53f8-52f1-a5bd-c2bcab9c3eab with identifier: SM01610
2026-03-30 10:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62d6301a-53f8-52f1-a5bd-c2bcab9c3eab with scrape type 2
2026-03-30 10:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62d6301a-53f8-52f1-a5bd-c2bcab9c3eab with scrape type 2
2026-03-30 10:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62d6301a-53f8-52f1-a5bd-c2bcab9c3eab, identifier: SM01610
2026-03-30 10:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62d6301a-53f8-52f1-a5bd-c2bcab9c3eab with identifier: SM01610
2026-03-30 10:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62d6301a-53f8-52f1-a5bd-c2bcab9c3eab with identifier: SM01610
2026-03-30 10:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62d6301a-53f8-52f1-a5bd-c2bcab9c3eab with identifier: SM01610 to the API
2026-03-30 10:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:15:13Z',
 'fuel_type': 'diesel',
 'id': '62d6301a-53f8-52f1-a5bd-c2bcab9c3eab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM01610',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 56938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-12',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2021}
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM01610%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [auto1.de] INFO: Saving data for SM01610: {'auction_closing_time': 1774970113.0, 'created_time': 1773688679.266066, 'last_price_update_time': 1774867725.255385}
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM01610') HTTP/1.1" 204 0
2026-03-30 10:48:45 [auto1.de] INFO: Found listing with ID: JY04317
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04317%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [auto1.de] INFO: Scrape type for JY04317: 2
2026-03-30 10:48:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1f4ab57-ebb8-5a7a-8066-e1cdb8eee977 with identifier: JY04317
2026-03-30 10:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1f4ab57-ebb8-5a7a-8066-e1cdb8eee977 with scrape type 2
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1f4ab57-ebb8-5a7a-8066-e1cdb8eee977 with scrape type 2
2026-03-30 10:48:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1f4ab57-ebb8-5a7a-8066-e1cdb8eee977, identifier: JY04317
2026-03-30 10:48:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1f4ab57-ebb8-5a7a-8066-e1cdb8eee977 with identifier: JY04317
2026-03-30 10:48:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1f4ab57-ebb8-5a7a-8066-e1cdb8eee977 with identifier: JY04317
2026-03-30 10:48:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1f4ab57-ebb8-5a7a-8066-e1cdb8eee977 with identifier: JY04317 to the API
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:05:45Z',
 'fuel_type': 'petrol',
 'id': 'f1f4ab57-ebb8-5a7a-8066-e1cdb8eee977',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY04317',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 86219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04317%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [auto1.de] INFO: Saving data for JY04317: {'auction_closing_time': 1774969545.0, 'created_time': 1774378379.853803, 'last_price_update_time': 1774867725.718228}
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY04317') HTTP/1.1" 204 0
2026-03-30 10:48:45 [auto1.de] INFO: Found listing with ID: JZ50493
2026-03-30 10:48:45 [auto1.de] INFO: Found listing with ID: GF43891
2026-03-30 10:48:45 [auto1.de] INFO: Found listing with ID: ZB42125
2026-03-30 10:48:45 [auto1.de] INFO: Found listing with ID: JE19895
2026-03-30 10:48:45 [auto1.de] INFO: Found listing with ID: AX74187
2026-03-30 10:48:45 [auto1.de] INFO: Found listing with ID: JT23307
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT23307%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [auto1.de] INFO: Scrape type for JT23307: 1
2026-03-30 10:48:45 [auto1.de] INFO: Found listing with ID: XA22438
2026-03-30 10:48:45 [auto1.de] INFO: Found listing with ID: PU71173
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU71173%27 HTTP/1.1" 200 None
2026-03-30 10:48:45 [auto1.de] INFO: Scrape type for PU71173: 2
2026-03-30 10:48:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa679e28-01a8-52c4-8a7e-53e0fed2d9bc with identifier: PU71173
2026-03-30 10:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa679e28-01a8-52c4-8a7e-53e0fed2d9bc with scrape type 2
2026-03-30 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa679e28-01a8-52c4-8a7e-53e0fed2d9bc with scrape type 2
2026-03-30 10:48:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa679e28-01a8-52c4-8a7e-53e0fed2d9bc, identifier: PU71173
2026-03-30 10:48:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa679e28-01a8-52c4-8a7e-53e0fed2d9bc with identifier: PU71173
2026-03-30 10:48:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa679e28-01a8-52c4-8a7e-53e0fed2d9bc with identifier: PU71173
2026-03-30 10:48:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa679e28-01a8-52c4-8a7e-53e0fed2d9bc with identifier: PU71173 to the API
2026-03-30 10:48:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:29:46Z',
 'fuel_type': 'petrol',
 'id': 'fa679e28-01a8-52c4-8a7e-53e0fed2d9bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU71173',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 143779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-15',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2015}
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU71173%27 HTTP/1.1" 200 None
2026-03-30 10:48:46 [auto1.de] INFO: Saving data for PU71173: {'auction_closing_time': 1774970986.0, 'created_time': 1773307182.169593, 'last_price_update_time': 1774867726.23982}
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU71173') HTTP/1.1" 204 0
2026-03-30 10:48:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:46 [auto1.de] INFO: Found listing with ID: LR15426
2026-03-30 10:48:46 [auto1.de] INFO: Found listing with ID: LZ41589
2026-03-30 10:48:46 [auto1.de] INFO: Found listing with ID: KG83393
2026-03-30 10:48:46 [auto1.de] INFO: Found listing with ID: LR88294
2026-03-30 10:48:46 [auto1.de] INFO: Found listing with ID: XG74436
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG74436%27 HTTP/1.1" 200 None
2026-03-30 10:48:46 [auto1.de] INFO: Scrape type for XG74436: 2
2026-03-30 10:48:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe166848-9353-5b6b-9fd3-3b77040a29cd with identifier: XG74436
2026-03-30 10:48:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe166848-9353-5b6b-9fd3-3b77040a29cd with scrape type 2
2026-03-30 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe166848-9353-5b6b-9fd3-3b77040a29cd with scrape type 2
2026-03-30 10:48:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe166848-9353-5b6b-9fd3-3b77040a29cd, identifier: XG74436
2026-03-30 10:48:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe166848-9353-5b6b-9fd3-3b77040a29cd with identifier: XG74436
2026-03-30 10:48:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe166848-9353-5b6b-9fd3-3b77040a29cd with identifier: XG74436
2026-03-30 10:48:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe166848-9353-5b6b-9fd3-3b77040a29cd with identifier: XG74436 to the API
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-31T15:25:27Z',
 'fuel_type': 'petrol',
 'id': 'fe166848-9353-5b6b-9fd3-3b77040a29cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG74436',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 46606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-07',
 'seller_name': None,
 'title': 'Mazda CX-5 2.5 Sports-Line 2WD',
 'transmission': 'automatic',
 'trim': 'Sports-Line 2WD',
 'year': 2021}
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG74436%27 HTTP/1.1" 200 None
2026-03-30 10:48:46 [auto1.de] INFO: Saving data for XG74436: {'auction_closing_time': 1774970727.0, 'created_time': 1774262300.274193, 'last_price_update_time': 1774867726.864169}
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG74436') HTTP/1.1" 204 0
2026-03-30 10:48:46 [auto1.de] INFO: Found listing with ID: TM99691
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM99691%27 HTTP/1.1" 200 None
2026-03-30 10:48:46 [auto1.de] INFO: Scrape type for TM99691: 1
2026-03-30 10:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PJ48616/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PG46559/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV80524/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU86287/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU86287> (referer: https://www.auto1.com/v1/car-details-view/TU86287/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5 with identifier: TU86287
2026-03-30 10:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5 with scrape type 1
2026-03-30 10:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F9a%252F5f9a82c628cfd03764cf71186619a1b8%252Fpa%252FTU86287_131a66c9797cae4943c0e6032791190b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_131a66c9797cae4943c0e6032791190b.jpg already downloaded
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F9a%252F5f9a82c628cfd03764cf71186619a1b8%252Fpa%252FTU86287_4e0f417735327d07eb126677b3dc2f57.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_4e0f417735327d07eb126677b3dc2f57.jpg already downloaded
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F9a%252F5f9a82c628cfd03764cf71186619a1b8%252Fpa%252FTU86287_a2d55b41b49ae5ec19a88f9a06eb3db9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_a2d55b41b49ae5ec19a88f9a06eb3db9.jpg already downloaded
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F9a%252F5f9a82c628cfd03764cf71186619a1b8%252Fpa%252FTU86287_fd9d3c58f69214b5abc3f3cdcca89276.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_fd9d3c58f69214b5abc3f3cdcca89276.jpg already downloaded
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F9a%252F5f9a82c628cfd03764cf71186619a1b8%252Fpa%252FTU86287_d48611811010635bb8ffd016a0877006.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_d48611811010635bb8ffd016a0877006.jpg already downloaded
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F9a%252F5f9a82c628cfd03764cf71186619a1b8%252Fpa%252FTU86287_fd1737d844d265a2304913955a16fdcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_fd1737d844d265a2304913955a16fdcd.jpg already downloaded
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F9a%252F5f9a82c628cfd03764cf71186619a1b8%252Fpa%252FTU86287_4658a94ae4ba08232996fb70945253c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_4658a94ae4ba08232996fb70945253c7.jpg already downloaded
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F9a%252F5f9a82c628cfd03764cf71186619a1b8%252Fpa%252FTU86287_6da2e78a7d9dc8a9babadc7053eec125.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_6da2e78a7d9dc8a9babadc7053eec125.jpg already downloaded
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F9a%252F5f9a82c628cfd03764cf71186619a1b8%252Fpa%252FTU86287_fdc231d4653d20b9ac0d8f0fa6966be5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_fdc231d4653d20b9ac0d8f0fa6966be5.jpg already downloaded
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F9a%252F5f9a82c628cfd03764cf71186619a1b8%252Fpa%252FTU86287_ca1d250e34bdeb80f841f08946ee0cf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_ca1d250e34bdeb80f841f08946ee0cf0.jpg already downloaded
2026-03-30 10:48:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5, identifier: TU86287
2026-03-30 10:48:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5 with identifier: TU86287
2026-03-30 10:48:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5 with identifier: TU86287
2026-03-30 10:48:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5 with identifier: TU86287 to the API
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TU86287>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:00:02Z',
 'fuel_type': 'diesel',
 'id': '13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU86287',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 272249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_131a66c9797cae4943c0e6032791190b.jpg',
                'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_4e0f417735327d07eb126677b3dc2f57.jpg',
                'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_a2d55b41b49ae5ec19a88f9a06eb3db9.jpg',
                'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_fd9d3c58f69214b5abc3f3cdcca89276.jpg',
                'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_d48611811010635bb8ffd016a0877006.jpg',
                'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_fd1737d844d265a2304913955a16fdcd.jpg',
                'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_4658a94ae4ba08232996fb70945253c7.jpg',
                'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_6da2e78a7d9dc8a9babadc7053eec125.jpg',
                'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_fdc231d4653d20b9ac0d8f0fa6966be5.jpg',
                'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_ca1d250e34bdeb80f841f08946ee0cf0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5/13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_131a66c9797cae4943c0e6032791190b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5/13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_4e0f417735327d07eb126677b3dc2f57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5/13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_a2d55b41b49ae5ec19a88f9a06eb3db9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5/13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_fd9d3c58f69214b5abc3f3cdcca89276.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5/13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_d48611811010635bb8ffd016a0877006.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5/13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_fd1737d844d265a2304913955a16fdcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5/13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_4658a94ae4ba08232996fb70945253c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5/13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_6da2e78a7d9dc8a9babadc7053eec125.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5/13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_fdc231d4653d20b9ac0d8f0fa6966be5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5/13183ad6-24a6-5e6f-a9cc-c11d7e30b0c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/9a/5f9a82c628cfd03764cf71186619a1b8/pa/TU86287_ca1d250e34bdeb80f841f08946ee0cf0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-12',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Premium L3',
 'transmission': 'automatic',
 'trim': 'Premium L3',
 'year': 2018}
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU86287%27 HTTP/1.1" 200 None
2026-03-30 10:48:49 [auto1.de] INFO: Saving data for TU86287: {'created_time': 1774867729.620605, 'last_price_update_time': 1774867729.620619, 'auction_closing_time': 1774969202.0}
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU86287') HTTP/1.1" 204 0
2026-03-30 10:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV80524> (referer: https://www.auto1.com/v1/car-details-view/VV80524/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b46d89e1-9bec-5301-bf42-70dd80f01c7e with identifier: VV80524
2026-03-30 10:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b46d89e1-9bec-5301-bf42-70dd80f01c7e with scrape type 1
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_19d0a0228f19f0ded34b47cf07a8bd61.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_19d0a0228f19f0ded34b47cf07a8bd61.jpg not downloaded yet
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_d91e85b2f8a05100ebc5949a6d567312.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_d91e85b2f8a05100ebc5949a6d567312.jpg not downloaded yet
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_68ae59b0d135fe83e5663bb8e930c5ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_68ae59b0d135fe83e5663bb8e930c5ce.jpg not downloaded yet
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_c4322e043c4da009fcfa2da8086d94e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_c4322e043c4da009fcfa2da8086d94e8.jpg not downloaded yet
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_0e49b0051c721469d3d9a9008051bfdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_0e49b0051c721469d3d9a9008051bfdf.jpg not downloaded yet
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_e1070a72ffef0e3d6fd68e89b1b7f3e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_e1070a72ffef0e3d6fd68e89b1b7f3e0.jpg not downloaded yet
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_ebb8027a6016a938df315bd7ce97f713.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_ebb8027a6016a938df315bd7ce97f713.jpg not downloaded yet
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_09d268ee390eed8521d6137c3e62b4a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_09d268ee390eed8521d6137c3e62b4a1.jpg not downloaded yet
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_ab86a1d49a48b6e060b820d39ceb723d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_ab86a1d49a48b6e060b820d39ceb723d.jpg not downloaded yet
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_27a4838fece986ae4a106310e3feea9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_27a4838fece986ae4a106310e3feea9c.jpg not downloaded yet
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_68ae59b0d135fe83e5663bb8e930c5ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_0e49b0051c721469d3d9a9008051bfdf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_e1070a72ffef0e3d6fd68e89b1b7f3e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_d91e85b2f8a05100ebc5949a6d567312.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_ebb8027a6016a938df315bd7ce97f713.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_c4322e043c4da009fcfa2da8086d94e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_19d0a0228f19f0ded34b47cf07a8bd61.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e674d0>
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_68ae59b0d135fe83e5663bb8e930c5ce.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_68ae59b0d135fe83e5663bb8e930c5ce.jpg saved to cache
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fed810>
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_0e49b0051c721469d3d9a9008051bfdf.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_0e49b0051c721469d3d9a9008051bfdf.jpg saved to cache
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_27a4838fece986ae4a106310e3feea9c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef852f3d0>
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_e1070a72ffef0e3d6fd68e89b1b7f3e0.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_e1070a72ffef0e3d6fd68e89b1b7f3e0.jpg saved to cache
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_ab86a1d49a48b6e060b820d39ceb723d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b37c90>
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_d91e85b2f8a05100ebc5949a6d567312.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_d91e85b2f8a05100ebc5949a6d567312.jpg saved to cache
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59635d0>
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_ebb8027a6016a938df315bd7ce97f713.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_ebb8027a6016a938df315bd7ce97f713.jpg saved to cache
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-03-30 10:48:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e28f10>
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_c4322e043c4da009fcfa2da8086d94e8.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_c4322e043c4da009fcfa2da8086d94e8.jpg saved to cache
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-03-30 10:48:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d7b890>
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_19d0a0228f19f0ded34b47cf07a8bd61.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_19d0a0228f19f0ded34b47cf07a8bd61.jpg saved to cache
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b37810>
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_27a4838fece986ae4a106310e3feea9c.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_27a4838fece986ae4a106310e3feea9c.jpg saved to cache
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e97750>
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_ab86a1d49a48b6e060b820d39ceb723d.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_ab86a1d49a48b6e060b820d39ceb723d.jpg saved to cache
2026-03-30 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_09d268ee390eed8521d6137c3e62b4a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:48:51 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 9494 | hits on page: 40
2026-03-30 10:48:51 [auto1.de] INFO: Found listing with ID: XG74436
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG74436%27 HTTP/1.1" 200 None
2026-03-30 10:48:51 [auto1.de] INFO: Scrape type for XG74436: 0
2026-03-30 10:48:51 [auto1.de] INFO: Found listing with ID: TM99691
2026-03-30 10:48:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:51 [auto1.de] INFO: Found listing with ID: ZH41637
2026-03-30 10:48:51 [auto1.de] INFO: Found listing with ID: KJ93142
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ93142%27 HTTP/1.1" 200 None
2026-03-30 10:48:51 [auto1.de] INFO: Scrape type for KJ93142: 1
2026-03-30 10:48:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d67690>
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd3%252Fd4d3c14a36a4f5f5fcb01e35cb118c91%252Fpa%252FVV80524_09d268ee390eed8521d6137c3e62b4a1.jpg') HTTP/1.1" 204 0
2026-03-30 10:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_09d268ee390eed8521d6137c3e62b4a1.jpg saved to cache
2026-03-30 10:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b46d89e1-9bec-5301-bf42-70dd80f01c7e
2026-03-30 10:48:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b46d89e1-9bec-5301-bf42-70dd80f01c7e, skipping ID generation
2026-03-30 10:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b46d89e1-9bec-5301-bf42-70dd80f01c7e with scrape type 1
2026-03-30 10:48:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b46d89e1-9bec-5301-bf42-70dd80f01c7e sending to next pipeline
2026-03-30 10:48:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b46d89e1-9bec-5301-bf42-70dd80f01c7e, identifier: VV80524
2026-03-30 10:48:52 [auto1.de] INFO: Found listing with ID: VG68690
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG68690%27 HTTP/1.1" 200 None
2026-03-30 10:48:52 [auto1.de] INFO: Scrape type for VG68690: 1
2026-03-30 10:48:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b46d89e1-9bec-5301-bf42-70dd80f01c7e with identifier: VV80524
2026-03-30 10:48:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b46d89e1-9bec-5301-bf42-70dd80f01c7e with identifier: VV80524
2026-03-30 10:48:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b46d89e1-9bec-5301-bf42-70dd80f01c7e with identifier: VV80524 to the API
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_09d268ee390eed8521d6137c3e62b4a1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:54:45Z',
 'fuel_type': 'petrol',
 'id': 'b46d89e1-9bec-5301-bf42-70dd80f01c7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV80524',
 'listing': 'auction',
 'location': 'DE, Balingen',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 104722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2645327,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_19d0a0228f19f0ded34b47cf07a8bd61.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2628445,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_d91e85b2f8a05100ebc5949a6d567312.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_68ae59b0d135fe83e5663bb8e930c5ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2546252,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_c4322e043c4da009fcfa2da8086d94e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_0e49b0051c721469d3d9a9008051bfdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_e1070a72ffef0e3d6fd68e89b1b7f3e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_ebb8027a6016a938df315bd7ce97f713.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2903734,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_09d268ee390eed8521d6137c3e62b4a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_ab86a1d49a48b6e060b820d39ceb723d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b46d89e1-9bec-5301-bf42-70dd80f01c7e/b46d89e1-9bec-5301-bf42-70dd80f01c7e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d3/d4d3c14a36a4f5f5fcb01e35cb118c91/pa/VV80524_27a4838fece986ae4a106310e3feea9c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-08-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2013}
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV80524%27 HTTP/1.1" 200 None
2026-03-30 10:48:52 [auto1.de] INFO: Saving data for VV80524: {'created_time': 1774867732.759972, 'last_price_update_time': 1774867732.759987, 'auction_closing_time': 1774972485.0}
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV80524') HTTP/1.1" 204 0
2026-03-30 10:48:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:52 [auto1.de] INFO: Found listing with ID: VN57759
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN57759%27 HTTP/1.1" 200 None
2026-03-30 10:48:52 [auto1.de] INFO: Scrape type for VN57759: 2
2026-03-30 10:48:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3da7ca9-5a68-51f4-a7b6-df20363fdadb with identifier: VN57759
2026-03-30 10:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3da7ca9-5a68-51f4-a7b6-df20363fdadb with scrape type 2
2026-03-30 10:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3da7ca9-5a68-51f4-a7b6-df20363fdadb with scrape type 2
2026-03-30 10:48:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3da7ca9-5a68-51f4-a7b6-df20363fdadb, identifier: VN57759
2026-03-30 10:48:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3da7ca9-5a68-51f4-a7b6-df20363fdadb with identifier: VN57759
2026-03-30 10:48:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3da7ca9-5a68-51f4-a7b6-df20363fdadb with identifier: VN57759
2026-03-30 10:48:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3da7ca9-5a68-51f4-a7b6-df20363fdadb with identifier: VN57759 to the API
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:31:58Z',
 'fuel_type': 'petrol',
 'id': 'f3da7ca9-5a68-51f4-a7b6-df20363fdadb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN57759',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'StreetKa',
 'odometer': 55881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-30',
 'seller_name': None,
 'title': 'Ford StreetKa 1.6 Elegance Roadster',
 'transmission': 'manual',
 'trim': 'Elegance Roadster',
 'year': 2005}
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN57759%27 HTTP/1.1" 200 None
2026-03-30 10:48:53 [auto1.de] INFO: Saving data for VN57759: {'auction_closing_time': 1774971118.0, 'created_time': 1773402787.604239, 'last_price_update_time': 1774867733.271988}
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN57759') HTTP/1.1" 204 0
2026-03-30 10:48:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:53 [auto1.de] INFO: Found listing with ID: GN20483
2026-03-30 10:48:53 [auto1.de] INFO: Found listing with ID: UY11504
2026-03-30 10:48:53 [auto1.de] INFO: Found listing with ID: JR21744
2026-03-30 10:48:53 [auto1.de] INFO: Found listing with ID: HC44441
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC44441%27 HTTP/1.1" 200 None
2026-03-30 10:48:53 [auto1.de] INFO: Scrape type for HC44441: 1
2026-03-30 10:48:53 [auto1.de] INFO: Found listing with ID: XA25457
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA25457%27 HTTP/1.1" 200 None
2026-03-30 10:48:53 [auto1.de] INFO: Scrape type for XA25457: 1
2026-03-30 10:48:53 [auto1.de] INFO: Found listing with ID: UZ93598
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ93598%27 HTTP/1.1" 200 None
2026-03-30 10:48:53 [auto1.de] INFO: Scrape type for UZ93598: 1
2026-03-30 10:48:53 [auto1.de] INFO: Found listing with ID: AG06219
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG06219%27 HTTP/1.1" 200 None
2026-03-30 10:48:53 [auto1.de] INFO: Scrape type for AG06219: 2
2026-03-30 10:48:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67c3b91d-37cc-504e-b114-24b5c7616462 with identifier: AG06219
2026-03-30 10:48:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67c3b91d-37cc-504e-b114-24b5c7616462 with scrape type 2
2026-03-30 10:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67c3b91d-37cc-504e-b114-24b5c7616462 with scrape type 2
2026-03-30 10:48:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67c3b91d-37cc-504e-b114-24b5c7616462, identifier: AG06219
2026-03-30 10:48:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67c3b91d-37cc-504e-b114-24b5c7616462 with identifier: AG06219
2026-03-30 10:48:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67c3b91d-37cc-504e-b114-24b5c7616462 with identifier: AG06219
2026-03-30 10:48:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67c3b91d-37cc-504e-b114-24b5c7616462 with identifier: AG06219 to the API
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:04:26Z',
 'fuel_type': 'petrol',
 'id': '67c3b91d-37cc-504e-b114-24b5c7616462',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG06219',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 72297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-02',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG06219%27 HTTP/1.1" 200 None
2026-03-30 10:48:53 [auto1.de] INFO: Saving data for AG06219: {'auction_closing_time': 1774969466.0, 'created_time': 1774291216.080973, 'last_price_update_time': 1774867733.964797}
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG06219') HTTP/1.1" 204 0
2026-03-30 10:48:53 [auto1.de] INFO: Found listing with ID: PE90731
2026-03-30 10:48:53 [auto1.de] INFO: Found listing with ID: UG25956
2026-03-30 10:48:53 [auto1.de] INFO: Found listing with ID: JP99561
2026-03-30 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP99561%27 HTTP/1.1" 200 None
2026-03-30 10:48:54 [auto1.de] INFO: Scrape type for JP99561: 1
2026-03-30 10:48:54 [auto1.de] INFO: Found listing with ID: SS69708
2026-03-30 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS69708%27 HTTP/1.1" 200 None
2026-03-30 10:48:54 [auto1.de] INFO: Scrape type for SS69708: 1
2026-03-30 10:48:54 [auto1.de] INFO: Found listing with ID: ZJ98470
2026-03-30 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ98470%27 HTTP/1.1" 200 None
2026-03-30 10:48:54 [auto1.de] INFO: Scrape type for ZJ98470: 1
2026-03-30 10:48:54 [auto1.de] INFO: Found listing with ID: PY04255
2026-03-30 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY04255%27 HTTP/1.1" 200 None
2026-03-30 10:48:54 [auto1.de] INFO: Scrape type for PY04255: 2
2026-03-30 10:48:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d19c5c42-6369-522c-876b-9f3720a0f180 with identifier: PY04255
2026-03-30 10:48:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d19c5c42-6369-522c-876b-9f3720a0f180 with scrape type 2
2026-03-30 10:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d19c5c42-6369-522c-876b-9f3720a0f180 with scrape type 2
2026-03-30 10:48:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d19c5c42-6369-522c-876b-9f3720a0f180, identifier: PY04255
2026-03-30 10:48:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d19c5c42-6369-522c-876b-9f3720a0f180 with identifier: PY04255
2026-03-30 10:48:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d19c5c42-6369-522c-876b-9f3720a0f180 with identifier: PY04255
2026-03-30 10:48:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d19c5c42-6369-522c-876b-9f3720a0f180 with identifier: PY04255 to the API
2026-03-30 10:48:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:08:03Z',
 'fuel_type': 'petrol',
 'id': 'd19c5c42-6369-522c-876b-9f3720a0f180',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY04255',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 93641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-10',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2012}
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY04255%27 HTTP/1.1" 200 None
2026-03-30 10:48:55 [auto1.de] INFO: Saving data for PY04255: {'auction_closing_time': 1774969683.0, 'created_time': 1773687948.771476, 'last_price_update_time': 1774867735.152206}
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY04255') HTTP/1.1" 204 0
2026-03-30 10:48:55 [auto1.de] INFO: Found listing with ID: WU72894
2026-03-30 10:48:55 [auto1.de] INFO: Found listing with ID: NY96025
2026-03-30 10:48:55 [auto1.de] INFO: Found listing with ID: BS49761
2026-03-30 10:48:55 [auto1.de] INFO: Found listing with ID: ZS77255
2026-03-30 10:48:55 [auto1.de] INFO: Found listing with ID: LN61761
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN61761%27 HTTP/1.1" 200 None
2026-03-30 10:48:55 [auto1.de] INFO: Scrape type for LN61761: 1
2026-03-30 10:48:55 [auto1.de] INFO: Found listing with ID: RM34833
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM34833%27 HTTP/1.1" 200 None
2026-03-30 10:48:55 [auto1.de] INFO: Scrape type for RM34833: 2
2026-03-30 10:48:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ad5cde2-6d83-5ab7-8ff2-23f82698d3c5 with identifier: RM34833
2026-03-30 10:48:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ad5cde2-6d83-5ab7-8ff2-23f82698d3c5 with scrape type 2
2026-03-30 10:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ad5cde2-6d83-5ab7-8ff2-23f82698d3c5 with scrape type 2
2026-03-30 10:48:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ad5cde2-6d83-5ab7-8ff2-23f82698d3c5, identifier: RM34833
2026-03-30 10:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PJ48616> (referer: https://www.auto1.com/v1/car-details-view/PJ48616/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ad5cde2-6d83-5ab7-8ff2-23f82698d3c5 with identifier: RM34833
2026-03-30 10:48:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ad5cde2-6d83-5ab7-8ff2-23f82698d3c5 with identifier: RM34833
2026-03-30 10:48:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ad5cde2-6d83-5ab7-8ff2-23f82698d3c5 with identifier: RM34833 to the API
2026-03-30 10:48:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:53:27Z',
 'fuel_type': 'petrol',
 'id': '1ad5cde2-6d83-5ab7-8ff2-23f82698d3c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM34833',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 40495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-13',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM34833%27 HTTP/1.1" 200 None
2026-03-30 10:48:56 [auto1.de] INFO: Saving data for RM34833: {'auction_closing_time': 1774972407.0, 'created_time': 1773230271.061705, 'last_price_update_time': 1774867736.577652}
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM34833') HTTP/1.1" 204 0
2026-03-30 10:48:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:56 [auto1.de] INFO: Found listing with ID: TF05985
2026-03-30 10:48:56 [auto1.de] INFO: Found listing with ID: XT65202
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT65202%27 HTTP/1.1" 200 None
2026-03-30 10:48:56 [auto1.de] INFO: Scrape type for XT65202: 1
2026-03-30 10:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ93142/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:56 [auto1.de] INFO: Found listing with ID: VC85429
2026-03-30 10:48:56 [auto1.de] INFO: Found listing with ID: BG36270
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG36270%27 HTTP/1.1" 200 None
2026-03-30 10:48:56 [auto1.de] INFO: Scrape type for BG36270: 1
2026-03-30 10:48:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f011387-7f5c-5f5f-8ec3-94f916989f59 with identifier: PJ48616
2026-03-30 10:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f011387-7f5c-5f5f-8ec3-94f916989f59 with scrape type 1
2026-03-30 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f011387-7f5c-5f5f-8ec3-94f916989f59
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fee%252F51ee09bb2fd8a423f28e41cd0ab102ad%252Fpa%252FPJ48616_d1b2a570dd94e5c55544c79d8fd4fe31.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_d1b2a570dd94e5c55544c79d8fd4fe31.jpg already downloaded
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fee%252F51ee09bb2fd8a423f28e41cd0ab102ad%252Fpa%252FPJ48616_900188bb2cc3e1435bfa183aa58ae814.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_900188bb2cc3e1435bfa183aa58ae814.jpg already downloaded
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fee%252F51ee09bb2fd8a423f28e41cd0ab102ad%252Fpa%252FPJ48616_39fa0651dad54ffae81efa7ee7c66ca3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_39fa0651dad54ffae81efa7ee7c66ca3.jpg already downloaded
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fee%252F51ee09bb2fd8a423f28e41cd0ab102ad%252Fpa%252FPJ48616_d306b6ae4dd5d3cf8ad636b1c3a07303.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_d306b6ae4dd5d3cf8ad636b1c3a07303.jpg already downloaded
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fee%252F51ee09bb2fd8a423f28e41cd0ab102ad%252Fpa%252FPJ48616_344f7efb21e0c2b94db0ffc29aa56ae2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_344f7efb21e0c2b94db0ffc29aa56ae2.jpg already downloaded
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fee%252F51ee09bb2fd8a423f28e41cd0ab102ad%252Fpa%252FPJ48616_e482fd3e54d44f02edd6d8c80d49dbe3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_e482fd3e54d44f02edd6d8c80d49dbe3.jpg already downloaded
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fee%252F51ee09bb2fd8a423f28e41cd0ab102ad%252Fpa%252FPJ48616_64b0463d078e2680d8e60ef9e35bf3f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_64b0463d078e2680d8e60ef9e35bf3f3.jpg already downloaded
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fee%252F51ee09bb2fd8a423f28e41cd0ab102ad%252Fpa%252FPJ48616_12380cc53cf8efb9e2229e234acf48c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_12380cc53cf8efb9e2229e234acf48c4.jpg already downloaded
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fee%252F51ee09bb2fd8a423f28e41cd0ab102ad%252Fpa%252FPJ48616_f45f049cad219e3e1e538e5eb0042221.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_f45f049cad219e3e1e538e5eb0042221.jpg already downloaded
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fee%252F51ee09bb2fd8a423f28e41cd0ab102ad%252Fpa%252FPJ48616_ea3ab42f45e3339000fa640270ce8bca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_ea3ab42f45e3339000fa640270ce8bca.jpg already downloaded
2026-03-30 10:48:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f011387-7f5c-5f5f-8ec3-94f916989f59, identifier: PJ48616
2026-03-30 10:48:57 [auto1.de] INFO: Found listing with ID: XH91941
2026-03-30 10:48:57 [auto1.de] INFO: Found listing with ID: FW22794
2026-03-30 10:48:57 [auto1.de] INFO: Found listing with ID: SE03748
2026-03-30 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE03748%27 HTTP/1.1" 200 None
2026-03-30 10:48:57 [auto1.de] INFO: Scrape type for SE03748: 2
2026-03-30 10:48:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2fd7fa1-f9d6-557d-a473-71c36258e6be with identifier: SE03748
2026-03-30 10:48:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2fd7fa1-f9d6-557d-a473-71c36258e6be with scrape type 2
2026-03-30 10:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2fd7fa1-f9d6-557d-a473-71c36258e6be with scrape type 2
2026-03-30 10:48:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2fd7fa1-f9d6-557d-a473-71c36258e6be, identifier: SE03748
2026-03-30 10:48:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f011387-7f5c-5f5f-8ec3-94f916989f59 with identifier: PJ48616
2026-03-30 10:48:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f011387-7f5c-5f5f-8ec3-94f916989f59 with identifier: PJ48616
2026-03-30 10:48:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f011387-7f5c-5f5f-8ec3-94f916989f59 with identifier: PJ48616 to the API
2026-03-30 10:48:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PJ48616>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:16:29Z',
 'fuel_type': 'petrol',
 'id': '6f011387-7f5c-5f5f-8ec3-94f916989f59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ48616',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'BMW',
 'model': '2er',
 'odometer': 37409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_d1b2a570dd94e5c55544c79d8fd4fe31.jpg',
                'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_900188bb2cc3e1435bfa183aa58ae814.jpg',
                'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_39fa0651dad54ffae81efa7ee7c66ca3.jpg',
                'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_d306b6ae4dd5d3cf8ad636b1c3a07303.jpg',
                'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_344f7efb21e0c2b94db0ffc29aa56ae2.jpg',
                'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_e482fd3e54d44f02edd6d8c80d49dbe3.jpg',
                'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_64b0463d078e2680d8e60ef9e35bf3f3.jpg',
                'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_12380cc53cf8efb9e2229e234acf48c4.jpg',
                'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_f45f049cad219e3e1e538e5eb0042221.jpg',
                'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_ea3ab42f45e3339000fa640270ce8bca.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f011387-7f5c-5f5f-8ec3-94f916989f59/6f011387-7f5c-5f5f-8ec3-94f916989f59_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2542515,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_d1b2a570dd94e5c55544c79d8fd4fe31.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f011387-7f5c-5f5f-8ec3-94f916989f59/6f011387-7f5c-5f5f-8ec3-94f916989f59_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2380731,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_900188bb2cc3e1435bfa183aa58ae814.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f011387-7f5c-5f5f-8ec3-94f916989f59/6f011387-7f5c-5f5f-8ec3-94f916989f59_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2361456,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_39fa0651dad54ffae81efa7ee7c66ca3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f011387-7f5c-5f5f-8ec3-94f916989f59/6f011387-7f5c-5f5f-8ec3-94f916989f59_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2723217,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_d306b6ae4dd5d3cf8ad636b1c3a07303.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f011387-7f5c-5f5f-8ec3-94f916989f59/6f011387-7f5c-5f5f-8ec3-94f916989f59_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2457132,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_344f7efb21e0c2b94db0ffc29aa56ae2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f011387-7f5c-5f5f-8ec3-94f916989f59/6f011387-7f5c-5f5f-8ec3-94f916989f59_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_e482fd3e54d44f02edd6d8c80d49dbe3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f011387-7f5c-5f5f-8ec3-94f916989f59/6f011387-7f5c-5f5f-8ec3-94f916989f59_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2372010,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_64b0463d078e2680d8e60ef9e35bf3f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f011387-7f5c-5f5f-8ec3-94f916989f59/6f011387-7f5c-5f5f-8ec3-94f916989f59_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2410181,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_12380cc53cf8efb9e2229e234acf48c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f011387-7f5c-5f5f-8ec3-94f916989f59/6f011387-7f5c-5f5f-8ec3-94f916989f59_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2624136,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_f45f049cad219e3e1e538e5eb0042221.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f011387-7f5c-5f5f-8ec3-94f916989f59/6f011387-7f5c-5f5f-8ec3-94f916989f59_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2245167,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/ee/51ee09bb2fd8a423f28e41cd0ab102ad/pa/PJ48616_ea3ab42f45e3339000fa640270ce8bca.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 218i Gran Coupe M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ48616%27 HTTP/1.1" 200 None
2026-03-30 10:48:57 [auto1.de] INFO: Saving data for PJ48616: {'created_time': 1774867737.549128, 'last_price_update_time': 1774867737.549138, 'auction_closing_time': 1774970189.0}
2026-03-30 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ48616') HTTP/1.1" 204 0
2026-03-30 10:48:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2fd7fa1-f9d6-557d-a473-71c36258e6be with identifier: SE03748
2026-03-30 10:48:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2fd7fa1-f9d6-557d-a473-71c36258e6be with identifier: SE03748
2026-03-30 10:48:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2fd7fa1-f9d6-557d-a473-71c36258e6be with identifier: SE03748 to the API
2026-03-30 10:48:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:32:59Z',
 'fuel_type': 'petrol',
 'id': 'e2fd7fa1-f9d6-557d-a473-71c36258e6be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE03748',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 181430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-30 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE03748%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [auto1.de] INFO: Saving data for SE03748: {'auction_closing_time': 1774971179.0, 'created_time': 1774380217.703524, 'last_price_update_time': 1774867738.001054}
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE03748') HTTP/1.1" 204 0
2026-03-30 10:48:58 [auto1.de] INFO: Found listing with ID: AE01122
2026-03-30 10:48:58 [auto1.de] INFO: Found listing with ID: FE15332
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE15332%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [auto1.de] INFO: Scrape type for FE15332: 1
2026-03-30 10:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PG46559> (referer: https://www.auto1.com/v1/car-details-view/PG46559/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:58 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 9494 | hits on page: 40
2026-03-30 10:48:58 [auto1.de] INFO: Found listing with ID: MY39780
2026-03-30 10:48:58 [auto1.de] INFO: Found listing with ID: GP33761
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP33761%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [auto1.de] INFO: Scrape type for GP33761: 1
2026-03-30 10:48:58 [auto1.de] INFO: Found listing with ID: CJ78489
2026-03-30 10:48:58 [auto1.de] INFO: Found listing with ID: AM79685
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM79685%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [auto1.de] INFO: Scrape type for AM79685: 1
2026-03-30 10:48:58 [auto1.de] INFO: Found listing with ID: LT55201
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT55201%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [auto1.de] INFO: Scrape type for LT55201: 1
2026-03-30 10:48:58 [auto1.de] INFO: Found listing with ID: BP11097
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP11097%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [auto1.de] INFO: Scrape type for BP11097: 1
2026-03-30 10:48:58 [auto1.de] INFO: Found listing with ID: UD05197
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD05197%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [auto1.de] INFO: Scrape type for UD05197: 1
2026-03-30 10:48:58 [auto1.de] INFO: Found listing with ID: ME64597
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME64597%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [auto1.de] INFO: Scrape type for ME64597: 1
2026-03-30 10:48:58 [auto1.de] INFO: Found listing with ID: DL76971
2026-03-30 10:48:58 [auto1.de] INFO: Found listing with ID: AZ54716
2026-03-30 10:48:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a9e75cd-f276-53a2-b81d-e62edc9230d4 with identifier: PG46559
2026-03-30 10:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a9e75cd-f276-53a2-b81d-e62edc9230d4 with scrape type 1
2026-03-30 10:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a9e75cd-f276-53a2-b81d-e62edc9230d4
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58b31eee51361f1d581f2bfc7fa430%252Fpa%252FPG46559_8f226152b7b42880e93affa282271d92.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_8f226152b7b42880e93affa282271d92.jpg already downloaded
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58b31eee51361f1d581f2bfc7fa430%252Fpa%252FPG46559_590f76e19d5a0f6ebb25835c4768707c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_590f76e19d5a0f6ebb25835c4768707c.jpg already downloaded
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58b31eee51361f1d581f2bfc7fa430%252Fpa%252FPG46559_2da35c77ec4ac883dc043c2f135e91fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_2da35c77ec4ac883dc043c2f135e91fa.jpg already downloaded
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58b31eee51361f1d581f2bfc7fa430%252Fpa%252FPG46559_e9427322d5399f841f337bb3ff4ea693.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_e9427322d5399f841f337bb3ff4ea693.jpg already downloaded
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58b31eee51361f1d581f2bfc7fa430%252Fpa%252FPG46559_424507f9edbb9b9a7b1b4f07b2e9d81c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_424507f9edbb9b9a7b1b4f07b2e9d81c.jpg already downloaded
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58b31eee51361f1d581f2bfc7fa430%252Fpa%252FPG46559_01cf934a9633011a11fc8252191c22ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_01cf934a9633011a11fc8252191c22ff.jpg already downloaded
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58b31eee51361f1d581f2bfc7fa430%252Fpa%252FPG46559_3d65e464cb7dc27973e8334880968938.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_3d65e464cb7dc27973e8334880968938.jpg already downloaded
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58b31eee51361f1d581f2bfc7fa430%252Fpa%252FPG46559_1eb50d2eed6a6a44d0c4232606cbc6e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_1eb50d2eed6a6a44d0c4232606cbc6e6.jpg already downloaded
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58b31eee51361f1d581f2bfc7fa430%252Fpa%252FPG46559_5d37e1250a0e1840ca2b44439b8ee21c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_5d37e1250a0e1840ca2b44439b8ee21c.jpg already downloaded
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58b31eee51361f1d581f2bfc7fa430%252Fpa%252FPG46559_4353028633c43f18cd1ca4ab4db07ae3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_4353028633c43f18cd1ca4ab4db07ae3.jpg already downloaded
2026-03-30 10:48:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a9e75cd-f276-53a2-b81d-e62edc9230d4, identifier: PG46559
2026-03-30 10:48:58 [auto1.de] INFO: Found listing with ID: DA24351
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA24351%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [auto1.de] INFO: Scrape type for DA24351: 1
2026-03-30 10:48:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a9e75cd-f276-53a2-b81d-e62edc9230d4 with identifier: PG46559
2026-03-30 10:48:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a9e75cd-f276-53a2-b81d-e62edc9230d4 with identifier: PG46559
2026-03-30 10:48:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a9e75cd-f276-53a2-b81d-e62edc9230d4 with identifier: PG46559 to the API
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PG46559>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:46:20Z',
 'fuel_type': 'petrol',
 'id': '4a9e75cd-f276-53a2-b81d-e62edc9230d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG46559',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 156452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_8f226152b7b42880e93affa282271d92.jpg',
                'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_590f76e19d5a0f6ebb25835c4768707c.jpg',
                'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_2da35c77ec4ac883dc043c2f135e91fa.jpg',
                'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_e9427322d5399f841f337bb3ff4ea693.jpg',
                'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_424507f9edbb9b9a7b1b4f07b2e9d81c.jpg',
                'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_01cf934a9633011a11fc8252191c22ff.jpg',
                'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_3d65e464cb7dc27973e8334880968938.jpg',
                'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_1eb50d2eed6a6a44d0c4232606cbc6e6.jpg',
                'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_5d37e1250a0e1840ca2b44439b8ee21c.jpg',
                'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_4353028633c43f18cd1ca4ab4db07ae3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9e75cd-f276-53a2-b81d-e62edc9230d4/4a9e75cd-f276-53a2-b81d-e62edc9230d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2586659,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_8f226152b7b42880e93affa282271d92.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9e75cd-f276-53a2-b81d-e62edc9230d4/4a9e75cd-f276-53a2-b81d-e62edc9230d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_590f76e19d5a0f6ebb25835c4768707c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9e75cd-f276-53a2-b81d-e62edc9230d4/4a9e75cd-f276-53a2-b81d-e62edc9230d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_2da35c77ec4ac883dc043c2f135e91fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9e75cd-f276-53a2-b81d-e62edc9230d4/4a9e75cd-f276-53a2-b81d-e62edc9230d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2314892,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_e9427322d5399f841f337bb3ff4ea693.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9e75cd-f276-53a2-b81d-e62edc9230d4/4a9e75cd-f276-53a2-b81d-e62edc9230d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_424507f9edbb9b9a7b1b4f07b2e9d81c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9e75cd-f276-53a2-b81d-e62edc9230d4/4a9e75cd-f276-53a2-b81d-e62edc9230d4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2419125,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_01cf934a9633011a11fc8252191c22ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9e75cd-f276-53a2-b81d-e62edc9230d4/4a9e75cd-f276-53a2-b81d-e62edc9230d4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2045935,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_3d65e464cb7dc27973e8334880968938.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9e75cd-f276-53a2-b81d-e62edc9230d4/4a9e75cd-f276-53a2-b81d-e62edc9230d4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2345557,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_1eb50d2eed6a6a44d0c4232606cbc6e6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9e75cd-f276-53a2-b81d-e62edc9230d4/4a9e75cd-f276-53a2-b81d-e62edc9230d4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2714836,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_5d37e1250a0e1840ca2b44439b8ee21c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a9e75cd-f276-53a2-b81d-e62edc9230d4/4a9e75cd-f276-53a2-b81d-e62edc9230d4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58b31eee51361f1d581f2bfc7fa430/pa/PG46559_4353028633c43f18cd1ca4ab4db07ae3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2017}
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG46559%27 HTTP/1.1" 200 None
2026-03-30 10:48:58 [auto1.de] INFO: Saving data for PG46559: {'created_time': 1774867738.871374, 'last_price_update_time': 1774867738.871387, 'auction_closing_time': 1774971980.0}
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG46559') HTTP/1.1" 204 0
2026-03-30 10:48:58 [auto1.de] INFO: Found listing with ID: XC24225
2026-03-30 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC24225%27 HTTP/1.1" 200 None
2026-03-30 10:48:59 [auto1.de] INFO: Scrape type for XC24225: 1
2026-03-30 10:48:59 [auto1.de] INFO: Found listing with ID: UZ72650
2026-03-30 10:48:59 [auto1.de] INFO: Found listing with ID: YB03135
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB03135%27 HTTP/1.1" 200 None
2026-03-30 10:48:59 [auto1.de] INFO: Scrape type for YB03135: 2
2026-03-30 10:48:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dce14d9-617f-541a-bd10-25ed2def4ed2 with identifier: YB03135
2026-03-30 10:48:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dce14d9-617f-541a-bd10-25ed2def4ed2 with scrape type 2
2026-03-30 10:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dce14d9-617f-541a-bd10-25ed2def4ed2 with scrape type 2
2026-03-30 10:48:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9dce14d9-617f-541a-bd10-25ed2def4ed2, identifier: YB03135
2026-03-30 10:48:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9dce14d9-617f-541a-bd10-25ed2def4ed2 with identifier: YB03135
2026-03-30 10:48:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9dce14d9-617f-541a-bd10-25ed2def4ed2 with identifier: YB03135
2026-03-30 10:48:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9dce14d9-617f-541a-bd10-25ed2def4ed2 with identifier: YB03135 to the API
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:11:38Z',
 'fuel_type': 'petrol',
 'id': '9dce14d9-617f-541a-bd10-25ed2def4ed2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB03135',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 36056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-24',
 'seller_name': None,
 'title': 'Hyundai ix20 1.6 Space blue',
 'transmission': 'manual',
 'trim': 'Space blue',
 'year': 2019}
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB03135%27 HTTP/1.1" 200 None
2026-03-30 10:48:59 [auto1.de] INFO: Saving data for YB03135: {'auction_closing_time': 1774969898.0, 'created_time': 1773305415.855208, 'last_price_update_time': 1774867739.461802}
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB03135') HTTP/1.1" 204 0
2026-03-30 10:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG68690/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:48:59 [auto1.de] INFO: Found listing with ID: LT57344
2026-03-30 10:48:59 [auto1.de] INFO: Found listing with ID: LC32113
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC32113%27 HTTP/1.1" 200 None
2026-03-30 10:48:59 [auto1.de] INFO: Scrape type for LC32113: 1
2026-03-30 10:48:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:48:59 [auto1.de] INFO: Found listing with ID: SW73821
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW73821%27 HTTP/1.1" 200 None
2026-03-30 10:48:59 [auto1.de] INFO: Scrape type for SW73821: 1
2026-03-30 10:48:59 [auto1.de] INFO: Found listing with ID: SX71911
2026-03-30 10:48:59 [auto1.de] INFO: Found listing with ID: RS78128
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS78128%27 HTTP/1.1" 200 None
2026-03-30 10:48:59 [auto1.de] INFO: Scrape type for RS78128: 1
2026-03-30 10:48:59 [auto1.de] INFO: Found listing with ID: UN38218
2026-03-30 10:48:59 [auto1.de] INFO: Found listing with ID: RP83269
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP83269%27 HTTP/1.1" 200 None
2026-03-30 10:48:59 [auto1.de] INFO: Scrape type for RP83269: 2
2026-03-30 10:48:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b601f4c9-b4af-5886-b057-13523a99a44a with identifier: RP83269
2026-03-30 10:48:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b601f4c9-b4af-5886-b057-13523a99a44a with scrape type 2
2026-03-30 10:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b601f4c9-b4af-5886-b057-13523a99a44a with scrape type 2
2026-03-30 10:48:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b601f4c9-b4af-5886-b057-13523a99a44a, identifier: RP83269
2026-03-30 10:48:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b601f4c9-b4af-5886-b057-13523a99a44a with identifier: RP83269
2026-03-30 10:48:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b601f4c9-b4af-5886-b057-13523a99a44a with identifier: RP83269
2026-03-30 10:48:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b601f4c9-b4af-5886-b057-13523a99a44a with identifier: RP83269 to the API
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:48:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:09:27Z',
 'fuel_type': 'diesel',
 'id': 'b601f4c9-b4af-5886-b057-13523a99a44a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP83269',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 157614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP83269%27 HTTP/1.1" 200 None
2026-03-30 10:48:59 [auto1.de] INFO: Saving data for RP83269: {'auction_closing_time': 1774969767.0, 'created_time': 1773302502.109937, 'last_price_update_time': 1774867739.999641}
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP83269') HTTP/1.1" 204 0
2026-03-30 10:49:00 [auto1.de] INFO: Found listing with ID: LX14183
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX14183%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [auto1.de] INFO: Scrape type for LX14183: 1
2026-03-30 10:49:00 [auto1.de] INFO: Found listing with ID: AS37884
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS37884%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [auto1.de] INFO: Scrape type for AS37884: 2
2026-03-30 10:49:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33ee78e9-a189-5121-8ffc-950c8b32d96c with identifier: AS37884
2026-03-30 10:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33ee78e9-a189-5121-8ffc-950c8b32d96c with scrape type 2
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33ee78e9-a189-5121-8ffc-950c8b32d96c with scrape type 2
2026-03-30 10:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33ee78e9-a189-5121-8ffc-950c8b32d96c, identifier: AS37884
2026-03-30 10:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA25457/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33ee78e9-a189-5121-8ffc-950c8b32d96c with identifier: AS37884
2026-03-30 10:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33ee78e9-a189-5121-8ffc-950c8b32d96c with identifier: AS37884
2026-03-30 10:49:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33ee78e9-a189-5121-8ffc-950c8b32d96c with identifier: AS37884 to the API
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-31T15:59:50Z',
 'fuel_type': 'diesel',
 'id': '33ee78e9-a189-5121-8ffc-950c8b32d96c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS37884',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 103117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-05',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS37884%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [auto1.de] INFO: Saving data for AS37884: {'auction_closing_time': 1774972790.0, 'created_time': 1773660151.451054, 'last_price_update_time': 1774867740.529207}
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS37884') HTTP/1.1" 204 0
2026-03-30 10:49:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:00 [auto1.de] INFO: Found listing with ID: GK60311
2026-03-30 10:49:00 [auto1.de] INFO: Found listing with ID: FE05241
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE05241%27 HTTP/1.1" 200 None
2026-03-30 10:49:00 [auto1.de] INFO: Scrape type for FE05241: 2
2026-03-30 10:49:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c96c0e1-ab5a-5a75-8b42-db511a576e3c with identifier: FE05241
2026-03-30 10:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c96c0e1-ab5a-5a75-8b42-db511a576e3c with scrape type 2
2026-03-30 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c96c0e1-ab5a-5a75-8b42-db511a576e3c with scrape type 2
2026-03-30 10:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c96c0e1-ab5a-5a75-8b42-db511a576e3c, identifier: FE05241
2026-03-30 10:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c96c0e1-ab5a-5a75-8b42-db511a576e3c with identifier: FE05241
2026-03-30 10:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c96c0e1-ab5a-5a75-8b42-db511a576e3c with identifier: FE05241
2026-03-30 10:49:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c96c0e1-ab5a-5a75-8b42-db511a576e3c with identifier: FE05241 to the API
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:46:09Z',
 'fuel_type': 'petrol',
 'id': '0c96c0e1-ab5a-5a75-8b42-db511a576e3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE05241',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 27334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-11',
 'seller_name': None,
 'title': 'Audi A5 40 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE05241%27 HTTP/1.1" 200 None
2026-03-30 10:49:01 [auto1.de] INFO: Saving data for FE05241: {'auction_closing_time': 1774971969.0, 'created_time': 1774293015.22472, 'last_price_update_time': 1774867741.107017}
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE05241') HTTP/1.1" 204 0
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: ZJ35248
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ35248%27 HTTP/1.1" 200 None
2026-03-30 10:49:01 [auto1.de] INFO: Scrape type for ZJ35248: 1
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: DM81124
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM81124%27 HTTP/1.1" 200 None
2026-03-30 10:49:01 [auto1.de] INFO: Scrape type for DM81124: 1
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: GG04913
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: TW68538
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: TA06372
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: TR92367
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: XS59646
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: NU64922
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU64922%27 HTTP/1.1" 200 None
2026-03-30 10:49:01 [auto1.de] INFO: Scrape type for NU64922: 1
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: HK95195
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK95195%27 HTTP/1.1" 200 None
2026-03-30 10:49:01 [auto1.de] INFO: Scrape type for HK95195: 2
2026-03-30 10:49:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4d53145-22ba-5f9b-8750-a7861726bf5c with identifier: HK95195
2026-03-30 10:49:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4d53145-22ba-5f9b-8750-a7861726bf5c with scrape type 2
2026-03-30 10:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4d53145-22ba-5f9b-8750-a7861726bf5c with scrape type 2
2026-03-30 10:49:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4d53145-22ba-5f9b-8750-a7861726bf5c, identifier: HK95195
2026-03-30 10:49:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4d53145-22ba-5f9b-8750-a7861726bf5c with identifier: HK95195
2026-03-30 10:49:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4d53145-22ba-5f9b-8750-a7861726bf5c with identifier: HK95195
2026-03-30 10:49:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4d53145-22ba-5f9b-8750-a7861726bf5c with identifier: HK95195 to the API
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:06:03Z',
 'fuel_type': 'petrol',
 'id': 'f4d53145-22ba-5f9b-8750-a7861726bf5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK95195',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 33270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-10',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2023}
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK95195%27 HTTP/1.1" 200 None
2026-03-30 10:49:01 [auto1.de] INFO: Saving data for HK95195: {'auction_closing_time': 1774969563.0, 'created_time': 1773688912.584871, 'last_price_update_time': 1774867741.674891}
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK95195') HTTP/1.1" 204 0
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: AX17463
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX17463%27 HTTP/1.1" 200 None
2026-03-30 10:49:01 [auto1.de] INFO: Scrape type for AX17463: 1
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: EZ95690
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ95690%27 HTTP/1.1" 200 None
2026-03-30 10:49:01 [auto1.de] INFO: Scrape type for EZ95690: 1
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: BS69347
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS69347%27 HTTP/1.1" 200 None
2026-03-30 10:49:01 [auto1.de] INFO: Scrape type for BS69347: 1
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: WA15492
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA15492%27 HTTP/1.1" 200 None
2026-03-30 10:49:01 [auto1.de] INFO: Scrape type for WA15492: 1
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: VW06813
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: RA14894
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA14894%27 HTTP/1.1" 200 None
2026-03-30 10:49:01 [auto1.de] INFO: Scrape type for RA14894: 1
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: DZ59899
2026-03-30 10:49:01 [auto1.de] INFO: Found listing with ID: BN22147
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN22147%27 HTTP/1.1" 200 None
2026-03-30 10:49:01 [auto1.de] INFO: Scrape type for BN22147: 2
2026-03-30 10:49:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d95ae61-832c-5a7c-a9be-3e190dcae4cf with identifier: BN22147
2026-03-30 10:49:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d95ae61-832c-5a7c-a9be-3e190dcae4cf with scrape type 2
2026-03-30 10:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d95ae61-832c-5a7c-a9be-3e190dcae4cf with scrape type 2
2026-03-30 10:49:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d95ae61-832c-5a7c-a9be-3e190dcae4cf, identifier: BN22147
2026-03-30 10:49:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d95ae61-832c-5a7c-a9be-3e190dcae4cf with identifier: BN22147
2026-03-30 10:49:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d95ae61-832c-5a7c-a9be-3e190dcae4cf with identifier: BN22147
2026-03-30 10:49:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d95ae61-832c-5a7c-a9be-3e190dcae4cf with identifier: BN22147 to the API
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:03:25Z',
 'fuel_type': 'petrol',
 'id': '2d95ae61-832c-5a7c-a9be-3e190dcae4cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN22147',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 70996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-30',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2005}
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN22147%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [auto1.de] INFO: Saving data for BN22147: {'auction_closing_time': 1774969405.0, 'created_time': 1774294477.128303, 'last_price_update_time': 1774867742.336299}
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN22147') HTTP/1.1" 204 0
2026-03-30 10:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS69708/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:02 [auto1.de] INFO: Found listing with ID: RU77143
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU77143%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [auto1.de] INFO: Scrape type for RU77143: 2
2026-03-30 10:49:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2f15d18-2044-5eb5-bc1f-078b8776d947 with identifier: RU77143
2026-03-30 10:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2f15d18-2044-5eb5-bc1f-078b8776d947 with scrape type 2
2026-03-30 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2f15d18-2044-5eb5-bc1f-078b8776d947 with scrape type 2
2026-03-30 10:49:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2f15d18-2044-5eb5-bc1f-078b8776d947, identifier: RU77143
2026-03-30 10:49:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2f15d18-2044-5eb5-bc1f-078b8776d947 with identifier: RU77143
2026-03-30 10:49:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2f15d18-2044-5eb5-bc1f-078b8776d947 with identifier: RU77143
2026-03-30 10:49:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2f15d18-2044-5eb5-bc1f-078b8776d947 with identifier: RU77143 to the API
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:24:50Z',
 'fuel_type': 'diesel',
 'id': 'e2f15d18-2044-5eb5-bc1f-078b8776d947',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU77143',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 263614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-20',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU77143%27 HTTP/1.1" 200 None
2026-03-30 10:49:02 [auto1.de] INFO: Saving data for RU77143: {'auction_closing_time': 1774970690.0, 'created_time': 1773381007.42797, 'last_price_update_time': 1774867742.849696}
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU77143') HTTP/1.1" 204 0
2026-03-30 10:49:02 [auto1.de] INFO: Found listing with ID: BG30699
2026-03-30 10:49:02 [auto1.de] INFO: Found listing with ID: SC02628
2026-03-30 10:49:02 [auto1.de] INFO: Found listing with ID: ED20045
2026-03-30 10:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZJ98470/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:03 [scrapy.extensions.logstats] INFO: Crawled 481 pages (at 22 pages/min), scraped 366 items (at 28 items/min)
2026-03-30 10:49:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-30 10:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT65202/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LN61761/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT23307/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC44441/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TM99691/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:20 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 9496 | hits on page: 40
2026-03-30 10:49:20 [auto1.de] INFO: Found listing with ID: SC02628
2026-03-30 10:49:20 [auto1.de] INFO: Found listing with ID: ED20045
2026-03-30 10:49:20 [auto1.de] INFO: Found listing with ID: ZE59650
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE59650%27 HTTP/1.1" 200 None
2026-03-30 10:49:21 [auto1.de] INFO: Scrape type for ZE59650: 1
2026-03-30 10:49:21 [auto1.de] INFO: Found listing with ID: CJ42991
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ42991%27 HTTP/1.1" 200 None
2026-03-30 10:49:21 [auto1.de] INFO: Scrape type for CJ42991: 1
2026-03-30 10:49:21 [auto1.de] INFO: Found listing with ID: KN84771
2026-03-30 10:49:21 [auto1.de] INFO: Found listing with ID: JA55411
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA55411%27 HTTP/1.1" 200 None
2026-03-30 10:49:21 [auto1.de] INFO: Scrape type for JA55411: 2
2026-03-30 10:49:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75ab1b41-d378-5c99-b2a4-e06b6afed920 with identifier: JA55411
2026-03-30 10:49:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75ab1b41-d378-5c99-b2a4-e06b6afed920 with scrape type 2
2026-03-30 10:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75ab1b41-d378-5c99-b2a4-e06b6afed920 with scrape type 2
2026-03-30 10:49:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75ab1b41-d378-5c99-b2a4-e06b6afed920, identifier: JA55411
2026-03-30 10:49:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75ab1b41-d378-5c99-b2a4-e06b6afed920 with identifier: JA55411
2026-03-30 10:49:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75ab1b41-d378-5c99-b2a4-e06b6afed920 with identifier: JA55411
2026-03-30 10:49:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75ab1b41-d378-5c99-b2a4-e06b6afed920 with identifier: JA55411 to the API
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:23:12Z',
 'fuel_type': 'diesel',
 'id': '75ab1b41-d378-5c99-b2a4-e06b6afed920',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA55411',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 206131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-12',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA55411%27 HTTP/1.1" 200 None
2026-03-30 10:49:21 [auto1.de] INFO: Saving data for JA55411: {'auction_closing_time': 1774970592.0, 'created_time': 1773773084.023211, 'last_price_update_time': 1774867761.464429}
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA55411') HTTP/1.1" 204 0
2026-03-30 10:49:21 [auto1.de] INFO: Found listing with ID: FP87912
2026-03-30 10:49:21 [auto1.de] INFO: Found listing with ID: CA83659
2026-03-30 10:49:21 [auto1.de] INFO: Found listing with ID: SZ20941
2026-03-30 10:49:21 [auto1.de] INFO: Found listing with ID: EH54966
2026-03-30 10:49:21 [auto1.de] INFO: Found listing with ID: BB98508
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98508%27 HTTP/1.1" 200 None
2026-03-30 10:49:21 [auto1.de] INFO: Scrape type for BB98508: 2
2026-03-30 10:49:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3014cef-c2f0-5c00-bf69-b8c6e9433806 with identifier: BB98508
2026-03-30 10:49:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3014cef-c2f0-5c00-bf69-b8c6e9433806 with scrape type 2
2026-03-30 10:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3014cef-c2f0-5c00-bf69-b8c6e9433806 with scrape type 2
2026-03-30 10:49:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3014cef-c2f0-5c00-bf69-b8c6e9433806, identifier: BB98508
2026-03-30 10:49:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3014cef-c2f0-5c00-bf69-b8c6e9433806 with identifier: BB98508
2026-03-30 10:49:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3014cef-c2f0-5c00-bf69-b8c6e9433806 with identifier: BB98508
2026-03-30 10:49:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3014cef-c2f0-5c00-bf69-b8c6e9433806 with identifier: BB98508 to the API
2026-03-30 10:49:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-31T15:30:41Z',
 'fuel_type': 'petrol',
 'id': 'a3014cef-c2f0-5c00-bf69-b8c6e9433806',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB98508',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 85246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-07',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2021}
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98508%27 HTTP/1.1" 200 None
2026-03-30 10:49:22 [auto1.de] INFO: Saving data for BB98508: {'auction_closing_time': 1774971041.0, 'created_time': 1774522407.517418, 'last_price_update_time': 1774867762.141707}
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB98508') HTTP/1.1" 204 0
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: VH26338
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: MH90700
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH90700%27 HTTP/1.1" 200 None
2026-03-30 10:49:22 [auto1.de] INFO: Scrape type for MH90700: 2
2026-03-30 10:49:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dacf1918-db19-5a63-be5c-a9b7bd31ad84 with identifier: MH90700
2026-03-30 10:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dacf1918-db19-5a63-be5c-a9b7bd31ad84 with scrape type 2
2026-03-30 10:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dacf1918-db19-5a63-be5c-a9b7bd31ad84 with scrape type 2
2026-03-30 10:49:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dacf1918-db19-5a63-be5c-a9b7bd31ad84, identifier: MH90700
2026-03-30 10:49:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dacf1918-db19-5a63-be5c-a9b7bd31ad84 with identifier: MH90700
2026-03-30 10:49:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dacf1918-db19-5a63-be5c-a9b7bd31ad84 with identifier: MH90700
2026-03-30 10:49:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dacf1918-db19-5a63-be5c-a9b7bd31ad84 with identifier: MH90700 to the API
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:44:28Z',
 'fuel_type': 'petrol',
 'id': 'dacf1918-db19-5a63-be5c-a9b7bd31ad84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH90700',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 39276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-06',
 'seller_name': None,
 'title': 'Renault Clio 1.3 TCe Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2019}
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH90700%27 HTTP/1.1" 200 None
2026-03-30 10:49:22 [auto1.de] INFO: Saving data for MH90700: {'auction_closing_time': 1774971868.0, 'created_time': 1774294104.587346, 'last_price_update_time': 1774867762.580062}
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH90700') HTTP/1.1" 204 0
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: YY96342
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY96342%27 HTTP/1.1" 200 None
2026-03-30 10:49:22 [auto1.de] INFO: Scrape type for YY96342: 1
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: ZN86582
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN86582%27 HTTP/1.1" 200 None
2026-03-30 10:49:22 [auto1.de] INFO: Scrape type for ZN86582: 1
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: AN56008
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN56008%27 HTTP/1.1" 200 None
2026-03-30 10:49:22 [auto1.de] INFO: Scrape type for AN56008: 1
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: RG93335
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: TL54182
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: WG19092
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG19092%27 HTTP/1.1" 200 None
2026-03-30 10:49:22 [auto1.de] INFO: Scrape type for WG19092: 1
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: JU04536
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU04536%27 HTTP/1.1" 200 None
2026-03-30 10:49:22 [auto1.de] INFO: Scrape type for JU04536: 1
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: JB73143
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: UY49160
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: TH94895
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: RE10488
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: NY45560
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45560%27 HTTP/1.1" 200 None
2026-03-30 10:49:22 [auto1.de] INFO: Scrape type for NY45560: 1
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: ZB25912
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB25912%27 HTTP/1.1" 200 None
2026-03-30 10:49:22 [auto1.de] INFO: Scrape type for ZB25912: 1
2026-03-30 10:49:22 [auto1.de] INFO: Found listing with ID: KM19595
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM19595%27 HTTP/1.1" 200 None
2026-03-30 10:49:22 [auto1.de] INFO: Scrape type for KM19595: 2
2026-03-30 10:49:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2c21852-22ab-52f7-8150-b0e3cb2ae6dc with identifier: KM19595
2026-03-30 10:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2c21852-22ab-52f7-8150-b0e3cb2ae6dc with scrape type 2
2026-03-30 10:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2c21852-22ab-52f7-8150-b0e3cb2ae6dc with scrape type 2
2026-03-30 10:49:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2c21852-22ab-52f7-8150-b0e3cb2ae6dc, identifier: KM19595
2026-03-30 10:49:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2c21852-22ab-52f7-8150-b0e3cb2ae6dc with identifier: KM19595
2026-03-30 10:49:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2c21852-22ab-52f7-8150-b0e3cb2ae6dc with identifier: KM19595
2026-03-30 10:49:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2c21852-22ab-52f7-8150-b0e3cb2ae6dc with identifier: KM19595 to the API
2026-03-30 10:49:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 239,
 'expiration_date': '2026-03-31T15:55:10Z',
 'fuel_type': 'diesel',
 'id': 'c2c21852-22ab-52f7-8150-b0e3cb2ae6dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM19595',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 113797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-22',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 BiTDI RS 4x4',
 'transmission': 'automatic',
 'trim': 'RS 4x4',
 'year': 2020}
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM19595%27 HTTP/1.1" 200 None
2026-03-30 10:49:23 [auto1.de] INFO: Saving data for KM19595: {'auction_closing_time': 1774972510.0, 'created_time': 1774294188.729616, 'last_price_update_time': 1774867763.15755}
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM19595') HTTP/1.1" 204 0
2026-03-30 10:49:23 [auto1.de] INFO: Found listing with ID: XD17541
2026-03-30 10:49:23 [auto1.de] INFO: Found listing with ID: GL13033
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL13033%27 HTTP/1.1" 200 None
2026-03-30 10:49:23 [auto1.de] INFO: Scrape type for GL13033: 2
2026-03-30 10:49:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fc132a1-c712-5d11-8291-22a38a18cc19 with identifier: GL13033
2026-03-30 10:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fc132a1-c712-5d11-8291-22a38a18cc19 with scrape type 2
2026-03-30 10:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fc132a1-c712-5d11-8291-22a38a18cc19 with scrape type 2
2026-03-30 10:49:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fc132a1-c712-5d11-8291-22a38a18cc19, identifier: GL13033
2026-03-30 10:49:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fc132a1-c712-5d11-8291-22a38a18cc19 with identifier: GL13033
2026-03-30 10:49:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fc132a1-c712-5d11-8291-22a38a18cc19 with identifier: GL13033
2026-03-30 10:49:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fc132a1-c712-5d11-8291-22a38a18cc19 with identifier: GL13033 to the API
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:58:31Z',
 'fuel_type': 'diesel',
 'id': '4fc132a1-c712-5d11-8291-22a38a18cc19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL13033',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 197656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-22',
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 Blue-HDi Business-Line',
 'transmission': 'manual',
 'trim': 'Business-Line',
 'year': 2015}
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL13033%27 HTTP/1.1" 200 None
2026-03-30 10:49:23 [auto1.de] INFO: Saving data for GL13033: {'auction_closing_time': 1774972711.0, 'created_time': 1774291900.640152, 'last_price_update_time': 1774867763.754185}
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL13033') HTTP/1.1" 204 0
2026-03-30 10:49:23 [auto1.de] INFO: Found listing with ID: KL67812
2026-03-30 10:49:23 [auto1.de] INFO: Found listing with ID: GH56807
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH56807%27 HTTP/1.1" 200 None
2026-03-30 10:49:23 [auto1.de] INFO: Scrape type for GH56807: 2
2026-03-30 10:49:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2434ec9-72d9-50f9-8ca3-c97dbfeece43 with identifier: GH56807
2026-03-30 10:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2434ec9-72d9-50f9-8ca3-c97dbfeece43 with scrape type 2
2026-03-30 10:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2434ec9-72d9-50f9-8ca3-c97dbfeece43 with scrape type 2
2026-03-30 10:49:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2434ec9-72d9-50f9-8ca3-c97dbfeece43, identifier: GH56807
2026-03-30 10:49:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2434ec9-72d9-50f9-8ca3-c97dbfeece43 with identifier: GH56807
2026-03-30 10:49:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2434ec9-72d9-50f9-8ca3-c97dbfeece43 with identifier: GH56807
2026-03-30 10:49:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2434ec9-72d9-50f9-8ca3-c97dbfeece43 with identifier: GH56807 to the API
2026-03-30 10:49:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:30:27Z',
 'fuel_type': 'diesel',
 'id': 'e2434ec9-72d9-50f9-8ca3-c97dbfeece43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH56807',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 179809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-16',
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH56807%27 HTTP/1.1" 200 None
2026-03-30 10:49:24 [auto1.de] INFO: Saving data for GH56807: {'auction_closing_time': 1774971027.0, 'created_time': 1774294816.118024, 'last_price_update_time': 1774867764.670413}
2026-03-30 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH56807') HTTP/1.1" 204 0
2026-03-30 10:49:24 [auto1.de] INFO: Found listing with ID: TG88062
2026-03-30 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG88062%27 HTTP/1.1" 200 None
2026-03-30 10:49:24 [auto1.de] INFO: Scrape type for TG88062: 2
2026-03-30 10:49:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7a82d61-984b-5d72-a0dd-61f375f30b05 with identifier: TG88062
2026-03-30 10:49:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7a82d61-984b-5d72-a0dd-61f375f30b05 with scrape type 2
2026-03-30 10:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7a82d61-984b-5d72-a0dd-61f375f30b05 with scrape type 2
2026-03-30 10:49:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7a82d61-984b-5d72-a0dd-61f375f30b05, identifier: TG88062
2026-03-30 10:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FE15332/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7a82d61-984b-5d72-a0dd-61f375f30b05 with identifier: TG88062
2026-03-30 10:49:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7a82d61-984b-5d72-a0dd-61f375f30b05 with identifier: TG88062
2026-03-30 10:49:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7a82d61-984b-5d72-a0dd-61f375f30b05 with identifier: TG88062 to the API
2026-03-30 10:49:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-31T15:04:35Z',
 'fuel_type': 'diesel',
 'id': 'c7a82d61-984b-5d72-a0dd-61f375f30b05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG88062',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 174243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-22',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Dream Team",
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2015}
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG88062%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [auto1.de] INFO: Saving data for TG88062: {'auction_closing_time': 1774969475.0, 'created_time': 1774640127.778644, 'last_price_update_time': 1774867765.135152}
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG88062') HTTP/1.1" 204 0
2026-03-30 10:49:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: AG12776
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: NG10221
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG10221%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [auto1.de] INFO: Scrape type for NG10221: 2
2026-03-30 10:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2717c145-1d62-520f-9847-00fdf35aaef0 with identifier: NG10221
2026-03-30 10:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2717c145-1d62-520f-9847-00fdf35aaef0 with scrape type 2
2026-03-30 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2717c145-1d62-520f-9847-00fdf35aaef0 with scrape type 2
2026-03-30 10:49:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2717c145-1d62-520f-9847-00fdf35aaef0, identifier: NG10221
2026-03-30 10:49:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2717c145-1d62-520f-9847-00fdf35aaef0 with identifier: NG10221
2026-03-30 10:49:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2717c145-1d62-520f-9847-00fdf35aaef0 with identifier: NG10221
2026-03-30 10:49:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2717c145-1d62-520f-9847-00fdf35aaef0 with identifier: NG10221 to the API
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:40:54Z',
 'fuel_type': 'diesel',
 'id': '2717c145-1d62-520f-9847-00fdf35aaef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG10221',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 145040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-22',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG10221%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [auto1.de] INFO: Saving data for NG10221: {'auction_closing_time': 1774971654.0, 'created_time': 1774608333.001277, 'last_price_update_time': 1774867765.572539}
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG10221') HTTP/1.1" 204 0
2026-03-30 10:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG68690> (referer: https://www.auto1.com/v1/car-details-view/VG68690/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: UU82160
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: XA81988
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA81988%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [auto1.de] INFO: Scrape type for XA81988: 1
2026-03-30 10:49:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: PF77669
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: KZ40910
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: LV20570
2026-03-30 10:49:25 [auto1.de] INFO: Found listing with ID: MD36296
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD36296%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [auto1.de] INFO: Scrape type for MD36296: 1
2026-03-30 10:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43730a0e-12a6-5edb-bcc2-fee097bc50c4 with identifier: VG68690
2026-03-30 10:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43730a0e-12a6-5edb-bcc2-fee097bc50c4 with scrape type 1
2026-03-30 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43730a0e-12a6-5edb-bcc2-fee097bc50c4
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_7182580a141b37771d590fcc1ebdbed0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_7182580a141b37771d590fcc1ebdbed0.jpg not downloaded yet
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_2085f8bc08812ccfe836d89fdb165640.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_2085f8bc08812ccfe836d89fdb165640.jpg not downloaded yet
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_018289463fc8c85dd4187320803f5002.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_018289463fc8c85dd4187320803f5002.jpg not downloaded yet
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_0d9fb2c0c1362ba7d4b2dcb2335c1981.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_0d9fb2c0c1362ba7d4b2dcb2335c1981.jpg not downloaded yet
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_a538e791169c211d6b68233d43a4e159.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_a538e791169c211d6b68233d43a4e159.jpg not downloaded yet
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_2bf8ad31e5561985ea90c461632ee3ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_2bf8ad31e5561985ea90c461632ee3ca.jpg not downloaded yet
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_52555ccc17d1bc49e234b4482f0bee4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_52555ccc17d1bc49e234b4482f0bee4d.jpg not downloaded yet
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_d72e9e913df2efe3bbebcc6936a8a9bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_d72e9e913df2efe3bbebcc6936a8a9bb.jpg not downloaded yet
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_7bd0220f02f9f0961421ec310e63bcd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_7bd0220f02f9f0961421ec310e63bcd1.jpg not downloaded yet
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_fe3fd9196dad6001252bf20028a7702d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_fe3fd9196dad6001252bf20028a7702d.jpg not downloaded yet
2026-03-30 10:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BG36270/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ93142> (referer: https://www.auto1.com/v1/car-details-view/KJ93142/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_fe3fd9196dad6001252bf20028a7702d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 728faed9-f9d6-5254-b6ca-95de9081257b with identifier: KJ93142
2026-03-30 10:49:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 728faed9-f9d6-5254-b6ca-95de9081257b with scrape type 1
2026-03-30 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 728faed9-f9d6-5254-b6ca-95de9081257b
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa6%252F14a6d7354f514a55f493e1bcf94e2ae0%252Fpa%252FKJ93142_28667c9a5922fec7aa0b462b35dbba5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_28667c9a5922fec7aa0b462b35dbba5b.jpg not downloaded yet
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa6%252F14a6d7354f514a55f493e1bcf94e2ae0%252Fpa%252FKJ93142_b04e489aa85d4e284af979dfb86658ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_b04e489aa85d4e284af979dfb86658ee.jpg not downloaded yet
2026-03-30 10:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC24225/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa6%252F14a6d7354f514a55f493e1bcf94e2ae0%252Fpa%252FKJ93142_d1799a7f757c106d9392d44c329635c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_d1799a7f757c106d9392d44c329635c1.jpg not downloaded yet
2026-03-30 10:49:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_d72e9e913df2efe3bbebcc6936a8a9bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a32410>
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_fe3fd9196dad6001252bf20028a7702d.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_fe3fd9196dad6001252bf20028a7702d.jpg saved to cache
2026-03-30 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43730a0e-12a6-5edb-bcc2-fee097bc50c4
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa6%252F14a6d7354f514a55f493e1bcf94e2ae0%252Fpa%252FKJ93142_b8acd7d00cd568ab30b1b5bd6ec78190.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_b8acd7d00cd568ab30b1b5bd6ec78190.jpg not downloaded yet
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa6%252F14a6d7354f514a55f493e1bcf94e2ae0%252Fpa%252FKJ93142_e36fdd98bf16ddf2a0dbda340dd6cf49.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_e36fdd98bf16ddf2a0dbda340dd6cf49.jpg not downloaded yet
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0a010>
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_d72e9e913df2efe3bbebcc6936a8a9bb.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_d72e9e913df2efe3bbebcc6936a8a9bb.jpg saved to cache
2026-03-30 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43730a0e-12a6-5edb-bcc2-fee097bc50c4
2026-03-30 10:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_7bd0220f02f9f0961421ec310e63bcd1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_28667c9a5922fec7aa0b462b35dbba5b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_b04e489aa85d4e284af979dfb86658ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f129d0>
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_7bd0220f02f9f0961421ec310e63bcd1.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_7bd0220f02f9f0961421ec310e63bcd1.jpg saved to cache
2026-03-30 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43730a0e-12a6-5edb-bcc2-fee097bc50c4
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb2850>
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728faed9-f9d6-5254-b6ca-95de9081257b/728faed9-f9d6-5254-b6ca-95de9081257b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa6%252F14a6d7354f514a55f493e1bcf94e2ae0%252Fpa%252FKJ93142_28667c9a5922fec7aa0b462b35dbba5b.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_28667c9a5922fec7aa0b462b35dbba5b.jpg saved to cache
2026-03-30 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 728faed9-f9d6-5254-b6ca-95de9081257b
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b2f890>
2026-03-30 10:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728faed9-f9d6-5254-b6ca-95de9081257b/728faed9-f9d6-5254-b6ca-95de9081257b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa6%252F14a6d7354f514a55f493e1bcf94e2ae0%252Fpa%252FKJ93142_b04e489aa85d4e284af979dfb86658ee.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_b04e489aa85d4e284af979dfb86658ee.jpg saved to cache
2026-03-30 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 728faed9-f9d6-5254-b6ca-95de9081257b
2026-03-30 10:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_e36fdd98bf16ddf2a0dbda340dd6cf49.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_b8acd7d00cd568ab30b1b5bd6ec78190.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_d1799a7f757c106d9392d44c329635c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b08a90>
2026-03-30 10:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728faed9-f9d6-5254-b6ca-95de9081257b/728faed9-f9d6-5254-b6ca-95de9081257b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa6%252F14a6d7354f514a55f493e1bcf94e2ae0%252Fpa%252FKJ93142_e36fdd98bf16ddf2a0dbda340dd6cf49.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_e36fdd98bf16ddf2a0dbda340dd6cf49.jpg saved to cache
2026-03-30 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 728faed9-f9d6-5254-b6ca-95de9081257b
2026-03-30 10:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e69550>
2026-03-30 10:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728faed9-f9d6-5254-b6ca-95de9081257b/728faed9-f9d6-5254-b6ca-95de9081257b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa6%252F14a6d7354f514a55f493e1bcf94e2ae0%252Fpa%252FKJ93142_b8acd7d00cd568ab30b1b5bd6ec78190.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_b8acd7d00cd568ab30b1b5bd6ec78190.jpg saved to cache
2026-03-30 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 728faed9-f9d6-5254-b6ca-95de9081257b
2026-03-30 10:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2a7d0>
2026-03-30 10:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728faed9-f9d6-5254-b6ca-95de9081257b/728faed9-f9d6-5254-b6ca-95de9081257b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fa6%252F14a6d7354f514a55f493e1bcf94e2ae0%252Fpa%252FKJ93142_d1799a7f757c106d9392d44c329635c1.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_d1799a7f757c106d9392d44c329635c1.jpg saved to cache
2026-03-30 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 728faed9-f9d6-5254-b6ca-95de9081257b
2026-03-30 10:49:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 728faed9-f9d6-5254-b6ca-95de9081257b, skipping ID generation
2026-03-30 10:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 728faed9-f9d6-5254-b6ca-95de9081257b with scrape type 1
2026-03-30 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 728faed9-f9d6-5254-b6ca-95de9081257b sending to next pipeline
2026-03-30 10:49:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 728faed9-f9d6-5254-b6ca-95de9081257b, identifier: KJ93142
2026-03-30 10:49:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 728faed9-f9d6-5254-b6ca-95de9081257b with identifier: KJ93142
2026-03-30 10:49:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 728faed9-f9d6-5254-b6ca-95de9081257b with identifier: KJ93142
2026-03-30 10:49:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 728faed9-f9d6-5254-b6ca-95de9081257b with identifier: KJ93142 to the API
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_d1799a7f757c106d9392d44c329635c1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:38:45Z',
 'fuel_type': 'petrol',
 'id': '728faed9-f9d6-5254-b6ca-95de9081257b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ93142',
 'listing': 'auction',
 'location': 'DE, Osnabrück',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 184920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728faed9-f9d6-5254-b6ca-95de9081257b/728faed9-f9d6-5254-b6ca-95de9081257b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_28667c9a5922fec7aa0b462b35dbba5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728faed9-f9d6-5254-b6ca-95de9081257b/728faed9-f9d6-5254-b6ca-95de9081257b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_b04e489aa85d4e284af979dfb86658ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728faed9-f9d6-5254-b6ca-95de9081257b/728faed9-f9d6-5254-b6ca-95de9081257b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_d1799a7f757c106d9392d44c329635c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728faed9-f9d6-5254-b6ca-95de9081257b/728faed9-f9d6-5254-b6ca-95de9081257b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_b8acd7d00cd568ab30b1b5bd6ec78190.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728faed9-f9d6-5254-b6ca-95de9081257b/728faed9-f9d6-5254-b6ca-95de9081257b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/a6/14a6d7354f514a55f493e1bcf94e2ae0/pa/KJ93142_e36fdd98bf16ddf2a0dbda340dd6cf49.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Ghia',
 'transmission': 'manual',
 'trim': 'Ghia',
 'year': 2008}
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ93142%27 HTTP/1.1" 200 None
2026-03-30 10:49:27 [auto1.de] INFO: Saving data for KJ93142: {'created_time': 1774867767.846203, 'last_price_update_time': 1774867767.846212, 'auction_closing_time': 1774971525.0}
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ93142') HTTP/1.1" 204 0
2026-03-30 10:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_52555ccc17d1bc49e234b4482f0bee4d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef599d090>
2026-03-30 10:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_52555ccc17d1bc49e234b4482f0bee4d.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_52555ccc17d1bc49e234b4482f0bee4d.jpg saved to cache
2026-03-30 10:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43730a0e-12a6-5edb-bcc2-fee097bc50c4
2026-03-30 10:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_2bf8ad31e5561985ea90c461632ee3ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e21c90>
2026-03-30 10:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_2bf8ad31e5561985ea90c461632ee3ca.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_2bf8ad31e5561985ea90c461632ee3ca.jpg saved to cache
2026-03-30 10:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43730a0e-12a6-5edb-bcc2-fee097bc50c4
2026-03-30 10:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_a538e791169c211d6b68233d43a4e159.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2ad10>
2026-03-30 10:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_a538e791169c211d6b68233d43a4e159.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_a538e791169c211d6b68233d43a4e159.jpg saved to cache
2026-03-30 10:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43730a0e-12a6-5edb-bcc2-fee097bc50c4
2026-03-30 10:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA15492/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_0d9fb2c0c1362ba7d4b2dcb2335c1981.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb1410>
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_0d9fb2c0c1362ba7d4b2dcb2335c1981.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_0d9fb2c0c1362ba7d4b2dcb2335c1981.jpg saved to cache
2026-03-30 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43730a0e-12a6-5edb-bcc2-fee097bc50c4
2026-03-30 10:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_018289463fc8c85dd4187320803f5002.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_2085f8bc08812ccfe836d89fdb165640.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b35690>
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_018289463fc8c85dd4187320803f5002.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_018289463fc8c85dd4187320803f5002.jpg saved to cache
2026-03-30 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43730a0e-12a6-5edb-bcc2-fee097bc50c4
2026-03-30 10:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_7182580a141b37771d590fcc1ebdbed0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b37fd0>
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_2085f8bc08812ccfe836d89fdb165640.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_2085f8bc08812ccfe836d89fdb165640.jpg saved to cache
2026-03-30 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43730a0e-12a6-5edb-bcc2-fee097bc50c4
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b34c90>
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9d%252Fbe9d42a5e739d92525a25d837cd5cd49%252Fpa%252FVG68690_7182580a141b37771d590fcc1ebdbed0.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_7182580a141b37771d590fcc1ebdbed0.jpg saved to cache
2026-03-30 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43730a0e-12a6-5edb-bcc2-fee097bc50c4
2026-03-30 10:49:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43730a0e-12a6-5edb-bcc2-fee097bc50c4, skipping ID generation
2026-03-30 10:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43730a0e-12a6-5edb-bcc2-fee097bc50c4 with scrape type 1
2026-03-30 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43730a0e-12a6-5edb-bcc2-fee097bc50c4 sending to next pipeline
2026-03-30 10:49:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43730a0e-12a6-5edb-bcc2-fee097bc50c4, identifier: VG68690
2026-03-30 10:49:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43730a0e-12a6-5edb-bcc2-fee097bc50c4 with identifier: VG68690
2026-03-30 10:49:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43730a0e-12a6-5edb-bcc2-fee097bc50c4 with identifier: VG68690
2026-03-30 10:49:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43730a0e-12a6-5edb-bcc2-fee097bc50c4 with identifier: VG68690 to the API
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_7182580a141b37771d590fcc1ebdbed0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:10:59Z',
 'fuel_type': 'diesel',
 'id': '43730a0e-12a6-5edb-bcc2-fee097bc50c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG68690',
 'listing': 'auction',
 'location': 'DE, Oldenburg',
 'make': 'BMW',
 'model': '5er',
 'odometer': 337621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_7182580a141b37771d590fcc1ebdbed0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_2085f8bc08812ccfe836d89fdb165640.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2509616,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_018289463fc8c85dd4187320803f5002.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2302129,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_0d9fb2c0c1362ba7d4b2dcb2335c1981.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2615527,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_a538e791169c211d6b68233d43a4e159.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_2bf8ad31e5561985ea90c461632ee3ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_52555ccc17d1bc49e234b4482f0bee4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_d72e9e913df2efe3bbebcc6936a8a9bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2614695,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_7bd0220f02f9f0961421ec310e63bcd1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43730a0e-12a6-5edb-bcc2-fee097bc50c4/43730a0e-12a6-5edb-bcc2-fee097bc50c4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/9d/be9d42a5e739d92525a25d837cd5cd49/pa/VG68690_fe3fd9196dad6001252bf20028a7702d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-08-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2011}
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG68690%27 HTTP/1.1" 200 None
2026-03-30 10:49:30 [auto1.de] INFO: Saving data for VG68690: {'created_time': 1774867770.107748, 'last_price_update_time': 1774867770.107763, 'auction_closing_time': 1774969859.0}
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG68690') HTTP/1.1" 204 0
2026-03-30 10:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS69708> (referer: https://www.auto1.com/v1/car-details-view/SS69708/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA14894/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 184fbbff-50a8-5ee8-ae41-3bdcb300173a with identifier: SS69708
2026-03-30 10:49:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 184fbbff-50a8-5ee8-ae41-3bdcb300173a with scrape type 1
2026-03-30 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 184fbbff-50a8-5ee8-ae41-3bdcb300173a
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_2849b3e29b1fdbe2137c4b798ec41164.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_2849b3e29b1fdbe2137c4b798ec41164.jpg not downloaded yet
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_2c44666556931096c7d1c22de1d82c89.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_2c44666556931096c7d1c22de1d82c89.jpg not downloaded yet
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_04472ae5fc1ff0c74d348d90c9533fff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_04472ae5fc1ff0c74d348d90c9533fff.jpg not downloaded yet
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_a632a0a20fec2c245e55463d7238c46d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_a632a0a20fec2c245e55463d7238c46d.jpg not downloaded yet
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_4337216acd6fd4a3a3d783f46b13ed6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_4337216acd6fd4a3a3d783f46b13ed6f.jpg not downloaded yet
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_f29d7e5f525e869d435062b3fbd78897.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_f29d7e5f525e869d435062b3fbd78897.jpg not downloaded yet
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_712f103af8033710b6dafc3c61d1b7bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_712f103af8033710b6dafc3c61d1b7bb.jpg not downloaded yet
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_1f7b9ba99b996d8940f89b9c07f61584.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_1f7b9ba99b996d8940f89b9c07f61584.jpg not downloaded yet
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_2f99ee9e2fefe963ebacf3175b5494e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_2f99ee9e2fefe963ebacf3175b5494e4.jpg not downloaded yet
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_b540d08caf37c76e50a0dbaf37138a6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_b540d08caf37c76e50a0dbaf37138a6a.jpg not downloaded yet
2026-03-30 10:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ93598/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_b540d08caf37c76e50a0dbaf37138a6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b08f90>
2026-03-30 10:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_b540d08caf37c76e50a0dbaf37138a6a.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_b540d08caf37c76e50a0dbaf37138a6a.jpg saved to cache
2026-03-30 10:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 184fbbff-50a8-5ee8-ae41-3bdcb300173a
2026-03-30 10:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT23307> (referer: https://www.auto1.com/v1/car-details-view/JT23307/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LN61761> (referer: https://www.auto1.com/v1/car-details-view/LN61761/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6ad1f58-9dd5-546b-861b-0f23b854fd56 with identifier: JT23307
2026-03-30 10:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6ad1f58-9dd5-546b-861b-0f23b854fd56 with scrape type 1
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6ad1f58-9dd5-546b-861b-0f23b854fd56
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F5a%252Faf5afe02ec0883355b29bd4d6a2c04d5%252Fpa%252FJT23307_1e7c8a00a2df2a1112f12893fd3e2900.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_1e7c8a00a2df2a1112f12893fd3e2900.jpg already downloaded
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F5a%252Faf5afe02ec0883355b29bd4d6a2c04d5%252Fpa%252FJT23307_372bc6785400c7c13cb5c1165b2e5894.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_372bc6785400c7c13cb5c1165b2e5894.jpg already downloaded
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F5a%252Faf5afe02ec0883355b29bd4d6a2c04d5%252Fpa%252FJT23307_01e54a01c22b72ab59d1e29dc56c82ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_01e54a01c22b72ab59d1e29dc56c82ff.jpg already downloaded
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F5a%252Faf5afe02ec0883355b29bd4d6a2c04d5%252Fpa%252FJT23307_1a48873c29814f1b3db9bc1082a9a935.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_1a48873c29814f1b3db9bc1082a9a935.jpg already downloaded
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F5a%252Faf5afe02ec0883355b29bd4d6a2c04d5%252Fpa%252FJT23307_8e077f6e837c2abc1767a9bfb6036f82.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_8e077f6e837c2abc1767a9bfb6036f82.jpg already downloaded
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F5a%252Faf5afe02ec0883355b29bd4d6a2c04d5%252Fpa%252FJT23307_1bf54ee919275c8db6cabe7c0ee8ceba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_1bf54ee919275c8db6cabe7c0ee8ceba.jpg already downloaded
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F5a%252Faf5afe02ec0883355b29bd4d6a2c04d5%252Fpa%252FJT23307_2d4b4dac2c1bf7209847a2d7696e503e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_2d4b4dac2c1bf7209847a2d7696e503e.jpg already downloaded
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F5a%252Faf5afe02ec0883355b29bd4d6a2c04d5%252Fpa%252FJT23307_72a7cd553ef0c53c9d1648493aca03f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_72a7cd553ef0c53c9d1648493aca03f4.jpg already downloaded
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F5a%252Faf5afe02ec0883355b29bd4d6a2c04d5%252Fpa%252FJT23307_2ea3c062261bb770710052d29899e280.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_2ea3c062261bb770710052d29899e280.jpg already downloaded
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F5a%252Faf5afe02ec0883355b29bd4d6a2c04d5%252Fpa%252FJT23307_ddbdbee3568f0d4f0c511450cde0a47f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_ddbdbee3568f0d4f0c511450cde0a47f.jpg already downloaded
2026-03-30 10:49:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6ad1f58-9dd5-546b-861b-0f23b854fd56, identifier: JT23307
2026-03-30 10:49:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6ad1f58-9dd5-546b-861b-0f23b854fd56 with identifier: JT23307
2026-03-30 10:49:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6ad1f58-9dd5-546b-861b-0f23b854fd56 with identifier: JT23307
2026-03-30 10:49:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6ad1f58-9dd5-546b-861b-0f23b854fd56 with identifier: JT23307 to the API
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JT23307>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:23:01Z',
 'fuel_type': 'diesel',
 'id': 'a6ad1f58-9dd5-546b-861b-0f23b854fd56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT23307',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 76460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_1e7c8a00a2df2a1112f12893fd3e2900.jpg',
                'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_372bc6785400c7c13cb5c1165b2e5894.jpg',
                'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_01e54a01c22b72ab59d1e29dc56c82ff.jpg',
                'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_1a48873c29814f1b3db9bc1082a9a935.jpg',
                'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_8e077f6e837c2abc1767a9bfb6036f82.jpg',
                'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_1bf54ee919275c8db6cabe7c0ee8ceba.jpg',
                'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_2d4b4dac2c1bf7209847a2d7696e503e.jpg',
                'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_72a7cd553ef0c53c9d1648493aca03f4.jpg',
                'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_2ea3c062261bb770710052d29899e280.jpg',
                'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_ddbdbee3568f0d4f0c511450cde0a47f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ad1f58-9dd5-546b-861b-0f23b854fd56/a6ad1f58-9dd5-546b-861b-0f23b854fd56_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2938012,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_1e7c8a00a2df2a1112f12893fd3e2900.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ad1f58-9dd5-546b-861b-0f23b854fd56/a6ad1f58-9dd5-546b-861b-0f23b854fd56_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2896206,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_372bc6785400c7c13cb5c1165b2e5894.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ad1f58-9dd5-546b-861b-0f23b854fd56/a6ad1f58-9dd5-546b-861b-0f23b854fd56_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2928641,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_01e54a01c22b72ab59d1e29dc56c82ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ad1f58-9dd5-546b-861b-0f23b854fd56/a6ad1f58-9dd5-546b-861b-0f23b854fd56_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3096758,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_1a48873c29814f1b3db9bc1082a9a935.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ad1f58-9dd5-546b-861b-0f23b854fd56/a6ad1f58-9dd5-546b-861b-0f23b854fd56_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3051405,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_8e077f6e837c2abc1767a9bfb6036f82.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ad1f58-9dd5-546b-861b-0f23b854fd56/a6ad1f58-9dd5-546b-861b-0f23b854fd56_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2889227,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_1bf54ee919275c8db6cabe7c0ee8ceba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ad1f58-9dd5-546b-861b-0f23b854fd56/a6ad1f58-9dd5-546b-861b-0f23b854fd56_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2999515,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_2d4b4dac2c1bf7209847a2d7696e503e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ad1f58-9dd5-546b-861b-0f23b854fd56/a6ad1f58-9dd5-546b-861b-0f23b854fd56_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2824620,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_72a7cd553ef0c53c9d1648493aca03f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ad1f58-9dd5-546b-861b-0f23b854fd56/a6ad1f58-9dd5-546b-861b-0f23b854fd56_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3153814,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_2ea3c062261bb770710052d29899e280.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ad1f58-9dd5-546b-861b-0f23b854fd56/a6ad1f58-9dd5-546b-861b-0f23b854fd56_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2974788,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/5a/af5afe02ec0883355b29bd4d6a2c04d5/pa/JT23307_ddbdbee3568f0d4f0c511450cde0a47f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT23307%27 HTTP/1.1" 200 None
2026-03-30 10:49:32 [auto1.de] INFO: Saving data for JT23307: {'created_time': 1774867772.994767, 'last_price_update_time': 1774867772.99478, 'auction_closing_time': 1774970581.0}
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT23307') HTTP/1.1" 204 0
2026-03-30 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_2f99ee9e2fefe963ebacf3175b5494e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_1f7b9ba99b996d8940f89b9c07f61584.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e33d0e6-dd01-5f30-be5e-457d2b21def6 with identifier: LN61761
2026-03-30 10:49:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e33d0e6-dd01-5f30-be5e-457d2b21def6 with scrape type 1
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e33d0e6-dd01-5f30-be5e-457d2b21def6
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_8e2543ce2ca8b3c0f8c4289e895168fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_8e2543ce2ca8b3c0f8c4289e895168fe.jpg not downloaded yet
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_dc8807a617a3e5cb9a8dbb2d7e7b3112.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_dc8807a617a3e5cb9a8dbb2d7e7b3112.jpg not downloaded yet
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_1b4a17f535ccdd3f963b61372b39c8cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_1b4a17f535ccdd3f963b61372b39c8cc.jpg not downloaded yet
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_532f19db1a6739643b053302b4ae1603.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_532f19db1a6739643b053302b4ae1603.jpg not downloaded yet
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_e7d08b3aced7e7b07bf1752e8791a345.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_e7d08b3aced7e7b07bf1752e8791a345.jpg not downloaded yet
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_55faf64cf5f8764d7a9d3942ba9a8c4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_55faf64cf5f8764d7a9d3942ba9a8c4b.jpg not downloaded yet
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b35690>
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_2f99ee9e2fefe963ebacf3175b5494e4.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_2f99ee9e2fefe963ebacf3175b5494e4.jpg saved to cache
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 184fbbff-50a8-5ee8-ae41-3bdcb300173a
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d64f90>
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_1f7b9ba99b996d8940f89b9c07f61584.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_1f7b9ba99b996d8940f89b9c07f61584.jpg saved to cache
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 184fbbff-50a8-5ee8-ae41-3bdcb300173a
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_2fb417eaf2dc436775a1fbefe6f47133.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_2fb417eaf2dc436775a1fbefe6f47133.jpg not downloaded yet
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_931e1eaadef1abb3d24d4e8ec4e6e698.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_931e1eaadef1abb3d24d4e8ec4e6e698.jpg not downloaded yet
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_6befd2ce3d277d10934eacc53fda8fa8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_6befd2ce3d277d10934eacc53fda8fa8.jpg not downloaded yet
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_ae72f6936a84feaf068ed783cc069f45.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_ae72f6936a84feaf068ed783cc069f45.jpg not downloaded yet
2026-03-30 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_712f103af8033710b6dafc3c61d1b7bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8f950>
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_712f103af8033710b6dafc3c61d1b7bb.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_712f103af8033710b6dafc3c61d1b7bb.jpg saved to cache
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 184fbbff-50a8-5ee8-ae41-3bdcb300173a
2026-03-30 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_ae72f6936a84feaf068ed783cc069f45.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_f29d7e5f525e869d435062b3fbd78897.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b1710>
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_ae72f6936a84feaf068ed783cc069f45.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_ae72f6936a84feaf068ed783cc069f45.jpg saved to cache
2026-03-30 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e33d0e6-dd01-5f30-be5e-457d2b21def6
2026-03-30 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_6befd2ce3d277d10934eacc53fda8fa8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6f0d0>
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_f29d7e5f525e869d435062b3fbd78897.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_f29d7e5f525e869d435062b3fbd78897.jpg saved to cache
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 184fbbff-50a8-5ee8-ae41-3bdcb300173a
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b3510>
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_6befd2ce3d277d10934eacc53fda8fa8.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_6befd2ce3d277d10934eacc53fda8fa8.jpg saved to cache
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e33d0e6-dd01-5f30-be5e-457d2b21def6
2026-03-30 10:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_931e1eaadef1abb3d24d4e8ec4e6e698.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_2fb417eaf2dc436775a1fbefe6f47133.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP99561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZJ98470> (referer: https://www.auto1.com/v1/car-details-view/ZJ98470/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5961b10>
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_931e1eaadef1abb3d24d4e8ec4e6e698.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_931e1eaadef1abb3d24d4e8ec4e6e698.jpg saved to cache
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e33d0e6-dd01-5f30-be5e-457d2b21def6
2026-03-30 10:49:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f08cd0>
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_2fb417eaf2dc436775a1fbefe6f47133.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_2fb417eaf2dc436775a1fbefe6f47133.jpg saved to cache
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e33d0e6-dd01-5f30-be5e-457d2b21def6
2026-03-30 10:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_e7d08b3aced7e7b07bf1752e8791a345.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_55faf64cf5f8764d7a9d3942ba9a8c4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 307e1deb-689c-597c-9674-0b7bbef5034f with identifier: ZJ98470
2026-03-30 10:49:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 307e1deb-689c-597c-9674-0b7bbef5034f with scrape type 1
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 307e1deb-689c-597c-9674-0b7bbef5034f
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F2854ebfbbd0df89c962499b2d5855a3f%252Fpa%252FZJ98470_f1716870f78cfb997b9151ed12879dad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_f1716870f78cfb997b9151ed12879dad.jpg not downloaded yet
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F2854ebfbbd0df89c962499b2d5855a3f%252Fpa%252FZJ98470_d6dffa134213117b99252600eeb5da48.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_d6dffa134213117b99252600eeb5da48.jpg not downloaded yet
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F2854ebfbbd0df89c962499b2d5855a3f%252Fpa%252FZJ98470_0efcede1c3c4691eb9a5cc30125a73b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_0efcede1c3c4691eb9a5cc30125a73b2.jpg not downloaded yet
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F2854ebfbbd0df89c962499b2d5855a3f%252Fpa%252FZJ98470_5f5291ba9d0f6eaa19a990d340711d2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_5f5291ba9d0f6eaa19a990d340711d2b.jpg not downloaded yet
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F2854ebfbbd0df89c962499b2d5855a3f%252Fpa%252FZJ98470_c31fb6bb14d4fdee81fe284a8a91dd77.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_c31fb6bb14d4fdee81fe284a8a91dd77.jpg not downloaded yet
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eb77d0>
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_e7d08b3aced7e7b07bf1752e8791a345.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_e7d08b3aced7e7b07bf1752e8791a345.jpg saved to cache
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e33d0e6-dd01-5f30-be5e-457d2b21def6
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c4cd50>
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_55faf64cf5f8764d7a9d3942ba9a8c4b.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_55faf64cf5f8764d7a9d3942ba9a8c4b.jpg saved to cache
2026-03-30 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e33d0e6-dd01-5f30-be5e-457d2b21def6
2026-03-30 10:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_1b4a17f535ccdd3f963b61372b39c8cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_532f19db1a6739643b053302b4ae1603.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef502ab10>
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_1b4a17f535ccdd3f963b61372b39c8cc.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_1b4a17f535ccdd3f963b61372b39c8cc.jpg saved to cache
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e33d0e6-dd01-5f30-be5e-457d2b21def6
2026-03-30 10:49:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f145d0>
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_532f19db1a6739643b053302b4ae1603.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_532f19db1a6739643b053302b4ae1603.jpg saved to cache
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e33d0e6-dd01-5f30-be5e-457d2b21def6
2026-03-30 10:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_5f5291ba9d0f6eaa19a990d340711d2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_c31fb6bb14d4fdee81fe284a8a91dd77.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7c0a150>
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_307e1deb-689c-597c-9674-0b7bbef5034f/307e1deb-689c-597c-9674-0b7bbef5034f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F2854ebfbbd0df89c962499b2d5855a3f%252Fpa%252FZJ98470_5f5291ba9d0f6eaa19a990d340711d2b.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_5f5291ba9d0f6eaa19a990d340711d2b.jpg saved to cache
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 307e1deb-689c-597c-9674-0b7bbef5034f
2026-03-30 10:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_0efcede1c3c4691eb9a5cc30125a73b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e97ed0>
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_307e1deb-689c-597c-9674-0b7bbef5034f/307e1deb-689c-597c-9674-0b7bbef5034f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F2854ebfbbd0df89c962499b2d5855a3f%252Fpa%252FZJ98470_c31fb6bb14d4fdee81fe284a8a91dd77.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_c31fb6bb14d4fdee81fe284a8a91dd77.jpg saved to cache
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 307e1deb-689c-597c-9674-0b7bbef5034f
2026-03-30 10:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_d6dffa134213117b99252600eeb5da48.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_f1716870f78cfb997b9151ed12879dad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd1810>
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_307e1deb-689c-597c-9674-0b7bbef5034f/307e1deb-689c-597c-9674-0b7bbef5034f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F2854ebfbbd0df89c962499b2d5855a3f%252Fpa%252FZJ98470_0efcede1c3c4691eb9a5cc30125a73b2.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_0efcede1c3c4691eb9a5cc30125a73b2.jpg saved to cache
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 307e1deb-689c-597c-9674-0b7bbef5034f
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b02d0>
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_307e1deb-689c-597c-9674-0b7bbef5034f/307e1deb-689c-597c-9674-0b7bbef5034f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F2854ebfbbd0df89c962499b2d5855a3f%252Fpa%252FZJ98470_d6dffa134213117b99252600eeb5da48.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_d6dffa134213117b99252600eeb5da48.jpg saved to cache
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 307e1deb-689c-597c-9674-0b7bbef5034f
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ac8710>
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_307e1deb-689c-597c-9674-0b7bbef5034f/307e1deb-689c-597c-9674-0b7bbef5034f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F54%252F2854ebfbbd0df89c962499b2d5855a3f%252Fpa%252FZJ98470_f1716870f78cfb997b9151ed12879dad.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_f1716870f78cfb997b9151ed12879dad.jpg saved to cache
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 307e1deb-689c-597c-9674-0b7bbef5034f
2026-03-30 10:49:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 307e1deb-689c-597c-9674-0b7bbef5034f, skipping ID generation
2026-03-30 10:49:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 307e1deb-689c-597c-9674-0b7bbef5034f with scrape type 1
2026-03-30 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 307e1deb-689c-597c-9674-0b7bbef5034f sending to next pipeline
2026-03-30 10:49:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 307e1deb-689c-597c-9674-0b7bbef5034f, identifier: ZJ98470
2026-03-30 10:49:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 307e1deb-689c-597c-9674-0b7bbef5034f with identifier: ZJ98470
2026-03-30 10:49:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 307e1deb-689c-597c-9674-0b7bbef5034f with identifier: ZJ98470
2026-03-30 10:49:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 307e1deb-689c-597c-9674-0b7bbef5034f with identifier: ZJ98470 to the API
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_f1716870f78cfb997b9151ed12879dad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:02:41Z',
 'fuel_type': 'petrol',
 'id': '307e1deb-689c-597c-9674-0b7bbef5034f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ98470',
 'listing': 'auction',
 'location': 'DE, Markkleeberg',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 125783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_307e1deb-689c-597c-9674-0b7bbef5034f/307e1deb-689c-597c-9674-0b7bbef5034f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_f1716870f78cfb997b9151ed12879dad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_307e1deb-689c-597c-9674-0b7bbef5034f/307e1deb-689c-597c-9674-0b7bbef5034f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_d6dffa134213117b99252600eeb5da48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_307e1deb-689c-597c-9674-0b7bbef5034f/307e1deb-689c-597c-9674-0b7bbef5034f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_0efcede1c3c4691eb9a5cc30125a73b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_307e1deb-689c-597c-9674-0b7bbef5034f/307e1deb-689c-597c-9674-0b7bbef5034f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_5f5291ba9d0f6eaa19a990d340711d2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_307e1deb-689c-597c-9674-0b7bbef5034f/307e1deb-689c-597c-9674-0b7bbef5034f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/54/2854ebfbbd0df89c962499b2d5855a3f/pa/ZJ98470_c31fb6bb14d4fdee81fe284a8a91dd77.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Chevrolet Spark 1.0 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2013}
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ98470%27 HTTP/1.1" 200 None
2026-03-30 10:49:36 [auto1.de] INFO: Saving data for ZJ98470: {'created_time': 1774867776.503627, 'last_price_update_time': 1774867776.503637, 'auction_closing_time': 1774969361.0}
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ98470') HTTP/1.1" 204 0
2026-03-30 10:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_dc8807a617a3e5cb9a8dbb2d7e7b3112.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_4337216acd6fd4a3a3d783f46b13ed6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_8e2543ce2ca8b3c0f8c4289e895168fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BG36270> (referer: https://www.auto1.com/v1/car-details-view/BG36270/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b31050>
2026-03-30 10:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_dc8807a617a3e5cb9a8dbb2d7e7b3112.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_dc8807a617a3e5cb9a8dbb2d7e7b3112.jpg saved to cache
2026-03-30 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e33d0e6-dd01-5f30-be5e-457d2b21def6
2026-03-30 10:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_a632a0a20fec2c245e55463d7238c46d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b01950>
2026-03-30 10:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_4337216acd6fd4a3a3d783f46b13ed6f.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_4337216acd6fd4a3a3d783f46b13ed6f.jpg saved to cache
2026-03-30 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 184fbbff-50a8-5ee8-ae41-3bdcb300173a
2026-03-30 10:49:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e6bb90>
2026-03-30 10:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8f%252F028fbdc040036a73efc3433018961cf2%252Fpa%252FLN61761_8e2543ce2ca8b3c0f8c4289e895168fe.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_8e2543ce2ca8b3c0f8c4289e895168fe.jpg saved to cache
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e33d0e6-dd01-5f30-be5e-457d2b21def6
2026-03-30 10:49:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e33d0e6-dd01-5f30-be5e-457d2b21def6, skipping ID generation
2026-03-30 10:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e33d0e6-dd01-5f30-be5e-457d2b21def6 with scrape type 1
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e33d0e6-dd01-5f30-be5e-457d2b21def6 sending to next pipeline
2026-03-30 10:49:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e33d0e6-dd01-5f30-be5e-457d2b21def6, identifier: LN61761
2026-03-30 10:49:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25428b5f-90fc-51c8-9672-38cbeaf0f885 with identifier: BG36270
2026-03-30 10:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25428b5f-90fc-51c8-9672-38cbeaf0f885 with scrape type 1
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 25428b5f-90fc-51c8-9672-38cbeaf0f885
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F32%252Ff732cacd7a54857f4456916fb2bb8a5c%252Fpa%252FBG36270_65b148378abfe3c0d953d35f7f26ba1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_65b148378abfe3c0d953d35f7f26ba1b.jpg not downloaded yet
2026-03-30 10:49:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e33d0e6-dd01-5f30-be5e-457d2b21def6 with identifier: LN61761
2026-03-30 10:49:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e33d0e6-dd01-5f30-be5e-457d2b21def6 with identifier: LN61761
2026-03-30 10:49:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e33d0e6-dd01-5f30-be5e-457d2b21def6 with identifier: LN61761 to the API
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_8e2543ce2ca8b3c0f8c4289e895168fe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:01:21Z',
 'fuel_type': 'petrol',
 'id': '9e33d0e6-dd01-5f30-be5e-457d2b21def6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN61761',
 'listing': 'auction',
 'location': 'DE, Kamen',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 59462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3144538,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_8e2543ce2ca8b3c0f8c4289e895168fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3126927,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_dc8807a617a3e5cb9a8dbb2d7e7b3112.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3272461,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_1b4a17f535ccdd3f963b61372b39c8cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3274263,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_532f19db1a6739643b053302b4ae1603.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_e7d08b3aced7e7b07bf1752e8791a345.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_55faf64cf5f8764d7a9d3942ba9a8c4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2478704,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_2fb417eaf2dc436775a1fbefe6f47133.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_931e1eaadef1abb3d24d4e8ec4e6e698.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_6befd2ce3d277d10934eacc53fda8fa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e33d0e6-dd01-5f30-be5e-457d2b21def6/9e33d0e6-dd01-5f30-be5e-457d2b21def6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2980229,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/8f/028fbdc040036a73efc3433018961cf2/pa/LN61761_ae72f6936a84feaf068ed783cc069f45.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2016}
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN61761%27 HTTP/1.1" 200 None
2026-03-30 10:49:37 [auto1.de] INFO: Saving data for LN61761: {'created_time': 1774867777.58936, 'last_price_update_time': 1774867777.589373, 'auction_closing_time': 1774969281.0}
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN61761') HTTP/1.1" 204 0
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F32%252Ff732cacd7a54857f4456916fb2bb8a5c%252Fpa%252FBG36270_93a69c11184d40f0a6deb856f935a688.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_93a69c11184d40f0a6deb856f935a688.jpg not downloaded yet
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F32%252Ff732cacd7a54857f4456916fb2bb8a5c%252Fpa%252FBG36270_a6601ebd8dcd6dfc3e49e22c5af32386.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_a6601ebd8dcd6dfc3e49e22c5af32386.jpg not downloaded yet
2026-03-30 10:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5995f10>
2026-03-30 10:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_a632a0a20fec2c245e55463d7238c46d.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_a632a0a20fec2c245e55463d7238c46d.jpg saved to cache
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 184fbbff-50a8-5ee8-ae41-3bdcb300173a
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F32%252Ff732cacd7a54857f4456916fb2bb8a5c%252Fpa%252FBG36270_187241ba7f8a265baf9d70a593223a36.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_187241ba7f8a265baf9d70a593223a36.jpg not downloaded yet
2026-03-30 10:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_65b148378abfe3c0d953d35f7f26ba1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F32%252Ff732cacd7a54857f4456916fb2bb8a5c%252Fpa%252FBG36270_fe977b46fa598bd9cab7e43ff31ea170.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_fe977b46fa598bd9cab7e43ff31ea170.jpg not downloaded yet
2026-03-30 10:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_2c44666556931096c7d1c22de1d82c89.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eb5c90>
2026-03-30 10:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25428b5f-90fc-51c8-9672-38cbeaf0f885/25428b5f-90fc-51c8-9672-38cbeaf0f885_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F32%252Ff732cacd7a54857f4456916fb2bb8a5c%252Fpa%252FBG36270_65b148378abfe3c0d953d35f7f26ba1b.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_65b148378abfe3c0d953d35f7f26ba1b.jpg saved to cache
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25428b5f-90fc-51c8-9672-38cbeaf0f885
2026-03-30 10:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_187241ba7f8a265baf9d70a593223a36.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_04472ae5fc1ff0c74d348d90c9533fff.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_fe977b46fa598bd9cab7e43ff31ea170.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a21410>
2026-03-30 10:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_2c44666556931096c7d1c22de1d82c89.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_2c44666556931096c7d1c22de1d82c89.jpg saved to cache
2026-03-30 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 184fbbff-50a8-5ee8-ae41-3bdcb300173a
2026-03-30 10:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_93a69c11184d40f0a6deb856f935a688.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_a6601ebd8dcd6dfc3e49e22c5af32386.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_2849b3e29b1fdbe2137c4b798ec41164.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fec5d0>
2026-03-30 10:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25428b5f-90fc-51c8-9672-38cbeaf0f885/25428b5f-90fc-51c8-9672-38cbeaf0f885_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F32%252Ff732cacd7a54857f4456916fb2bb8a5c%252Fpa%252FBG36270_187241ba7f8a265baf9d70a593223a36.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_187241ba7f8a265baf9d70a593223a36.jpg saved to cache
2026-03-30 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25428b5f-90fc-51c8-9672-38cbeaf0f885
2026-03-30 10:49:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee3910>
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_04472ae5fc1ff0c74d348d90c9533fff.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_04472ae5fc1ff0c74d348d90c9533fff.jpg saved to cache
2026-03-30 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 184fbbff-50a8-5ee8-ae41-3bdcb300173a
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c4e310>
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25428b5f-90fc-51c8-9672-38cbeaf0f885/25428b5f-90fc-51c8-9672-38cbeaf0f885_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F32%252Ff732cacd7a54857f4456916fb2bb8a5c%252Fpa%252FBG36270_fe977b46fa598bd9cab7e43ff31ea170.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_fe977b46fa598bd9cab7e43ff31ea170.jpg saved to cache
2026-03-30 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25428b5f-90fc-51c8-9672-38cbeaf0f885
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5acb810>
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25428b5f-90fc-51c8-9672-38cbeaf0f885/25428b5f-90fc-51c8-9672-38cbeaf0f885_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F32%252Ff732cacd7a54857f4456916fb2bb8a5c%252Fpa%252FBG36270_93a69c11184d40f0a6deb856f935a688.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_93a69c11184d40f0a6deb856f935a688.jpg saved to cache
2026-03-30 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25428b5f-90fc-51c8-9672-38cbeaf0f885
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50723d0>
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25428b5f-90fc-51c8-9672-38cbeaf0f885/25428b5f-90fc-51c8-9672-38cbeaf0f885_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F32%252Ff732cacd7a54857f4456916fb2bb8a5c%252Fpa%252FBG36270_a6601ebd8dcd6dfc3e49e22c5af32386.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_a6601ebd8dcd6dfc3e49e22c5af32386.jpg saved to cache
2026-03-30 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25428b5f-90fc-51c8-9672-38cbeaf0f885
2026-03-30 10:49:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25428b5f-90fc-51c8-9672-38cbeaf0f885, skipping ID generation
2026-03-30 10:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25428b5f-90fc-51c8-9672-38cbeaf0f885 with scrape type 1
2026-03-30 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25428b5f-90fc-51c8-9672-38cbeaf0f885 sending to next pipeline
2026-03-30 10:49:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25428b5f-90fc-51c8-9672-38cbeaf0f885, identifier: BG36270
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea8d10>
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fff%252F59ff20d6e4012a631475fb5c37881614%252Fpa%252FSS69708_2849b3e29b1fdbe2137c4b798ec41164.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_2849b3e29b1fdbe2137c4b798ec41164.jpg saved to cache
2026-03-30 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 184fbbff-50a8-5ee8-ae41-3bdcb300173a
2026-03-30 10:49:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 184fbbff-50a8-5ee8-ae41-3bdcb300173a, skipping ID generation
2026-03-30 10:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 184fbbff-50a8-5ee8-ae41-3bdcb300173a with scrape type 1
2026-03-30 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 184fbbff-50a8-5ee8-ae41-3bdcb300173a sending to next pipeline
2026-03-30 10:49:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 184fbbff-50a8-5ee8-ae41-3bdcb300173a, identifier: SS69708
2026-03-30 10:49:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25428b5f-90fc-51c8-9672-38cbeaf0f885 with identifier: BG36270
2026-03-30 10:49:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25428b5f-90fc-51c8-9672-38cbeaf0f885 with identifier: BG36270
2026-03-30 10:49:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25428b5f-90fc-51c8-9672-38cbeaf0f885 with identifier: BG36270 to the API
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_a6601ebd8dcd6dfc3e49e22c5af32386.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:00:04Z',
 'fuel_type': 'diesel',
 'id': '25428b5f-90fc-51c8-9672-38cbeaf0f885',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG36270',
 'listing': 'auction',
 'location': 'DE, Oranienburg',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 267413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25428b5f-90fc-51c8-9672-38cbeaf0f885/25428b5f-90fc-51c8-9672-38cbeaf0f885_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_65b148378abfe3c0d953d35f7f26ba1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25428b5f-90fc-51c8-9672-38cbeaf0f885/25428b5f-90fc-51c8-9672-38cbeaf0f885_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_93a69c11184d40f0a6deb856f935a688.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25428b5f-90fc-51c8-9672-38cbeaf0f885/25428b5f-90fc-51c8-9672-38cbeaf0f885_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_a6601ebd8dcd6dfc3e49e22c5af32386.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25428b5f-90fc-51c8-9672-38cbeaf0f885/25428b5f-90fc-51c8-9672-38cbeaf0f885_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_187241ba7f8a265baf9d70a593223a36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25428b5f-90fc-51c8-9672-38cbeaf0f885/25428b5f-90fc-51c8-9672-38cbeaf0f885_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/32/f732cacd7a54857f4456916fb2bb8a5c/pa/BG36270_fe977b46fa598bd9cab7e43ff31ea170.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2013}
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG36270%27 HTTP/1.1" 200 None
2026-03-30 10:49:39 [auto1.de] INFO: Saving data for BG36270: {'created_time': 1774867779.025949, 'last_price_update_time': 1774867779.025961, 'auction_closing_time': 1774969204.0}
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG36270') HTTP/1.1" 204 0
2026-03-30 10:49:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 184fbbff-50a8-5ee8-ae41-3bdcb300173a with identifier: SS69708
2026-03-30 10:49:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 184fbbff-50a8-5ee8-ae41-3bdcb300173a with identifier: SS69708
2026-03-30 10:49:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 184fbbff-50a8-5ee8-ae41-3bdcb300173a with identifier: SS69708 to the API
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_2849b3e29b1fdbe2137c4b798ec41164.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:40:50Z',
 'fuel_type': 'petrol',
 'id': '184fbbff-50a8-5ee8-ae41-3bdcb300173a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS69708',
 'listing': 'auction',
 'location': 'DE, Bremen',
 'make': 'BMW',
 'model': '1er',
 'odometer': 123585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_2849b3e29b1fdbe2137c4b798ec41164.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_2c44666556931096c7d1c22de1d82c89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2465468,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_04472ae5fc1ff0c74d348d90c9533fff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_a632a0a20fec2c245e55463d7238c46d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2519294,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_4337216acd6fd4a3a3d783f46b13ed6f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2324979,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_f29d7e5f525e869d435062b3fbd78897.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2380469,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_712f103af8033710b6dafc3c61d1b7bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_1f7b9ba99b996d8940f89b9c07f61584.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_2f99ee9e2fefe963ebacf3175b5494e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_184fbbff-50a8-5ee8-ae41-3bdcb300173a/184fbbff-50a8-5ee8-ae41-3bdcb300173a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2578623,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ff20d6e4012a631475fb5c37881614/pa/SS69708_b540d08caf37c76e50a0dbaf37138a6a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS69708%27 HTTP/1.1" 200 None
2026-03-30 10:49:39 [auto1.de] INFO: Saving data for SS69708: {'created_time': 1774867779.473179, 'last_price_update_time': 1774867779.473194, 'auction_closing_time': 1774971650.0}
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS69708') HTTP/1.1" 204 0
2026-03-30 10:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD36296/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TM99691> (referer: https://www.auto1.com/v1/car-details-view/TM99691/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbbb0c87-c588-5fd3-82c0-b4578d602596 with identifier: TM99691
2026-03-30 10:49:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbbb0c87-c588-5fd3-82c0-b4578d602596 with scrape type 1
2026-03-30 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbbb0c87-c588-5fd3-82c0-b4578d602596
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_4e60d4160ae9a6dfb7b46e319726b986.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_4e60d4160ae9a6dfb7b46e319726b986.jpg not downloaded yet
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_445a970a1c2019b715ddac71beb91f86.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_445a970a1c2019b715ddac71beb91f86.jpg not downloaded yet
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_5a00afadbe5803c5b163dc738f6d8dd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_5a00afadbe5803c5b163dc738f6d8dd4.jpg not downloaded yet
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_ced1c8ca60cd15f67735622380191b94.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_ced1c8ca60cd15f67735622380191b94.jpg not downloaded yet
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_9e43854f59bf25dbfebabe70f30843e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_9e43854f59bf25dbfebabe70f30843e2.jpg not downloaded yet
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_8d07c58cdc28d4bfdd687e5910d826f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_8d07c58cdc28d4bfdd687e5910d826f7.jpg not downloaded yet
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_bb3f22ef5cf5266182f5cabc07d962ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_bb3f22ef5cf5266182f5cabc07d962ba.jpg not downloaded yet
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_525c9ba90d33cd0497a675ac0d5b7c87.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_525c9ba90d33cd0497a675ac0d5b7c87.jpg not downloaded yet
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_2c89c4002de6c96c0743368254e27982.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_2c89c4002de6c96c0743368254e27982.jpg not downloaded yet
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_781661b2f73d8835a7cbdb676c2db698.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_781661b2f73d8835a7cbdb676c2db698.jpg not downloaded yet
2026-03-30 10:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB25912/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_781661b2f73d8835a7cbdb676c2db698.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a27cd0>
2026-03-30 10:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_781661b2f73d8835a7cbdb676c2db698.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_781661b2f73d8835a7cbdb676c2db698.jpg saved to cache
2026-03-30 10:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dbbb0c87-c588-5fd3-82c0-b4578d602596
2026-03-30 10:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FE15332> (referer: https://www.auto1.com/v1/car-details-view/FE15332/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f462c37-79de-5de8-ab6d-c8b1caf07696 with identifier: FE15332
2026-03-30 10:49:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f462c37-79de-5de8-ab6d-c8b1caf07696 with scrape type 1
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f462c37-79de-5de8-ab6d-c8b1caf07696
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_86f126c9d3542d0594d3e76ee972317c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_86f126c9d3542d0594d3e76ee972317c.jpg not downloaded yet
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_cd081d3fff82f87afac240137fdfe715.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_cd081d3fff82f87afac240137fdfe715.jpg not downloaded yet
2026-03-30 10:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA81988/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_d525cbcc8158fd9e23eb51313758d364.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_d525cbcc8158fd9e23eb51313758d364.jpg not downloaded yet
2026-03-30 10:49:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA15492> (referer: https://www.auto1.com/v1/car-details-view/WA15492/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_ba8f71638ee3afcdaeb9f078e92bbe23.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_ba8f71638ee3afcdaeb9f078e92bbe23.jpg not downloaded yet
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_3d61d0a1d945c03fe230811775735440.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_3d61d0a1d945c03fe230811775735440.jpg not downloaded yet
2026-03-30 10:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_2c89c4002de6c96c0743368254e27982.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_0675d3d23e7a43ec9e262f8bcdbf9b75.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_0675d3d23e7a43ec9e262f8bcdbf9b75.jpg not downloaded yet
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_fc38bbf4d3da04b0e44e5dc023475a70.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_fc38bbf4d3da04b0e44e5dc023475a70.jpg not downloaded yet
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_ddfc271beadd6c0592bfbbf697b08933.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_ddfc271beadd6c0592bfbbf697b08933.jpg not downloaded yet
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_54e285e5a7acf34453d9fc6e0b824f45.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_54e285e5a7acf34453d9fc6e0b824f45.jpg not downloaded yet
2026-03-30 10:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_cd081d3fff82f87afac240137fdfe715.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_d6c32854c63837c49dfa99d00e1a3fac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_d6c32854c63837c49dfa99d00e1a3fac.jpg not downloaded yet
2026-03-30 10:49:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ca3e159-b640-5c79-bc62-9a383f56e6f7 with identifier: WA15492
2026-03-30 10:49:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ca3e159-b640-5c79-bc62-9a383f56e6f7 with scrape type 1
2026-03-30 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ca3e159-b640-5c79-bc62-9a383f56e6f7
2026-03-30 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F2e%252F9c2eda525a57a8ab63ee6206c742ebf6%252Fpa%252FWA15492_d8ed256f3a5fc082560f1644028de5cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_d8ed256f3a5fc082560f1644028de5cc.jpg already downloaded
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F2e%252F9c2eda525a57a8ab63ee6206c742ebf6%252Fpa%252FWA15492_b6c9873c1abcce3c26091b3064741304.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_b6c9873c1abcce3c26091b3064741304.jpg already downloaded
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F2e%252F9c2eda525a57a8ab63ee6206c742ebf6%252Fpa%252FWA15492_b05f74f912a4239c4ea5f5ca164debe8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_b05f74f912a4239c4ea5f5ca164debe8.jpg already downloaded
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F2e%252F9c2eda525a57a8ab63ee6206c742ebf6%252Fpa%252FWA15492_0b665249064aa18696350dc66e119f43.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_0b665249064aa18696350dc66e119f43.jpg already downloaded
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F2e%252F9c2eda525a57a8ab63ee6206c742ebf6%252Fpa%252FWA15492_23d3a27550a9fccc5b4ca737c326f558.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_23d3a27550a9fccc5b4ca737c326f558.jpg already downloaded
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F2e%252F9c2eda525a57a8ab63ee6206c742ebf6%252Fpa%252FWA15492_883db720cc0f5304d3e3a40d7aee4030.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_883db720cc0f5304d3e3a40d7aee4030.jpg already downloaded
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F2e%252F9c2eda525a57a8ab63ee6206c742ebf6%252Fpa%252FWA15492_59aaa3b0776ebab82e2b693a830c4ebc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_59aaa3b0776ebab82e2b693a830c4ebc.jpg already downloaded
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F2e%252F9c2eda525a57a8ab63ee6206c742ebf6%252Fpa%252FWA15492_5f9d603a70a6f95944ed082493d8d660.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_5f9d603a70a6f95944ed082493d8d660.jpg already downloaded
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F2e%252F9c2eda525a57a8ab63ee6206c742ebf6%252Fpa%252FWA15492_27ea3bcf539749c82f9c395f214422d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_27ea3bcf539749c82f9c395f214422d8.jpg already downloaded
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F2e%252F9c2eda525a57a8ab63ee6206c742ebf6%252Fpa%252FWA15492_ddab4d750279a6d820cbf4cc29404d76.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_ddab4d750279a6d820cbf4cc29404d76.jpg already downloaded
2026-03-30 10:49:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ca3e159-b640-5c79-bc62-9a383f56e6f7, identifier: WA15492
2026-03-30 10:49:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ca3e159-b640-5c79-bc62-9a383f56e6f7 with identifier: WA15492
2026-03-30 10:49:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ca3e159-b640-5c79-bc62-9a383f56e6f7 with identifier: WA15492
2026-03-30 10:49:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ca3e159-b640-5c79-bc62-9a383f56e6f7 with identifier: WA15492 to the API
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WA15492>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:16:07Z',
 'fuel_type': 'diesel',
 'id': '5ca3e159-b640-5c79-bc62-9a383f56e6f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA15492',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 182343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_d8ed256f3a5fc082560f1644028de5cc.jpg',
                'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_b6c9873c1abcce3c26091b3064741304.jpg',
                'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_b05f74f912a4239c4ea5f5ca164debe8.jpg',
                'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_0b665249064aa18696350dc66e119f43.jpg',
                'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_23d3a27550a9fccc5b4ca737c326f558.jpg',
                'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_883db720cc0f5304d3e3a40d7aee4030.jpg',
                'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_59aaa3b0776ebab82e2b693a830c4ebc.jpg',
                'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_5f9d603a70a6f95944ed082493d8d660.jpg',
                'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_27ea3bcf539749c82f9c395f214422d8.jpg',
                'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_ddab4d750279a6d820cbf4cc29404d76.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca3e159-b640-5c79-bc62-9a383f56e6f7/5ca3e159-b640-5c79-bc62-9a383f56e6f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_d8ed256f3a5fc082560f1644028de5cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca3e159-b640-5c79-bc62-9a383f56e6f7/5ca3e159-b640-5c79-bc62-9a383f56e6f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_b6c9873c1abcce3c26091b3064741304.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca3e159-b640-5c79-bc62-9a383f56e6f7/5ca3e159-b640-5c79-bc62-9a383f56e6f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2351329,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_b05f74f912a4239c4ea5f5ca164debe8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca3e159-b640-5c79-bc62-9a383f56e6f7/5ca3e159-b640-5c79-bc62-9a383f56e6f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_0b665249064aa18696350dc66e119f43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca3e159-b640-5c79-bc62-9a383f56e6f7/5ca3e159-b640-5c79-bc62-9a383f56e6f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_23d3a27550a9fccc5b4ca737c326f558.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca3e159-b640-5c79-bc62-9a383f56e6f7/5ca3e159-b640-5c79-bc62-9a383f56e6f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2328241,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_883db720cc0f5304d3e3a40d7aee4030.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca3e159-b640-5c79-bc62-9a383f56e6f7/5ca3e159-b640-5c79-bc62-9a383f56e6f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_59aaa3b0776ebab82e2b693a830c4ebc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca3e159-b640-5c79-bc62-9a383f56e6f7/5ca3e159-b640-5c79-bc62-9a383f56e6f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_5f9d603a70a6f95944ed082493d8d660.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca3e159-b640-5c79-bc62-9a383f56e6f7/5ca3e159-b640-5c79-bc62-9a383f56e6f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_27ea3bcf539749c82f9c395f214422d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca3e159-b640-5c79-bc62-9a383f56e6f7/5ca3e159-b640-5c79-bc62-9a383f56e6f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/2e/9c2eda525a57a8ab63ee6206c742ebf6/pa/WA15492_ddab4d750279a6d820cbf4cc29404d76.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2013}
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA15492%27 HTTP/1.1" 200 None
2026-03-30 10:49:44 [auto1.de] INFO: Saving data for WA15492: {'created_time': 1774867784.630474, 'last_price_update_time': 1774867784.630483, 'auction_closing_time': 1774970167.0}
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA15492') HTTP/1.1" 204 0
2026-03-30 10:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_3d61d0a1d945c03fe230811775735440.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef501ffd0>
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_2c89c4002de6c96c0743368254e27982.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_2c89c4002de6c96c0743368254e27982.jpg saved to cache
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dbbb0c87-c588-5fd3-82c0-b4578d602596
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b02850>
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_cd081d3fff82f87afac240137fdfe715.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_cd081d3fff82f87afac240137fdfe715.jpg saved to cache
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f462c37-79de-5de8-ab6d-c8b1caf07696
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c0850>
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_3d61d0a1d945c03fe230811775735440.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_3d61d0a1d945c03fe230811775735440.jpg saved to cache
2026-03-30 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f462c37-79de-5de8-ab6d-c8b1caf07696
2026-03-30 10:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_86f126c9d3542d0594d3e76ee972317c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_d6c32854c63837c49dfa99d00e1a3fac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_54e285e5a7acf34453d9fc6e0b824f45.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 10:49:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 10:49:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 10:49:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 10:49:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2bd90>
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_86f126c9d3542d0594d3e76ee972317c.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_86f126c9d3542d0594d3e76ee972317c.jpg saved to cache
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f462c37-79de-5de8-ab6d-c8b1caf07696
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fca650>
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_d6c32854c63837c49dfa99d00e1a3fac.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_d6c32854c63837c49dfa99d00e1a3fac.jpg saved to cache
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f462c37-79de-5de8-ab6d-c8b1caf07696
2026-03-30 10:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_fc38bbf4d3da04b0e44e5dc023475a70.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_ddfc271beadd6c0592bfbbf697b08933.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fcafd0>
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_54e285e5a7acf34453d9fc6e0b824f45.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_54e285e5a7acf34453d9fc6e0b824f45.jpg saved to cache
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f462c37-79de-5de8-ab6d-c8b1caf07696
2026-03-30 10:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_0675d3d23e7a43ec9e262f8bcdbf9b75.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7886450>
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_fc38bbf4d3da04b0e44e5dc023475a70.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_fc38bbf4d3da04b0e44e5dc023475a70.jpg saved to cache
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f462c37-79de-5de8-ab6d-c8b1caf07696
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b3a50>
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_ddfc271beadd6c0592bfbbf697b08933.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_ddfc271beadd6c0592bfbbf697b08933.jpg saved to cache
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f462c37-79de-5de8-ab6d-c8b1caf07696
2026-03-30 10:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_ba8f71638ee3afcdaeb9f078e92bbe23.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f13490>
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_0675d3d23e7a43ec9e262f8bcdbf9b75.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_0675d3d23e7a43ec9e262f8bcdbf9b75.jpg saved to cache
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f462c37-79de-5de8-ab6d-c8b1caf07696
2026-03-30 10:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_d525cbcc8158fd9e23eb51313758d364.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b2350>
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_ba8f71638ee3afcdaeb9f078e92bbe23.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_ba8f71638ee3afcdaeb9f078e92bbe23.jpg saved to cache
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f462c37-79de-5de8-ab6d-c8b1caf07696
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee3e50>
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F1c%252Fbb1c9a9cafbd3af20336b339c9876365%252Fpa%252FFE15332_d525cbcc8158fd9e23eb51313758d364.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_d525cbcc8158fd9e23eb51313758d364.jpg saved to cache
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f462c37-79de-5de8-ab6d-c8b1caf07696
2026-03-30 10:49:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f462c37-79de-5de8-ab6d-c8b1caf07696, skipping ID generation
2026-03-30 10:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f462c37-79de-5de8-ab6d-c8b1caf07696 with scrape type 1
2026-03-30 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f462c37-79de-5de8-ab6d-c8b1caf07696 sending to next pipeline
2026-03-30 10:49:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f462c37-79de-5de8-ab6d-c8b1caf07696, identifier: FE15332
2026-03-30 10:49:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f462c37-79de-5de8-ab6d-c8b1caf07696 with identifier: FE15332
2026-03-30 10:49:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f462c37-79de-5de8-ab6d-c8b1caf07696 with identifier: FE15332
2026-03-30 10:49:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f462c37-79de-5de8-ab6d-c8b1caf07696 with identifier: FE15332 to the API
2026-03-30 10:49:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_d525cbcc8158fd9e23eb51313758d364.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.5L',
 'engine_horse_power': 333,
 'expiration_date': '2026-03-31T15:18:38Z',
 'fuel_type': 'petrol',
 'id': '9f462c37-79de-5de8-ab6d-c8b1caf07696',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE15332',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 244294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4763918,
             'Height': 4284,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_86f126c9d3542d0594d3e76ee972317c.jpg',
             'Width': 5712},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_cd081d3fff82f87afac240137fdfe715.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_d525cbcc8158fd9e23eb51313758d364.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_ba8f71638ee3afcdaeb9f078e92bbe23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_3d61d0a1d945c03fe230811775735440.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_0675d3d23e7a43ec9e262f8bcdbf9b75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_fc38bbf4d3da04b0e44e5dc023475a70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_ddfc271beadd6c0592bfbbf697b08933.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_54e285e5a7acf34453d9fc6e0b824f45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f462c37-79de-5de8-ab6d-c8b1caf07696/9f462c37-79de-5de8-ab6d-c8b1caf07696_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/1c/bb1c9a9cafbd3af20336b339c9876365/pa/FE15332_d6c32854c63837c49dfa99d00e1a3fac.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 400 T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2017}
2026-03-30 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE15332%27 HTTP/1.1" 200 None
2026-03-30 10:49:46 [auto1.de] INFO: Saving data for FE15332: {'created_time': 1774867786.781935, 'last_price_update_time': 1774867786.781946, 'auction_closing_time': 1774970318.0}
2026-03-30 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE15332') HTTP/1.1" 204 0
2026-03-30 10:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_525c9ba90d33cd0497a675ac0d5b7c87.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_bb3f22ef5cf5266182f5cabc07d962ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f101d0>
2026-03-30 10:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_525c9ba90d33cd0497a675ac0d5b7c87.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_525c9ba90d33cd0497a675ac0d5b7c87.jpg saved to cache
2026-03-30 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dbbb0c87-c588-5fd3-82c0-b4578d602596
2026-03-30 10:49:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b2fb10>
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_bb3f22ef5cf5266182f5cabc07d962ba.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_bb3f22ef5cf5266182f5cabc07d962ba.jpg saved to cache
2026-03-30 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dbbb0c87-c588-5fd3-82c0-b4578d602596
2026-03-30 10:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_8d07c58cdc28d4bfdd687e5910d826f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b09610>
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_8d07c58cdc28d4bfdd687e5910d826f7.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_8d07c58cdc28d4bfdd687e5910d826f7.jpg saved to cache
2026-03-30 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dbbb0c87-c588-5fd3-82c0-b4578d602596
2026-03-30 10:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_9e43854f59bf25dbfebabe70f30843e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_ced1c8ca60cd15f67735622380191b94.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fcad90>
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_9e43854f59bf25dbfebabe70f30843e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_9e43854f59bf25dbfebabe70f30843e2.jpg saved to cache
2026-03-30 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbbb0c87-c588-5fd3-82c0-b4578d602596
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b31c50>
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_ced1c8ca60cd15f67735622380191b94.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_ced1c8ca60cd15f67735622380191b94.jpg saved to cache
2026-03-30 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbbb0c87-c588-5fd3-82c0-b4578d602596
2026-03-30 10:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_5a00afadbe5803c5b163dc738f6d8dd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_445a970a1c2019b715ddac71beb91f86.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f14690>
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_5a00afadbe5803c5b163dc738f6d8dd4.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_5a00afadbe5803c5b163dc738f6d8dd4.jpg saved to cache
2026-03-30 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbbb0c87-c588-5fd3-82c0-b4578d602596
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ec2750>
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_445a970a1c2019b715ddac71beb91f86.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_445a970a1c2019b715ddac71beb91f86.jpg saved to cache
2026-03-30 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbbb0c87-c588-5fd3-82c0-b4578d602596
2026-03-30 10:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP99561> (referer: https://www.auto1.com/v1/car-details-view/JP99561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1b648c6-ee92-5cdb-a624-302b4eee6987 with identifier: JP99561
2026-03-30 10:49:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1b648c6-ee92-5cdb-a624-302b4eee6987 with scrape type 1
2026-03-30 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b1b648c6-ee92-5cdb-a624-302b4eee6987
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_f8a98528c600c7993eb7b69536230f59.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_f8a98528c600c7993eb7b69536230f59.jpg not downloaded yet
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_9e004c255a6e6135f287fe9014384c67.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_9e004c255a6e6135f287fe9014384c67.jpg not downloaded yet
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_5625d25a58ddef0111aade80890351da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_5625d25a58ddef0111aade80890351da.jpg not downloaded yet
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_338d02517ea6cd5710c58396de78b619.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_338d02517ea6cd5710c58396de78b619.jpg not downloaded yet
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_be899830ceac273e3e015f53ddc11add.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_be899830ceac273e3e015f53ddc11add.jpg not downloaded yet
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_4fbe63435d469d3ff308e15d26c58fc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_4fbe63435d469d3ff308e15d26c58fc1.jpg not downloaded yet
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_d7a8273852325bf03efdaf2fcde4c93f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_d7a8273852325bf03efdaf2fcde4c93f.jpg not downloaded yet
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_b51b82fdd8c72c824042c8bf8f65880f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_b51b82fdd8c72c824042c8bf8f65880f.jpg not downloaded yet
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_6f91a70f2c3748f1854c335963b620d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_6f91a70f2c3748f1854c335963b620d5.jpg not downloaded yet
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_ab1862e776712bf31c925d5d06c7938e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_ab1862e776712bf31c925d5d06c7938e.jpg not downloaded yet
2026-03-30 10:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_4e60d4160ae9a6dfb7b46e319726b986.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb3fd0>
2026-03-30 10:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0e%252F1e0ef707ba2a01e5d00685ea06973e8f%252Fpa%252FTM99691_4e60d4160ae9a6dfb7b46e319726b986.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_4e60d4160ae9a6dfb7b46e319726b986.jpg saved to cache
2026-03-30 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbbb0c87-c588-5fd3-82c0-b4578d602596
2026-03-30 10:49:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbbb0c87-c588-5fd3-82c0-b4578d602596, skipping ID generation
2026-03-30 10:49:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbbb0c87-c588-5fd3-82c0-b4578d602596 with scrape type 1
2026-03-30 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbbb0c87-c588-5fd3-82c0-b4578d602596 sending to next pipeline
2026-03-30 10:49:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbbb0c87-c588-5fd3-82c0-b4578d602596, identifier: TM99691
2026-03-30 10:49:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbbb0c87-c588-5fd3-82c0-b4578d602596 with identifier: TM99691
2026-03-30 10:49:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbbb0c87-c588-5fd3-82c0-b4578d602596 with identifier: TM99691
2026-03-30 10:49:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbbb0c87-c588-5fd3-82c0-b4578d602596 with identifier: TM99691 to the API
2026-03-30 10:49:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_4e60d4160ae9a6dfb7b46e319726b986.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:01:38Z',
 'fuel_type': 'petrol',
 'id': 'dbbb0c87-c588-5fd3-82c0-b4578d602596',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM99691',
 'listing': 'auction',
 'location': 'DE, Weiterstadt',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 169114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3190249,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_4e60d4160ae9a6dfb7b46e319726b986.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_445a970a1c2019b715ddac71beb91f86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_5a00afadbe5803c5b163dc738f6d8dd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_ced1c8ca60cd15f67735622380191b94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_9e43854f59bf25dbfebabe70f30843e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2946249,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_8d07c58cdc28d4bfdd687e5910d826f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2803022,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_bb3f22ef5cf5266182f5cabc07d962ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2941089,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_525c9ba90d33cd0497a675ac0d5b7c87.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_2c89c4002de6c96c0743368254e27982.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbb0c87-c588-5fd3-82c0-b4578d602596/dbbb0c87-c588-5fd3-82c0-b4578d602596_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/0e/1e0ef707ba2a01e5d00685ea06973e8f/pa/TM99691_781661b2f73d8835a7cbdb676c2db698.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i40 1.6 5 Star Edition',
 'transmission': 'manual',
 'trim': '5 Star Edition',
 'year': 2013}
2026-03-30 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM99691%27 HTTP/1.1" 200 None
2026-03-30 10:49:49 [auto1.de] INFO: Saving data for TM99691: {'created_time': 1774867789.767326, 'last_price_update_time': 1774867789.767338, 'auction_closing_time': 1774969298.0}
2026-03-30 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM99691') HTTP/1.1" 204 0
2026-03-30 10:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_ab1862e776712bf31c925d5d06c7938e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG19092/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_6f91a70f2c3748f1854c335963b620d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5012510>
2026-03-30 10:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_ab1862e776712bf31c925d5d06c7938e.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_ab1862e776712bf31c925d5d06c7938e.jpg saved to cache
2026-03-30 10:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b1b648c6-ee92-5cdb-a624-302b4eee6987
2026-03-30 10:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee0c50>
2026-03-30 10:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_6f91a70f2c3748f1854c335963b620d5.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_6f91a70f2c3748f1854c335963b620d5.jpg saved to cache
2026-03-30 10:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b1b648c6-ee92-5cdb-a624-302b4eee6987
2026-03-30 10:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_b51b82fdd8c72c824042c8bf8f65880f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_d7a8273852325bf03efdaf2fcde4c93f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ec3610>
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_b51b82fdd8c72c824042c8bf8f65880f.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_b51b82fdd8c72c824042c8bf8f65880f.jpg saved to cache
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b1b648c6-ee92-5cdb-a624-302b4eee6987
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b03750>
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_d7a8273852325bf03efdaf2fcde4c93f.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_d7a8273852325bf03efdaf2fcde4c93f.jpg saved to cache
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b1b648c6-ee92-5cdb-a624-302b4eee6987
2026-03-30 10:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_4fbe63435d469d3ff308e15d26c58fc1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5013190>
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_4fbe63435d469d3ff308e15d26c58fc1.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_4fbe63435d469d3ff308e15d26c58fc1.jpg saved to cache
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1b648c6-ee92-5cdb-a624-302b4eee6987
2026-03-30 10:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_be899830ceac273e3e015f53ddc11add.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f11e90>
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_be899830ceac273e3e015f53ddc11add.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_be899830ceac273e3e015f53ddc11add.jpg saved to cache
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1b648c6-ee92-5cdb-a624-302b4eee6987
2026-03-30 10:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_338d02517ea6cd5710c58396de78b619.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_5625d25a58ddef0111aade80890351da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b23f10>
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_338d02517ea6cd5710c58396de78b619.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_338d02517ea6cd5710c58396de78b619.jpg saved to cache
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1b648c6-ee92-5cdb-a624-302b4eee6987
2026-03-30 10:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_9e004c255a6e6135f287fe9014384c67.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN56008/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f12450>
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_5625d25a58ddef0111aade80890351da.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_5625d25a58ddef0111aade80890351da.jpg saved to cache
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1b648c6-ee92-5cdb-a624-302b4eee6987
2026-03-30 10:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_f8a98528c600c7993eb7b69536230f59.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c1f10>
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_9e004c255a6e6135f287fe9014384c67.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_9e004c255a6e6135f287fe9014384c67.jpg saved to cache
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1b648c6-ee92-5cdb-a624-302b4eee6987
2026-03-30 10:49:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef501fcd0>
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fab%252F76ab071dbbe31b8a329f4f9d38f34457%252Fpa%252FJP99561_f8a98528c600c7993eb7b69536230f59.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_f8a98528c600c7993eb7b69536230f59.jpg saved to cache
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1b648c6-ee92-5cdb-a624-302b4eee6987
2026-03-30 10:49:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1b648c6-ee92-5cdb-a624-302b4eee6987, skipping ID generation
2026-03-30 10:49:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1b648c6-ee92-5cdb-a624-302b4eee6987 with scrape type 1
2026-03-30 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1b648c6-ee92-5cdb-a624-302b4eee6987 sending to next pipeline
2026-03-30 10:49:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1b648c6-ee92-5cdb-a624-302b4eee6987, identifier: JP99561
2026-03-30 10:49:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1b648c6-ee92-5cdb-a624-302b4eee6987 with identifier: JP99561
2026-03-30 10:49:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1b648c6-ee92-5cdb-a624-302b4eee6987 with identifier: JP99561
2026-03-30 10:49:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1b648c6-ee92-5cdb-a624-302b4eee6987 with identifier: JP99561 to the API
2026-03-30 10:49:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_f8a98528c600c7993eb7b69536230f59.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:45:13Z',
 'fuel_type': 'petrol',
 'id': 'b1b648c6-ee92-5cdb-a624-302b4eee6987',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP99561',
 'listing': 'auction',
 'location': 'DE, Augsburg',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 10384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394676,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_f8a98528c600c7993eb7b69536230f59.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61109,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_9e004c255a6e6135f287fe9014384c67.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63156,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_5625d25a58ddef0111aade80890351da.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47358,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_338d02517ea6cd5710c58396de78b619.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66789,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_be899830ceac273e3e015f53ddc11add.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61079,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_4fbe63435d469d3ff308e15d26c58fc1.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43436,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_d7a8273852325bf03efdaf2fcde4c93f.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59993,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_b51b82fdd8c72c824042c8bf8f65880f.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61166,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_6f91a70f2c3748f1854c335963b620d5.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1b648c6-ee92-5cdb-a624-302b4eee6987/b1b648c6-ee92-5cdb-a624-302b4eee6987_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52521,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img76/ab/76ab071dbbe31b8a329f4f9d38f34457/pa/JP99561_ab1862e776712bf31c925d5d06c7938e.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake Mild-Hybrid AMG '
          'Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-03-30 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP99561%27 HTTP/1.1" 200 None
2026-03-30 10:49:51 [auto1.de] INFO: Saving data for JP99561: {'created_time': 1774867791.505989, 'last_price_update_time': 1774867791.505999, 'auction_closing_time': 1774971913.0}
2026-03-30 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP99561') HTTP/1.1" 204 0
2026-03-30 10:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY45560/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:53 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.943(s), this was the 1st time calling it.
2026-03-30 10:49:53 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.587082971239987 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA14894> (referer: https://www.auto1.com/v1/car-details-view/RA14894/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1dd074c-f1f5-5597-86bf-8fd7e40766f3 with identifier: RA14894
2026-03-30 10:49:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1dd074c-f1f5-5597-86bf-8fd7e40766f3 with scrape type 1
2026-03-30 10:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b1dd074c-f1f5-5597-86bf-8fd7e40766f3
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_12244b386568fc55c47bf101a418c83d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_12244b386568fc55c47bf101a418c83d.jpg not downloaded yet
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_760ba9924b2e0d2049356039f67160d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_760ba9924b2e0d2049356039f67160d2.jpg not downloaded yet
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_29f81a171183b5d0594653c84b8b3ea3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_29f81a171183b5d0594653c84b8b3ea3.jpg not downloaded yet
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_523da5316c06562e5bd43d7c96fffa7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_523da5316c06562e5bd43d7c96fffa7f.jpg not downloaded yet
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_7305ee82d1286359871e94a7f29b6b07.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_7305ee82d1286359871e94a7f29b6b07.jpg not downloaded yet
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_fb58a3d352af0ae4ec41a4ddb4383326.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_fb58a3d352af0ae4ec41a4ddb4383326.jpg not downloaded yet
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_7c4ed1be20191feecb3be485964add79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_7c4ed1be20191feecb3be485964add79.jpg not downloaded yet
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_8b440aad8da201a6339c57dd0cec2190.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_8b440aad8da201a6339c57dd0cec2190.jpg not downloaded yet
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_5d7ae49dcee918a18a28d757147ffd9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_5d7ae49dcee918a18a28d757147ffd9f.jpg not downloaded yet
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_638db0df6d8e3c93a32fb451f155aef1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_638db0df6d8e3c93a32fb451f155aef1.jpg not downloaded yet
2026-03-30 10:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU04536/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_638db0df6d8e3c93a32fb451f155aef1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c3ad0>
2026-03-30 10:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_638db0df6d8e3c93a32fb451f155aef1.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_638db0df6d8e3c93a32fb451f155aef1.jpg saved to cache
2026-03-30 10:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b1dd074c-f1f5-5597-86bf-8fd7e40766f3
2026-03-30 10:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY96342/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_5d7ae49dcee918a18a28d757147ffd9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b34990>
2026-03-30 10:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_5d7ae49dcee918a18a28d757147ffd9f.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_5d7ae49dcee918a18a28d757147ffd9f.jpg saved to cache
2026-03-30 10:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b1dd074c-f1f5-5597-86bf-8fd7e40766f3
2026-03-30 10:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ93598> (referer: https://www.auto1.com/v1/car-details-view/UZ93598/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75dd3c21-65de-588b-9047-2020a5ae6051 with identifier: UZ93598
2026-03-30 10:49:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75dd3c21-65de-588b-9047-2020a5ae6051 with scrape type 1
2026-03-30 10:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 75dd3c21-65de-588b-9047-2020a5ae6051
2026-03-30 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Ffc%252F7ffcc6c21faa38dd008a088da3d3f6f5%252Fpa%252FUZ93598_7113e5e6beb90537a32935c5b77ee686.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/fc/7ffcc6c21faa38dd008a088da3d3f6f5/pa/UZ93598_7113e5e6beb90537a32935c5b77ee686.jpg already downloaded
2026-03-30 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Ffc%252F7ffcc6c21faa38dd008a088da3d3f6f5%252Fpa%252FUZ93598_b4b80b6d6f9053be7e27167579b5b831.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/fc/7ffcc6c21faa38dd008a088da3d3f6f5/pa/UZ93598_b4b80b6d6f9053be7e27167579b5b831.jpg already downloaded
2026-03-30 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Ffc%252F7ffcc6c21faa38dd008a088da3d3f6f5%252Fpa%252FUZ93598_0708f2d75bc5e32fac2f476acdf48397.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/fc/7ffcc6c21faa38dd008a088da3d3f6f5/pa/UZ93598_0708f2d75bc5e32fac2f476acdf48397.jpg already downloaded
2026-03-30 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Ffc%252F7ffcc6c21faa38dd008a088da3d3f6f5%252Fpa%252FUZ93598_6a7af6d215306a23534154fcfea7a6c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/fc/7ffcc6c21faa38dd008a088da3d3f6f5/pa/UZ93598_6a7af6d215306a23534154fcfea7a6c3.jpg already downloaded
2026-03-30 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Ffc%252F7ffcc6c21faa38dd008a088da3d3f6f5%252Fpa%252FUZ93598_0f5f2060cfefc49284f663df8cf8e1cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/fc/7ffcc6c21faa38dd008a088da3d3f6f5/pa/UZ93598_0f5f2060cfefc49284f663df8cf8e1cd.jpg already downloaded
2026-03-30 10:49:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75dd3c21-65de-588b-9047-2020a5ae6051, identifier: UZ93598
2026-03-30 10:49:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75dd3c21-65de-588b-9047-2020a5ae6051 with identifier: UZ93598
2026-03-30 10:49:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75dd3c21-65de-588b-9047-2020a5ae6051 with identifier: UZ93598
2026-03-30 10:49:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75dd3c21-65de-588b-9047-2020a5ae6051 with identifier: UZ93598 to the API
2026-03-30 10:49:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:49:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UZ93598>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 3',
 'engine': '1.9L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:09:56Z',
 'fuel_type': 'diesel',
 'id': '75dd3c21-65de-588b-9047-2020a5ae6051',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ93598',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 278976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img7f/fc/7ffcc6c21faa38dd008a088da3d3f6f5/pa/UZ93598_7113e5e6beb90537a32935c5b77ee686.jpg',
                'https://img-pa.auto1.com/img7f/fc/7ffcc6c21faa38dd008a088da3d3f6f5/pa/UZ93598_b4b80b6d6f9053be7e27167579b5b831.jpg',
                'https://img-pa.auto1.com/img7f/fc/7ffcc6c21faa38dd008a088da3d3f6f5/pa/UZ93598_0708f2d75bc5e32fac2f476acdf48397.jpg',
                'https://img-pa.auto1.com/img7f/fc/7ffcc6c21faa38dd008a088da3d3f6f5/pa/UZ93598_6a7af6d215306a23534154fcfea7a6c3.jpg',
                'https://img-pa.auto1.com/img7f/fc/7ffcc6c21faa38dd008a088da3d3f6f5/pa/UZ93598_0f5f2060cfefc49284f663df8cf8e1cd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75dd3c21-65de-588b-9047-2020a5ae6051/75dd3c21-65de-588b-9047-2020a5ae6051_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/fc/7ffcc6c21faa38dd008a088da3d3f6f5/pa/UZ93598_7113e5e6beb90537a32935c5b77ee686.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75dd3c21-65de-588b-9047-2020a5ae6051/75dd3c21-65de-588b-9047-2020a5ae6051_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/fc/7ffcc6c21faa38dd008a088da3d3f6f5/pa/UZ93598_b4b80b6d6f9053be7e27167579b5b831.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75dd3c21-65de-588b-9047-2020a5ae6051/75dd3c21-65de-588b-9047-2020a5ae6051_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/fc/7ffcc6c21faa38dd008a088da3d3f6f5/pa/UZ93598_0708f2d75bc5e32fac2f476acdf48397.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75dd3c21-65de-588b-9047-2020a5ae6051/75dd3c21-65de-588b-9047-2020a5ae6051_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/fc/7ffcc6c21faa38dd008a088da3d3f6f5/pa/UZ93598_6a7af6d215306a23534154fcfea7a6c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75dd3c21-65de-588b-9047-2020a5ae6051/75dd3c21-65de-588b-9047-2020a5ae6051_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/fc/7ffcc6c21faa38dd008a088da3d3f6f5/pa/UZ93598_0f5f2060cfefc49284f663df8cf8e1cd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 1.9 TDI Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2005}
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ93598%27 HTTP/1.1" 200 None
2026-03-30 10:49:59 [auto1.de] INFO: Saving data for UZ93598: {'created_time': 1774867799.160888, 'last_price_update_time': 1774867799.1609, 'auction_closing_time': 1774969796.0}
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ93598') HTTP/1.1" 204 0
2026-03-30 10:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_8b440aad8da201a6339c57dd0cec2190.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea8210>
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_8b440aad8da201a6339c57dd0cec2190.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_8b440aad8da201a6339c57dd0cec2190.jpg saved to cache
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b1dd074c-f1f5-5597-86bf-8fd7e40766f3
2026-03-30 10:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_7c4ed1be20191feecb3be485964add79.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da0cd0>
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_7c4ed1be20191feecb3be485964add79.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_7c4ed1be20191feecb3be485964add79.jpg saved to cache
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b1dd074c-f1f5-5597-86bf-8fd7e40766f3
2026-03-30 10:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_fb58a3d352af0ae4ec41a4ddb4383326.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_7305ee82d1286359871e94a7f29b6b07.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB25912> (referer: https://www.auto1.com/v1/car-details-view/ZB25912/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:49:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da0e90>
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_fb58a3d352af0ae4ec41a4ddb4383326.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_fb58a3d352af0ae4ec41a4ddb4383326.jpg saved to cache
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1dd074c-f1f5-5597-86bf-8fd7e40766f3
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb2910>
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_7305ee82d1286359871e94a7f29b6b07.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_7305ee82d1286359871e94a7f29b6b07.jpg saved to cache
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1dd074c-f1f5-5597-86bf-8fd7e40766f3
2026-03-30 10:49:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 621285ad-fa86-5dbc-a5d8-784d3bc590d9 with identifier: ZB25912
2026-03-30 10:49:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 621285ad-fa86-5dbc-a5d8-784d3bc590d9 with scrape type 1
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 621285ad-fa86-5dbc-a5d8-784d3bc590d9
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_e42313533db14cb65d6beefc52cfb06d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_e42313533db14cb65d6beefc52cfb06d.jpg not downloaded yet
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_21be5b5dca65e8b3d4d6275aeeb1c002.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_21be5b5dca65e8b3d4d6275aeeb1c002.jpg not downloaded yet
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_fc3eaecbed0c4058c62d50689860a0a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_fc3eaecbed0c4058c62d50689860a0a6.jpg not downloaded yet
2026-03-30 10:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_523da5316c06562e5bd43d7c96fffa7f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_2d85b096f970320b5ae9eb3b833a66e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_2d85b096f970320b5ae9eb3b833a66e5.jpg not downloaded yet
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_33298f3da3c7fdfae7e05a3f39d7bf10.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_33298f3da3c7fdfae7e05a3f39d7bf10.jpg not downloaded yet
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_9e2862e27535c80eb35eec6dbb8552c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_9e2862e27535c80eb35eec6dbb8552c8.jpg not downloaded yet
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_016be3a4c7fda0d7b85be520d4f795be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_016be3a4c7fda0d7b85be520d4f795be.jpg not downloaded yet
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_2294172d5209c03f2d8c01dab98f7961.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_2294172d5209c03f2d8c01dab98f7961.jpg not downloaded yet
2026-03-30 10:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_21be5b5dca65e8b3d4d6275aeeb1c002.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_52038e74d94d7048601e8cc9f0825954.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_52038e74d94d7048601e8cc9f0825954.jpg not downloaded yet
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_cf7af837faf63453b3cc077bfbf002d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_cf7af837faf63453b3cc077bfbf002d9.jpg not downloaded yet
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0e550>
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_523da5316c06562e5bd43d7c96fffa7f.jpg') HTTP/1.1" 204 0
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_523da5316c06562e5bd43d7c96fffa7f.jpg saved to cache
2026-03-30 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1dd074c-f1f5-5597-86bf-8fd7e40766f3
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fcb4d0>
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_21be5b5dca65e8b3d4d6275aeeb1c002.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_21be5b5dca65e8b3d4d6275aeeb1c002.jpg saved to cache
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 621285ad-fa86-5dbc-a5d8-784d3bc590d9
2026-03-30 10:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_2294172d5209c03f2d8c01dab98f7961.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_29f81a171183b5d0594653c84b8b3ea3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_52038e74d94d7048601e8cc9f0825954.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da2990>
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_2294172d5209c03f2d8c01dab98f7961.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_2294172d5209c03f2d8c01dab98f7961.jpg saved to cache
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 621285ad-fa86-5dbc-a5d8-784d3bc590d9
2026-03-30 10:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_016be3a4c7fda0d7b85be520d4f795be.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f13850>
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_29f81a171183b5d0594653c84b8b3ea3.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_29f81a171183b5d0594653c84b8b3ea3.jpg saved to cache
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1dd074c-f1f5-5597-86bf-8fd7e40766f3
2026-03-30 10:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_cf7af837faf63453b3cc077bfbf002d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb1610>
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_52038e74d94d7048601e8cc9f0825954.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_52038e74d94d7048601e8cc9f0825954.jpg saved to cache
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 621285ad-fa86-5dbc-a5d8-784d3bc590d9
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b20dd0>
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_016be3a4c7fda0d7b85be520d4f795be.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_016be3a4c7fda0d7b85be520d4f795be.jpg saved to cache
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 621285ad-fa86-5dbc-a5d8-784d3bc590d9
2026-03-30 10:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_9e2862e27535c80eb35eec6dbb8552c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595c710>
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_cf7af837faf63453b3cc077bfbf002d9.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_cf7af837faf63453b3cc077bfbf002d9.jpg saved to cache
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 621285ad-fa86-5dbc-a5d8-784d3bc590d9
2026-03-30 10:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_33298f3da3c7fdfae7e05a3f39d7bf10.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_2d85b096f970320b5ae9eb3b833a66e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da01d0>
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_9e2862e27535c80eb35eec6dbb8552c8.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_9e2862e27535c80eb35eec6dbb8552c8.jpg saved to cache
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 621285ad-fa86-5dbc-a5d8-784d3bc590d9
2026-03-30 10:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_e42313533db14cb65d6beefc52cfb06d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_fc3eaecbed0c4058c62d50689860a0a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e29b50>
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_33298f3da3c7fdfae7e05a3f39d7bf10.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_33298f3da3c7fdfae7e05a3f39d7bf10.jpg saved to cache
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 621285ad-fa86-5dbc-a5d8-784d3bc590d9
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a341d0>
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_2d85b096f970320b5ae9eb3b833a66e5.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_2d85b096f970320b5ae9eb3b833a66e5.jpg saved to cache
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 621285ad-fa86-5dbc-a5d8-784d3bc590d9
2026-03-30 10:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_12244b386568fc55c47bf101a418c83d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f89e50>
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_e42313533db14cb65d6beefc52cfb06d.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_e42313533db14cb65d6beefc52cfb06d.jpg saved to cache
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 621285ad-fa86-5dbc-a5d8-784d3bc590d9
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef8152d10>
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff2%252Fe3f2c7c28c641e1ad2a88d10ed3f6960%252Fpa%252FZB25912_fc3eaecbed0c4058c62d50689860a0a6.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_fc3eaecbed0c4058c62d50689860a0a6.jpg saved to cache
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 621285ad-fa86-5dbc-a5d8-784d3bc590d9
2026-03-30 10:50:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 621285ad-fa86-5dbc-a5d8-784d3bc590d9, skipping ID generation
2026-03-30 10:50:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 621285ad-fa86-5dbc-a5d8-784d3bc590d9 with scrape type 1
2026-03-30 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 621285ad-fa86-5dbc-a5d8-784d3bc590d9 sending to next pipeline
2026-03-30 10:50:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 621285ad-fa86-5dbc-a5d8-784d3bc590d9, identifier: ZB25912
2026-03-30 10:50:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 621285ad-fa86-5dbc-a5d8-784d3bc590d9 with identifier: ZB25912
2026-03-30 10:50:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 621285ad-fa86-5dbc-a5d8-784d3bc590d9 with identifier: ZB25912
2026-03-30 10:50:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 621285ad-fa86-5dbc-a5d8-784d3bc590d9 with identifier: ZB25912 to the API
2026-03-30 10:50:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_fc3eaecbed0c4058c62d50689860a0a6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:39:54Z',
 'fuel_type': 'electro',
 'id': '621285ad-fa86-5dbc-a5d8-784d3bc590d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB25912',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 38,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_e42313533db14cb65d6beefc52cfb06d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_21be5b5dca65e8b3d4d6275aeeb1c002.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_fc3eaecbed0c4058c62d50689860a0a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_2d85b096f970320b5ae9eb3b833a66e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_33298f3da3c7fdfae7e05a3f39d7bf10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_9e2862e27535c80eb35eec6dbb8552c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_016be3a4c7fda0d7b85be520d4f795be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_2294172d5209c03f2d8c01dab98f7961.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_52038e74d94d7048601e8cc9f0825954.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621285ad-fa86-5dbc-a5d8-784d3bc590d9/621285ad-fa86-5dbc-a5d8-784d3bc590d9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/f2/e3f2c7c28c641e1ad2a88d10ed3f6960/pa/ZB25912_cf7af837faf63453b3cc077bfbf002d9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-30 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB25912%27 HTTP/1.1" 200 None
2026-03-30 10:50:01 [auto1.de] INFO: Saving data for ZB25912: {'created_time': 1774867801.483795, 'last_price_update_time': 1774867801.48381, 'auction_closing_time': 1774971594.0}
2026-03-30 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB25912') HTTP/1.1" 204 0
2026-03-30 10:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_760ba9924b2e0d2049356039f67160d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a36810>
2026-03-30 10:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_12244b386568fc55c47bf101a418c83d.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_12244b386568fc55c47bf101a418c83d.jpg saved to cache
2026-03-30 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1dd074c-f1f5-5597-86bf-8fd7e40766f3
2026-03-30 10:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8a810>
2026-03-30 10:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afbf3d11a0009c720a2e2641698d69d%252Fpa%252FRA14894_760ba9924b2e0d2049356039f67160d2.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_760ba9924b2e0d2049356039f67160d2.jpg saved to cache
2026-03-30 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1dd074c-f1f5-5597-86bf-8fd7e40766f3
2026-03-30 10:50:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1dd074c-f1f5-5597-86bf-8fd7e40766f3, skipping ID generation
2026-03-30 10:50:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1dd074c-f1f5-5597-86bf-8fd7e40766f3 with scrape type 1
2026-03-30 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1dd074c-f1f5-5597-86bf-8fd7e40766f3 sending to next pipeline
2026-03-30 10:50:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1dd074c-f1f5-5597-86bf-8fd7e40766f3, identifier: RA14894
2026-03-30 10:50:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1dd074c-f1f5-5597-86bf-8fd7e40766f3 with identifier: RA14894
2026-03-30 10:50:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1dd074c-f1f5-5597-86bf-8fd7e40766f3 with identifier: RA14894
2026-03-30 10:50:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1dd074c-f1f5-5597-86bf-8fd7e40766f3 with identifier: RA14894 to the API
2026-03-30 10:50:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_760ba9924b2e0d2049356039f67160d2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 194,
 'expiration_date': '2026-03-31T15:03:13Z',
 'fuel_type': 'petrol',
 'id': 'b1dd074c-f1f5-5597-86bf-8fd7e40766f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA14894',
 'listing': 'auction',
 'location': 'DE, Dresden',
 'make': 'Mazda',
 'model': '6',
 'odometer': 13971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_12244b386568fc55c47bf101a418c83d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_760ba9924b2e0d2049356039f67160d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2417595,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_29f81a171183b5d0594653c84b8b3ea3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694357,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_523da5316c06562e5bd43d7c96fffa7f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_7305ee82d1286359871e94a7f29b6b07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_fb58a3d352af0ae4ec41a4ddb4383326.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_7c4ed1be20191feecb3be485964add79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_8b440aad8da201a6339c57dd0cec2190.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_5d7ae49dcee918a18a28d757147ffd9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1dd074c-f1f5-5597-86bf-8fd7e40766f3/b1dd074c-f1f5-5597-86bf-8fd7e40766f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2395453,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afbf3d11a0009c720a2e2641698d69d/pa/RA14894_638db0df6d8e3c93a32fb451f155aef1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 6 2.5 SKYACTIV-G 20th Anniversary',
 'transmission': 'automatic',
 'trim': '20th Anniversary',
 'year': 2025}
2026-03-30 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA14894%27 HTTP/1.1" 200 None
2026-03-30 10:50:02 [auto1.de] INFO: Saving data for RA14894: {'created_time': 1774867802.111213, 'last_price_update_time': 1774867802.111226, 'auction_closing_time': 1774969393.0}
2026-03-30 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA14894') HTTP/1.1" 204 0
2026-03-30 10:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG19092> (referer: https://www.auto1.com/v1/car-details-view/WG19092/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a49713df-c901-5493-b83c-7bd4a45d195f with identifier: WG19092
2026-03-30 10:50:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a49713df-c901-5493-b83c-7bd4a45d195f with scrape type 1
2026-03-30 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a49713df-c901-5493-b83c-7bd4a45d195f
2026-03-30 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F9e%252F879ea0c027b30cda7a6f9937409ab9fe%252Fpa%252FWG19092_582326414f68ffbfad59ec2b27573968.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_582326414f68ffbfad59ec2b27573968.jpg not downloaded yet
2026-03-30 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F9e%252F879ea0c027b30cda7a6f9937409ab9fe%252Fpa%252FWG19092_b40906d4696831617b3b1bcf53bdb1ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_b40906d4696831617b3b1bcf53bdb1ec.jpg not downloaded yet
2026-03-30 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F9e%252F879ea0c027b30cda7a6f9937409ab9fe%252Fpa%252FWG19092_8c5eef6d6349115586f103d82c56e1a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_8c5eef6d6349115586f103d82c56e1a6.jpg not downloaded yet
2026-03-30 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F9e%252F879ea0c027b30cda7a6f9937409ab9fe%252Fpa%252FWG19092_135bf961ccdb6443d6d5b745b032ab27.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_135bf961ccdb6443d6d5b745b032ab27.jpg not downloaded yet
2026-03-30 10:50:04 [scrapy.extensions.logstats] INFO: Crawled 517 pages (at 36 pages/min), scraped 388 items (at 22 items/min)
2026-03-30 10:50:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-30 10:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F9e%252F879ea0c027b30cda7a6f9937409ab9fe%252Fpa%252FWG19092_c47aaeebbcb88bc1c45c4ac89efae844.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_c47aaeebbcb88bc1c45c4ac89efae844.jpg not downloaded yet
2026-03-30 10:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS99643/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_c47aaeebbcb88bc1c45c4ac89efae844.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2b310>
2026-03-30 10:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a49713df-c901-5493-b83c-7bd4a45d195f/a49713df-c901-5493-b83c-7bd4a45d195f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F9e%252F879ea0c027b30cda7a6f9937409ab9fe%252Fpa%252FWG19092_c47aaeebbcb88bc1c45c4ac89efae844.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_c47aaeebbcb88bc1c45c4ac89efae844.jpg saved to cache
2026-03-30 10:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a49713df-c901-5493-b83c-7bd4a45d195f
2026-03-30 10:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CJ42991/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_135bf961ccdb6443d6d5b745b032ab27.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5997210>
2026-03-30 10:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a49713df-c901-5493-b83c-7bd4a45d195f/a49713df-c901-5493-b83c-7bd4a45d195f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F9e%252F879ea0c027b30cda7a6f9937409ab9fe%252Fpa%252FWG19092_135bf961ccdb6443d6d5b745b032ab27.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_135bf961ccdb6443d6d5b745b032ab27.jpg saved to cache
2026-03-30 10:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a49713df-c901-5493-b83c-7bd4a45d195f
2026-03-30 10:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD36296> (referer: https://www.auto1.com/v1/car-details-view/MD36296/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9af7424f-9eb6-5de7-9aea-72501ef869a4 with identifier: MD36296
2026-03-30 10:50:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9af7424f-9eb6-5de7-9aea-72501ef869a4 with scrape type 1
2026-03-30 10:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9af7424f-9eb6-5de7-9aea-72501ef869a4
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F3e%252F593ef9ec3da3cbecf8f80c1dbeaf54b7%252Fpa%252FMD36296_2fec47eb1f04f082cff2dde6cab1deb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_2fec47eb1f04f082cff2dde6cab1deb7.jpg already downloaded
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F3e%252F593ef9ec3da3cbecf8f80c1dbeaf54b7%252Fpa%252FMD36296_ad6657d065dd3483c16fa2093033ef7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_ad6657d065dd3483c16fa2093033ef7f.jpg already downloaded
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F3e%252F593ef9ec3da3cbecf8f80c1dbeaf54b7%252Fpa%252FMD36296_eb51431b10d9353eeeba4374ec5e3154.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_eb51431b10d9353eeeba4374ec5e3154.jpg already downloaded
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F3e%252F593ef9ec3da3cbecf8f80c1dbeaf54b7%252Fpa%252FMD36296_037bdad223ce48c116ae3f3f60ee6085.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_037bdad223ce48c116ae3f3f60ee6085.jpg already downloaded
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F3e%252F593ef9ec3da3cbecf8f80c1dbeaf54b7%252Fpa%252FMD36296_af235a5df3c16cb8015ce6ff088c8017.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_af235a5df3c16cb8015ce6ff088c8017.jpg already downloaded
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F3e%252F593ef9ec3da3cbecf8f80c1dbeaf54b7%252Fpa%252FMD36296_b77910d33bd21bc0b880b879a24dba23.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_b77910d33bd21bc0b880b879a24dba23.jpg already downloaded
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F3e%252F593ef9ec3da3cbecf8f80c1dbeaf54b7%252Fpa%252FMD36296_f8d46184f6ae034a8cfe3bdf622e4a32.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_f8d46184f6ae034a8cfe3bdf622e4a32.jpg already downloaded
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F3e%252F593ef9ec3da3cbecf8f80c1dbeaf54b7%252Fpa%252FMD36296_ca6fc985e22637dc6e4e34471e402df5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_ca6fc985e22637dc6e4e34471e402df5.jpg already downloaded
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F3e%252F593ef9ec3da3cbecf8f80c1dbeaf54b7%252Fpa%252FMD36296_b764fad037050098472a81671a1bb464.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_b764fad037050098472a81671a1bb464.jpg already downloaded
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F3e%252F593ef9ec3da3cbecf8f80c1dbeaf54b7%252Fpa%252FMD36296_3734007d6b7477b6256fcfbeef595e6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_3734007d6b7477b6256fcfbeef595e6a.jpg already downloaded
2026-03-30 10:50:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9af7424f-9eb6-5de7-9aea-72501ef869a4, identifier: MD36296
2026-03-30 10:50:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9af7424f-9eb6-5de7-9aea-72501ef869a4 with identifier: MD36296
2026-03-30 10:50:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9af7424f-9eb6-5de7-9aea-72501ef869a4 with identifier: MD36296
2026-03-30 10:50:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9af7424f-9eb6-5de7-9aea-72501ef869a4 with identifier: MD36296 to the API
2026-03-30 10:50:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MD36296>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:01:30Z',
 'fuel_type': 'diesel',
 'id': '9af7424f-9eb6-5de7-9aea-72501ef869a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD36296',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 237974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_2fec47eb1f04f082cff2dde6cab1deb7.jpg',
                'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_ad6657d065dd3483c16fa2093033ef7f.jpg',
                'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_eb51431b10d9353eeeba4374ec5e3154.jpg',
                'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_037bdad223ce48c116ae3f3f60ee6085.jpg',
                'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_af235a5df3c16cb8015ce6ff088c8017.jpg',
                'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_b77910d33bd21bc0b880b879a24dba23.jpg',
                'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_f8d46184f6ae034a8cfe3bdf622e4a32.jpg',
                'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_ca6fc985e22637dc6e4e34471e402df5.jpg',
                'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_b764fad037050098472a81671a1bb464.jpg',
                'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_3734007d6b7477b6256fcfbeef595e6a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9af7424f-9eb6-5de7-9aea-72501ef869a4/9af7424f-9eb6-5de7-9aea-72501ef869a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_2fec47eb1f04f082cff2dde6cab1deb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9af7424f-9eb6-5de7-9aea-72501ef869a4/9af7424f-9eb6-5de7-9aea-72501ef869a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_ad6657d065dd3483c16fa2093033ef7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9af7424f-9eb6-5de7-9aea-72501ef869a4/9af7424f-9eb6-5de7-9aea-72501ef869a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_eb51431b10d9353eeeba4374ec5e3154.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9af7424f-9eb6-5de7-9aea-72501ef869a4/9af7424f-9eb6-5de7-9aea-72501ef869a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_037bdad223ce48c116ae3f3f60ee6085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9af7424f-9eb6-5de7-9aea-72501ef869a4/9af7424f-9eb6-5de7-9aea-72501ef869a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_af235a5df3c16cb8015ce6ff088c8017.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9af7424f-9eb6-5de7-9aea-72501ef869a4/9af7424f-9eb6-5de7-9aea-72501ef869a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_b77910d33bd21bc0b880b879a24dba23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9af7424f-9eb6-5de7-9aea-72501ef869a4/9af7424f-9eb6-5de7-9aea-72501ef869a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_f8d46184f6ae034a8cfe3bdf622e4a32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9af7424f-9eb6-5de7-9aea-72501ef869a4/9af7424f-9eb6-5de7-9aea-72501ef869a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_ca6fc985e22637dc6e4e34471e402df5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9af7424f-9eb6-5de7-9aea-72501ef869a4/9af7424f-9eb6-5de7-9aea-72501ef869a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_b764fad037050098472a81671a1bb464.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9af7424f-9eb6-5de7-9aea-72501ef869a4/9af7424f-9eb6-5de7-9aea-72501ef869a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/3e/593ef9ec3da3cbecf8f80c1dbeaf54b7/pa/MD36296_3734007d6b7477b6256fcfbeef595e6a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2014}
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD36296%27 HTTP/1.1" 200 None
2026-03-30 10:50:17 [auto1.de] INFO: Saving data for MD36296: {'created_time': 1774867817.162945, 'last_price_update_time': 1774867817.162956, 'auction_closing_time': 1774969290.0}
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD36296') HTTP/1.1" 204 0
2026-03-30 10:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_8c5eef6d6349115586f103d82c56e1a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8f2d0>
2026-03-30 10:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a49713df-c901-5493-b83c-7bd4a45d195f/a49713df-c901-5493-b83c-7bd4a45d195f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F9e%252F879ea0c027b30cda7a6f9937409ab9fe%252Fpa%252FWG19092_8c5eef6d6349115586f103d82c56e1a6.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_8c5eef6d6349115586f103d82c56e1a6.jpg saved to cache
2026-03-30 10:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a49713df-c901-5493-b83c-7bd4a45d195f
2026-03-30 10:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_b40906d4696831617b3b1bcf53bdb1ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_582326414f68ffbfad59ec2b27573968.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c2550>
2026-03-30 10:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a49713df-c901-5493-b83c-7bd4a45d195f/a49713df-c901-5493-b83c-7bd4a45d195f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F9e%252F879ea0c027b30cda7a6f9937409ab9fe%252Fpa%252FWG19092_b40906d4696831617b3b1bcf53bdb1ec.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_b40906d4696831617b3b1bcf53bdb1ec.jpg saved to cache
2026-03-30 10:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a49713df-c901-5493-b83c-7bd4a45d195f
2026-03-30 10:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a64e10>
2026-03-30 10:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a49713df-c901-5493-b83c-7bd4a45d195f/a49713df-c901-5493-b83c-7bd4a45d195f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F9e%252F879ea0c027b30cda7a6f9937409ab9fe%252Fpa%252FWG19092_582326414f68ffbfad59ec2b27573968.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_582326414f68ffbfad59ec2b27573968.jpg saved to cache
2026-03-30 10:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a49713df-c901-5493-b83c-7bd4a45d195f
2026-03-30 10:50:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a49713df-c901-5493-b83c-7bd4a45d195f, skipping ID generation
2026-03-30 10:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a49713df-c901-5493-b83c-7bd4a45d195f with scrape type 1
2026-03-30 10:50:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a49713df-c901-5493-b83c-7bd4a45d195f sending to next pipeline
2026-03-30 10:50:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a49713df-c901-5493-b83c-7bd4a45d195f, identifier: WG19092
2026-03-30 10:50:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a49713df-c901-5493-b83c-7bd4a45d195f with identifier: WG19092
2026-03-30 10:50:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a49713df-c901-5493-b83c-7bd4a45d195f with identifier: WG19092
2026-03-30 10:50:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a49713df-c901-5493-b83c-7bd4a45d195f with identifier: WG19092 to the API
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_582326414f68ffbfad59ec2b27573968.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:07:08Z',
 'fuel_type': 'petrol',
 'id': 'a49713df-c901-5493-b83c-7bd4a45d195f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG19092',
 'listing': 'auction',
 'location': 'DE, Leipzig',
 'make': 'Nissan',
 'model': 'Almera Tino',
 'odometer': 66109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a49713df-c901-5493-b83c-7bd4a45d195f/a49713df-c901-5493-b83c-7bd4a45d195f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_582326414f68ffbfad59ec2b27573968.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a49713df-c901-5493-b83c-7bd4a45d195f/a49713df-c901-5493-b83c-7bd4a45d195f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_b40906d4696831617b3b1bcf53bdb1ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a49713df-c901-5493-b83c-7bd4a45d195f/a49713df-c901-5493-b83c-7bd4a45d195f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_8c5eef6d6349115586f103d82c56e1a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a49713df-c901-5493-b83c-7bd4a45d195f/a49713df-c901-5493-b83c-7bd4a45d195f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_135bf961ccdb6443d6d5b745b032ab27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a49713df-c901-5493-b83c-7bd4a45d195f/a49713df-c901-5493-b83c-7bd4a45d195f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/9e/879ea0c027b30cda7a6f9937409ab9fe/pa/WG19092_c47aaeebbcb88bc1c45c4ac89efae844.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Almera Tino 1.8 Acenta plus',
 'transmission': 'manual',
 'trim': 'Acenta plus',
 'year': 2005}
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG19092%27 HTTP/1.1" 200 None
2026-03-30 10:50:18 [auto1.de] INFO: Saving data for WG19092: {'created_time': 1774867818.027091, 'last_price_update_time': 1774867818.027103, 'auction_closing_time': 1774969628.0}
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG19092') HTTP/1.1" 204 0
2026-03-30 10:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN56008> (referer: https://www.auto1.com/v1/car-details-view/AN56008/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3cb308f-6aa0-5d32-aa12-3306cc968953 with identifier: AN56008
2026-03-30 10:50:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3cb308f-6aa0-5d32-aa12-3306cc968953 with scrape type 1
2026-03-30 10:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d3cb308f-6aa0-5d32-aa12-3306cc968953
2026-03-30 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F22%252Ff8223b316403aeb2c0d22d692eaaed57%252Fpa%252FAN56008_056044263474120a248ad4af586fda15.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/22/f8223b316403aeb2c0d22d692eaaed57/pa/AN56008_056044263474120a248ad4af586fda15.jpg already downloaded
2026-03-30 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F22%252Ff8223b316403aeb2c0d22d692eaaed57%252Fpa%252FAN56008_c3d084d0eecf7c134bcf439f0b3a134d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/22/f8223b316403aeb2c0d22d692eaaed57/pa/AN56008_c3d084d0eecf7c134bcf439f0b3a134d.jpg already downloaded
2026-03-30 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F22%252Ff8223b316403aeb2c0d22d692eaaed57%252Fpa%252FAN56008_9d18f4305e266830f7869426132072a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/22/f8223b316403aeb2c0d22d692eaaed57/pa/AN56008_9d18f4305e266830f7869426132072a4.jpg already downloaded
2026-03-30 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F22%252Ff8223b316403aeb2c0d22d692eaaed57%252Fpa%252FAN56008_d20565b33ec9639e06381777afa87757.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/22/f8223b316403aeb2c0d22d692eaaed57/pa/AN56008_d20565b33ec9639e06381777afa87757.jpg already downloaded
2026-03-30 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F22%252Ff8223b316403aeb2c0d22d692eaaed57%252Fpa%252FAN56008_dd126dc396c6dffb27d698de32e6d1cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/22/f8223b316403aeb2c0d22d692eaaed57/pa/AN56008_dd126dc396c6dffb27d698de32e6d1cf.jpg already downloaded
2026-03-30 10:50:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3cb308f-6aa0-5d32-aa12-3306cc968953, identifier: AN56008
2026-03-30 10:50:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3cb308f-6aa0-5d32-aa12-3306cc968953 with identifier: AN56008
2026-03-30 10:50:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3cb308f-6aa0-5d32-aa12-3306cc968953 with identifier: AN56008
2026-03-30 10:50:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3cb308f-6aa0-5d32-aa12-3306cc968953 with identifier: AN56008 to the API
2026-03-30 10:50:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AN56008>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:46:51Z',
 'fuel_type': 'diesel',
 'id': 'd3cb308f-6aa0-5d32-aa12-3306cc968953',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN56008',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 219522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgf8/22/f8223b316403aeb2c0d22d692eaaed57/pa/AN56008_056044263474120a248ad4af586fda15.jpg',
                'https://img-pa.auto1.com/imgf8/22/f8223b316403aeb2c0d22d692eaaed57/pa/AN56008_c3d084d0eecf7c134bcf439f0b3a134d.jpg',
                'https://img-pa.auto1.com/imgf8/22/f8223b316403aeb2c0d22d692eaaed57/pa/AN56008_9d18f4305e266830f7869426132072a4.jpg',
                'https://img-pa.auto1.com/imgf8/22/f8223b316403aeb2c0d22d692eaaed57/pa/AN56008_d20565b33ec9639e06381777afa87757.jpg',
                'https://img-pa.auto1.com/imgf8/22/f8223b316403aeb2c0d22d692eaaed57/pa/AN56008_dd126dc396c6dffb27d698de32e6d1cf.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cb308f-6aa0-5d32-aa12-3306cc968953/d3cb308f-6aa0-5d32-aa12-3306cc968953_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/22/f8223b316403aeb2c0d22d692eaaed57/pa/AN56008_056044263474120a248ad4af586fda15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cb308f-6aa0-5d32-aa12-3306cc968953/d3cb308f-6aa0-5d32-aa12-3306cc968953_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/22/f8223b316403aeb2c0d22d692eaaed57/pa/AN56008_c3d084d0eecf7c134bcf439f0b3a134d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cb308f-6aa0-5d32-aa12-3306cc968953/d3cb308f-6aa0-5d32-aa12-3306cc968953_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/22/f8223b316403aeb2c0d22d692eaaed57/pa/AN56008_9d18f4305e266830f7869426132072a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cb308f-6aa0-5d32-aa12-3306cc968953/d3cb308f-6aa0-5d32-aa12-3306cc968953_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/22/f8223b316403aeb2c0d22d692eaaed57/pa/AN56008_d20565b33ec9639e06381777afa87757.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cb308f-6aa0-5d32-aa12-3306cc968953/d3cb308f-6aa0-5d32-aa12-3306cc968953_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/22/f8223b316403aeb2c0d22d692eaaed57/pa/AN56008_dd126dc396c6dffb27d698de32e6d1cf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2011}
2026-03-30 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN56008%27 HTTP/1.1" 200 None
2026-03-30 10:50:24 [auto1.de] INFO: Saving data for AN56008: {'created_time': 1774867824.269645, 'last_price_update_time': 1774867824.269657, 'auction_closing_time': 1774972011.0}
2026-03-30 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN56008') HTTP/1.1" 204 0
2026-03-30 10:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN86582/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:26 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 9504 | hits on page: 40
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: AG12776
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: NG10221
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG10221%27 HTTP/1.1" 200 None
2026-03-30 10:50:26 [auto1.de] INFO: Scrape type for NG10221: 0
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: UU82160
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: XA81988
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: PF77669
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: KZ40910
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: LV20570
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: MD36296
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD36296%27 HTTP/1.1" 200 None
2026-03-30 10:50:26 [auto1.de] INFO: Scrape type for MD36296: 0
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: ZH93684
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH93684%27 HTTP/1.1" 200 None
2026-03-30 10:50:26 [auto1.de] INFO: Scrape type for ZH93684: 1
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: NM84118
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM84118%27 HTTP/1.1" 200 None
2026-03-30 10:50:26 [auto1.de] INFO: Scrape type for NM84118: 1
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: FN84005
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: AJ41355
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: DZ18684
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: CH70727
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH70727%27 HTTP/1.1" 200 None
2026-03-30 10:50:26 [auto1.de] INFO: Scrape type for CH70727: 1
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: RH55673
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH55673%27 HTTP/1.1" 200 None
2026-03-30 10:50:26 [auto1.de] INFO: Scrape type for RH55673: 1
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: GV01951
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: WR71249
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: AY54602
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY54602%27 HTTP/1.1" 200 None
2026-03-30 10:50:26 [auto1.de] INFO: Scrape type for AY54602: 1
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: SW67477
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW67477%27 HTTP/1.1" 200 None
2026-03-30 10:50:26 [auto1.de] INFO: Scrape type for SW67477: 2
2026-03-30 10:50:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca7bd3dd-5cb4-5f19-aaf3-05d03b5a338c with identifier: SW67477
2026-03-30 10:50:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca7bd3dd-5cb4-5f19-aaf3-05d03b5a338c with scrape type 2
2026-03-30 10:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca7bd3dd-5cb4-5f19-aaf3-05d03b5a338c with scrape type 2
2026-03-30 10:50:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca7bd3dd-5cb4-5f19-aaf3-05d03b5a338c, identifier: SW67477
2026-03-30 10:50:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca7bd3dd-5cb4-5f19-aaf3-05d03b5a338c with identifier: SW67477
2026-03-30 10:50:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca7bd3dd-5cb4-5f19-aaf3-05d03b5a338c with identifier: SW67477
2026-03-30 10:50:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca7bd3dd-5cb4-5f19-aaf3-05d03b5a338c with identifier: SW67477 to the API
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:43:11Z',
 'fuel_type': 'petrol',
 'id': 'ca7bd3dd-5cb4-5f19-aaf3-05d03b5a338c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW67477',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 81501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-17',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2015}
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW67477%27 HTTP/1.1" 200 None
2026-03-30 10:50:26 [auto1.de] INFO: Saving data for SW67477: {'auction_closing_time': 1774971791.0, 'created_time': 1774292215.582794, 'last_price_update_time': 1774867826.706463}
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW67477') HTTP/1.1" 204 0
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: CG08115
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: TU57543
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU57543%27 HTTP/1.1" 200 None
2026-03-30 10:50:26 [auto1.de] INFO: Scrape type for TU57543: 1
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: NJ99756
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ99756%27 HTTP/1.1" 200 None
2026-03-30 10:50:26 [auto1.de] INFO: Scrape type for NJ99756: 1
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: XK73988
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: CU76931
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: CE39561
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: EK50913
2026-03-30 10:50:26 [auto1.de] INFO: Found listing with ID: GF68697
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF68697%27 HTTP/1.1" 200 None
2026-03-30 10:50:26 [auto1.de] INFO: Scrape type for GF68697: 2
2026-03-30 10:50:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89f5427f-9377-5241-93f4-2bbdc85c3440 with identifier: GF68697
2026-03-30 10:50:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f5427f-9377-5241-93f4-2bbdc85c3440 with scrape type 2
2026-03-30 10:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89f5427f-9377-5241-93f4-2bbdc85c3440 with scrape type 2
2026-03-30 10:50:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89f5427f-9377-5241-93f4-2bbdc85c3440, identifier: GF68697
2026-03-30 10:50:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89f5427f-9377-5241-93f4-2bbdc85c3440 with identifier: GF68697
2026-03-30 10:50:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89f5427f-9377-5241-93f4-2bbdc85c3440 with identifier: GF68697
2026-03-30 10:50:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89f5427f-9377-5241-93f4-2bbdc85c3440 with identifier: GF68697 to the API
2026-03-30 10:50:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-31T15:26:46Z',
 'fuel_type': 'diesel',
 'id': '89f5427f-9377-5241-93f4-2bbdc85c3440',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF68697',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 112191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-12',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2019}
2026-03-30 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF68697%27 HTTP/1.1" 200 None
2026-03-30 10:50:27 [auto1.de] INFO: Saving data for GF68697: {'auction_closing_time': 1774970806.0, 'created_time': 1773306818.271798, 'last_price_update_time': 1774867827.410552}
2026-03-30 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF68697') HTTP/1.1" 204 0
2026-03-30 10:50:27 [auto1.de] INFO: Found listing with ID: AL28178
2026-03-30 10:50:27 [auto1.de] INFO: Found listing with ID: TN97869
2026-03-30 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN97869%27 HTTP/1.1" 200 None
2026-03-30 10:50:27 [auto1.de] INFO: Scrape type for TN97869: 2
2026-03-30 10:50:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78c8291d-701e-5e99-bcb6-a254c7b2f4af with identifier: TN97869
2026-03-30 10:50:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78c8291d-701e-5e99-bcb6-a254c7b2f4af with scrape type 2
2026-03-30 10:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78c8291d-701e-5e99-bcb6-a254c7b2f4af with scrape type 2
2026-03-30 10:50:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78c8291d-701e-5e99-bcb6-a254c7b2f4af, identifier: TN97869
2026-03-30 10:50:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78c8291d-701e-5e99-bcb6-a254c7b2f4af with identifier: TN97869
2026-03-30 10:50:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78c8291d-701e-5e99-bcb6-a254c7b2f4af with identifier: TN97869
2026-03-30 10:50:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78c8291d-701e-5e99-bcb6-a254c7b2f4af with identifier: TN97869 to the API
2026-03-30 10:50:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:03:02Z',
 'fuel_type': 'petrol',
 'id': '78c8291d-701e-5e99-bcb6-a254c7b2f4af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN97869',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 50079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-20',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2019}
2026-03-30 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN97869%27 HTTP/1.1" 200 None
2026-03-30 10:50:27 [auto1.de] INFO: Saving data for TN97869: {'auction_closing_time': 1774969382.0, 'created_time': 1773306031.829825, 'last_price_update_time': 1774867827.84237}
2026-03-30 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN97869') HTTP/1.1" 204 0
2026-03-30 10:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC44441> (referer: https://www.auto1.com/v1/car-details-view/HC44441/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY96342> (referer: https://www.auto1.com/v1/car-details-view/YY96342/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:27 [auto1.de] INFO: Found listing with ID: ZG52412
2026-03-30 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG52412%27 HTTP/1.1" 200 None
2026-03-30 10:50:27 [auto1.de] INFO: Scrape type for ZG52412: 2
2026-03-30 10:50:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34b054ef-a6e2-585e-b455-9a60db4f8519 with identifier: ZG52412
2026-03-30 10:50:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34b054ef-a6e2-585e-b455-9a60db4f8519 with scrape type 2
2026-03-30 10:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34b054ef-a6e2-585e-b455-9a60db4f8519 with scrape type 2
2026-03-30 10:50:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34b054ef-a6e2-585e-b455-9a60db4f8519, identifier: ZG52412
2026-03-30 10:50:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY45560> (referer: https://www.auto1.com/v1/car-details-view/NY45560/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34b054ef-a6e2-585e-b455-9a60db4f8519 with identifier: ZG52412
2026-03-30 10:50:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34b054ef-a6e2-585e-b455-9a60db4f8519 with identifier: ZG52412
2026-03-30 10:50:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34b054ef-a6e2-585e-b455-9a60db4f8519 with identifier: ZG52412 to the API
2026-03-30 10:50:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:16:41Z',
 'fuel_type': 'diesel',
 'id': '34b054ef-a6e2-585e-b455-9a60db4f8519',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG52412',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 178837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-12',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-30 10:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG52412%27 HTTP/1.1" 200 None
2026-03-30 10:50:28 [auto1.de] INFO: Saving data for ZG52412: {'auction_closing_time': 1774970201.0, 'created_time': 1773307409.903973, 'last_price_update_time': 1774867828.286889}
2026-03-30 10:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG52412') HTTP/1.1" 204 0
2026-03-30 10:50:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:28 [auto1.de] INFO: Found listing with ID: DT44924
2026-03-30 10:50:28 [auto1.de] INFO: Found listing with ID: TP11686
2026-03-30 10:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP11686%27 HTTP/1.1" 200 None
2026-03-30 10:50:28 [auto1.de] INFO: Scrape type for TP11686: 2
2026-03-30 10:50:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a78c832-8045-5b0f-9244-a1affa1952b4 with identifier: TP11686
2026-03-30 10:50:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a78c832-8045-5b0f-9244-a1affa1952b4 with scrape type 2
2026-03-30 10:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a78c832-8045-5b0f-9244-a1affa1952b4 with scrape type 2
2026-03-30 10:50:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a78c832-8045-5b0f-9244-a1affa1952b4, identifier: TP11686
2026-03-30 10:50:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a78c832-8045-5b0f-9244-a1affa1952b4 with identifier: TP11686
2026-03-30 10:50:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a78c832-8045-5b0f-9244-a1affa1952b4 with identifier: TP11686
2026-03-30 10:50:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a78c832-8045-5b0f-9244-a1affa1952b4 with identifier: TP11686 to the API
2026-03-30 10:50:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-31T15:29:20Z',
 'fuel_type': 'petrol',
 'id': '7a78c832-8045-5b0f-9244-a1affa1952b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP11686',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 52796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2022}
2026-03-30 10:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP11686%27 HTTP/1.1" 200 None
2026-03-30 10:50:28 [auto1.de] INFO: Saving data for TP11686: {'auction_closing_time': 1774970960.0, 'created_time': 1773306918.68996, 'last_price_update_time': 1774867828.915706}
2026-03-30 10:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP11686') HTTP/1.1" 204 0
2026-03-30 10:50:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50cfda84-e0d7-5d2c-aad0-e81061737e98 with identifier: HC44441
2026-03-30 10:50:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50cfda84-e0d7-5d2c-aad0-e81061737e98 with scrape type 1
2026-03-30 10:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 50cfda84-e0d7-5d2c-aad0-e81061737e98
2026-03-30 10:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F83%252Fa1835df2cef7f5557254481bbc73caf0%252Fpa%252FHC44441_6fcca2c4551332904edae674080f9f3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_6fcca2c4551332904edae674080f9f3a.jpg not downloaded yet
2026-03-30 10:50:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f33b256-ae79-5822-8422-c9bc3d19156d with identifier: YY96342
2026-03-30 10:50:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f33b256-ae79-5822-8422-c9bc3d19156d with scrape type 1
2026-03-30 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8f33b256-ae79-5822-8422-c9bc3d19156d
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fae%252Fdaaeda35164a255d93f54d1d82b0ed3d%252Fpa%252FYY96342_51397c4be328de7cfe2608803dc14ea6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_51397c4be328de7cfe2608803dc14ea6.jpg not downloaded yet
2026-03-30 10:50:29 [auto1.de] INFO: Found listing with ID: BX30024
2026-03-30 10:50:29 [auto1.de] INFO: Found listing with ID: DP32279
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP32279%27 HTTP/1.1" 200 None
2026-03-30 10:50:29 [auto1.de] INFO: Scrape type for DP32279: 1
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F83%252Fa1835df2cef7f5557254481bbc73caf0%252Fpa%252FHC44441_4898f10bb791e5051643891f19d91bdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_4898f10bb791e5051643891f19d91bdc.jpg not downloaded yet
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fae%252Fdaaeda35164a255d93f54d1d82b0ed3d%252Fpa%252FYY96342_3c04af4f7b2db4c7e9238de162450a00.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_3c04af4f7b2db4c7e9238de162450a00.jpg not downloaded yet
2026-03-30 10:50:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc3605dc-32e2-5789-a46b-9b3d8104fa00 with identifier: NY45560
2026-03-30 10:50:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc3605dc-32e2-5789-a46b-9b3d8104fa00 with scrape type 1
2026-03-30 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item bc3605dc-32e2-5789-a46b-9b3d8104fa00
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fce%252Ff2ce52bb9a0de984b139dbf289124417%252Fpa%252FNY45560_d6bb7bf4220caa2ed3a87e5af0ae915c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_d6bb7bf4220caa2ed3a87e5af0ae915c.jpg not downloaded yet
2026-03-30 10:50:29 [auto1.de] INFO: Found listing with ID: LX18259
2026-03-30 10:50:29 [auto1.de] INFO: Found listing with ID: GZ97235
2026-03-30 10:50:29 [auto1.de] INFO: Found listing with ID: LW43153
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43153%27 HTTP/1.1" 200 None
2026-03-30 10:50:29 [auto1.de] INFO: Scrape type for LW43153: 2
2026-03-30 10:50:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7264dd34-9fca-539c-8e84-4b781714c703 with identifier: LW43153
2026-03-30 10:50:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7264dd34-9fca-539c-8e84-4b781714c703 with scrape type 2
2026-03-30 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7264dd34-9fca-539c-8e84-4b781714c703 with scrape type 2
2026-03-30 10:50:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7264dd34-9fca-539c-8e84-4b781714c703, identifier: LW43153
2026-03-30 10:50:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7264dd34-9fca-539c-8e84-4b781714c703 with identifier: LW43153
2026-03-30 10:50:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7264dd34-9fca-539c-8e84-4b781714c703 with identifier: LW43153
2026-03-30 10:50:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7264dd34-9fca-539c-8e84-4b781714c703 with identifier: LW43153 to the API
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-31T15:51:32Z',
 'fuel_type': 'petrol',
 'id': '7264dd34-9fca-539c-8e84-4b781714c703',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW43153',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 129037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 63 AMG S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2017}
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43153%27 HTTP/1.1" 200 None
2026-03-30 10:50:29 [auto1.de] INFO: Saving data for LW43153: {'auction_closing_time': 1774972292.0, 'created_time': 1773226390.338949, 'last_price_update_time': 1774867829.713066}
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW43153') HTTP/1.1" 204 0
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F83%252Fa1835df2cef7f5557254481bbc73caf0%252Fpa%252FHC44441_7c9552e26643ab0e590071c89fc17f8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_7c9552e26643ab0e590071c89fc17f8b.jpg not downloaded yet
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fae%252Fdaaeda35164a255d93f54d1d82b0ed3d%252Fpa%252FYY96342_61bbf8a5032812ba880d26f067e1ac3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_61bbf8a5032812ba880d26f067e1ac3d.jpg not downloaded yet
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fce%252Ff2ce52bb9a0de984b139dbf289124417%252Fpa%252FNY45560_61c12555a517d310cf95cc80619f5f87.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_61c12555a517d310cf95cc80619f5f87.jpg not downloaded yet
2026-03-30 10:50:29 [auto1.de] INFO: Found listing with ID: XT84885
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT84885%27 HTTP/1.1" 200 None
2026-03-30 10:50:29 [auto1.de] INFO: Scrape type for XT84885: 2
2026-03-30 10:50:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e84e5676-bf5c-5613-81fc-65c094e1231f with identifier: XT84885
2026-03-30 10:50:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e84e5676-bf5c-5613-81fc-65c094e1231f with scrape type 2
2026-03-30 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e84e5676-bf5c-5613-81fc-65c094e1231f with scrape type 2
2026-03-30 10:50:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e84e5676-bf5c-5613-81fc-65c094e1231f, identifier: XT84885
2026-03-30 10:50:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e84e5676-bf5c-5613-81fc-65c094e1231f with identifier: XT84885
2026-03-30 10:50:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e84e5676-bf5c-5613-81fc-65c094e1231f with identifier: XT84885
2026-03-30 10:50:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e84e5676-bf5c-5613-81fc-65c094e1231f with identifier: XT84885 to the API
2026-03-30 10:50:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:25:48Z',
 'fuel_type': 'diesel',
 'id': 'e84e5676-bf5c-5613-81fc-65c094e1231f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT84885',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 440619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-20',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT84885%27 HTTP/1.1" 200 None
2026-03-30 10:50:30 [auto1.de] INFO: Saving data for XT84885: {'auction_closing_time': 1774970748.0, 'created_time': 1774294869.127953, 'last_price_update_time': 1774867830.269695}
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT84885') HTTP/1.1" 204 0
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F83%252Fa1835df2cef7f5557254481bbc73caf0%252Fpa%252FHC44441_bf870c5639ff62b9f23f9f8c71b54b88.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_bf870c5639ff62b9f23f9f8c71b54b88.jpg not downloaded yet
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fae%252Fdaaeda35164a255d93f54d1d82b0ed3d%252Fpa%252FYY96342_8628f604debad5a4601da8ba8889d92b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_8628f604debad5a4601da8ba8889d92b.jpg not downloaded yet
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fce%252Ff2ce52bb9a0de984b139dbf289124417%252Fpa%252FNY45560_671bdb0d27f52213c6fe3535458a5a03.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_671bdb0d27f52213c6fe3535458a5a03.jpg not downloaded yet
2026-03-30 10:50:30 [auto1.de] INFO: Found listing with ID: RK06421
2026-03-30 10:50:30 [auto1.de] INFO: Found listing with ID: RY02033
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY02033%27 HTTP/1.1" 200 None
2026-03-30 10:50:30 [auto1.de] INFO: Scrape type for RY02033: 1
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F83%252Fa1835df2cef7f5557254481bbc73caf0%252Fpa%252FHC44441_45eb92938b396afbbe92c3075d048438.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_45eb92938b396afbbe92c3075d048438.jpg not downloaded yet
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fae%252Fdaaeda35164a255d93f54d1d82b0ed3d%252Fpa%252FYY96342_da0b04152f23c27f564d737429ff3519.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_da0b04152f23c27f564d737429ff3519.jpg not downloaded yet
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fce%252Ff2ce52bb9a0de984b139dbf289124417%252Fpa%252FNY45560_2b6b56f81ed32a2c68c4bb58c1efbb29.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_2b6b56f81ed32a2c68c4bb58c1efbb29.jpg not downloaded yet
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fce%252Ff2ce52bb9a0de984b139dbf289124417%252Fpa%252FNY45560_4521ea9f6902c67ee68fa2f4058416b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_4521ea9f6902c67ee68fa2f4058416b3.jpg not downloaded yet
2026-03-30 10:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS99643> (referer: https://www.auto1.com/v1/car-details-view/CS99643/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e69a1e0-019f-5bc5-a00e-26d544218e12 with identifier: CS99643
2026-03-30 10:50:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e69a1e0-019f-5bc5-a00e-26d544218e12 with scrape type 1
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4e69a1e0-019f-5bc5-a00e-26d544218e12
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe9%252F21e99a495b3cba2ecf5041f89c958dd6%252Fpa%252FCS99643_9a1f4c6c99e7ec00047c1d77fad9dc2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_9a1f4c6c99e7ec00047c1d77fad9dc2f.jpg not downloaded yet
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe9%252F21e99a495b3cba2ecf5041f89c958dd6%252Fpa%252FCS99643_7ce7c66c75aaa6b65d087bee5f7ef1bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_7ce7c66c75aaa6b65d087bee5f7ef1bb.jpg not downloaded yet
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe9%252F21e99a495b3cba2ecf5041f89c958dd6%252Fpa%252FCS99643_b04ecf8b844cf70f796c5c79a84490d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_b04ecf8b844cf70f796c5c79a84490d3.jpg not downloaded yet
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe9%252F21e99a495b3cba2ecf5041f89c958dd6%252Fpa%252FCS99643_a8f03c9fc24ad04c827deb18b1b34b0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_a8f03c9fc24ad04c827deb18b1b34b0c.jpg not downloaded yet
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe9%252F21e99a495b3cba2ecf5041f89c958dd6%252Fpa%252FCS99643_d8aca3b8ab1d44785ba3c9670b26d487.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_d8aca3b8ab1d44785ba3c9670b26d487.jpg not downloaded yet
2026-03-30 10:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_4521ea9f6902c67ee68fa2f4058416b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_d8aca3b8ab1d44785ba3c9670b26d487.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef92ded10>
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc3605dc-32e2-5789-a46b-9b3d8104fa00/bc3605dc-32e2-5789-a46b-9b3d8104fa00_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fce%252Ff2ce52bb9a0de984b139dbf289124417%252Fpa%252FNY45560_4521ea9f6902c67ee68fa2f4058416b3.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_4521ea9f6902c67ee68fa2f4058416b3.jpg saved to cache
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc3605dc-32e2-5789-a46b-9b3d8104fa00
2026-03-30 10:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_a8f03c9fc24ad04c827deb18b1b34b0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU04536> (referer: https://www.auto1.com/v1/car-details-view/JU04536/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe0cd0>
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e69a1e0-019f-5bc5-a00e-26d544218e12/4e69a1e0-019f-5bc5-a00e-26d544218e12_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe9%252F21e99a495b3cba2ecf5041f89c958dd6%252Fpa%252FCS99643_d8aca3b8ab1d44785ba3c9670b26d487.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_d8aca3b8ab1d44785ba3c9670b26d487.jpg saved to cache
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e69a1e0-019f-5bc5-a00e-26d544218e12
2026-03-30 10:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_7ce7c66c75aaa6b65d087bee5f7ef1bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT65202> (referer: https://www.auto1.com/v1/car-details-view/XT65202/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c5350>
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e69a1e0-019f-5bc5-a00e-26d544218e12/4e69a1e0-019f-5bc5-a00e-26d544218e12_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe9%252F21e99a495b3cba2ecf5041f89c958dd6%252Fpa%252FCS99643_a8f03c9fc24ad04c827deb18b1b34b0c.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_a8f03c9fc24ad04c827deb18b1b34b0c.jpg saved to cache
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e69a1e0-019f-5bc5-a00e-26d544218e12
2026-03-30 10:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_9a1f4c6c99e7ec00047c1d77fad9dc2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b58405c-b76d-5ff4-b4c8-8a93a3e69811 with identifier: JU04536
2026-03-30 10:50:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811 with scrape type 1
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_ec2719d881413a04e92029b0b6fc10cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_ec2719d881413a04e92029b0b6fc10cf.jpg not downloaded yet
2026-03-30 10:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_b04ecf8b844cf70f796c5c79a84490d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_6c889a2b1effb7e864ee1e389fd856a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_6c889a2b1effb7e864ee1e389fd856a8.jpg not downloaded yet
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_fabdb07917269d82e81de6cfd3d4569f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_fabdb07917269d82e81de6cfd3d4569f.jpg not downloaded yet
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e66450>
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e69a1e0-019f-5bc5-a00e-26d544218e12/4e69a1e0-019f-5bc5-a00e-26d544218e12_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe9%252F21e99a495b3cba2ecf5041f89c958dd6%252Fpa%252FCS99643_7ce7c66c75aaa6b65d087bee5f7ef1bb.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_7ce7c66c75aaa6b65d087bee5f7ef1bb.jpg saved to cache
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e69a1e0-019f-5bc5-a00e-26d544218e12
2026-03-30 10:50:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f31d2408-7eee-558a-9822-99fd00206f06 with identifier: XT65202
2026-03-30 10:50:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f31d2408-7eee-558a-9822-99fd00206f06 with scrape type 1
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f31d2408-7eee-558a-9822-99fd00206f06
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_c102bafc36e0f7118a8a0c90b92b2356.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_c102bafc36e0f7118a8a0c90b92b2356.jpg not downloaded yet
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_bf69b37bc660258bbea31cb7410c914c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf69b37bc660258bbea31cb7410c914c.jpg not downloaded yet
2026-03-30 10:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_2b6b56f81ed32a2c68c4bb58c1efbb29.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_da0b04152f23c27f564d737429ff3519.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_aad63bb6c9963e0655d52dc19a8a434d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_aad63bb6c9963e0655d52dc19a8a434d.jpg not downloaded yet
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db6350>
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e69a1e0-019f-5bc5-a00e-26d544218e12/4e69a1e0-019f-5bc5-a00e-26d544218e12_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe9%252F21e99a495b3cba2ecf5041f89c958dd6%252Fpa%252FCS99643_9a1f4c6c99e7ec00047c1d77fad9dc2f.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_9a1f4c6c99e7ec00047c1d77fad9dc2f.jpg saved to cache
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e69a1e0-019f-5bc5-a00e-26d544218e12
2026-03-30 10:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_ec2719d881413a04e92029b0b6fc10cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_51900ed08f1968bdc53ad110ce81fad9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_51900ed08f1968bdc53ad110ce81fad9.jpg not downloaded yet
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_0bf3b2677f4ccc5d5327de8ce6438176.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_0bf3b2677f4ccc5d5327de8ce6438176.jpg not downloaded yet
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5104610>
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e69a1e0-019f-5bc5-a00e-26d544218e12/4e69a1e0-019f-5bc5-a00e-26d544218e12_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fe9%252F21e99a495b3cba2ecf5041f89c958dd6%252Fpa%252FCS99643_b04ecf8b844cf70f796c5c79a84490d3.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_b04ecf8b844cf70f796c5c79a84490d3.jpg saved to cache
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e69a1e0-019f-5bc5-a00e-26d544218e12
2026-03-30 10:50:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e69a1e0-019f-5bc5-a00e-26d544218e12, skipping ID generation
2026-03-30 10:50:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e69a1e0-019f-5bc5-a00e-26d544218e12 with scrape type 1
2026-03-30 10:50:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e69a1e0-019f-5bc5-a00e-26d544218e12 sending to next pipeline
2026-03-30 10:50:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e69a1e0-019f-5bc5-a00e-26d544218e12, identifier: CS99643
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_501565123894a58c631cea39d9c36bd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_501565123894a58c631cea39d9c36bd1.jpg not downloaded yet
2026-03-30 10:50:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e69a1e0-019f-5bc5-a00e-26d544218e12 with identifier: CS99643
2026-03-30 10:50:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e69a1e0-019f-5bc5-a00e-26d544218e12 with identifier: CS99643
2026-03-30 10:50:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e69a1e0-019f-5bc5-a00e-26d544218e12 with identifier: CS99643 to the API
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_b04ecf8b844cf70f796c5c79a84490d3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:56:39Z',
 'fuel_type': 'diesel',
 'id': '4e69a1e0-019f-5bc5-a00e-26d544218e12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS99643',
 'listing': 'auction',
 'location': 'DE, Hoyerswerda',
 'make': 'BMW',
 'model': '1er',
 'odometer': 292394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e69a1e0-019f-5bc5-a00e-26d544218e12/4e69a1e0-019f-5bc5-a00e-26d544218e12_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_9a1f4c6c99e7ec00047c1d77fad9dc2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e69a1e0-019f-5bc5-a00e-26d544218e12/4e69a1e0-019f-5bc5-a00e-26d544218e12_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_7ce7c66c75aaa6b65d087bee5f7ef1bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e69a1e0-019f-5bc5-a00e-26d544218e12/4e69a1e0-019f-5bc5-a00e-26d544218e12_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_b04ecf8b844cf70f796c5c79a84490d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e69a1e0-019f-5bc5-a00e-26d544218e12/4e69a1e0-019f-5bc5-a00e-26d544218e12_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_a8f03c9fc24ad04c827deb18b1b34b0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e69a1e0-019f-5bc5-a00e-26d544218e12/4e69a1e0-019f-5bc5-a00e-26d544218e12_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/e9/21e99a495b3cba2ecf5041f89c958dd6/pa/CS99643_d8aca3b8ab1d44785ba3c9670b26d487.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS99643%27 HTTP/1.1" 200 None
2026-03-30 10:50:32 [auto1.de] INFO: Saving data for CS99643: {'created_time': 1774867832.438104, 'last_price_update_time': 1774867832.438115, 'auction_closing_time': 1774972599.0}
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS99643') HTTP/1.1" 204 0
2026-03-30 10:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_c102bafc36e0f7118a8a0c90b92b2356.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_7160f960cedc5d7da80885daaefc90a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_7160f960cedc5d7da80885daaefc90a3.jpg not downloaded yet
2026-03-30 10:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_fabdb07917269d82e81de6cfd3d4569f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_005a0be1a901cdd0e7586affc9fadb94.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_005a0be1a901cdd0e7586affc9fadb94.jpg not downloaded yet
2026-03-30 10:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CJ42991> (referer: https://www.auto1.com/v1/car-details-view/CJ42991/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b2ff10>
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc3605dc-32e2-5789-a46b-9b3d8104fa00/bc3605dc-32e2-5789-a46b-9b3d8104fa00_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fce%252Ff2ce52bb9a0de984b139dbf289124417%252Fpa%252FNY45560_2b6b56f81ed32a2c68c4bb58c1efbb29.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_2b6b56f81ed32a2c68c4bb58c1efbb29.jpg saved to cache
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc3605dc-32e2-5789-a46b-9b3d8104fa00
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c7b90>
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f33b256-ae79-5822-8422-c9bc3d19156d/8f33b256-ae79-5822-8422-c9bc3d19156d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fae%252Fdaaeda35164a255d93f54d1d82b0ed3d%252Fpa%252FYY96342_da0b04152f23c27f564d737429ff3519.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_da0b04152f23c27f564d737429ff3519.jpg saved to cache
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f33b256-ae79-5822-8422-c9bc3d19156d
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef785fd90>
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_ec2719d881413a04e92029b0b6fc10cf.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_ec2719d881413a04e92029b0b6fc10cf.jpg saved to cache
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_d7e1f2a922d6336ae71fea29f695026d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_d7e1f2a922d6336ae71fea29f695026d.jpg not downloaded yet
2026-03-30 10:50:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_bf1de3320b0f653f4affaeb68b1b0a8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf1de3320b0f653f4affaeb68b1b0a8d.jpg not downloaded yet
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_167fcf63769a870c3b50832ad6e1f25b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_167fcf63769a870c3b50832ad6e1f25b.jpg not downloaded yet
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e61b90>
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_c102bafc36e0f7118a8a0c90b92b2356.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_c102bafc36e0f7118a8a0c90b92b2356.jpg saved to cache
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f31d2408-7eee-558a-9822-99fd00206f06
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e29490>
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_fabdb07917269d82e81de6cfd3d4569f.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_fabdb07917269d82e81de6cfd3d4569f.jpg saved to cache
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-03-30 10:50:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cab2c47-1dad-5879-86e0-0e8ce343a876 with identifier: CJ42991
2026-03-30 10:50:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cab2c47-1dad-5879-86e0-0e8ce343a876 with scrape type 1
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0cab2c47-1dad-5879-86e0-0e8ce343a876
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_ab51e0e5bb3078cda985eef2ec674f96.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_ab51e0e5bb3078cda985eef2ec674f96.jpg not downloaded yet
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_b37c8f51c6210aae9942e22e8f9c864a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_b37c8f51c6210aae9942e22e8f9c864a.jpg not downloaded yet
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_392f051705d2f4666f6a4464875aeb39.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_392f051705d2f4666f6a4464875aeb39.jpg not downloaded yet
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_70228b36620112bbf76393278b814967.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_70228b36620112bbf76393278b814967.jpg not downloaded yet
2026-03-30 10:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_0bf3b2677f4ccc5d5327de8ce6438176.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_56e6daa1a5ae8cbf1ea41bbbfeef0266.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_56e6daa1a5ae8cbf1ea41bbbfeef0266.jpg not downloaded yet
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_c44d770af594109cac473f7a1a5a8f3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_c44d770af594109cac473f7a1a5a8f3d.jpg not downloaded yet
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_5d40d48a55c1a90b05f2c3dba307b651.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_5d40d48a55c1a90b05f2c3dba307b651.jpg not downloaded yet
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_3c309fdcc255a4de17bba9aa163063ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_3c309fdcc255a4de17bba9aa163063ce.jpg not downloaded yet
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_8a0e92095809c594a3726caaca0aa2bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_8a0e92095809c594a3726caaca0aa2bc.jpg not downloaded yet
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_9d7f5493f46ff5ce142da5dd1dab49c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_9d7f5493f46ff5ce142da5dd1dab49c0.jpg not downloaded yet
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_343123272a42f981cc4338d8b3076de2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_343123272a42f981cc4338d8b3076de2.jpg not downloaded yet
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_27dc4c745ceafd8af742e6f22c68a13b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_27dc4c745ceafd8af742e6f22c68a13b.jpg not downloaded yet
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb37d0>
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_0bf3b2677f4ccc5d5327de8ce6438176.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_0bf3b2677f4ccc5d5327de8ce6438176.jpg saved to cache
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f31d2408-7eee-558a-9822-99fd00206f06
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_0f93e2e987f4d0fbad1738ef3621cbc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_0f93e2e987f4d0fbad1738ef3621cbc8.jpg not downloaded yet
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_a7d6d1c2f711eb73040bfd9103ca57f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_a7d6d1c2f711eb73040bfd9103ca57f0.jpg not downloaded yet
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_cf0a10f78d73db083c00d7d6a8f4234b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_cf0a10f78d73db083c00d7d6a8f4234b.jpg not downloaded yet
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_63c1146c53636bf3a7d0cd100ae1657a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_63c1146c53636bf3a7d0cd100ae1657a.jpg not downloaded yet
2026-03-30 10:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf69b37bc660258bbea31cb7410c914c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_7160f960cedc5d7da80885daaefc90a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_b37c8f51c6210aae9942e22e8f9c864a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ec3690>
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_bf69b37bc660258bbea31cb7410c914c.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf69b37bc660258bbea31cb7410c914c.jpg saved to cache
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-03-30 10:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_63c1146c53636bf3a7d0cd100ae1657a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_cf0a10f78d73db083c00d7d6a8f4234b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50ded10>
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_7160f960cedc5d7da80885daaefc90a3.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_7160f960cedc5d7da80885daaefc90a3.jpg saved to cache
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f31d2408-7eee-558a-9822-99fd00206f06
2026-03-30 10:50:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eb4d50>
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_b37c8f51c6210aae9942e22e8f9c864a.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_b37c8f51c6210aae9942e22e8f9c864a.jpg saved to cache
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508d550>
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_63c1146c53636bf3a7d0cd100ae1657a.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_63c1146c53636bf3a7d0cd100ae1657a.jpg saved to cache
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0cab2c47-1dad-5879-86e0-0e8ce343a876
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7b350>
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_cf0a10f78d73db083c00d7d6a8f4234b.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_cf0a10f78d73db083c00d7d6a8f4234b.jpg saved to cache
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0cab2c47-1dad-5879-86e0-0e8ce343a876
2026-03-30 10:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_501565123894a58c631cea39d9c36bd1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5086810>
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_501565123894a58c631cea39d9c36bd1.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_501565123894a58c631cea39d9c36bd1.jpg saved to cache
2026-03-30 10:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-03-30 10:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_0f93e2e987f4d0fbad1738ef3621cbc8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_a7d6d1c2f711eb73040bfd9103ca57f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_343123272a42f981cc4338d8b3076de2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5125b50>
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_0f93e2e987f4d0fbad1738ef3621cbc8.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_0f93e2e987f4d0fbad1738ef3621cbc8.jpg saved to cache
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0cab2c47-1dad-5879-86e0-0e8ce343a876
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5084b10>
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_a7d6d1c2f711eb73040bfd9103ca57f0.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_a7d6d1c2f711eb73040bfd9103ca57f0.jpg saved to cache
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0cab2c47-1dad-5879-86e0-0e8ce343a876
2026-03-30 10:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_3c309fdcc255a4de17bba9aa163063ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_8a0e92095809c594a3726caaca0aa2bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e023d0>
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_343123272a42f981cc4338d8b3076de2.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_343123272a42f981cc4338d8b3076de2.jpg saved to cache
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0cab2c47-1dad-5879-86e0-0e8ce343a876
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da0110>
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_3c309fdcc255a4de17bba9aa163063ce.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_3c309fdcc255a4de17bba9aa163063ce.jpg saved to cache
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f31d2408-7eee-558a-9822-99fd00206f06
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e44610>
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_8a0e92095809c594a3726caaca0aa2bc.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_8a0e92095809c594a3726caaca0aa2bc.jpg saved to cache
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0cab2c47-1dad-5879-86e0-0e8ce343a876
2026-03-30 10:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_c44d770af594109cac473f7a1a5a8f3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_9d7f5493f46ff5ce142da5dd1dab49c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_56e6daa1a5ae8cbf1ea41bbbfeef0266.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee5d90>
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_c44d770af594109cac473f7a1a5a8f3d.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_c44d770af594109cac473f7a1a5a8f3d.jpg saved to cache
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f31d2408-7eee-558a-9822-99fd00206f06
2026-03-30 10:50:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eb71d0>
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_9d7f5493f46ff5ce142da5dd1dab49c0.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_9d7f5493f46ff5ce142da5dd1dab49c0.jpg saved to cache
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f31d2408-7eee-558a-9822-99fd00206f06
2026-03-30 10:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_392f051705d2f4666f6a4464875aeb39.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe0d90>
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_56e6daa1a5ae8cbf1ea41bbbfeef0266.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_56e6daa1a5ae8cbf1ea41bbbfeef0266.jpg saved to cache
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-03-30 10:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_5d40d48a55c1a90b05f2c3dba307b651.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_ab51e0e5bb3078cda985eef2ec674f96.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_70228b36620112bbf76393278b814967.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e44850>
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_392f051705d2f4666f6a4464875aeb39.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_392f051705d2f4666f6a4464875aeb39.jpg saved to cache
2026-03-30 10:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f31d2408-7eee-558a-9822-99fd00206f06
2026-03-30 10:50:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe3050>
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_5d40d48a55c1a90b05f2c3dba307b651.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_5d40d48a55c1a90b05f2c3dba307b651.jpg saved to cache
2026-03-30 10:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0cab2c47-1dad-5879-86e0-0e8ce343a876
2026-03-30 10:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_27dc4c745ceafd8af742e6f22c68a13b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_167fcf63769a870c3b50832ad6e1f25b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fec7d0>
2026-03-30 10:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_ab51e0e5bb3078cda985eef2ec674f96.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_ab51e0e5bb3078cda985eef2ec674f96.jpg saved to cache
2026-03-30 10:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cab2c47-1dad-5879-86e0-0e8ce343a876
2026-03-30 10:50:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5013350>
2026-03-30 10:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_70228b36620112bbf76393278b814967.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_70228b36620112bbf76393278b814967.jpg saved to cache
2026-03-30 10:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0cab2c47-1dad-5879-86e0-0e8ce343a876
2026-03-30 10:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EZ95690/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c69b10>
2026-03-30 10:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F1a%252F691af26f1bea3a273926a9d1823825ea%252Fpa%252FCJ42991_27dc4c745ceafd8af742e6f22c68a13b.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_27dc4c745ceafd8af742e6f22c68a13b.jpg saved to cache
2026-03-30 10:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0cab2c47-1dad-5879-86e0-0e8ce343a876
2026-03-30 10:50:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cab2c47-1dad-5879-86e0-0e8ce343a876, skipping ID generation
2026-03-30 10:50:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cab2c47-1dad-5879-86e0-0e8ce343a876 with scrape type 1
2026-03-30 10:50:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cab2c47-1dad-5879-86e0-0e8ce343a876 sending to next pipeline
2026-03-30 10:50:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cab2c47-1dad-5879-86e0-0e8ce343a876, identifier: CJ42991
2026-03-30 10:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8f290>
2026-03-30 10:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_167fcf63769a870c3b50832ad6e1f25b.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_167fcf63769a870c3b50832ad6e1f25b.jpg saved to cache
2026-03-30 10:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f31d2408-7eee-558a-9822-99fd00206f06
2026-03-30 10:50:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cab2c47-1dad-5879-86e0-0e8ce343a876 with identifier: CJ42991
2026-03-30 10:50:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cab2c47-1dad-5879-86e0-0e8ce343a876 with identifier: CJ42991
2026-03-30 10:50:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cab2c47-1dad-5879-86e0-0e8ce343a876 with identifier: CJ42991 to the API
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_27dc4c745ceafd8af742e6f22c68a13b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:01:41Z',
 'fuel_type': 'petrol',
 'id': '0cab2c47-1dad-5879-86e0-0e8ce343a876',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ42991',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 47776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_ab51e0e5bb3078cda985eef2ec674f96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3303490,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_70228b36620112bbf76393278b814967.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3134585,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_5d40d48a55c1a90b05f2c3dba307b651.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_8a0e92095809c594a3726caaca0aa2bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3245971,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_343123272a42f981cc4338d8b3076de2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3241510,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_27dc4c745ceafd8af742e6f22c68a13b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_0f93e2e987f4d0fbad1738ef3621cbc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_a7d6d1c2f711eb73040bfd9103ca57f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_cf0a10f78d73db083c00d7d6a8f4234b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cab2c47-1dad-5879-86e0-0e8ce343a876/0cab2c47-1dad-5879-86e0-0e8ce343a876_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/1a/691af26f1bea3a273926a9d1823825ea/pa/CJ42991_63c1146c53636bf3a7d0cd100ae1657a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 GDI Dream-Team",
 'transmission': 'manual',
 'trim': 'Dream-Team',
 'year': 2018}
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ42991%27 HTTP/1.1" 200 None
2026-03-30 10:50:36 [auto1.de] INFO: Saving data for CJ42991: {'created_time': 1774867836.112047, 'last_price_update_time': 1774867836.112063, 'auction_closing_time': 1774969301.0}
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ42991') HTTP/1.1" 204 0
2026-03-30 10:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_005a0be1a901cdd0e7586affc9fadb94.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS69347/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_d7e1f2a922d6336ae71fea29f695026d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf1de3320b0f653f4affaeb68b1b0a8d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_aad63bb6c9963e0655d52dc19a8a434d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_51900ed08f1968bdc53ad110ce81fad9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_45eb92938b396afbbe92c3075d048438.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ffe210>
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_005a0be1a901cdd0e7586affc9fadb94.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_005a0be1a901cdd0e7586affc9fadb94.jpg saved to cache
2026-03-30 10:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a78690>
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_d7e1f2a922d6336ae71fea29f695026d.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_d7e1f2a922d6336ae71fea29f695026d.jpg saved to cache
2026-03-30 10:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f31d2408-7eee-558a-9822-99fd00206f06
2026-03-30 10:50:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a76e90>
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_bf1de3320b0f653f4affaeb68b1b0a8d.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf1de3320b0f653f4affaeb68b1b0a8d.jpg saved to cache
2026-03-30 10:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-03-30 10:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_671bdb0d27f52213c6fe3535458a5a03.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e28a90>
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F51%252F7251f898c1ffa000a1ef555540a40e83%252Fpa%252FXT65202_aad63bb6c9963e0655d52dc19a8a434d.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_aad63bb6c9963e0655d52dc19a8a434d.jpg saved to cache
2026-03-30 10:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f31d2408-7eee-558a-9822-99fd00206f06
2026-03-30 10:50:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f31d2408-7eee-558a-9822-99fd00206f06, skipping ID generation
2026-03-30 10:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f31d2408-7eee-558a-9822-99fd00206f06 with scrape type 1
2026-03-30 10:50:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f31d2408-7eee-558a-9822-99fd00206f06 sending to next pipeline
2026-03-30 10:50:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f31d2408-7eee-558a-9822-99fd00206f06, identifier: XT65202
2026-03-30 10:50:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5107e50>
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_51900ed08f1968bdc53ad110ce81fad9.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_51900ed08f1968bdc53ad110ce81fad9.jpg saved to cache
2026-03-30 10:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ae22d0>
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cfda84-e0d7-5d2c-aad0-e81061737e98/50cfda84-e0d7-5d2c-aad0-e81061737e98_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F83%252Fa1835df2cef7f5557254481bbc73caf0%252Fpa%252FHC44441_45eb92938b396afbbe92c3075d048438.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_45eb92938b396afbbe92c3075d048438.jpg saved to cache
2026-03-30 10:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 50cfda84-e0d7-5d2c-aad0-e81061737e98
2026-03-30 10:50:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f31d2408-7eee-558a-9822-99fd00206f06 with identifier: XT65202
2026-03-30 10:50:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f31d2408-7eee-558a-9822-99fd00206f06 with identifier: XT65202
2026-03-30 10:50:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f31d2408-7eee-558a-9822-99fd00206f06 with identifier: XT65202 to the API
2026-03-30 10:50:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_aad63bb6c9963e0655d52dc19a8a434d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 207,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:43:05Z',
 'fuel_type': 'diesel',
 'id': 'f31d2408-7eee-558a-9822-99fd00206f06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT65202',
 'listing': 'auction',
 'location': 'DE, Bad Bevensen',
 'make': 'Opel',
 'model': 'Movano',
 'odometer': 90958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_c102bafc36e0f7118a8a0c90b92b2356.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_aad63bb6c9963e0655d52dc19a8a434d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_0bf3b2677f4ccc5d5327de8ce6438176.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2505326,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_7160f960cedc5d7da80885daaefc90a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_d7e1f2a922d6336ae71fea29f695026d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_167fcf63769a870c3b50832ad6e1f25b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_392f051705d2f4666f6a4464875aeb39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_c44d770af594109cac473f7a1a5a8f3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_3c309fdcc255a4de17bba9aa163063ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f31d2408-7eee-558a-9822-99fd00206f06/f31d2408-7eee-558a-9822-99fd00206f06_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2708768,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img72/51/7251f898c1ffa000a1ef555540a40e83/pa/XT65202_9d7f5493f46ff5ce142da5dd1dab49c0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Movano 2.3 CDTI Pritsche L3H1 3,5t DoKa',
 'transmission': 'manual',
 'trim': 'Pritsche L3H1 3,5t DoKa',
 'year': 2017}
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT65202%27 HTTP/1.1" 200 None
2026-03-30 10:50:37 [auto1.de] INFO: Saving data for XT65202: {'created_time': 1774867837.764544, 'last_price_update_time': 1774867837.764557, 'auction_closing_time': 1774971785.0}
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT65202') HTTP/1.1" 204 0
2026-03-30 10:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_bf870c5639ff62b9f23f9f8c71b54b88.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ99756/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508da10>
2026-03-30 10:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc3605dc-32e2-5789-a46b-9b3d8104fa00/bc3605dc-32e2-5789-a46b-9b3d8104fa00_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fce%252Ff2ce52bb9a0de984b139dbf289124417%252Fpa%252FNY45560_671bdb0d27f52213c6fe3535458a5a03.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_671bdb0d27f52213c6fe3535458a5a03.jpg saved to cache
2026-03-30 10:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc3605dc-32e2-5789-a46b-9b3d8104fa00
2026-03-30 10:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_8628f604debad5a4601da8ba8889d92b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN86582> (referer: https://www.auto1.com/v1/car-details-view/ZN86582/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_6c889a2b1effb7e864ee1e389fd856a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5994a10>
2026-03-30 10:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cfda84-e0d7-5d2c-aad0-e81061737e98/50cfda84-e0d7-5d2c-aad0-e81061737e98_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F83%252Fa1835df2cef7f5557254481bbc73caf0%252Fpa%252FHC44441_bf870c5639ff62b9f23f9f8c71b54b88.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_bf870c5639ff62b9f23f9f8c71b54b88.jpg saved to cache
2026-03-30 10:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 50cfda84-e0d7-5d2c-aad0-e81061737e98
2026-03-30 10:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_3c04af4f7b2db4c7e9238de162450a00.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_d6bb7bf4220caa2ed3a87e5af0ae915c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_7c9552e26643ab0e590071c89fc17f8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50dd0d0>
2026-03-30 10:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f33b256-ae79-5822-8422-c9bc3d19156d/8f33b256-ae79-5822-8422-c9bc3d19156d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fae%252Fdaaeda35164a255d93f54d1d82b0ed3d%252Fpa%252FYY96342_8628f604debad5a4601da8ba8889d92b.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_8628f604debad5a4601da8ba8889d92b.jpg saved to cache
2026-03-30 10:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f33b256-ae79-5822-8422-c9bc3d19156d
2026-03-30 10:50:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f9973e2-4609-5361-b000-2628c73c7e26 with identifier: ZN86582
2026-03-30 10:50:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f9973e2-4609-5361-b000-2628c73c7e26 with scrape type 1
2026-03-30 10:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f9973e2-4609-5361-b000-2628c73c7e26
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ff3%252Fa8f3e5015040bc19fab4c51853fc739f%252Fpa%252FZN86582_5f290a7ea0bc36a3db07d321a67004b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_5f290a7ea0bc36a3db07d321a67004b7.jpg already downloaded
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ff3%252Fa8f3e5015040bc19fab4c51853fc739f%252Fpa%252FZN86582_6ebd0ee54f3a09f1534c0e816e27162c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_6ebd0ee54f3a09f1534c0e816e27162c.jpg already downloaded
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ff3%252Fa8f3e5015040bc19fab4c51853fc739f%252Fpa%252FZN86582_7ffb1bdb09fbdf596aae6c5e45713941.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_7ffb1bdb09fbdf596aae6c5e45713941.jpg already downloaded
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ff3%252Fa8f3e5015040bc19fab4c51853fc739f%252Fpa%252FZN86582_f61d0055e8da2e4e59a1dcb6c925c4c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_f61d0055e8da2e4e59a1dcb6c925c4c5.jpg already downloaded
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ff3%252Fa8f3e5015040bc19fab4c51853fc739f%252Fpa%252FZN86582_841c1d804894fce8b84465b3685b4819.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_841c1d804894fce8b84465b3685b4819.jpg already downloaded
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ff3%252Fa8f3e5015040bc19fab4c51853fc739f%252Fpa%252FZN86582_9cc1781d0ee7cf28b4600bc506ed7545.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_9cc1781d0ee7cf28b4600bc506ed7545.jpg already downloaded
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ff3%252Fa8f3e5015040bc19fab4c51853fc739f%252Fpa%252FZN86582_1f8a365d20f8a0fe4535111f04e07f8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_1f8a365d20f8a0fe4535111f04e07f8f.jpg already downloaded
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ff3%252Fa8f3e5015040bc19fab4c51853fc739f%252Fpa%252FZN86582_b9642377e22ac91b947baf398e564132.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_b9642377e22ac91b947baf398e564132.jpg already downloaded
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ff3%252Fa8f3e5015040bc19fab4c51853fc739f%252Fpa%252FZN86582_5967295c0709f3b4c13c6f2598a51613.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_5967295c0709f3b4c13c6f2598a51613.jpg already downloaded
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Ff3%252Fa8f3e5015040bc19fab4c51853fc739f%252Fpa%252FZN86582_5a00fa8243817c185387a94a9b021132.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_5a00fa8243817c185387a94a9b021132.jpg already downloaded
2026-03-30 10:50:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f9973e2-4609-5361-b000-2628c73c7e26, identifier: ZN86582
2026-03-30 10:50:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508e390>
2026-03-30 10:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F94%252Ff094ad7b23adfb7b62599e5581169b3b%252Fpa%252FJU04536_6c889a2b1effb7e864ee1e389fd856a8.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_6c889a2b1effb7e864ee1e389fd856a8.jpg saved to cache
2026-03-30 10:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811
2026-03-30 10:50:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b58405c-b76d-5ff4-b4c8-8a93a3e69811, skipping ID generation
2026-03-30 10:50:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811 with scrape type 1
2026-03-30 10:50:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b58405c-b76d-5ff4-b4c8-8a93a3e69811 sending to next pipeline
2026-03-30 10:50:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b58405c-b76d-5ff4-b4c8-8a93a3e69811, identifier: JU04536
2026-03-30 10:50:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f9973e2-4609-5361-b000-2628c73c7e26 with identifier: ZN86582
2026-03-30 10:50:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f9973e2-4609-5361-b000-2628c73c7e26 with identifier: ZN86582
2026-03-30 10:50:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f9973e2-4609-5361-b000-2628c73c7e26 with identifier: ZN86582 to the API
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZN86582>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:14:23Z',
 'fuel_type': 'hybrid',
 'id': '9f9973e2-4609-5361-b000-2628c73c7e26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN86582',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Cupra',
 'model': 'Leon',
 'odometer': 40483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_5f290a7ea0bc36a3db07d321a67004b7.jpg',
                'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_6ebd0ee54f3a09f1534c0e816e27162c.jpg',
                'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_7ffb1bdb09fbdf596aae6c5e45713941.jpg',
                'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_f61d0055e8da2e4e59a1dcb6c925c4c5.jpg',
                'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_841c1d804894fce8b84465b3685b4819.jpg',
                'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_9cc1781d0ee7cf28b4600bc506ed7545.jpg',
                'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_1f8a365d20f8a0fe4535111f04e07f8f.jpg',
                'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_b9642377e22ac91b947baf398e564132.jpg',
                'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_5967295c0709f3b4c13c6f2598a51613.jpg',
                'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_5a00fa8243817c185387a94a9b021132.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9973e2-4609-5361-b000-2628c73c7e26/9f9973e2-4609-5361-b000-2628c73c7e26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_5f290a7ea0bc36a3db07d321a67004b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9973e2-4609-5361-b000-2628c73c7e26/9f9973e2-4609-5361-b000-2628c73c7e26_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_6ebd0ee54f3a09f1534c0e816e27162c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9973e2-4609-5361-b000-2628c73c7e26/9f9973e2-4609-5361-b000-2628c73c7e26_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_7ffb1bdb09fbdf596aae6c5e45713941.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9973e2-4609-5361-b000-2628c73c7e26/9f9973e2-4609-5361-b000-2628c73c7e26_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_f61d0055e8da2e4e59a1dcb6c925c4c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9973e2-4609-5361-b000-2628c73c7e26/9f9973e2-4609-5361-b000-2628c73c7e26_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_841c1d804894fce8b84465b3685b4819.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9973e2-4609-5361-b000-2628c73c7e26/9f9973e2-4609-5361-b000-2628c73c7e26_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_9cc1781d0ee7cf28b4600bc506ed7545.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9973e2-4609-5361-b000-2628c73c7e26/9f9973e2-4609-5361-b000-2628c73c7e26_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_1f8a365d20f8a0fe4535111f04e07f8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9973e2-4609-5361-b000-2628c73c7e26/9f9973e2-4609-5361-b000-2628c73c7e26_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_b9642377e22ac91b947baf398e564132.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9973e2-4609-5361-b000-2628c73c7e26/9f9973e2-4609-5361-b000-2628c73c7e26_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_5967295c0709f3b4c13c6f2598a51613.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9973e2-4609-5361-b000-2628c73c7e26/9f9973e2-4609-5361-b000-2628c73c7e26_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/f3/a8f3e5015040bc19fab4c51853fc739f/pa/ZN86582_5a00fa8243817c185387a94a9b021132.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Leon 1.4 e-HYBRID',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN86582%27 HTTP/1.1" 200 None
2026-03-30 10:50:38 [auto1.de] INFO: Saving data for ZN86582: {'created_time': 1774867838.876834, 'last_price_update_time': 1774867838.876849, 'auction_closing_time': 1774970063.0}
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN86582') HTTP/1.1" 204 0
2026-03-30 10:50:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b58405c-b76d-5ff4-b4c8-8a93a3e69811 with identifier: JU04536
2026-03-30 10:50:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b58405c-b76d-5ff4-b4c8-8a93a3e69811 with identifier: JU04536
2026-03-30 10:50:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b58405c-b76d-5ff4-b4c8-8a93a3e69811 with identifier: JU04536 to the API
2026-03-30 10:50:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_6c889a2b1effb7e864ee1e389fd856a8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:15:12Z',
 'fuel_type': 'petrol',
 'id': '9b58405c-b76d-5ff4-b4c8-8a93a3e69811',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU04536',
 'listing': 'auction',
 'location': 'DE, Karlsruhe',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 169534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_ec2719d881413a04e92029b0b6fc10cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2700439,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_6c889a2b1effb7e864ee1e389fd856a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_fabdb07917269d82e81de6cfd3d4569f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2439604,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf69b37bc660258bbea31cb7410c914c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2465326,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_51900ed08f1968bdc53ad110ce81fad9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2613962,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_501565123894a58c631cea39d9c36bd1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_005a0be1a901cdd0e7586affc9fadb94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2649481,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_bf1de3320b0f653f4affaeb68b1b0a8d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2730822,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_b37c8f51c6210aae9942e22e8f9c864a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b58405c-b76d-5ff4-b4c8-8a93a3e69811/9b58405c-b76d-5ff4-b4c8-8a93a3e69811_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/94/f094ad7b23adfb7b62599e5581169b3b/pa/JU04536_56e6daa1a5ae8cbf1ea41bbbfeef0266.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Yeti 1.8 TSI Active Plus Edition 4x4',
 'transmission': 'manual',
 'trim': 'Active Plus Edition 4x4',
 'year': 2011}
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU04536%27 HTTP/1.1" 200 None
2026-03-30 10:50:39 [auto1.de] INFO: Saving data for JU04536: {'created_time': 1774867839.245462, 'last_price_update_time': 1774867839.245473, 'auction_closing_time': 1774970112.0}
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU04536') HTTP/1.1" 204 0
2026-03-30 10:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_61bbf8a5032812ba880d26f067e1ac3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_51397c4be328de7cfe2608803dc14ea6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_4898f10bb791e5051643891f19d91bdc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_61c12555a517d310cf95cc80619f5f87.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef8068110>
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f33b256-ae79-5822-8422-c9bc3d19156d/8f33b256-ae79-5822-8422-c9bc3d19156d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fae%252Fdaaeda35164a255d93f54d1d82b0ed3d%252Fpa%252FYY96342_3c04af4f7b2db4c7e9238de162450a00.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_3c04af4f7b2db4c7e9238de162450a00.jpg saved to cache
2026-03-30 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f33b256-ae79-5822-8422-c9bc3d19156d
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e443d0>
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc3605dc-32e2-5789-a46b-9b3d8104fa00/bc3605dc-32e2-5789-a46b-9b3d8104fa00_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fce%252Ff2ce52bb9a0de984b139dbf289124417%252Fpa%252FNY45560_d6bb7bf4220caa2ed3a87e5af0ae915c.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_d6bb7bf4220caa2ed3a87e5af0ae915c.jpg saved to cache
2026-03-30 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc3605dc-32e2-5789-a46b-9b3d8104fa00
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e6b010>
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cfda84-e0d7-5d2c-aad0-e81061737e98/50cfda84-e0d7-5d2c-aad0-e81061737e98_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F83%252Fa1835df2cef7f5557254481bbc73caf0%252Fpa%252FHC44441_7c9552e26643ab0e590071c89fc17f8b.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_7c9552e26643ab0e590071c89fc17f8b.jpg saved to cache
2026-03-30 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 50cfda84-e0d7-5d2c-aad0-e81061737e98
2026-03-30 10:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_6fcca2c4551332904edae674080f9f3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b02d0>
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f33b256-ae79-5822-8422-c9bc3d19156d/8f33b256-ae79-5822-8422-c9bc3d19156d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fae%252Fdaaeda35164a255d93f54d1d82b0ed3d%252Fpa%252FYY96342_61bbf8a5032812ba880d26f067e1ac3d.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_61bbf8a5032812ba880d26f067e1ac3d.jpg saved to cache
2026-03-30 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f33b256-ae79-5822-8422-c9bc3d19156d
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef854b2d0>
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f33b256-ae79-5822-8422-c9bc3d19156d/8f33b256-ae79-5822-8422-c9bc3d19156d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fae%252Fdaaeda35164a255d93f54d1d82b0ed3d%252Fpa%252FYY96342_51397c4be328de7cfe2608803dc14ea6.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_51397c4be328de7cfe2608803dc14ea6.jpg saved to cache
2026-03-30 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f33b256-ae79-5822-8422-c9bc3d19156d
2026-03-30 10:50:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f33b256-ae79-5822-8422-c9bc3d19156d, skipping ID generation
2026-03-30 10:50:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f33b256-ae79-5822-8422-c9bc3d19156d with scrape type 1
2026-03-30 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f33b256-ae79-5822-8422-c9bc3d19156d sending to next pipeline
2026-03-30 10:50:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f33b256-ae79-5822-8422-c9bc3d19156d, identifier: YY96342
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7c01050>
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cfda84-e0d7-5d2c-aad0-e81061737e98/50cfda84-e0d7-5d2c-aad0-e81061737e98_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F83%252Fa1835df2cef7f5557254481bbc73caf0%252Fpa%252FHC44441_4898f10bb791e5051643891f19d91bdc.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_4898f10bb791e5051643891f19d91bdc.jpg saved to cache
2026-03-30 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 50cfda84-e0d7-5d2c-aad0-e81061737e98
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8fed0>
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc3605dc-32e2-5789-a46b-9b3d8104fa00/bc3605dc-32e2-5789-a46b-9b3d8104fa00_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fce%252Ff2ce52bb9a0de984b139dbf289124417%252Fpa%252FNY45560_61c12555a517d310cf95cc80619f5f87.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_61c12555a517d310cf95cc80619f5f87.jpg saved to cache
2026-03-30 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc3605dc-32e2-5789-a46b-9b3d8104fa00
2026-03-30 10:50:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc3605dc-32e2-5789-a46b-9b3d8104fa00, skipping ID generation
2026-03-30 10:50:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc3605dc-32e2-5789-a46b-9b3d8104fa00 with scrape type 1
2026-03-30 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc3605dc-32e2-5789-a46b-9b3d8104fa00 sending to next pipeline
2026-03-30 10:50:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc3605dc-32e2-5789-a46b-9b3d8104fa00, identifier: NY45560
2026-03-30 10:50:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f33b256-ae79-5822-8422-c9bc3d19156d with identifier: YY96342
2026-03-30 10:50:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f33b256-ae79-5822-8422-c9bc3d19156d with identifier: YY96342
2026-03-30 10:50:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f33b256-ae79-5822-8422-c9bc3d19156d with identifier: YY96342 to the API
2026-03-30 10:50:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_51397c4be328de7cfe2608803dc14ea6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:38:20Z',
 'fuel_type': 'petrol',
 'id': '8f33b256-ae79-5822-8422-c9bc3d19156d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY96342',
 'listing': 'auction',
 'location': 'DE, Blankenfelde-Mahlow',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 172524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f33b256-ae79-5822-8422-c9bc3d19156d/8f33b256-ae79-5822-8422-c9bc3d19156d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_51397c4be328de7cfe2608803dc14ea6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f33b256-ae79-5822-8422-c9bc3d19156d/8f33b256-ae79-5822-8422-c9bc3d19156d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_3c04af4f7b2db4c7e9238de162450a00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f33b256-ae79-5822-8422-c9bc3d19156d/8f33b256-ae79-5822-8422-c9bc3d19156d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_61bbf8a5032812ba880d26f067e1ac3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f33b256-ae79-5822-8422-c9bc3d19156d/8f33b256-ae79-5822-8422-c9bc3d19156d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_8628f604debad5a4601da8ba8889d92b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f33b256-ae79-5822-8422-c9bc3d19156d/8f33b256-ae79-5822-8422-c9bc3d19156d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/ae/daaeda35164a255d93f54d1d82b0ed3d/pa/YY96342_da0b04152f23c27f564d737429ff3519.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2011}
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY96342%27 HTTP/1.1" 200 None
2026-03-30 10:50:40 [auto1.de] INFO: Saving data for YY96342: {'created_time': 1774867840.124175, 'last_price_update_time': 1774867840.124191, 'auction_closing_time': 1774971500.0}
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY96342') HTTP/1.1" 204 0
2026-03-30 10:50:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc3605dc-32e2-5789-a46b-9b3d8104fa00 with identifier: NY45560
2026-03-30 10:50:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc3605dc-32e2-5789-a46b-9b3d8104fa00 with identifier: NY45560
2026-03-30 10:50:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc3605dc-32e2-5789-a46b-9b3d8104fa00 with identifier: NY45560 to the API
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_61c12555a517d310cf95cc80619f5f87.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:42:24Z',
 'fuel_type': 'petrol',
 'id': 'bc3605dc-32e2-5789-a46b-9b3d8104fa00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY45560',
 'listing': 'auction',
 'location': 'DE, Ludwigsburg',
 'make': 'BMW',
 'model': '1er',
 'odometer': 202617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc3605dc-32e2-5789-a46b-9b3d8104fa00/bc3605dc-32e2-5789-a46b-9b3d8104fa00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_d6bb7bf4220caa2ed3a87e5af0ae915c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc3605dc-32e2-5789-a46b-9b3d8104fa00/bc3605dc-32e2-5789-a46b-9b3d8104fa00_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_61c12555a517d310cf95cc80619f5f87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc3605dc-32e2-5789-a46b-9b3d8104fa00/bc3605dc-32e2-5789-a46b-9b3d8104fa00_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_671bdb0d27f52213c6fe3535458a5a03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc3605dc-32e2-5789-a46b-9b3d8104fa00/bc3605dc-32e2-5789-a46b-9b3d8104fa00_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_2b6b56f81ed32a2c68c4bb58c1efbb29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc3605dc-32e2-5789-a46b-9b3d8104fa00/bc3605dc-32e2-5789-a46b-9b3d8104fa00_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/ce/f2ce52bb9a0de984b139dbf289124417/pa/NY45560_4521ea9f6902c67ee68fa2f4058416b3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45560%27 HTTP/1.1" 200 None
2026-03-30 10:50:40 [auto1.de] INFO: Saving data for NY45560: {'created_time': 1774867840.532851, 'last_price_update_time': 1774867840.532863, 'auction_closing_time': 1774971744.0}
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY45560') HTTP/1.1" 204 0
2026-03-30 10:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX17463/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef86a6cd0>
2026-03-30 10:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cfda84-e0d7-5d2c-aad0-e81061737e98/50cfda84-e0d7-5d2c-aad0-e81061737e98_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F83%252Fa1835df2cef7f5557254481bbc73caf0%252Fpa%252FHC44441_6fcca2c4551332904edae674080f9f3a.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_6fcca2c4551332904edae674080f9f3a.jpg saved to cache
2026-03-30 10:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50cfda84-e0d7-5d2c-aad0-e81061737e98
2026-03-30 10:50:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50cfda84-e0d7-5d2c-aad0-e81061737e98, skipping ID generation
2026-03-30 10:50:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50cfda84-e0d7-5d2c-aad0-e81061737e98 with scrape type 1
2026-03-30 10:50:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50cfda84-e0d7-5d2c-aad0-e81061737e98 sending to next pipeline
2026-03-30 10:50:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50cfda84-e0d7-5d2c-aad0-e81061737e98, identifier: HC44441
2026-03-30 10:50:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50cfda84-e0d7-5d2c-aad0-e81061737e98 with identifier: HC44441
2026-03-30 10:50:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50cfda84-e0d7-5d2c-aad0-e81061737e98 with identifier: HC44441
2026-03-30 10:50:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50cfda84-e0d7-5d2c-aad0-e81061737e98 with identifier: HC44441 to the API
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_6fcca2c4551332904edae674080f9f3a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 97,
 'expiration_date': '2026-03-31T15:52:26Z',
 'fuel_type': 'petrol',
 'id': '50cfda84-e0d7-5d2c-aad0-e81061737e98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC44441',
 'listing': 'auction',
 'location': 'DE, Gera',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 103532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cfda84-e0d7-5d2c-aad0-e81061737e98/50cfda84-e0d7-5d2c-aad0-e81061737e98_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_6fcca2c4551332904edae674080f9f3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cfda84-e0d7-5d2c-aad0-e81061737e98/50cfda84-e0d7-5d2c-aad0-e81061737e98_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_4898f10bb791e5051643891f19d91bdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cfda84-e0d7-5d2c-aad0-e81061737e98/50cfda84-e0d7-5d2c-aad0-e81061737e98_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_7c9552e26643ab0e590071c89fc17f8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cfda84-e0d7-5d2c-aad0-e81061737e98/50cfda84-e0d7-5d2c-aad0-e81061737e98_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_bf870c5639ff62b9f23f9f8c71b54b88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cfda84-e0d7-5d2c-aad0-e81061737e98/50cfda84-e0d7-5d2c-aad0-e81061737e98_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/83/a1835df2cef7f5557254481bbc73caf0/pa/HC44441_45eb92938b396afbbe92c3075d048438.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2009}
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC44441%27 HTTP/1.1" 200 None
2026-03-30 10:50:41 [auto1.de] INFO: Saving data for HC44441: {'created_time': 1774867841.095419, 'last_price_update_time': 1774867841.095431, 'auction_closing_time': 1774972346.0}
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC44441') HTTP/1.1" 204 0
2026-03-30 10:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC24225> (referer: https://www.auto1.com/v1/car-details-view/XC24225/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA25457> (referer: https://www.auto1.com/v1/car-details-view/XA25457/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU57543/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc963c30-8113-55ad-9440-b1a81a2788f1 with identifier: XC24225
2026-03-30 10:50:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc963c30-8113-55ad-9440-b1a81a2788f1 with scrape type 1
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc963c30-8113-55ad-9440-b1a81a2788f1
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_982e2e3d0ebb8ddc71ed1596b8198a61.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_982e2e3d0ebb8ddc71ed1596b8198a61.jpg not downloaded yet
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_f9c151318d0137228cd7a70f9140ab9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_f9c151318d0137228cd7a70f9140ab9a.jpg not downloaded yet
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_a34afafc847e99ce914a3f0ebfff5732.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_a34afafc847e99ce914a3f0ebfff5732.jpg not downloaded yet
2026-03-30 10:50:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faef22d5-1386-5e26-9f13-dfd3218852e6 with identifier: XA25457
2026-03-30 10:50:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faef22d5-1386-5e26-9f13-dfd3218852e6 with scrape type 1
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item faef22d5-1386-5e26-9f13-dfd3218852e6
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F91%252Fc4914d8dde3eb3388d3c49868d303495%252Fpa%252FXA25457_4b2a5eb442826073d43e837b2496542e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_4b2a5eb442826073d43e837b2496542e.jpg not downloaded yet
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_a83fb3d05b17e81115faa186b33615fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_a83fb3d05b17e81115faa186b33615fe.jpg not downloaded yet
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F91%252Fc4914d8dde3eb3388d3c49868d303495%252Fpa%252FXA25457_6892ff06979d4023f03e99f1bc0fd33c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_6892ff06979d4023f03e99f1bc0fd33c.jpg not downloaded yet
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_0704fcf9b0b13d0b35d113e78b00681c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_0704fcf9b0b13d0b35d113e78b00681c.jpg not downloaded yet
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F91%252Fc4914d8dde3eb3388d3c49868d303495%252Fpa%252FXA25457_9149e31d9223bdd138e255b187b7a9c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_9149e31d9223bdd138e255b187b7a9c9.jpg not downloaded yet
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_742a5d9a5e079b2d08a1540a57db627a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_742a5d9a5e079b2d08a1540a57db627a.jpg not downloaded yet
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F91%252Fc4914d8dde3eb3388d3c49868d303495%252Fpa%252FXA25457_b218ec78c5018d8115bb021957558495.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_b218ec78c5018d8115bb021957558495.jpg not downloaded yet
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_a160c316d8c66c70d6c9e2b84677a0e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_a160c316d8c66c70d6c9e2b84677a0e1.jpg not downloaded yet
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F91%252Fc4914d8dde3eb3388d3c49868d303495%252Fpa%252FXA25457_94d7206143c3351a3909b72bec87cf4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_94d7206143c3351a3909b72bec87cf4a.jpg not downloaded yet
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_8ea4a5431a37da8b8c2071c2163ad722.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_8ea4a5431a37da8b8c2071c2163ad722.jpg not downloaded yet
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_58c05b47c06250a70e9017b880502c20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_58c05b47c06250a70e9017b880502c20.jpg not downloaded yet
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_076e181ce4b44c928c0bc83abeef8d85.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_076e181ce4b44c928c0bc83abeef8d85.jpg not downloaded yet
2026-03-30 10:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NU64922/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_076e181ce4b44c928c0bc83abeef8d85.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_58c05b47c06250a70e9017b880502c20.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6e8d0>
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_076e181ce4b44c928c0bc83abeef8d85.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_076e181ce4b44c928c0bc83abeef8d85.jpg saved to cache
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc963c30-8113-55ad-9440-b1a81a2788f1
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f20d0>
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_58c05b47c06250a70e9017b880502c20.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_58c05b47c06250a70e9017b880502c20.jpg saved to cache
2026-03-30 10:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc963c30-8113-55ad-9440-b1a81a2788f1
2026-03-30 10:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ99756> (referer: https://www.auto1.com/v1/car-details-view/NJ99756/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_8ea4a5431a37da8b8c2071c2163ad722.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01d7f3fc-4bb3-5128-8b95-4553c289602f with identifier: NJ99756
2026-03-30 10:50:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01d7f3fc-4bb3-5128-8b95-4553c289602f with scrape type 1
2026-03-30 10:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01d7f3fc-4bb3-5128-8b95-4553c289602f
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_657551cce0619d9094769a521fd7f716.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_657551cce0619d9094769a521fd7f716.jpg not downloaded yet
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_a311fbee4f5aff9ed9faa6d146f8fa67.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_a311fbee4f5aff9ed9faa6d146f8fa67.jpg not downloaded yet
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_2def633ea7623968cc9605c20f957588.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_2def633ea7623968cc9605c20f957588.jpg not downloaded yet
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_6e31575b60493cf4697973d06b13ac92.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_6e31575b60493cf4697973d06b13ac92.jpg not downloaded yet
2026-03-30 10:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50e7310>
2026-03-30 10:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_8ea4a5431a37da8b8c2071c2163ad722.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_8ea4a5431a37da8b8c2071c2163ad722.jpg saved to cache
2026-03-30 10:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc963c30-8113-55ad-9440-b1a81a2788f1
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_4d0fb979733a609a6438e74baa1d64af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_4d0fb979733a609a6438e74baa1d64af.jpg not downloaded yet
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_769d4b7124015be901ef21becd952cde.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_769d4b7124015be901ef21becd952cde.jpg not downloaded yet
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_5319cce26a9834b4f908ed48f1ff558b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_5319cce26a9834b4f908ed48f1ff558b.jpg not downloaded yet
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_2d01791ef3a245ae1bdfd2aca7612c65.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_2d01791ef3a245ae1bdfd2aca7612c65.jpg not downloaded yet
2026-03-30 10:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_94d7206143c3351a3909b72bec87cf4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_0c973e2af4832374d97ed6abbf8ce21e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_0c973e2af4832374d97ed6abbf8ce21e.jpg not downloaded yet
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_9d44ef4783b33fa9a11bd296da88d3b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_9d44ef4783b33fa9a11bd296da88d3b0.jpg not downloaded yet
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f19d0>
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faef22d5-1386-5e26-9f13-dfd3218852e6/faef22d5-1386-5e26-9f13-dfd3218852e6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F91%252Fc4914d8dde3eb3388d3c49868d303495%252Fpa%252FXA25457_94d7206143c3351a3909b72bec87cf4a.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_94d7206143c3351a3909b72bec87cf4a.jpg saved to cache
2026-03-30 10:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item faef22d5-1386-5e26-9f13-dfd3218852e6
2026-03-30 10:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_5319cce26a9834b4f908ed48f1ff558b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e03fd0>
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_5319cce26a9834b4f908ed48f1ff558b.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_5319cce26a9834b4f908ed48f1ff558b.jpg saved to cache
2026-03-30 10:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01d7f3fc-4bb3-5128-8b95-4553c289602f
2026-03-30 10:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_9d44ef4783b33fa9a11bd296da88d3b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_0c973e2af4832374d97ed6abbf8ce21e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a23dd0>
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_9d44ef4783b33fa9a11bd296da88d3b0.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_9d44ef4783b33fa9a11bd296da88d3b0.jpg saved to cache
2026-03-30 10:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01d7f3fc-4bb3-5128-8b95-4553c289602f
2026-03-30 10:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RH55673/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_2d01791ef3a245ae1bdfd2aca7612c65.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f47d90>
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_0c973e2af4832374d97ed6abbf8ce21e.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_0c973e2af4832374d97ed6abbf8ce21e.jpg saved to cache
2026-03-30 10:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01d7f3fc-4bb3-5128-8b95-4553c289602f
2026-03-30 10:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_4d0fb979733a609a6438e74baa1d64af.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4feef90>
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_2d01791ef3a245ae1bdfd2aca7612c65.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_2d01791ef3a245ae1bdfd2aca7612c65.jpg saved to cache
2026-03-30 10:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01d7f3fc-4bb3-5128-8b95-4553c289602f
2026-03-30 10:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_6e31575b60493cf4697973d06b13ac92.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_769d4b7124015be901ef21becd952cde.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e021d0>
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_4d0fb979733a609a6438e74baa1d64af.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_4d0fb979733a609a6438e74baa1d64af.jpg saved to cache
2026-03-30 10:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01d7f3fc-4bb3-5128-8b95-4553c289602f
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6cb10>
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_6e31575b60493cf4697973d06b13ac92.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_6e31575b60493cf4697973d06b13ac92.jpg saved to cache
2026-03-30 10:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01d7f3fc-4bb3-5128-8b95-4553c289602f
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a30390>
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_769d4b7124015be901ef21becd952cde.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_769d4b7124015be901ef21becd952cde.jpg saved to cache
2026-03-30 10:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01d7f3fc-4bb3-5128-8b95-4553c289602f
2026-03-30 10:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_2def633ea7623968cc9605c20f957588.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd2e50>
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_2def633ea7623968cc9605c20f957588.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_2def633ea7623968cc9605c20f957588.jpg saved to cache
2026-03-30 10:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01d7f3fc-4bb3-5128-8b95-4553c289602f
2026-03-30 10:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY02033/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_a311fbee4f5aff9ed9faa6d146f8fa67.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_657551cce0619d9094769a521fd7f716.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_a160c316d8c66c70d6c9e2b84677a0e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6eb10>
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_a311fbee4f5aff9ed9faa6d146f8fa67.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_a311fbee4f5aff9ed9faa6d146f8fa67.jpg saved to cache
2026-03-30 10:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01d7f3fc-4bb3-5128-8b95-4553c289602f
2026-03-30 10:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_742a5d9a5e079b2d08a1540a57db627a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5074850>
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fed%252F79edafe5998eb9f4e846bd4b569a32a5%252Fpa%252FNJ99756_657551cce0619d9094769a521fd7f716.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_657551cce0619d9094769a521fd7f716.jpg saved to cache
2026-03-30 10:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01d7f3fc-4bb3-5128-8b95-4553c289602f
2026-03-30 10:50:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01d7f3fc-4bb3-5128-8b95-4553c289602f, skipping ID generation
2026-03-30 10:50:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01d7f3fc-4bb3-5128-8b95-4553c289602f with scrape type 1
2026-03-30 10:50:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01d7f3fc-4bb3-5128-8b95-4553c289602f sending to next pipeline
2026-03-30 10:50:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01d7f3fc-4bb3-5128-8b95-4553c289602f, identifier: NJ99756
2026-03-30 10:50:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01d7f3fc-4bb3-5128-8b95-4553c289602f with identifier: NJ99756
2026-03-30 10:50:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01d7f3fc-4bb3-5128-8b95-4553c289602f with identifier: NJ99756
2026-03-30 10:50:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01d7f3fc-4bb3-5128-8b95-4553c289602f with identifier: NJ99756 to the API
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_657551cce0619d9094769a521fd7f716.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-31T15:32:49Z',
 'fuel_type': 'petrol',
 'id': '01d7f3fc-4bb3-5128-8b95-4553c289602f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ99756',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 64081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_657551cce0619d9094769a521fd7f716.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_a311fbee4f5aff9ed9faa6d146f8fa67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_2def633ea7623968cc9605c20f957588.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_6e31575b60493cf4697973d06b13ac92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_4d0fb979733a609a6438e74baa1d64af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_769d4b7124015be901ef21becd952cde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_5319cce26a9834b4f908ed48f1ff558b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_2d01791ef3a245ae1bdfd2aca7612c65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_0c973e2af4832374d97ed6abbf8ce21e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d7f3fc-4bb3-5128-8b95-4553c289602f/01d7f3fc-4bb3-5128-8b95-4553c289602f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79edafe5998eb9f4e846bd4b569a32a5/pa/NJ99756_9d44ef4783b33fa9a11bd296da88d3b0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Design&Tech Start/Stop',
 'transmission': 'manual',
 'trim': 'Design&Tech Start/Stop',
 'year': 2021}
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ99756%27 HTTP/1.1" 200 None
2026-03-30 10:50:45 [auto1.de] INFO: Saving data for NJ99756: {'created_time': 1774867845.866655, 'last_price_update_time': 1774867845.866666, 'auction_closing_time': 1774971169.0}
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ99756') HTTP/1.1" 204 0
2026-03-30 10:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_b218ec78c5018d8115bb021957558495.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH70727/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5009c10>
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_a160c316d8c66c70d6c9e2b84677a0e1.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_a160c316d8c66c70d6c9e2b84677a0e1.jpg saved to cache
2026-03-30 10:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc963c30-8113-55ad-9440-b1a81a2788f1
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0c890>
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_742a5d9a5e079b2d08a1540a57db627a.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_742a5d9a5e079b2d08a1540a57db627a.jpg saved to cache
2026-03-30 10:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc963c30-8113-55ad-9440-b1a81a2788f1
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a31150>
2026-03-30 10:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faef22d5-1386-5e26-9f13-dfd3218852e6/faef22d5-1386-5e26-9f13-dfd3218852e6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F91%252Fc4914d8dde3eb3388d3c49868d303495%252Fpa%252FXA25457_b218ec78c5018d8115bb021957558495.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_b218ec78c5018d8115bb021957558495.jpg saved to cache
2026-03-30 10:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item faef22d5-1386-5e26-9f13-dfd3218852e6
2026-03-30 10:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_0704fcf9b0b13d0b35d113e78b00681c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_9149e31d9223bdd138e255b187b7a9c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a33990>
2026-03-30 10:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_0704fcf9b0b13d0b35d113e78b00681c.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_0704fcf9b0b13d0b35d113e78b00681c.jpg saved to cache
2026-03-30 10:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc963c30-8113-55ad-9440-b1a81a2788f1
2026-03-30 10:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50a5490>
2026-03-30 10:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faef22d5-1386-5e26-9f13-dfd3218852e6/faef22d5-1386-5e26-9f13-dfd3218852e6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F91%252Fc4914d8dde3eb3388d3c49868d303495%252Fpa%252FXA25457_9149e31d9223bdd138e255b187b7a9c9.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_9149e31d9223bdd138e255b187b7a9c9.jpg saved to cache
2026-03-30 10:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item faef22d5-1386-5e26-9f13-dfd3218852e6
2026-03-30 10:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM84118/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_6892ff06979d4023f03e99f1bc0fd33c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a33750>
2026-03-30 10:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faef22d5-1386-5e26-9f13-dfd3218852e6/faef22d5-1386-5e26-9f13-dfd3218852e6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F91%252Fc4914d8dde3eb3388d3c49868d303495%252Fpa%252FXA25457_6892ff06979d4023f03e99f1bc0fd33c.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_6892ff06979d4023f03e99f1bc0fd33c.jpg saved to cache
2026-03-30 10:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item faef22d5-1386-5e26-9f13-dfd3218852e6
2026-03-30 10:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX17463> (referer: https://www.auto1.com/v1/car-details-view/AX17463/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6444ea66-adb3-55da-9d3a-ed85737fa5dd with identifier: AX17463
2026-03-30 10:50:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6444ea66-adb3-55da-9d3a-ed85737fa5dd with scrape type 1
2026-03-30 10:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6444ea66-adb3-55da-9d3a-ed85737fa5dd
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Fba%252Fc9bace637038250e97bc95d43d60ddcf%252Fpa%252FAX17463_52e46c48356e5081784bba8e4f53d678.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_52e46c48356e5081784bba8e4f53d678.jpg already downloaded
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Fba%252Fc9bace637038250e97bc95d43d60ddcf%252Fpa%252FAX17463_11465c6e84a2d26fe3be22b3b193ea6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_11465c6e84a2d26fe3be22b3b193ea6c.jpg already downloaded
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Fba%252Fc9bace637038250e97bc95d43d60ddcf%252Fpa%252FAX17463_44c0b7b1c7994ae6223717e00b493896.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_44c0b7b1c7994ae6223717e00b493896.jpg already downloaded
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Fba%252Fc9bace637038250e97bc95d43d60ddcf%252Fpa%252FAX17463_85adebf799489e8bcfd85217d9e0caa0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_85adebf799489e8bcfd85217d9e0caa0.jpg already downloaded
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Fba%252Fc9bace637038250e97bc95d43d60ddcf%252Fpa%252FAX17463_5364019938b9ec3bdeaf53dc09271976.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_5364019938b9ec3bdeaf53dc09271976.jpg already downloaded
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Fba%252Fc9bace637038250e97bc95d43d60ddcf%252Fpa%252FAX17463_7e75216f1b9d9201ce7309a9730dde6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_7e75216f1b9d9201ce7309a9730dde6a.jpg already downloaded
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Fba%252Fc9bace637038250e97bc95d43d60ddcf%252Fpa%252FAX17463_c61703c8039f9b6a5e06c0dff121a6ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_c61703c8039f9b6a5e06c0dff121a6ff.jpg already downloaded
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Fba%252Fc9bace637038250e97bc95d43d60ddcf%252Fpa%252FAX17463_e3ba95be1e4a1456c46eb29ea5ec7927.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_e3ba95be1e4a1456c46eb29ea5ec7927.jpg already downloaded
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Fba%252Fc9bace637038250e97bc95d43d60ddcf%252Fpa%252FAX17463_056451001986e0f206db07a81eefff3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_056451001986e0f206db07a81eefff3a.jpg already downloaded
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Fba%252Fc9bace637038250e97bc95d43d60ddcf%252Fpa%252FAX17463_39ff00c8ff5aa2afdcc62b11583c3b97.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_39ff00c8ff5aa2afdcc62b11583c3b97.jpg already downloaded
2026-03-30 10:50:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6444ea66-adb3-55da-9d3a-ed85737fa5dd, identifier: AX17463
2026-03-30 10:50:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6444ea66-adb3-55da-9d3a-ed85737fa5dd with identifier: AX17463
2026-03-30 10:50:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6444ea66-adb3-55da-9d3a-ed85737fa5dd with identifier: AX17463
2026-03-30 10:50:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6444ea66-adb3-55da-9d3a-ed85737fa5dd with identifier: AX17463 to the API
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AX17463>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:51:12Z',
 'fuel_type': 'petrol',
 'id': '6444ea66-adb3-55da-9d3a-ed85737fa5dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX17463',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 61171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_52e46c48356e5081784bba8e4f53d678.jpg',
                'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_11465c6e84a2d26fe3be22b3b193ea6c.jpg',
                'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_44c0b7b1c7994ae6223717e00b493896.jpg',
                'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_85adebf799489e8bcfd85217d9e0caa0.jpg',
                'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_5364019938b9ec3bdeaf53dc09271976.jpg',
                'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_7e75216f1b9d9201ce7309a9730dde6a.jpg',
                'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_c61703c8039f9b6a5e06c0dff121a6ff.jpg',
                'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_e3ba95be1e4a1456c46eb29ea5ec7927.jpg',
                'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_056451001986e0f206db07a81eefff3a.jpg',
                'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_39ff00c8ff5aa2afdcc62b11583c3b97.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6444ea66-adb3-55da-9d3a-ed85737fa5dd/6444ea66-adb3-55da-9d3a-ed85737fa5dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_52e46c48356e5081784bba8e4f53d678.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6444ea66-adb3-55da-9d3a-ed85737fa5dd/6444ea66-adb3-55da-9d3a-ed85737fa5dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_11465c6e84a2d26fe3be22b3b193ea6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6444ea66-adb3-55da-9d3a-ed85737fa5dd/6444ea66-adb3-55da-9d3a-ed85737fa5dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_44c0b7b1c7994ae6223717e00b493896.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6444ea66-adb3-55da-9d3a-ed85737fa5dd/6444ea66-adb3-55da-9d3a-ed85737fa5dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_85adebf799489e8bcfd85217d9e0caa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6444ea66-adb3-55da-9d3a-ed85737fa5dd/6444ea66-adb3-55da-9d3a-ed85737fa5dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_5364019938b9ec3bdeaf53dc09271976.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6444ea66-adb3-55da-9d3a-ed85737fa5dd/6444ea66-adb3-55da-9d3a-ed85737fa5dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_7e75216f1b9d9201ce7309a9730dde6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6444ea66-adb3-55da-9d3a-ed85737fa5dd/6444ea66-adb3-55da-9d3a-ed85737fa5dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_c61703c8039f9b6a5e06c0dff121a6ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6444ea66-adb3-55da-9d3a-ed85737fa5dd/6444ea66-adb3-55da-9d3a-ed85737fa5dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_e3ba95be1e4a1456c46eb29ea5ec7927.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6444ea66-adb3-55da-9d3a-ed85737fa5dd/6444ea66-adb3-55da-9d3a-ed85737fa5dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_056451001986e0f206db07a81eefff3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6444ea66-adb3-55da-9d3a-ed85737fa5dd/6444ea66-adb3-55da-9d3a-ed85737fa5dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/ba/c9bace637038250e97bc95d43d60ddcf/pa/AX17463_39ff00c8ff5aa2afdcc62b11583c3b97.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2019}
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX17463%27 HTTP/1.1" 200 None
2026-03-30 10:50:49 [auto1.de] INFO: Saving data for AX17463: {'created_time': 1774867849.387239, 'last_price_update_time': 1774867849.387254, 'auction_closing_time': 1774972272.0}
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX17463') HTTP/1.1" 204 0
2026-03-30 10:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_a83fb3d05b17e81115faa186b33615fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EZ95690> (referer: https://www.auto1.com/v1/car-details-view/EZ95690/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_a34afafc847e99ce914a3f0ebfff5732.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_4b2a5eb442826073d43e837b2496542e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5077450>
2026-03-30 10:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_a83fb3d05b17e81115faa186b33615fe.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_a83fb3d05b17e81115faa186b33615fe.jpg saved to cache
2026-03-30 10:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc963c30-8113-55ad-9440-b1a81a2788f1
2026-03-30 10:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_f9c151318d0137228cd7a70f9140ab9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_982e2e3d0ebb8ddc71ed1596b8198a61.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fda08c46-4c8e-527d-acf5-bec11a7e521c with identifier: EZ95690
2026-03-30 10:50:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fda08c46-4c8e-527d-acf5-bec11a7e521c with scrape type 1
2026-03-30 10:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fda08c46-4c8e-527d-acf5-bec11a7e521c
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_1a6680d880089fb755606ccfd1afd801.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_1a6680d880089fb755606ccfd1afd801.jpg not downloaded yet
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_7c1a6e5e0bb938fd2f86d1e51aaadd79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_7c1a6e5e0bb938fd2f86d1e51aaadd79.jpg not downloaded yet
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_1593edc79d0d50357484c938d2b0c8b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_1593edc79d0d50357484c938d2b0c8b3.jpg not downloaded yet
2026-03-30 10:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a266d0>
2026-03-30 10:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_a34afafc847e99ce914a3f0ebfff5732.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_a34afafc847e99ce914a3f0ebfff5732.jpg saved to cache
2026-03-30 10:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc963c30-8113-55ad-9440-b1a81a2788f1
2026-03-30 10:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8c290>
2026-03-30 10:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faef22d5-1386-5e26-9f13-dfd3218852e6/faef22d5-1386-5e26-9f13-dfd3218852e6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F91%252Fc4914d8dde3eb3388d3c49868d303495%252Fpa%252FXA25457_4b2a5eb442826073d43e837b2496542e.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_4b2a5eb442826073d43e837b2496542e.jpg saved to cache
2026-03-30 10:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item faef22d5-1386-5e26-9f13-dfd3218852e6
2026-03-30 10:50:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: faef22d5-1386-5e26-9f13-dfd3218852e6, skipping ID generation
2026-03-30 10:50:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faef22d5-1386-5e26-9f13-dfd3218852e6 with scrape type 1
2026-03-30 10:50:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item faef22d5-1386-5e26-9f13-dfd3218852e6 sending to next pipeline
2026-03-30 10:50:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faef22d5-1386-5e26-9f13-dfd3218852e6, identifier: XA25457
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_dd7fa116415c3e3432e974b88adc4e9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_dd7fa116415c3e3432e974b88adc4e9b.jpg not downloaded yet
2026-03-30 10:50:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faef22d5-1386-5e26-9f13-dfd3218852e6 with identifier: XA25457
2026-03-30 10:50:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faef22d5-1386-5e26-9f13-dfd3218852e6 with identifier: XA25457
2026-03-30 10:50:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faef22d5-1386-5e26-9f13-dfd3218852e6 with identifier: XA25457 to the API
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_4b2a5eb442826073d43e837b2496542e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.7L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:36:24Z',
 'fuel_type': 'petrol',
 'id': 'faef22d5-1386-5e26-9f13-dfd3218852e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA25457',
 'listing': 'auction',
 'location': 'DE, Erfurt',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 144130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faef22d5-1386-5e26-9f13-dfd3218852e6/faef22d5-1386-5e26-9f13-dfd3218852e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_4b2a5eb442826073d43e837b2496542e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faef22d5-1386-5e26-9f13-dfd3218852e6/faef22d5-1386-5e26-9f13-dfd3218852e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_6892ff06979d4023f03e99f1bc0fd33c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faef22d5-1386-5e26-9f13-dfd3218852e6/faef22d5-1386-5e26-9f13-dfd3218852e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_9149e31d9223bdd138e255b187b7a9c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faef22d5-1386-5e26-9f13-dfd3218852e6/faef22d5-1386-5e26-9f13-dfd3218852e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_b218ec78c5018d8115bb021957558495.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faef22d5-1386-5e26-9f13-dfd3218852e6/faef22d5-1386-5e26-9f13-dfd3218852e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/91/c4914d8dde3eb3388d3c49868d303495/pa/XA25457_94d7206143c3351a3909b72bec87cf4a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 170',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA25457%27 HTTP/1.1" 200 None
2026-03-30 10:50:50 [auto1.de] INFO: Saving data for XA25457: {'created_time': 1774867850.328134, 'last_price_update_time': 1774867850.328145, 'auction_closing_time': 1774971384.0}
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA25457') HTTP/1.1" 204 0
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_e2073086de274c564917eba95b329f0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_e2073086de274c564917eba95b329f0e.jpg not downloaded yet
2026-03-30 10:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY54602/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_e9408587343fa98690dee5c75be0a5ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_e9408587343fa98690dee5c75be0a5ed.jpg not downloaded yet
2026-03-30 10:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b23650>
2026-03-30 10:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_f9c151318d0137228cd7a70f9140ab9a.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_f9c151318d0137228cd7a70f9140ab9a.jpg saved to cache
2026-03-30 10:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc963c30-8113-55ad-9440-b1a81a2788f1
2026-03-30 10:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea1190>
2026-03-30 10:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F4f%252F6c4fe7c4e1418f76c62234ae5eaacba6%252Fpa%252FXC24225_982e2e3d0ebb8ddc71ed1596b8198a61.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_982e2e3d0ebb8ddc71ed1596b8198a61.jpg saved to cache
2026-03-30 10:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc963c30-8113-55ad-9440-b1a81a2788f1
2026-03-30 10:50:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc963c30-8113-55ad-9440-b1a81a2788f1, skipping ID generation
2026-03-30 10:50:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc963c30-8113-55ad-9440-b1a81a2788f1 with scrape type 1
2026-03-30 10:50:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc963c30-8113-55ad-9440-b1a81a2788f1 sending to next pipeline
2026-03-30 10:50:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc963c30-8113-55ad-9440-b1a81a2788f1, identifier: XC24225
2026-03-30 10:50:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc963c30-8113-55ad-9440-b1a81a2788f1 with identifier: XC24225
2026-03-30 10:50:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc963c30-8113-55ad-9440-b1a81a2788f1 with identifier: XC24225
2026-03-30 10:50:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc963c30-8113-55ad-9440-b1a81a2788f1 with identifier: XC24225 to the API
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_982e2e3d0ebb8ddc71ed1596b8198a61.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:11:44Z',
 'fuel_type': 'hybrid',
 'id': 'dc963c30-8113-55ad-9440-b1a81a2788f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC24225',
 'listing': 'auction',
 'location': 'DE, Saarlouis',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 90527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_982e2e3d0ebb8ddc71ed1596b8198a61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_f9c151318d0137228cd7a70f9140ab9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_a34afafc847e99ce914a3f0ebfff5732.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_a83fb3d05b17e81115faa186b33615fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_0704fcf9b0b13d0b35d113e78b00681c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_742a5d9a5e079b2d08a1540a57db627a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_a160c316d8c66c70d6c9e2b84677a0e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_8ea4a5431a37da8b8c2071c2163ad722.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_58c05b47c06250a70e9017b880502c20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc963c30-8113-55ad-9440-b1a81a2788f1/dc963c30-8113-55ad-9440-b1a81a2788f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/4f/6c4fe7c4e1418f76c62234ae5eaacba6/pa/XC24225_076e181ce4b44c928c0bc83abeef8d85.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC24225%27 HTTP/1.1" 200 None
2026-03-30 10:50:51 [auto1.de] INFO: Saving data for XC24225: {'created_time': 1774867851.096577, 'last_price_update_time': 1774867851.096589, 'auction_closing_time': 1774969904.0}
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC24225') HTTP/1.1" 204 0
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_4d04830e917f68b72d2d460879d01ab3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_4d04830e917f68b72d2d460879d01ab3.jpg not downloaded yet
2026-03-30 10:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_dcad9d354f72f2e20083222722e40220.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_dcad9d354f72f2e20083222722e40220.jpg not downloaded yet
2026-03-30 10:50:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_4fb795a42d614d203ffebb06d5768b6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_4fb795a42d614d203ffebb06d5768b6c.jpg not downloaded yet
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_01e9d686ed6d423cda6c0e897814517d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_01e9d686ed6d423cda6c0e897814517d.jpg not downloaded yet
2026-03-30 10:50:51 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 9504 | hits on page: 40
2026-03-30 10:50:51 [auto1.de] INFO: Found listing with ID: YL37879
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL37879%27 HTTP/1.1" 200 None
2026-03-30 10:50:51 [auto1.de] INFO: Scrape type for YL37879: 2
2026-03-30 10:50:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56afc06b-c288-5f67-a754-37faa251f5c2 with identifier: YL37879
2026-03-30 10:50:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56afc06b-c288-5f67-a754-37faa251f5c2 with scrape type 2
2026-03-30 10:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56afc06b-c288-5f67-a754-37faa251f5c2 with scrape type 2
2026-03-30 10:50:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56afc06b-c288-5f67-a754-37faa251f5c2, identifier: YL37879
2026-03-30 10:50:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56afc06b-c288-5f67-a754-37faa251f5c2 with identifier: YL37879
2026-03-30 10:50:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56afc06b-c288-5f67-a754-37faa251f5c2 with identifier: YL37879
2026-03-30 10:50:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56afc06b-c288-5f67-a754-37faa251f5c2 with identifier: YL37879 to the API
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:46:55Z',
 'fuel_type': 'diesel',
 'id': '56afc06b-c288-5f67-a754-37faa251f5c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL37879',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Phaeton',
 'odometer': 302576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-05',
 'seller_name': None,
 'title': 'Volkswagen Phaeton 3.0 V6 TDI Lang 4Motion',
 'transmission': 'automatic',
 'trim': 'Lang 4Motion',
 'year': 2009}
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL37879%27 HTTP/1.1" 200 None
2026-03-30 10:50:52 [auto1.de] INFO: Saving data for YL37879: {'auction_closing_time': 1774972015.0, 'created_time': 1773227922.208218, 'last_price_update_time': 1774867852.025527}
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL37879') HTTP/1.1" 204 0
2026-03-30 10:50:52 [auto1.de] INFO: Found listing with ID: RR13912
2026-03-30 10:50:52 [auto1.de] INFO: Found listing with ID: RK02982
2026-03-30 10:50:52 [auto1.de] INFO: Found listing with ID: EJ29706
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ29706%27 HTTP/1.1" 200 None
2026-03-30 10:50:52 [auto1.de] INFO: Scrape type for EJ29706: 1
2026-03-30 10:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_e2073086de274c564917eba95b329f0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:52 [auto1.de] INFO: Found listing with ID: PR60744
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR60744%27 HTTP/1.1" 200 None
2026-03-30 10:50:52 [auto1.de] INFO: Scrape type for PR60744: 2
2026-03-30 10:50:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0a684af-e11c-54cf-892f-4ccb2253c6b7 with identifier: PR60744
2026-03-30 10:50:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0a684af-e11c-54cf-892f-4ccb2253c6b7 with scrape type 2
2026-03-30 10:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0a684af-e11c-54cf-892f-4ccb2253c6b7 with scrape type 2
2026-03-30 10:50:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0a684af-e11c-54cf-892f-4ccb2253c6b7, identifier: PR60744
2026-03-30 10:50:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0a684af-e11c-54cf-892f-4ccb2253c6b7 with identifier: PR60744
2026-03-30 10:50:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0a684af-e11c-54cf-892f-4ccb2253c6b7 with identifier: PR60744
2026-03-30 10:50:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0a684af-e11c-54cf-892f-4ccb2253c6b7 with identifier: PR60744 to the API
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:07:36Z',
 'fuel_type': 'diesel',
 'id': 'c0a684af-e11c-54cf-892f-4ccb2253c6b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR60744',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 109098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-31',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Business Innovation',
 'transmission': 'manual',
 'trim': 'Business Innovation',
 'year': 2017}
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR60744%27 HTTP/1.1" 200 None
2026-03-30 10:50:52 [auto1.de] INFO: Saving data for PR60744: {'auction_closing_time': 1774969656.0, 'created_time': 1773429481.033966, 'last_price_update_time': 1774867852.591623}
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR60744') HTTP/1.1" 204 0
2026-03-30 10:50:52 [auto1.de] INFO: Found listing with ID: JJ25259
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ25259%27 HTTP/1.1" 200 None
2026-03-30 10:50:52 [auto1.de] INFO: Scrape type for JJ25259: 2
2026-03-30 10:50:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32e72c1e-b897-55af-bcc3-1ff02c1df25f with identifier: JJ25259
2026-03-30 10:50:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32e72c1e-b897-55af-bcc3-1ff02c1df25f with scrape type 2
2026-03-30 10:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32e72c1e-b897-55af-bcc3-1ff02c1df25f with scrape type 2
2026-03-30 10:50:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32e72c1e-b897-55af-bcc3-1ff02c1df25f, identifier: JJ25259
2026-03-30 10:50:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32e72c1e-b897-55af-bcc3-1ff02c1df25f with identifier: JJ25259
2026-03-30 10:50:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32e72c1e-b897-55af-bcc3-1ff02c1df25f with identifier: JJ25259
2026-03-30 10:50:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32e72c1e-b897-55af-bcc3-1ff02c1df25f with identifier: JJ25259 to the API
2026-03-30 10:50:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:06:18Z',
 'fuel_type': 'petrol',
 'id': '32e72c1e-b897-55af-bcc3-1ff02c1df25f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ25259',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 221623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-19',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.4 Turbo Super',
 'transmission': 'manual',
 'trim': 'Super',
 'year': 2011}
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ25259%27 HTTP/1.1" 200 None
2026-03-30 10:50:53 [auto1.de] INFO: Saving data for JJ25259: {'auction_closing_time': 1774969578.0, 'created_time': 1774349955.465154, 'last_price_update_time': 1774867853.152776}
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ25259') HTTP/1.1" 204 0
2026-03-30 10:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM81124/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fbab90>
2026-03-30 10:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_e2073086de274c564917eba95b329f0e.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_e2073086de274c564917eba95b329f0e.jpg saved to cache
2026-03-30 10:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fda08c46-4c8e-527d-acf5-bec11a7e521c
2026-03-30 10:50:53 [auto1.de] INFO: Found listing with ID: MK63509
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK63509%27 HTTP/1.1" 200 None
2026-03-30 10:50:53 [auto1.de] INFO: Scrape type for MK63509: 1
2026-03-30 10:50:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:53 [auto1.de] INFO: Found listing with ID: UM69054
2026-03-30 10:50:53 [auto1.de] INFO: Found listing with ID: KM40135
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM40135%27 HTTP/1.1" 200 None
2026-03-30 10:50:53 [auto1.de] INFO: Scrape type for KM40135: 2
2026-03-30 10:50:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 481b6c9f-9c88-5aab-8224-3074da5aa9b2 with identifier: KM40135
2026-03-30 10:50:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 481b6c9f-9c88-5aab-8224-3074da5aa9b2 with scrape type 2
2026-03-30 10:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 481b6c9f-9c88-5aab-8224-3074da5aa9b2 with scrape type 2
2026-03-30 10:50:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 481b6c9f-9c88-5aab-8224-3074da5aa9b2, identifier: KM40135
2026-03-30 10:50:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 481b6c9f-9c88-5aab-8224-3074da5aa9b2 with identifier: KM40135
2026-03-30 10:50:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 481b6c9f-9c88-5aab-8224-3074da5aa9b2 with identifier: KM40135
2026-03-30 10:50:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 481b6c9f-9c88-5aab-8224-3074da5aa9b2 with identifier: KM40135 to the API
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:51:41Z',
 'fuel_type': 'petrol',
 'id': '481b6c9f-9c88-5aab-8224-3074da5aa9b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM40135',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 12865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-16',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2024}
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM40135%27 HTTP/1.1" 200 None
2026-03-30 10:50:53 [auto1.de] INFO: Saving data for KM40135: {'auction_closing_time': 1774972301.0, 'created_time': 1773306873.675477, 'last_price_update_time': 1774867853.716606}
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM40135') HTTP/1.1" 204 0
2026-03-30 10:50:53 [auto1.de] INFO: Found listing with ID: FJ71862
2026-03-30 10:50:53 [auto1.de] INFO: Found listing with ID: YP95979
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP95979%27 HTTP/1.1" 200 None
2026-03-30 10:50:53 [auto1.de] INFO: Scrape type for YP95979: 1
2026-03-30 10:50:53 [auto1.de] INFO: Found listing with ID: MZ76661
2026-03-30 10:50:53 [auto1.de] INFO: Found listing with ID: FC01690
2026-03-30 10:50:53 [auto1.de] INFO: Found listing with ID: MD91791
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD91791%27 HTTP/1.1" 200 None
2026-03-30 10:50:53 [auto1.de] INFO: Scrape type for MD91791: 2
2026-03-30 10:50:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04e8051e-099b-54a9-a118-ef40653b11b5 with identifier: MD91791
2026-03-30 10:50:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04e8051e-099b-54a9-a118-ef40653b11b5 with scrape type 2
2026-03-30 10:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04e8051e-099b-54a9-a118-ef40653b11b5 with scrape type 2
2026-03-30 10:50:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04e8051e-099b-54a9-a118-ef40653b11b5, identifier: MD91791
2026-03-30 10:50:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04e8051e-099b-54a9-a118-ef40653b11b5 with identifier: MD91791
2026-03-30 10:50:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04e8051e-099b-54a9-a118-ef40653b11b5 with identifier: MD91791
2026-03-30 10:50:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04e8051e-099b-54a9-a118-ef40653b11b5 with identifier: MD91791 to the API
2026-03-30 10:50:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:54:35Z',
 'fuel_type': 'petrol',
 'id': '04e8051e-099b-54a9-a118-ef40653b11b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD91791',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 152105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-04',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI FR Edition',
 'transmission': 'automatic',
 'trim': 'FR Edition',
 'year': 2019}
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD91791%27 HTTP/1.1" 200 None
2026-03-30 10:50:54 [auto1.de] INFO: Saving data for MD91791: {'auction_closing_time': 1774972475.0, 'created_time': 1773307415.878536, 'last_price_update_time': 1774867854.195826}
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD91791') HTTP/1.1" 204 0
2026-03-30 10:50:54 [auto1.de] INFO: Found listing with ID: TP91786
2026-03-30 10:50:54 [auto1.de] INFO: Found listing with ID: DW28316
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW28316%27 HTTP/1.1" 200 None
2026-03-30 10:50:54 [auto1.de] INFO: Scrape type for DW28316: 2
2026-03-30 10:50:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcd7f7ec-d473-55a9-80a7-01adb666158d with identifier: DW28316
2026-03-30 10:50:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcd7f7ec-d473-55a9-80a7-01adb666158d with scrape type 2
2026-03-30 10:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcd7f7ec-d473-55a9-80a7-01adb666158d with scrape type 2
2026-03-30 10:50:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcd7f7ec-d473-55a9-80a7-01adb666158d, identifier: DW28316
2026-03-30 10:50:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcd7f7ec-d473-55a9-80a7-01adb666158d with identifier: DW28316
2026-03-30 10:50:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcd7f7ec-d473-55a9-80a7-01adb666158d with identifier: DW28316
2026-03-30 10:50:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcd7f7ec-d473-55a9-80a7-01adb666158d with identifier: DW28316 to the API
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:32:56Z',
 'fuel_type': 'petrol',
 'id': 'dcd7f7ec-d473-55a9-80a7-01adb666158d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW28316',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 144045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW28316%27 HTTP/1.1" 200 None
2026-03-30 10:50:54 [auto1.de] INFO: Saving data for DW28316: {'auction_closing_time': 1774971176.0, 'created_time': 1774294878.043313, 'last_price_update_time': 1774867854.760959}
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW28316') HTTP/1.1" 204 0
2026-03-30 10:50:54 [auto1.de] INFO: Found listing with ID: YF96126
2026-03-30 10:50:54 [auto1.de] INFO: Found listing with ID: TS03545
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS03545%27 HTTP/1.1" 200 None
2026-03-30 10:50:54 [auto1.de] INFO: Scrape type for TS03545: 1
2026-03-30 10:50:54 [auto1.de] INFO: Found listing with ID: BH45611
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH45611%27 HTTP/1.1" 200 None
2026-03-30 10:50:54 [auto1.de] INFO: Scrape type for BH45611: 1
2026-03-30 10:50:54 [auto1.de] INFO: Found listing with ID: UZ85196
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ85196%27 HTTP/1.1" 200 None
2026-03-30 10:50:54 [auto1.de] INFO: Scrape type for UZ85196: 1
2026-03-30 10:50:54 [auto1.de] INFO: Found listing with ID: CR07619
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR07619%27 HTTP/1.1" 200 None
2026-03-30 10:50:54 [auto1.de] INFO: Scrape type for CR07619: 1
2026-03-30 10:50:54 [auto1.de] INFO: Found listing with ID: FE23219
2026-03-30 10:50:54 [auto1.de] INFO: Found listing with ID: LK64913
2026-03-30 10:50:54 [auto1.de] INFO: Found listing with ID: CA34591
2026-03-30 10:50:54 [auto1.de] INFO: Found listing with ID: JP87174
2026-03-30 10:50:54 [auto1.de] INFO: Found listing with ID: FE34808
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE34808%27 HTTP/1.1" 200 None
2026-03-30 10:50:54 [auto1.de] INFO: Scrape type for FE34808: 2
2026-03-30 10:50:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1930d26-be90-5729-9dd9-570c0659970c with identifier: FE34808
2026-03-30 10:50:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1930d26-be90-5729-9dd9-570c0659970c with scrape type 2
2026-03-30 10:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1930d26-be90-5729-9dd9-570c0659970c with scrape type 2
2026-03-30 10:50:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1930d26-be90-5729-9dd9-570c0659970c, identifier: FE34808
2026-03-30 10:50:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1930d26-be90-5729-9dd9-570c0659970c with identifier: FE34808
2026-03-30 10:50:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1930d26-be90-5729-9dd9-570c0659970c with identifier: FE34808
2026-03-30 10:50:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1930d26-be90-5729-9dd9-570c0659970c with identifier: FE34808 to the API
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:11:44Z',
 'fuel_type': 'petrol',
 'id': 'd1930d26-be90-5729-9dd9-570c0659970c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE34808',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 180891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-16',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE34808%27 HTTP/1.1" 200 None
2026-03-30 10:50:55 [auto1.de] INFO: Saving data for FE34808: {'auction_closing_time': 1774969904.0, 'created_time': 1773571849.688129, 'last_price_update_time': 1774867855.334476}
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE34808') HTTP/1.1" 204 0
2026-03-30 10:50:55 [auto1.de] INFO: Found listing with ID: BC17196
2026-03-30 10:50:55 [auto1.de] INFO: Found listing with ID: CK11901
2026-03-30 10:50:55 [auto1.de] INFO: Found listing with ID: UZ12630
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ12630%27 HTTP/1.1" 200 None
2026-03-30 10:50:55 [auto1.de] INFO: Scrape type for UZ12630: 1
2026-03-30 10:50:55 [auto1.de] INFO: Found listing with ID: EZ57191
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ57191%27 HTTP/1.1" 200 None
2026-03-30 10:50:55 [auto1.de] INFO: Scrape type for EZ57191: 2
2026-03-30 10:50:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de6d035b-fbf5-5fe8-bd28-2cefdeeb8f65 with identifier: EZ57191
2026-03-30 10:50:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de6d035b-fbf5-5fe8-bd28-2cefdeeb8f65 with scrape type 2
2026-03-30 10:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de6d035b-fbf5-5fe8-bd28-2cefdeeb8f65 with scrape type 2
2026-03-30 10:50:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de6d035b-fbf5-5fe8-bd28-2cefdeeb8f65, identifier: EZ57191
2026-03-30 10:50:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de6d035b-fbf5-5fe8-bd28-2cefdeeb8f65 with identifier: EZ57191
2026-03-30 10:50:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de6d035b-fbf5-5fe8-bd28-2cefdeeb8f65 with identifier: EZ57191
2026-03-30 10:50:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de6d035b-fbf5-5fe8-bd28-2cefdeeb8f65 with identifier: EZ57191 to the API
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:04:32Z',
 'fuel_type': 'petrol',
 'id': 'de6d035b-fbf5-5fe8-bd28-2cefdeeb8f65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ57191',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 55914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-27',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2020}
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ57191%27 HTTP/1.1" 200 None
2026-03-30 10:50:56 [auto1.de] INFO: Saving data for EZ57191: {'auction_closing_time': 1774969472.0, 'created_time': 1773726039.776591, 'last_price_update_time': 1774867856.00971}
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ57191') HTTP/1.1" 204 0
2026-03-30 10:50:56 [auto1.de] INFO: Found listing with ID: AR08419
2026-03-30 10:50:56 [auto1.de] INFO: Found listing with ID: DA80798
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA80798%27 HTTP/1.1" 200 None
2026-03-30 10:50:56 [auto1.de] INFO: Scrape type for DA80798: 1
2026-03-30 10:50:56 [auto1.de] INFO: Found listing with ID: AA94538
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA94538%27 HTTP/1.1" 200 None
2026-03-30 10:50:56 [auto1.de] INFO: Scrape type for AA94538: 2
2026-03-30 10:50:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97557017-15e3-539b-9e21-6869645c116c with identifier: AA94538
2026-03-30 10:50:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97557017-15e3-539b-9e21-6869645c116c with scrape type 2
2026-03-30 10:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97557017-15e3-539b-9e21-6869645c116c with scrape type 2
2026-03-30 10:50:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97557017-15e3-539b-9e21-6869645c116c, identifier: AA94538
2026-03-30 10:50:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97557017-15e3-539b-9e21-6869645c116c with identifier: AA94538
2026-03-30 10:50:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97557017-15e3-539b-9e21-6869645c116c with identifier: AA94538
2026-03-30 10:50:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97557017-15e3-539b-9e21-6869645c116c with identifier: AA94538 to the API
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:58:06Z',
 'fuel_type': 'petrol',
 'id': '97557017-15e3-539b-9e21-6869645c116c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA94538',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 9706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-04-03',
 'seller_name': None,
 'title': 'Skoda Fabia 1.5 TSI ACT Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2025}
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA94538%27 HTTP/1.1" 200 None
2026-03-30 10:50:56 [auto1.de] INFO: Saving data for AA94538: {'auction_closing_time': 1774972686.0, 'created_time': 1774292239.043937, 'last_price_update_time': 1774867856.486234}
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA94538') HTTP/1.1" 204 0
2026-03-30 10:50:56 [auto1.de] INFO: Found listing with ID: FK95635
2026-03-30 10:50:56 [auto1.de] INFO: Found listing with ID: AH51648
2026-03-30 10:50:56 [auto1.de] INFO: Found listing with ID: VA91828
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA91828%27 HTTP/1.1" 200 None
2026-03-30 10:50:56 [auto1.de] INFO: Scrape type for VA91828: 1
2026-03-30 10:50:56 [auto1.de] INFO: Found listing with ID: XL02877
2026-03-30 10:50:56 [auto1.de] INFO: Found listing with ID: WW35819
2026-03-30 10:50:56 [auto1.de] INFO: Found listing with ID: YY43496
2026-03-30 10:50:56 [auto1.de] INFO: Found listing with ID: XN67118
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN67118%27 HTTP/1.1" 200 None
2026-03-30 10:50:56 [auto1.de] INFO: Scrape type for XN67118: 2
2026-03-30 10:50:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5227bffd-9c7e-5944-9886-0fe29b3c4c47 with identifier: XN67118
2026-03-30 10:50:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5227bffd-9c7e-5944-9886-0fe29b3c4c47 with scrape type 2
2026-03-30 10:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5227bffd-9c7e-5944-9886-0fe29b3c4c47 with scrape type 2
2026-03-30 10:50:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5227bffd-9c7e-5944-9886-0fe29b3c4c47, identifier: XN67118
2026-03-30 10:50:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5227bffd-9c7e-5944-9886-0fe29b3c4c47 with identifier: XN67118
2026-03-30 10:50:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5227bffd-9c7e-5944-9886-0fe29b3c4c47 with identifier: XN67118
2026-03-30 10:50:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5227bffd-9c7e-5944-9886-0fe29b3c4c47 with identifier: XN67118 to the API
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:47:14Z',
 'fuel_type': 'diesel',
 'id': '5227bffd-9c7e-5944-9886-0fe29b3c4c47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN67118',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 204505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-28',
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2020}
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN67118%27 HTTP/1.1" 200 None
2026-03-30 10:50:57 [auto1.de] INFO: Saving data for XN67118: {'auction_closing_time': 1774972034.0, 'created_time': 1773689319.682256, 'last_price_update_time': 1774867857.019229}
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN67118') HTTP/1.1" 204 0
2026-03-30 10:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_4d04830e917f68b72d2d460879d01ab3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:50:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee28d0>
2026-03-30 10:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_4d04830e917f68b72d2d460879d01ab3.jpg') HTTP/1.1" 204 0
2026-03-30 10:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_4d04830e917f68b72d2d460879d01ab3.jpg saved to cache
2026-03-30 10:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fda08c46-4c8e-527d-acf5-bec11a7e521c
2026-03-30 10:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH93684/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NU64922> (referer: https://www.auto1.com/v1/car-details-view/NU64922/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae1b75c7-be13-5038-8b32-63f328ace2ac with identifier: NU64922
2026-03-30 10:50:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae1b75c7-be13-5038-8b32-63f328ace2ac with scrape type 1
2026-03-30 10:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae1b75c7-be13-5038-8b32-63f328ace2ac
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe6%252F4ee6a08ee4e8b1099649166014f5642a%252Fpa%252FNU64922_260fb6b2ecc97f1a6427aae1096bf89b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_260fb6b2ecc97f1a6427aae1096bf89b.jpg already downloaded
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe6%252F4ee6a08ee4e8b1099649166014f5642a%252Fpa%252FNU64922_68d0e0194bbcd289a394d11ebe8ce3c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_68d0e0194bbcd289a394d11ebe8ce3c7.jpg already downloaded
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe6%252F4ee6a08ee4e8b1099649166014f5642a%252Fpa%252FNU64922_8cfa6c3bc4fc91006be8efb96ae5148f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_8cfa6c3bc4fc91006be8efb96ae5148f.jpg already downloaded
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe6%252F4ee6a08ee4e8b1099649166014f5642a%252Fpa%252FNU64922_adc0e0be161233d782a0fde9990c86b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_adc0e0be161233d782a0fde9990c86b1.jpg already downloaded
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe6%252F4ee6a08ee4e8b1099649166014f5642a%252Fpa%252FNU64922_44ed81e6973f490b19a7df54ec635e94.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_44ed81e6973f490b19a7df54ec635e94.jpg already downloaded
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe6%252F4ee6a08ee4e8b1099649166014f5642a%252Fpa%252FNU64922_603af2037226c84fc26216697ebc3e5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_603af2037226c84fc26216697ebc3e5f.jpg already downloaded
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe6%252F4ee6a08ee4e8b1099649166014f5642a%252Fpa%252FNU64922_327d6f762bebd3f93db68260b92ea731.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_327d6f762bebd3f93db68260b92ea731.jpg already downloaded
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe6%252F4ee6a08ee4e8b1099649166014f5642a%252Fpa%252FNU64922_8e9ffcea76d0dbaeda852f637b701124.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_8e9ffcea76d0dbaeda852f637b701124.jpg already downloaded
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe6%252F4ee6a08ee4e8b1099649166014f5642a%252Fpa%252FNU64922_0477ef0c8315d49a1a61e49019235880.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_0477ef0c8315d49a1a61e49019235880.jpg already downloaded
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe6%252F4ee6a08ee4e8b1099649166014f5642a%252Fpa%252FNU64922_ee57ca011ceefd4e2733c99faf772d84.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_ee57ca011ceefd4e2733c99faf772d84.jpg already downloaded
2026-03-30 10:50:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae1b75c7-be13-5038-8b32-63f328ace2ac, identifier: NU64922
2026-03-30 10:50:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae1b75c7-be13-5038-8b32-63f328ace2ac with identifier: NU64922
2026-03-30 10:50:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae1b75c7-be13-5038-8b32-63f328ace2ac with identifier: NU64922
2026-03-30 10:50:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae1b75c7-be13-5038-8b32-63f328ace2ac with identifier: NU64922 to the API
2026-03-30 10:50:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NU64922>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:46:37Z',
 'fuel_type': 'diesel',
 'id': 'ae1b75c7-be13-5038-8b32-63f328ace2ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU64922',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'BMW',
 'model': '3er',
 'odometer': 230699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_260fb6b2ecc97f1a6427aae1096bf89b.jpg',
                'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_68d0e0194bbcd289a394d11ebe8ce3c7.jpg',
                'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_8cfa6c3bc4fc91006be8efb96ae5148f.jpg',
                'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_adc0e0be161233d782a0fde9990c86b1.jpg',
                'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_44ed81e6973f490b19a7df54ec635e94.jpg',
                'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_603af2037226c84fc26216697ebc3e5f.jpg',
                'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_327d6f762bebd3f93db68260b92ea731.jpg',
                'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_8e9ffcea76d0dbaeda852f637b701124.jpg',
                'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_0477ef0c8315d49a1a61e49019235880.jpg',
                'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_ee57ca011ceefd4e2733c99faf772d84.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1b75c7-be13-5038-8b32-63f328ace2ac/ae1b75c7-be13-5038-8b32-63f328ace2ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_260fb6b2ecc97f1a6427aae1096bf89b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1b75c7-be13-5038-8b32-63f328ace2ac/ae1b75c7-be13-5038-8b32-63f328ace2ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2908139,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_68d0e0194bbcd289a394d11ebe8ce3c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1b75c7-be13-5038-8b32-63f328ace2ac/ae1b75c7-be13-5038-8b32-63f328ace2ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2905876,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_8cfa6c3bc4fc91006be8efb96ae5148f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1b75c7-be13-5038-8b32-63f328ace2ac/ae1b75c7-be13-5038-8b32-63f328ace2ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3006599,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_adc0e0be161233d782a0fde9990c86b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1b75c7-be13-5038-8b32-63f328ace2ac/ae1b75c7-be13-5038-8b32-63f328ace2ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_44ed81e6973f490b19a7df54ec635e94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1b75c7-be13-5038-8b32-63f328ace2ac/ae1b75c7-be13-5038-8b32-63f328ace2ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2885462,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_603af2037226c84fc26216697ebc3e5f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1b75c7-be13-5038-8b32-63f328ace2ac/ae1b75c7-be13-5038-8b32-63f328ace2ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_327d6f762bebd3f93db68260b92ea731.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1b75c7-be13-5038-8b32-63f328ace2ac/ae1b75c7-be13-5038-8b32-63f328ace2ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3118260,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_8e9ffcea76d0dbaeda852f637b701124.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1b75c7-be13-5038-8b32-63f328ace2ac/ae1b75c7-be13-5038-8b32-63f328ace2ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_0477ef0c8315d49a1a61e49019235880.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae1b75c7-be13-5038-8b32-63f328ace2ac/ae1b75c7-be13-5038-8b32-63f328ace2ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3063216,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e6/4ee6a08ee4e8b1099649166014f5642a/pa/NU64922_ee57ca011ceefd4e2733c99faf772d84.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 335d GT xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2017}
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU64922%27 HTTP/1.1" 200 None
2026-03-30 10:50:59 [auto1.de] INFO: Saving data for NU64922: {'created_time': 1774867859.178365, 'last_price_update_time': 1774867859.178379, 'auction_closing_time': 1774971997.0}
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU64922') HTTP/1.1" 204 0
2026-03-30 10:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RH55673> (referer: https://www.auto1.com/v1/car-details-view/RH55673/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:50:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd07fd7e-cdbf-5fef-93d3-d778fa35849b with identifier: RH55673
2026-03-30 10:50:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd07fd7e-cdbf-5fef-93d3-d778fa35849b with scrape type 1
2026-03-30 10:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cd07fd7e-cdbf-5fef-93d3-d778fa35849b
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc3%252F17c367c94ff223391a013b73c685154a%252Fpa%252FRH55673_47ab82631ba5ce16326fc591470dd81f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_47ab82631ba5ce16326fc591470dd81f.jpg already downloaded
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc3%252F17c367c94ff223391a013b73c685154a%252Fpa%252FRH55673_9605d864d96dfa3fbf1f863a3ca6588d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_9605d864d96dfa3fbf1f863a3ca6588d.jpg already downloaded
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc3%252F17c367c94ff223391a013b73c685154a%252Fpa%252FRH55673_9335c66b33d6631396e8af28c1cc77ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_9335c66b33d6631396e8af28c1cc77ee.jpg already downloaded
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc3%252F17c367c94ff223391a013b73c685154a%252Fpa%252FRH55673_352fd2c5e7c1453b5e2880f3f36729f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_352fd2c5e7c1453b5e2880f3f36729f7.jpg already downloaded
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc3%252F17c367c94ff223391a013b73c685154a%252Fpa%252FRH55673_e2460bed5a49cb4e9026716b427767b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_e2460bed5a49cb4e9026716b427767b5.jpg already downloaded
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc3%252F17c367c94ff223391a013b73c685154a%252Fpa%252FRH55673_e028fb67ae21af426a17638f93272572.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_e028fb67ae21af426a17638f93272572.jpg already downloaded
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc3%252F17c367c94ff223391a013b73c685154a%252Fpa%252FRH55673_abf1fcb8e0e26c6a064373db928e8fd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_abf1fcb8e0e26c6a064373db928e8fd7.jpg already downloaded
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc3%252F17c367c94ff223391a013b73c685154a%252Fpa%252FRH55673_3b5b8217bb755b826283cd5a65496c05.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_3b5b8217bb755b826283cd5a65496c05.jpg already downloaded
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc3%252F17c367c94ff223391a013b73c685154a%252Fpa%252FRH55673_dbefe995c2f4a80ac4433f1a5d5a4254.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_dbefe995c2f4a80ac4433f1a5d5a4254.jpg already downloaded
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fc3%252F17c367c94ff223391a013b73c685154a%252Fpa%252FRH55673_d96181908497c5530b76e75c5437877b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_d96181908497c5530b76e75c5437877b.jpg already downloaded
2026-03-30 10:50:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd07fd7e-cdbf-5fef-93d3-d778fa35849b, identifier: RH55673
2026-03-30 10:50:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd07fd7e-cdbf-5fef-93d3-d778fa35849b with identifier: RH55673
2026-03-30 10:50:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd07fd7e-cdbf-5fef-93d3-d778fa35849b with identifier: RH55673
2026-03-30 10:50:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd07fd7e-cdbf-5fef-93d3-d778fa35849b with identifier: RH55673 to the API
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:50:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RH55673>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:49:07Z',
 'fuel_type': 'petrol',
 'id': 'cd07fd7e-cdbf-5fef-93d3-d778fa35849b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH55673',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 174200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 40,
 'photo_urls': ['https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_47ab82631ba5ce16326fc591470dd81f.jpg',
                'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_9605d864d96dfa3fbf1f863a3ca6588d.jpg',
                'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_9335c66b33d6631396e8af28c1cc77ee.jpg',
                'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_352fd2c5e7c1453b5e2880f3f36729f7.jpg',
                'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_e2460bed5a49cb4e9026716b427767b5.jpg',
                'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_e028fb67ae21af426a17638f93272572.jpg',
                'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_abf1fcb8e0e26c6a064373db928e8fd7.jpg',
                'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_3b5b8217bb755b826283cd5a65496c05.jpg',
                'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_dbefe995c2f4a80ac4433f1a5d5a4254.jpg',
                'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_d96181908497c5530b76e75c5437877b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd07fd7e-cdbf-5fef-93d3-d778fa35849b/cd07fd7e-cdbf-5fef-93d3-d778fa35849b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_47ab82631ba5ce16326fc591470dd81f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd07fd7e-cdbf-5fef-93d3-d778fa35849b/cd07fd7e-cdbf-5fef-93d3-d778fa35849b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_9605d864d96dfa3fbf1f863a3ca6588d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd07fd7e-cdbf-5fef-93d3-d778fa35849b/cd07fd7e-cdbf-5fef-93d3-d778fa35849b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_9335c66b33d6631396e8af28c1cc77ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd07fd7e-cdbf-5fef-93d3-d778fa35849b/cd07fd7e-cdbf-5fef-93d3-d778fa35849b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_352fd2c5e7c1453b5e2880f3f36729f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd07fd7e-cdbf-5fef-93d3-d778fa35849b/cd07fd7e-cdbf-5fef-93d3-d778fa35849b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_e2460bed5a49cb4e9026716b427767b5.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd07fd7e-cdbf-5fef-93d3-d778fa35849b/cd07fd7e-cdbf-5fef-93d3-d778fa35849b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_e028fb67ae21af426a17638f93272572.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd07fd7e-cdbf-5fef-93d3-d778fa35849b/cd07fd7e-cdbf-5fef-93d3-d778fa35849b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_abf1fcb8e0e26c6a064373db928e8fd7.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd07fd7e-cdbf-5fef-93d3-d778fa35849b/cd07fd7e-cdbf-5fef-93d3-d778fa35849b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_3b5b8217bb755b826283cd5a65496c05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd07fd7e-cdbf-5fef-93d3-d778fa35849b/cd07fd7e-cdbf-5fef-93d3-d778fa35849b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_dbefe995c2f4a80ac4433f1a5d5a4254.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd07fd7e-cdbf-5fef-93d3-d778fa35849b/cd07fd7e-cdbf-5fef-93d3-d778fa35849b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/c3/17c367c94ff223391a013b73c685154a/pa/RH55673_d96181908497c5530b76e75c5437877b.jpg',
             'Width': 799}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI ScoutLine',
 'transmission': 'manual',
 'trim': 'ScoutLine',
 'year': 2018}
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH55673%27 HTTP/1.1" 200 None
2026-03-30 10:50:59 [auto1.de] INFO: Saving data for RH55673: {'created_time': 1774867859.987788, 'last_price_update_time': 1774867859.987797, 'auction_closing_time': 1774972147.0}
2026-03-30 10:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RH55673') HTTP/1.1" 204 0
2026-03-30 10:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY02033> (referer: https://www.auto1.com/v1/car-details-view/RY02033/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 666efe1c-a499-52c7-a5e9-21a44f3623e3 with identifier: RY02033
2026-03-30 10:51:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 666efe1c-a499-52c7-a5e9-21a44f3623e3 with scrape type 1
2026-03-30 10:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 666efe1c-a499-52c7-a5e9-21a44f3623e3
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_e222193159ba5acd21076996235f9934.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_e222193159ba5acd21076996235f9934.jpg not downloaded yet
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_be69e54cd0a40ab8d18164ffda8c4172.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_be69e54cd0a40ab8d18164ffda8c4172.jpg not downloaded yet
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_b6f42ca60483d82e87cb0a12aba3b9f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_b6f42ca60483d82e87cb0a12aba3b9f1.jpg not downloaded yet
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_9744c53bcf8c47d9ba2b5be5c59afa37.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_9744c53bcf8c47d9ba2b5be5c59afa37.jpg not downloaded yet
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_2b40ffdb4a1ef5dd87b4587737c4e8aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_2b40ffdb4a1ef5dd87b4587737c4e8aa.jpg not downloaded yet
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_41d2b8c4ce488fb090bd7fc456670f28.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_41d2b8c4ce488fb090bd7fc456670f28.jpg not downloaded yet
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_91b20ec27d04cbc60dbe8e6eff4a4606.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_91b20ec27d04cbc60dbe8e6eff4a4606.jpg not downloaded yet
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_7c29d8bd63283e984e4d44125c892bb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_7c29d8bd63283e984e4d44125c892bb0.jpg not downloaded yet
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_5621073c94a9214556419c1681dd74af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_5621073c94a9214556419c1681dd74af.jpg not downloaded yet
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_07425c090a46753d1302f6155bc36c2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_07425c090a46753d1302f6155bc36c2a.jpg not downloaded yet
2026-03-30 10:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM84118> (referer: https://www.auto1.com/v1/car-details-view/NM84118/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a472fd1f-e3c0-586e-a105-c3dac7d6ecfc with identifier: NM84118
2026-03-30 10:51:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a472fd1f-e3c0-586e-a105-c3dac7d6ecfc with scrape type 1
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a472fd1f-e3c0-586e-a105-c3dac7d6ecfc
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_0a1dbeca10791424736d6d1cb22dd414.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_0a1dbeca10791424736d6d1cb22dd414.jpg not downloaded yet
2026-03-30 10:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_07425c090a46753d1302f6155bc36c2a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_71b79c0f62a804fddc5eba4444b81004.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_71b79c0f62a804fddc5eba4444b81004.jpg not downloaded yet
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_e61c92bfa2c8d9e595b584163970c9cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_e61c92bfa2c8d9e595b584163970c9cc.jpg not downloaded yet
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_9c0369bad6868911cb1247727e4a0fa4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_9c0369bad6868911cb1247727e4a0fa4.jpg not downloaded yet
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_8dcb9a62fd35586adfd7a458ea257a41.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_8dcb9a62fd35586adfd7a458ea257a41.jpg not downloaded yet
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_144ca139e91690640dc72e25b258a932.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_144ca139e91690640dc72e25b258a932.jpg not downloaded yet
2026-03-30 10:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef500b610>
2026-03-30 10:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_07425c090a46753d1302f6155bc36c2a.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_07425c090a46753d1302f6155bc36c2a.jpg saved to cache
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 666efe1c-a499-52c7-a5e9-21a44f3623e3
2026-03-30 10:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_0a1dbeca10791424736d6d1cb22dd414.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_6bb2d3388750072aa0df431b5dad7d53.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_6bb2d3388750072aa0df431b5dad7d53.jpg not downloaded yet
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_c81886957cb6aee8b885218e1da03311.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_c81886957cb6aee8b885218e1da03311.jpg not downloaded yet
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_74976551b43ce5eee5a9bd648ac95ff4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_74976551b43ce5eee5a9bd648ac95ff4.jpg not downloaded yet
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_5a125a10aa596ac0b4c255bafd55ebe1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_5a125a10aa596ac0b4c255bafd55ebe1.jpg not downloaded yet
2026-03-30 10:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b0bd50>
2026-03-30 10:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_0a1dbeca10791424736d6d1cb22dd414.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_0a1dbeca10791424736d6d1cb22dd414.jpg saved to cache
2026-03-30 10:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a472fd1f-e3c0-586e-a105-c3dac7d6ecfc
2026-03-30 10:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_144ca139e91690640dc72e25b258a932.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c41610>
2026-03-30 10:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_144ca139e91690640dc72e25b258a932.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_144ca139e91690640dc72e25b258a932.jpg saved to cache
2026-03-30 10:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a472fd1f-e3c0-586e-a105-c3dac7d6ecfc
2026-03-30 10:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_5a125a10aa596ac0b4c255bafd55ebe1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef503c6d0>
2026-03-30 10:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_5a125a10aa596ac0b4c255bafd55ebe1.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_5a125a10aa596ac0b4c255bafd55ebe1.jpg saved to cache
2026-03-30 10:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a472fd1f-e3c0-586e-a105-c3dac7d6ecfc
2026-03-30 10:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_74976551b43ce5eee5a9bd648ac95ff4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7930190>
2026-03-30 10:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_74976551b43ce5eee5a9bd648ac95ff4.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_74976551b43ce5eee5a9bd648ac95ff4.jpg saved to cache
2026-03-30 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a472fd1f-e3c0-586e-a105-c3dac7d6ecfc
2026-03-30 10:51:04 [scrapy.extensions.logstats] INFO: Crawled 554 pages (at 37 pages/min), scraped 422 items (at 34 items/min)
2026-03-30 10:51:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-30 10:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_c81886957cb6aee8b885218e1da03311.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd3610>
2026-03-30 10:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_c81886957cb6aee8b885218e1da03311.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_c81886957cb6aee8b885218e1da03311.jpg saved to cache
2026-03-30 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a472fd1f-e3c0-586e-a105-c3dac7d6ecfc
2026-03-30 10:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_6bb2d3388750072aa0df431b5dad7d53.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a33510>
2026-03-30 10:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_6bb2d3388750072aa0df431b5dad7d53.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_6bb2d3388750072aa0df431b5dad7d53.jpg saved to cache
2026-03-30 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a472fd1f-e3c0-586e-a105-c3dac7d6ecfc
2026-03-30 10:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_8dcb9a62fd35586adfd7a458ea257a41.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZJ35248/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd3510>
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_8dcb9a62fd35586adfd7a458ea257a41.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_8dcb9a62fd35586adfd7a458ea257a41.jpg saved to cache
2026-03-30 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a472fd1f-e3c0-586e-a105-c3dac7d6ecfc
2026-03-30 10:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_9c0369bad6868911cb1247727e4a0fa4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_e61c92bfa2c8d9e595b584163970c9cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX14183/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50a76d0>
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_9c0369bad6868911cb1247727e4a0fa4.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_9c0369bad6868911cb1247727e4a0fa4.jpg saved to cache
2026-03-30 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a472fd1f-e3c0-586e-a105-c3dac7d6ecfc
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e61010>
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_e61c92bfa2c8d9e595b584163970c9cc.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_e61c92bfa2c8d9e595b584163970c9cc.jpg saved to cache
2026-03-30 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a472fd1f-e3c0-586e-a105-c3dac7d6ecfc
2026-03-30 10:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_5621073c94a9214556419c1681dd74af.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_7c29d8bd63283e984e4d44125c892bb0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_71b79c0f62a804fddc5eba4444b81004.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee2010>
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_5621073c94a9214556419c1681dd74af.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_5621073c94a9214556419c1681dd74af.jpg saved to cache
2026-03-30 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 666efe1c-a499-52c7-a5e9-21a44f3623e3
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ac8990>
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_7c29d8bd63283e984e4d44125c892bb0.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_7c29d8bd63283e984e4d44125c892bb0.jpg saved to cache
2026-03-30 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 666efe1c-a499-52c7-a5e9-21a44f3623e3
2026-03-30 10:51:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f46e10>
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F02%252F6f026070b703d76ba4eee43562208f82%252Fpa%252FNM84118_71b79c0f62a804fddc5eba4444b81004.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_71b79c0f62a804fddc5eba4444b81004.jpg saved to cache
2026-03-30 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a472fd1f-e3c0-586e-a105-c3dac7d6ecfc
2026-03-30 10:51:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a472fd1f-e3c0-586e-a105-c3dac7d6ecfc, skipping ID generation
2026-03-30 10:51:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a472fd1f-e3c0-586e-a105-c3dac7d6ecfc with scrape type 1
2026-03-30 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a472fd1f-e3c0-586e-a105-c3dac7d6ecfc sending to next pipeline
2026-03-30 10:51:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a472fd1f-e3c0-586e-a105-c3dac7d6ecfc, identifier: NM84118
2026-03-30 10:51:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a472fd1f-e3c0-586e-a105-c3dac7d6ecfc with identifier: NM84118
2026-03-30 10:51:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a472fd1f-e3c0-586e-a105-c3dac7d6ecfc with identifier: NM84118
2026-03-30 10:51:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a472fd1f-e3c0-586e-a105-c3dac7d6ecfc with identifier: NM84118 to the API
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_71b79c0f62a804fddc5eba4444b81004.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:39:36Z',
 'fuel_type': 'diesel',
 'id': 'a472fd1f-e3c0-586e-a105-c3dac7d6ecfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM84118',
 'listing': 'auction',
 'location': 'DE, Dornach',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 97348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_0a1dbeca10791424736d6d1cb22dd414.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2913499,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_71b79c0f62a804fddc5eba4444b81004.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_e61c92bfa2c8d9e595b584163970c9cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_9c0369bad6868911cb1247727e4a0fa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3086662,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_8dcb9a62fd35586adfd7a458ea257a41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2959775,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_144ca139e91690640dc72e25b258a932.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_6bb2d3388750072aa0df431b5dad7d53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2972184,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_c81886957cb6aee8b885218e1da03311.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2727031,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_74976551b43ce5eee5a9bd648ac95ff4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a472fd1f-e3c0-586e-a105-c3dac7d6ecfc/a472fd1f-e3c0-586e-a105-c3dac7d6ecfc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/02/6f026070b703d76ba4eee43562208f82/pa/NM84118_5a125a10aa596ac0b4c255bafd55ebe1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 250 CDI BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2014}
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM84118%27 HTTP/1.1" 200 None
2026-03-30 10:51:06 [auto1.de] INFO: Saving data for NM84118: {'created_time': 1774867866.444541, 'last_price_update_time': 1774867866.444555, 'auction_closing_time': 1774971576.0}
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM84118') HTTP/1.1" 204 0
2026-03-30 10:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_91b20ec27d04cbc60dbe8e6eff4a4606.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e652d0>
2026-03-30 10:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_91b20ec27d04cbc60dbe8e6eff4a4606.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_91b20ec27d04cbc60dbe8e6eff4a4606.jpg saved to cache
2026-03-30 10:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 666efe1c-a499-52c7-a5e9-21a44f3623e3
2026-03-30 10:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_41d2b8c4ce488fb090bd7fc456670f28.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef503e610>
2026-03-30 10:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_41d2b8c4ce488fb090bd7fc456670f28.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_41d2b8c4ce488fb090bd7fc456670f28.jpg saved to cache
2026-03-30 10:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 666efe1c-a499-52c7-a5e9-21a44f3623e3
2026-03-30 10:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_2b40ffdb4a1ef5dd87b4587737c4e8aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ad5e10>
2026-03-30 10:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_2b40ffdb4a1ef5dd87b4587737c4e8aa.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_2b40ffdb4a1ef5dd87b4587737c4e8aa.jpg saved to cache
2026-03-30 10:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 666efe1c-a499-52c7-a5e9-21a44f3623e3
2026-03-30 10:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_9744c53bcf8c47d9ba2b5be5c59afa37.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e66250>
2026-03-30 10:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_9744c53bcf8c47d9ba2b5be5c59afa37.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_9744c53bcf8c47d9ba2b5be5c59afa37.jpg saved to cache
2026-03-30 10:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 666efe1c-a499-52c7-a5e9-21a44f3623e3
2026-03-30 10:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_b6f42ca60483d82e87cb0a12aba3b9f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6edd0>
2026-03-30 10:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_b6f42ca60483d82e87cb0a12aba3b9f1.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_b6f42ca60483d82e87cb0a12aba3b9f1.jpg saved to cache
2026-03-30 10:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 666efe1c-a499-52c7-a5e9-21a44f3623e3
2026-03-30 10:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_e222193159ba5acd21076996235f9934.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_be69e54cd0a40ab8d18164ffda8c4172.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:07 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 9506 | hits on page: 40
2026-03-30 10:51:07 [auto1.de] INFO: Found listing with ID: YY43496
2026-03-30 10:51:07 [auto1.de] INFO: Found listing with ID: XN67118
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN67118%27 HTTP/1.1" 200 None
2026-03-30 10:51:07 [auto1.de] INFO: Scrape type for XN67118: 0
2026-03-30 10:51:07 [auto1.de] INFO: Found listing with ID: CS82090
2026-03-30 10:51:07 [auto1.de] INFO: Found listing with ID: FT47423
2026-03-30 10:51:07 [auto1.de] INFO: Found listing with ID: SD94329
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD94329%27 HTTP/1.1" 200 None
2026-03-30 10:51:07 [auto1.de] INFO: Scrape type for SD94329: 2
2026-03-30 10:51:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74fe72d7-2154-5ca9-a5c2-1117590ccd8e with identifier: SD94329
2026-03-30 10:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74fe72d7-2154-5ca9-a5c2-1117590ccd8e with scrape type 2
2026-03-30 10:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74fe72d7-2154-5ca9-a5c2-1117590ccd8e with scrape type 2
2026-03-30 10:51:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74fe72d7-2154-5ca9-a5c2-1117590ccd8e, identifier: SD94329
2026-03-30 10:51:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74fe72d7-2154-5ca9-a5c2-1117590ccd8e with identifier: SD94329
2026-03-30 10:51:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74fe72d7-2154-5ca9-a5c2-1117590ccd8e with identifier: SD94329
2026-03-30 10:51:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74fe72d7-2154-5ca9-a5c2-1117590ccd8e with identifier: SD94329 to the API
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:54:10Z',
 'fuel_type': 'diesel',
 'id': '74fe72d7-2154-5ca9-a5c2-1117590ccd8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD94329',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 58870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-04',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten FWD',
 'transmission': 'manual',
 'trim': 'Kasten FWD',
 'year': 2020}
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD94329%27 HTTP/1.1" 200 None
2026-03-30 10:51:07 [auto1.de] INFO: Saving data for SD94329: {'auction_closing_time': 1774972450.0, 'created_time': 1774293579.667817, 'last_price_update_time': 1774867867.928742}
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD94329') HTTP/1.1" 204 0
2026-03-30 10:51:07 [auto1.de] INFO: Found listing with ID: FE58121
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE58121%27 HTTP/1.1" 200 None
2026-03-30 10:51:07 [auto1.de] INFO: Scrape type for FE58121: 1
2026-03-30 10:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d65e90>
2026-03-30 10:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_e222193159ba5acd21076996235f9934.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_e222193159ba5acd21076996235f9934.jpg saved to cache
2026-03-30 10:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 666efe1c-a499-52c7-a5e9-21a44f3623e3
2026-03-30 10:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fc8e50>
2026-03-30 10:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fb1%252F89b1d96798768a87b3d9fbf53f38e378%252Fpa%252FRY02033_be69e54cd0a40ab8d18164ffda8c4172.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_be69e54cd0a40ab8d18164ffda8c4172.jpg saved to cache
2026-03-30 10:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 666efe1c-a499-52c7-a5e9-21a44f3623e3
2026-03-30 10:51:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 666efe1c-a499-52c7-a5e9-21a44f3623e3, skipping ID generation
2026-03-30 10:51:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 666efe1c-a499-52c7-a5e9-21a44f3623e3 with scrape type 1
2026-03-30 10:51:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 666efe1c-a499-52c7-a5e9-21a44f3623e3 sending to next pipeline
2026-03-30 10:51:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 666efe1c-a499-52c7-a5e9-21a44f3623e3, identifier: RY02033
2026-03-30 10:51:08 [auto1.de] INFO: Found listing with ID: TR13013
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13013%27 HTTP/1.1" 200 None
2026-03-30 10:51:08 [auto1.de] INFO: Scrape type for TR13013: 1
2026-03-30 10:51:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 666efe1c-a499-52c7-a5e9-21a44f3623e3 with identifier: RY02033
2026-03-30 10:51:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 666efe1c-a499-52c7-a5e9-21a44f3623e3 with identifier: RY02033
2026-03-30 10:51:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 666efe1c-a499-52c7-a5e9-21a44f3623e3 with identifier: RY02033 to the API
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_be69e54cd0a40ab8d18164ffda8c4172.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:41:12Z',
 'fuel_type': 'petrol',
 'id': '666efe1c-a499-52c7-a5e9-21a44f3623e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY02033',
 'listing': 'auction',
 'location': 'DE, Köln',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 68091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_e222193159ba5acd21076996235f9934.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_be69e54cd0a40ab8d18164ffda8c4172.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_b6f42ca60483d82e87cb0a12aba3b9f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_9744c53bcf8c47d9ba2b5be5c59afa37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_2b40ffdb4a1ef5dd87b4587737c4e8aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_41d2b8c4ce488fb090bd7fc456670f28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_91b20ec27d04cbc60dbe8e6eff4a4606.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_7c29d8bd63283e984e4d44125c892bb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_5621073c94a9214556419c1681dd74af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666efe1c-a499-52c7-a5e9-21a44f3623e3/666efe1c-a499-52c7-a5e9-21a44f3623e3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/b1/89b1d96798768a87b3d9fbf53f38e378/pa/RY02033_07425c090a46753d1302f6155bc36c2a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY02033%27 HTTP/1.1" 200 None
2026-03-30 10:51:08 [auto1.de] INFO: Saving data for RY02033: {'created_time': 1774867868.621823, 'last_price_update_time': 1774867868.621834, 'auction_closing_time': 1774971672.0}
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY02033') HTTP/1.1" 204 0
2026-03-30 10:51:08 [auto1.de] INFO: Found listing with ID: BM23326
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM23326%27 HTTP/1.1" 200 None
2026-03-30 10:51:08 [auto1.de] INFO: Scrape type for BM23326: 1
2026-03-30 10:51:08 [auto1.de] INFO: Found listing with ID: FJ52050
2026-03-30 10:51:08 [auto1.de] INFO: Found listing with ID: HC12973
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC12973%27 HTTP/1.1" 200 None
2026-03-30 10:51:08 [auto1.de] INFO: Scrape type for HC12973: 1
2026-03-30 10:51:08 [auto1.de] INFO: Found listing with ID: AR52532
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR52532%27 HTTP/1.1" 200 None
2026-03-30 10:51:08 [auto1.de] INFO: Scrape type for AR52532: 1
2026-03-30 10:51:08 [auto1.de] INFO: Found listing with ID: VV99941
2026-03-30 10:51:08 [auto1.de] INFO: Found listing with ID: BK51820
2026-03-30 10:51:08 [auto1.de] INFO: Found listing with ID: FT13435
2026-03-30 10:51:08 [auto1.de] INFO: Found listing with ID: AK78787
2026-03-30 10:51:08 [auto1.de] INFO: Found listing with ID: CB76983
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB76983%27 HTTP/1.1" 200 None
2026-03-30 10:51:08 [auto1.de] INFO: Scrape type for CB76983: 1
2026-03-30 10:51:08 [auto1.de] INFO: Found listing with ID: MD89807
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD89807%27 HTTP/1.1" 200 None
2026-03-30 10:51:08 [auto1.de] INFO: Scrape type for MD89807: 1
2026-03-30 10:51:08 [auto1.de] INFO: Found listing with ID: TV25506
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV25506%27 HTTP/1.1" 200 None
2026-03-30 10:51:08 [auto1.de] INFO: Scrape type for TV25506: 2
2026-03-30 10:51:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c01cdf7-6788-53bd-989d-9b3d21e0ce8f with identifier: TV25506
2026-03-30 10:51:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c01cdf7-6788-53bd-989d-9b3d21e0ce8f with scrape type 2
2026-03-30 10:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c01cdf7-6788-53bd-989d-9b3d21e0ce8f with scrape type 2
2026-03-30 10:51:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c01cdf7-6788-53bd-989d-9b3d21e0ce8f, identifier: TV25506
2026-03-30 10:51:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c01cdf7-6788-53bd-989d-9b3d21e0ce8f with identifier: TV25506
2026-03-30 10:51:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c01cdf7-6788-53bd-989d-9b3d21e0ce8f with identifier: TV25506
2026-03-30 10:51:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c01cdf7-6788-53bd-989d-9b3d21e0ce8f with identifier: TV25506 to the API
2026-03-30 10:51:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:19:26Z',
 'fuel_type': 'diesel',
 'id': '1c01cdf7-6788-53bd-989d-9b3d21e0ce8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV25506',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 155775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-27',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Sendo AWD',
 'transmission': 'manual',
 'trim': 'Sendo AWD',
 'year': 2014}
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV25506%27 HTTP/1.1" 200 None
2026-03-30 10:51:09 [auto1.de] INFO: Saving data for TV25506: {'auction_closing_time': 1774970366.0, 'created_time': 1774380398.681419, 'last_price_update_time': 1774867869.216303}
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV25506') HTTP/1.1" 204 0
2026-03-30 10:51:09 [auto1.de] INFO: Found listing with ID: DJ56370
2026-03-30 10:51:09 [auto1.de] INFO: Found listing with ID: RL37399
2026-03-30 10:51:09 [auto1.de] INFO: Found listing with ID: XV64183
2026-03-30 10:51:09 [auto1.de] INFO: Found listing with ID: SK74966
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK74966%27 HTTP/1.1" 200 None
2026-03-30 10:51:09 [auto1.de] INFO: Scrape type for SK74966: 1
2026-03-30 10:51:09 [auto1.de] INFO: Found listing with ID: VL87987
2026-03-30 10:51:09 [auto1.de] INFO: Found listing with ID: SJ67214
2026-03-30 10:51:09 [auto1.de] INFO: Found listing with ID: GS55217
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS55217%27 HTTP/1.1" 200 None
2026-03-30 10:51:09 [auto1.de] INFO: Scrape type for GS55217: 2
2026-03-30 10:51:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae388c92-5b63-5240-8ac9-516c5c547c93 with identifier: GS55217
2026-03-30 10:51:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae388c92-5b63-5240-8ac9-516c5c547c93 with scrape type 2
2026-03-30 10:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae388c92-5b63-5240-8ac9-516c5c547c93 with scrape type 2
2026-03-30 10:51:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae388c92-5b63-5240-8ac9-516c5c547c93, identifier: GS55217
2026-03-30 10:51:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae388c92-5b63-5240-8ac9-516c5c547c93 with identifier: GS55217
2026-03-30 10:51:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae388c92-5b63-5240-8ac9-516c5c547c93 with identifier: GS55217
2026-03-30 10:51:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae388c92-5b63-5240-8ac9-516c5c547c93 with identifier: GS55217 to the API
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:08:18Z',
 'fuel_type': 'petrol',
 'id': 'ae388c92-5b63-5240-8ac9-516c5c547c93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS55217',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 160538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS55217%27 HTTP/1.1" 200 None
2026-03-30 10:51:09 [auto1.de] INFO: Saving data for GS55217: {'auction_closing_time': 1774969698.0, 'created_time': 1773227841.246597, 'last_price_update_time': 1774867869.768451}
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS55217') HTTP/1.1" 204 0
2026-03-30 10:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VA91828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:09 [auto1.de] INFO: Found listing with ID: VZ72237
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ72237%27 HTTP/1.1" 200 None
2026-03-30 10:51:09 [auto1.de] INFO: Scrape type for VZ72237: 1
2026-03-30 10:51:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:09 [auto1.de] INFO: Found listing with ID: XH62328
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH62328%27 HTTP/1.1" 200 None
2026-03-30 10:51:09 [auto1.de] INFO: Scrape type for XH62328: 1
2026-03-30 10:51:09 [auto1.de] INFO: Found listing with ID: AG69292
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG69292%27 HTTP/1.1" 200 None
2026-03-30 10:51:09 [auto1.de] INFO: Scrape type for AG69292: 1
2026-03-30 10:51:09 [auto1.de] INFO: Found listing with ID: FG17042
2026-03-30 10:51:09 [auto1.de] INFO: Found listing with ID: HY62565
2026-03-30 10:51:09 [auto1.de] INFO: Found listing with ID: EY90590
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY90590%27 HTTP/1.1" 200 None
2026-03-30 10:51:09 [auto1.de] INFO: Scrape type for EY90590: 2
2026-03-30 10:51:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7c62c05-07c0-5cdf-845b-380c3f9ace89 with identifier: EY90590
2026-03-30 10:51:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7c62c05-07c0-5cdf-845b-380c3f9ace89 with scrape type 2
2026-03-30 10:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7c62c05-07c0-5cdf-845b-380c3f9ace89 with scrape type 2
2026-03-30 10:51:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7c62c05-07c0-5cdf-845b-380c3f9ace89, identifier: EY90590
2026-03-30 10:51:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7c62c05-07c0-5cdf-845b-380c3f9ace89 with identifier: EY90590
2026-03-30 10:51:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7c62c05-07c0-5cdf-845b-380c3f9ace89 with identifier: EY90590
2026-03-30 10:51:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7c62c05-07c0-5cdf-845b-380c3f9ace89 with identifier: EY90590 to the API
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:47:38Z',
 'fuel_type': 'hybrid',
 'id': 'd7c62c05-07c0-5cdf-845b-380c3f9ace89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY90590',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 71022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-16',
 'seller_name': None,
 'title': 'Audi A3 Sportback 40 TFSIe advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2020}
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY90590%27 HTTP/1.1" 200 None
2026-03-30 10:51:10 [auto1.de] INFO: Saving data for EY90590: {'auction_closing_time': 1774972058.0, 'created_time': 1774294335.701852, 'last_price_update_time': 1774867870.325456}
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY90590') HTTP/1.1" 204 0
2026-03-30 10:51:10 [auto1.de] INFO: Found listing with ID: NM07390
2026-03-30 10:51:10 [auto1.de] INFO: Found listing with ID: NL38495
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL38495%27 HTTP/1.1" 200 None
2026-03-30 10:51:10 [auto1.de] INFO: Scrape type for NL38495: 1
2026-03-30 10:51:10 [auto1.de] INFO: Found listing with ID: BN14015
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN14015%27 HTTP/1.1" 200 None
2026-03-30 10:51:10 [auto1.de] INFO: Scrape type for BN14015: 1
2026-03-30 10:51:10 [auto1.de] INFO: Found listing with ID: TE81781
2026-03-30 10:51:10 [auto1.de] INFO: Found listing with ID: RZ03047
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ03047%27 HTTP/1.1" 200 None
2026-03-30 10:51:10 [auto1.de] INFO: Scrape type for RZ03047: 2
2026-03-30 10:51:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8056398a-c3f3-5b70-8d40-682d40173976 with identifier: RZ03047
2026-03-30 10:51:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8056398a-c3f3-5b70-8d40-682d40173976 with scrape type 2
2026-03-30 10:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8056398a-c3f3-5b70-8d40-682d40173976 with scrape type 2
2026-03-30 10:51:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8056398a-c3f3-5b70-8d40-682d40173976, identifier: RZ03047
2026-03-30 10:51:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8056398a-c3f3-5b70-8d40-682d40173976 with identifier: RZ03047
2026-03-30 10:51:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8056398a-c3f3-5b70-8d40-682d40173976 with identifier: RZ03047
2026-03-30 10:51:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8056398a-c3f3-5b70-8d40-682d40173976 with identifier: RZ03047 to the API
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:28:17Z',
 'fuel_type': 'petrol',
 'id': '8056398a-c3f3-5b70-8d40-682d40173976',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ03047',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 40464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-28',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2016}
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ03047%27 HTTP/1.1" 200 None
2026-03-30 10:51:10 [auto1.de] INFO: Saving data for RZ03047: {'auction_closing_time': 1774970897.0, 'created_time': 1773775622.142787, 'last_price_update_time': 1774867870.960173}
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ03047') HTTP/1.1" 204 0
2026-03-30 10:51:10 [auto1.de] INFO: Found listing with ID: ZW58241
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW58241%27 HTTP/1.1" 200 None
2026-03-30 10:51:10 [auto1.de] INFO: Scrape type for ZW58241: 2
2026-03-30 10:51:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 562c5b60-cdd8-5c75-b54e-3cb64a16b103 with identifier: ZW58241
2026-03-30 10:51:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 562c5b60-cdd8-5c75-b54e-3cb64a16b103 with scrape type 2
2026-03-30 10:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 562c5b60-cdd8-5c75-b54e-3cb64a16b103 with scrape type 2
2026-03-30 10:51:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 562c5b60-cdd8-5c75-b54e-3cb64a16b103, identifier: ZW58241
2026-03-30 10:51:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 562c5b60-cdd8-5c75-b54e-3cb64a16b103 with identifier: ZW58241
2026-03-30 10:51:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 562c5b60-cdd8-5c75-b54e-3cb64a16b103 with identifier: ZW58241
2026-03-30 10:51:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 562c5b60-cdd8-5c75-b54e-3cb64a16b103 with identifier: ZW58241 to the API
2026-03-30 10:51:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:49:52Z',
 'fuel_type': 'diesel',
 'id': '562c5b60-cdd8-5c75-b54e-3cb64a16b103',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW58241',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 133423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-22',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2017}
2026-03-30 10:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW58241%27 HTTP/1.1" 200 None
2026-03-30 10:51:11 [auto1.de] INFO: Saving data for ZW58241: {'auction_closing_time': 1774972192.0, 'created_time': 1773688278.178393, 'last_price_update_time': 1774867871.435458}
2026-03-30 10:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW58241') HTTP/1.1" 204 0
2026-03-30 10:51:11 [auto1.de] INFO: Found listing with ID: YS78642
2026-03-30 10:51:11 [auto1.de] INFO: Found listing with ID: HK63697
2026-03-30 10:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK63697%27 HTTP/1.1" 200 None
2026-03-30 10:51:11 [auto1.de] INFO: Scrape type for HK63697: 2
2026-03-30 10:51:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with identifier: HK63697
2026-03-30 10:51:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with scrape type 2
2026-03-30 10:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with scrape type 2
2026-03-30 10:51:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6f0a743-ec6e-5e13-8d60-b5021a1389c3, identifier: HK63697
2026-03-30 10:51:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with identifier: HK63697
2026-03-30 10:51:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with identifier: HK63697
2026-03-30 10:51:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with identifier: HK63697 to the API
2026-03-30 10:51:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 462,
 'expiration_date': '2026-03-31T15:44:54Z',
 'fuel_type': 'hybrid',
 'id': 'd6f0a743-ec6e-5e13-8d60-b5021a1389c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK63697',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 23182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-23',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 TSI eHybrid R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2024}
2026-03-30 10:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK63697%27 HTTP/1.1" 200 None
2026-03-30 10:51:11 [auto1.de] INFO: Saving data for HK63697: {'auction_closing_time': 1774971894.0, 'created_time': 1774608304.869078, 'last_price_update_time': 1774867871.91283}
2026-03-30 10:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK63697') HTTP/1.1" 204 0
2026-03-30 10:51:11 [auto1.de] INFO: Found listing with ID: VZ61460
2026-03-30 10:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA80798/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP32279/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ12630/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR07619/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ29706/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH70727> (referer: https://www.auto1.com/v1/car-details-view/CH70727/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9e16a0f-eb56-5274-86f4-3b2816383a12 with identifier: CH70727
2026-03-30 10:51:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e16a0f-eb56-5274-86f4-3b2816383a12 with scrape type 1
2026-03-30 10:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9e16a0f-eb56-5274-86f4-3b2816383a12
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_c0af3d6f940febbaf544288dfcd5acd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_c0af3d6f940febbaf544288dfcd5acd6.jpg not downloaded yet
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_f2db3c59fa1571f9786416b4f88c95ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_f2db3c59fa1571f9786416b4f88c95ea.jpg not downloaded yet
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_9e39b87e1e19d3306ea18f9bac42ff34.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_9e39b87e1e19d3306ea18f9bac42ff34.jpg not downloaded yet
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_8204b30ebcf61d58a27530ddd292f987.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_8204b30ebcf61d58a27530ddd292f987.jpg not downloaded yet
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_92c0dd35fb64ed3fd8b7ba75b4a0912d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_92c0dd35fb64ed3fd8b7ba75b4a0912d.jpg not downloaded yet
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_11874c1b846a56c259e46af3acc4284d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_11874c1b846a56c259e46af3acc4284d.jpg not downloaded yet
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_bbda25694d4a92fcf108cee2bb9145df.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_bbda25694d4a92fcf108cee2bb9145df.jpg not downloaded yet
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_9a7440cb7779e458f7e931f4ff7f37f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_9a7440cb7779e458f7e931f4ff7f37f2.jpg not downloaded yet
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_4f5163418c40a7c4ef43d4f23641696b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_4f5163418c40a7c4ef43d4f23641696b.jpg not downloaded yet
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_b76937243d7d6fb3487b8276d1be04b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_b76937243d7d6fb3487b8276d1be04b6.jpg not downloaded yet
2026-03-30 10:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX14183> (referer: https://www.auto1.com/v1/car-details-view/LX14183/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_b76937243d7d6fb3487b8276d1be04b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e561fa08-ef66-5e65-9f5a-062adcb26751 with identifier: LX14183
2026-03-30 10:51:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e561fa08-ef66-5e65-9f5a-062adcb26751 with scrape type 1
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e561fa08-ef66-5e65-9f5a-062adcb26751
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_774e815fcf7267f27311e1ff50489b2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_774e815fcf7267f27311e1ff50489b2c.jpg not downloaded yet
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_49b33ba467fce55113de7b32b9f7b442.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_49b33ba467fce55113de7b32b9f7b442.jpg not downloaded yet
2026-03-30 10:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH93684> (referer: https://www.auto1.com/v1/car-details-view/ZH93684/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_11a705275e98cd1fecae4b9d196642e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_11a705275e98cd1fecae4b9d196642e0.jpg not downloaded yet
2026-03-30 10:51:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_4f5163418c40a7c4ef43d4f23641696b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_0dbee314c70a44bb1fc11b6dd460ea80.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_0dbee314c70a44bb1fc11b6dd460ea80.jpg not downloaded yet
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_3fb680807002a5c314053dd2fafc3edb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_3fb680807002a5c314053dd2fafc3edb.jpg not downloaded yet
2026-03-30 10:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ec0190>
2026-03-30 10:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_b76937243d7d6fb3487b8276d1be04b6.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_b76937243d7d6fb3487b8276d1be04b6.jpg saved to cache
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9e16a0f-eb56-5274-86f4-3b2816383a12
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_cda6c240c4e87eb05ae16d7fda0c09a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_cda6c240c4e87eb05ae16d7fda0c09a9.jpg not downloaded yet
2026-03-30 10:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_11a705275e98cd1fecae4b9d196642e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_cb30f8e272234bd5d32b957b7cc0e5fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_cb30f8e272234bd5d32b957b7cc0e5fc.jpg not downloaded yet
2026-03-30 10:51:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd9dc07d-b043-5e57-a2cb-f3f7225bb08b with identifier: ZH93684
2026-03-30 10:51:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd9dc07d-b043-5e57-a2cb-f3f7225bb08b with scrape type 1
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item dd9dc07d-b043-5e57-a2cb-f3f7225bb08b
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F84%252Fe784d59c167b502a9fe8d7f135ef810a%252Fpa%252FZH93684_98e966293fa33dfda344ac5739f1979a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_98e966293fa33dfda344ac5739f1979a.jpg not downloaded yet
2026-03-30 10:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e64d90>
2026-03-30 10:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_4f5163418c40a7c4ef43d4f23641696b.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_4f5163418c40a7c4ef43d4f23641696b.jpg saved to cache
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9e16a0f-eb56-5274-86f4-3b2816383a12
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_56d92d4676c5ad18db4dadbeb27d8d6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_56d92d4676c5ad18db4dadbeb27d8d6c.jpg not downloaded yet
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F84%252Fe784d59c167b502a9fe8d7f135ef810a%252Fpa%252FZH93684_bb568061ac9f47dbf759ddc4980a5895.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_bb568061ac9f47dbf759ddc4980a5895.jpg not downloaded yet
2026-03-30 10:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_49b33ba467fce55113de7b32b9f7b442.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_2441cefd47a88cd72799de9e6f06bbc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_2441cefd47a88cd72799de9e6f06bbc7.jpg not downloaded yet
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F84%252Fe784d59c167b502a9fe8d7f135ef810a%252Fpa%252FZH93684_1ba297d2056fa89e2d676589e3646d2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_1ba297d2056fa89e2d676589e3646d2e.jpg not downloaded yet
2026-03-30 10:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e28050>
2026-03-30 10:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_11a705275e98cd1fecae4b9d196642e0.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_11a705275e98cd1fecae4b9d196642e0.jpg saved to cache
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e561fa08-ef66-5e65-9f5a-062adcb26751
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_6279750383ea29cedf6bacff8086238f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_6279750383ea29cedf6bacff8086238f.jpg not downloaded yet
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F84%252Fe784d59c167b502a9fe8d7f135ef810a%252Fpa%252FZH93684_2c7f4f569dd325ef8899119b986a12cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_2c7f4f569dd325ef8899119b986a12cc.jpg not downloaded yet
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F84%252Fe784d59c167b502a9fe8d7f135ef810a%252Fpa%252FZH93684_a6051ab517cb994db3185d8d625c4c5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_a6051ab517cb994db3185d8d625c4c5c.jpg not downloaded yet
2026-03-30 10:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b34cd0>
2026-03-30 10:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_49b33ba467fce55113de7b32b9f7b442.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_49b33ba467fce55113de7b32b9f7b442.jpg saved to cache
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e561fa08-ef66-5e65-9f5a-062adcb26751
2026-03-30 10:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_cda6c240c4e87eb05ae16d7fda0c09a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F84%252Fe784d59c167b502a9fe8d7f135ef810a%252Fpa%252FZH93684_6d0bea0cbd00805109ee0f579a17488c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_6d0bea0cbd00805109ee0f579a17488c.jpg not downloaded yet
2026-03-30 10:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_a6051ab517cb994db3185d8d625c4c5c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_56d92d4676c5ad18db4dadbeb27d8d6c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b0a7d0>
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_cda6c240c4e87eb05ae16d7fda0c09a9.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_cda6c240c4e87eb05ae16d7fda0c09a9.jpg saved to cache
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e561fa08-ef66-5e65-9f5a-062adcb26751
2026-03-30 10:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_2c7f4f569dd325ef8899119b986a12cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_6d0bea0cbd00805109ee0f579a17488c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f88f10>
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd9dc07d-b043-5e57-a2cb-f3f7225bb08b/dd9dc07d-b043-5e57-a2cb-f3f7225bb08b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F84%252Fe784d59c167b502a9fe8d7f135ef810a%252Fpa%252FZH93684_a6051ab517cb994db3185d8d625c4c5c.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_a6051ab517cb994db3185d8d625c4c5c.jpg saved to cache
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd9dc07d-b043-5e57-a2cb-f3f7225bb08b
2026-03-30 10:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_1ba297d2056fa89e2d676589e3646d2e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50a7f90>
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_56d92d4676c5ad18db4dadbeb27d8d6c.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_56d92d4676c5ad18db4dadbeb27d8d6c.jpg saved to cache
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e561fa08-ef66-5e65-9f5a-062adcb26751
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a74a50>
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd9dc07d-b043-5e57-a2cb-f3f7225bb08b/dd9dc07d-b043-5e57-a2cb-f3f7225bb08b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F84%252Fe784d59c167b502a9fe8d7f135ef810a%252Fpa%252FZH93684_2c7f4f569dd325ef8899119b986a12cc.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_2c7f4f569dd325ef8899119b986a12cc.jpg saved to cache
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd9dc07d-b043-5e57-a2cb-f3f7225bb08b
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c4f910>
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd9dc07d-b043-5e57-a2cb-f3f7225bb08b/dd9dc07d-b043-5e57-a2cb-f3f7225bb08b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F84%252Fe784d59c167b502a9fe8d7f135ef810a%252Fpa%252FZH93684_6d0bea0cbd00805109ee0f579a17488c.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_6d0bea0cbd00805109ee0f579a17488c.jpg saved to cache
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd9dc07d-b043-5e57-a2cb-f3f7225bb08b
2026-03-30 10:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_6279750383ea29cedf6bacff8086238f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee0e50>
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd9dc07d-b043-5e57-a2cb-f3f7225bb08b/dd9dc07d-b043-5e57-a2cb-f3f7225bb08b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F84%252Fe784d59c167b502a9fe8d7f135ef810a%252Fpa%252FZH93684_1ba297d2056fa89e2d676589e3646d2e.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_1ba297d2056fa89e2d676589e3646d2e.jpg saved to cache
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd9dc07d-b043-5e57-a2cb-f3f7225bb08b
2026-03-30 10:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ85196/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5012690>
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_6279750383ea29cedf6bacff8086238f.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_6279750383ea29cedf6bacff8086238f.jpg saved to cache
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e561fa08-ef66-5e65-9f5a-062adcb26751
2026-03-30 10:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_bb568061ac9f47dbf759ddc4980a5895.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_98e966293fa33dfda344ac5739f1979a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_2441cefd47a88cd72799de9e6f06bbc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b21a10>
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd9dc07d-b043-5e57-a2cb-f3f7225bb08b/dd9dc07d-b043-5e57-a2cb-f3f7225bb08b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F84%252Fe784d59c167b502a9fe8d7f135ef810a%252Fpa%252FZH93684_bb568061ac9f47dbf759ddc4980a5895.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_bb568061ac9f47dbf759ddc4980a5895.jpg saved to cache
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd9dc07d-b043-5e57-a2cb-f3f7225bb08b
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb04d0>
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd9dc07d-b043-5e57-a2cb-f3f7225bb08b/dd9dc07d-b043-5e57-a2cb-f3f7225bb08b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F84%252Fe784d59c167b502a9fe8d7f135ef810a%252Fpa%252FZH93684_98e966293fa33dfda344ac5739f1979a.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_98e966293fa33dfda344ac5739f1979a.jpg saved to cache
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd9dc07d-b043-5e57-a2cb-f3f7225bb08b
2026-03-30 10:51:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd9dc07d-b043-5e57-a2cb-f3f7225bb08b, skipping ID generation
2026-03-30 10:51:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd9dc07d-b043-5e57-a2cb-f3f7225bb08b with scrape type 1
2026-03-30 10:51:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd9dc07d-b043-5e57-a2cb-f3f7225bb08b sending to next pipeline
2026-03-30 10:51:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd9dc07d-b043-5e57-a2cb-f3f7225bb08b, identifier: ZH93684
2026-03-30 10:51:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd9dc07d-b043-5e57-a2cb-f3f7225bb08b with identifier: ZH93684
2026-03-30 10:51:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd9dc07d-b043-5e57-a2cb-f3f7225bb08b with identifier: ZH93684
2026-03-30 10:51:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd9dc07d-b043-5e57-a2cb-f3f7225bb08b with identifier: ZH93684 to the API
2026-03-30 10:51:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_98e966293fa33dfda344ac5739f1979a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:13:30Z',
 'fuel_type': 'petrol',
 'id': 'dd9dc07d-b043-5e57-a2cb-f3f7225bb08b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH93684',
 'listing': 'auction',
 'location': 'DE, Aachen',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 185792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9dc07d-b043-5e57-a2cb-f3f7225bb08b/dd9dc07d-b043-5e57-a2cb-f3f7225bb08b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_98e966293fa33dfda344ac5739f1979a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9dc07d-b043-5e57-a2cb-f3f7225bb08b/dd9dc07d-b043-5e57-a2cb-f3f7225bb08b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_bb568061ac9f47dbf759ddc4980a5895.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9dc07d-b043-5e57-a2cb-f3f7225bb08b/dd9dc07d-b043-5e57-a2cb-f3f7225bb08b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_1ba297d2056fa89e2d676589e3646d2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9dc07d-b043-5e57-a2cb-f3f7225bb08b/dd9dc07d-b043-5e57-a2cb-f3f7225bb08b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_2c7f4f569dd325ef8899119b986a12cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9dc07d-b043-5e57-a2cb-f3f7225bb08b/dd9dc07d-b043-5e57-a2cb-f3f7225bb08b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_a6051ab517cb994db3185d8d625c4c5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9dc07d-b043-5e57-a2cb-f3f7225bb08b/dd9dc07d-b043-5e57-a2cb-f3f7225bb08b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/84/e784d59c167b502a9fe8d7f135ef810a/pa/ZH93684_6d0bea0cbd00805109ee0f579a17488c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Edition 7',
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2012}
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH93684%27 HTTP/1.1" 200 None
2026-03-30 10:51:23 [auto1.de] INFO: Saving data for ZH93684: {'created_time': 1774867883.236649, 'last_price_update_time': 1774867883.236659, 'auction_closing_time': 1774970010.0}
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH93684') HTTP/1.1" 204 0
2026-03-30 10:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_cb30f8e272234bd5d32b957b7cc0e5fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_3fb680807002a5c314053dd2fafc3edb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_0dbee314c70a44bb1fc11b6dd460ea80.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH45611/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50a5e50>
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_2441cefd47a88cd72799de9e6f06bbc7.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_2441cefd47a88cd72799de9e6f06bbc7.jpg saved to cache
2026-03-30 10:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e561fa08-ef66-5e65-9f5a-062adcb26751
2026-03-30 10:51:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_774e815fcf7267f27311e1ff50489b2c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5acad10>
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_cb30f8e272234bd5d32b957b7cc0e5fc.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_cb30f8e272234bd5d32b957b7cc0e5fc.jpg saved to cache
2026-03-30 10:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e561fa08-ef66-5e65-9f5a-062adcb26751
2026-03-30 10:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_9a7440cb7779e458f7e931f4ff7f37f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d66a10>
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_3fb680807002a5c314053dd2fafc3edb.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_3fb680807002a5c314053dd2fafc3edb.jpg saved to cache
2026-03-30 10:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e561fa08-ef66-5e65-9f5a-062adcb26751
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef503e650>
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_0dbee314c70a44bb1fc11b6dd460ea80.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_0dbee314c70a44bb1fc11b6dd460ea80.jpg saved to cache
2026-03-30 10:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e561fa08-ef66-5e65-9f5a-062adcb26751
2026-03-30 10:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_bbda25694d4a92fcf108cee2bb9145df.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZJ35248> (referer: https://www.auto1.com/v1/car-details-view/ZJ35248/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c411d0>
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fa8%252F47a8397b3551634db6d8038b4b5817f0%252Fpa%252FLX14183_774e815fcf7267f27311e1ff50489b2c.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_774e815fcf7267f27311e1ff50489b2c.jpg saved to cache
2026-03-30 10:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e561fa08-ef66-5e65-9f5a-062adcb26751
2026-03-30 10:51:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e561fa08-ef66-5e65-9f5a-062adcb26751, skipping ID generation
2026-03-30 10:51:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e561fa08-ef66-5e65-9f5a-062adcb26751 with scrape type 1
2026-03-30 10:51:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e561fa08-ef66-5e65-9f5a-062adcb26751 sending to next pipeline
2026-03-30 10:51:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e561fa08-ef66-5e65-9f5a-062adcb26751, identifier: LX14183
2026-03-30 10:51:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e561fa08-ef66-5e65-9f5a-062adcb26751 with identifier: LX14183
2026-03-30 10:51:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e561fa08-ef66-5e65-9f5a-062adcb26751 with identifier: LX14183
2026-03-30 10:51:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e561fa08-ef66-5e65-9f5a-062adcb26751 with identifier: LX14183 to the API
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_774e815fcf7267f27311e1ff50489b2c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:18:19Z',
 'fuel_type': 'petrol',
 'id': 'e561fa08-ef66-5e65-9f5a-062adcb26751',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX14183',
 'listing': 'auction',
 'location': 'DE, Lübeck',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 178935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_774e815fcf7267f27311e1ff50489b2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_49b33ba467fce55113de7b32b9f7b442.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_11a705275e98cd1fecae4b9d196642e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_0dbee314c70a44bb1fc11b6dd460ea80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_3fb680807002a5c314053dd2fafc3edb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_cda6c240c4e87eb05ae16d7fda0c09a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_cb30f8e272234bd5d32b957b7cc0e5fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_56d92d4676c5ad18db4dadbeb27d8d6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_2441cefd47a88cd72799de9e6f06bbc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e561fa08-ef66-5e65-9f5a-062adcb26751/e561fa08-ef66-5e65-9f5a-062adcb26751_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/a8/47a8397b3551634db6d8038b4b5817f0/pa/LX14183_6279750383ea29cedf6bacff8086238f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i40 1.6 5 Star Edition',
 'transmission': 'manual',
 'trim': '5 Star Edition',
 'year': 2014}
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX14183%27 HTTP/1.1" 200 None
2026-03-30 10:51:24 [auto1.de] INFO: Saving data for LX14183: {'created_time': 1774867884.057934, 'last_price_update_time': 1774867884.057943, 'auction_closing_time': 1774970299.0}
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX14183') HTTP/1.1" 204 0
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e624d0>
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_9a7440cb7779e458f7e931f4ff7f37f2.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_9a7440cb7779e458f7e931f4ff7f37f2.jpg saved to cache
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9e16a0f-eb56-5274-86f4-3b2816383a12
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe27d0>
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_bbda25694d4a92fcf108cee2bb9145df.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_bbda25694d4a92fcf108cee2bb9145df.jpg saved to cache
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9e16a0f-eb56-5274-86f4-3b2816383a12
2026-03-30 10:51:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6f353d6-f828-52d6-8f35-8ce9b635c49d with identifier: ZJ35248
2026-03-30 10:51:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f353d6-f828-52d6-8f35-8ce9b635c49d with scrape type 1
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_230d21692bbf4d239161e5caa3476a66.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_230d21692bbf4d239161e5caa3476a66.jpg not downloaded yet
2026-03-30 10:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_92c0dd35fb64ed3fd8b7ba75b4a0912d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_f1d3a7ec651cf26f90c9b15702d6c510.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_f1d3a7ec651cf26f90c9b15702d6c510.jpg not downloaded yet
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_3c3afad9e38a40b3c17aefd01e8c92d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_3c3afad9e38a40b3c17aefd01e8c92d6.jpg not downloaded yet
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_c4a9524c4043435ed2b4b7a209614f11.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_c4a9524c4043435ed2b4b7a209614f11.jpg not downloaded yet
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_71c53ada8bfa645b3d07bf92e2e0147d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_71c53ada8bfa645b3d07bf92e2e0147d.jpg not downloaded yet
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_c2991d9e4093609ecf099ada62953f24.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_c2991d9e4093609ecf099ada62953f24.jpg not downloaded yet
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_c725739cdb16af5da46a5783fa95af81.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_c725739cdb16af5da46a5783fa95af81.jpg not downloaded yet
2026-03-30 10:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_8204b30ebcf61d58a27530ddd292f987.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_11874c1b846a56c259e46af3acc4284d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_230d21692bbf4d239161e5caa3476a66.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_2ab75358a6784de050df8b44878463c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_2ab75358a6784de050df8b44878463c1.jpg not downloaded yet
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f17f10>
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_92c0dd35fb64ed3fd8b7ba75b4a0912d.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_92c0dd35fb64ed3fd8b7ba75b4a0912d.jpg saved to cache
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9e16a0f-eb56-5274-86f4-3b2816383a12
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_aa0b6ae6694ffc464713d2ccb2788de9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_aa0b6ae6694ffc464713d2ccb2788de9.jpg not downloaded yet
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_44647d994ebe5bdbf37326a665e2baa8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_44647d994ebe5bdbf37326a665e2baa8.jpg not downloaded yet
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b30a90>
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_8204b30ebcf61d58a27530ddd292f987.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_8204b30ebcf61d58a27530ddd292f987.jpg saved to cache
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9e16a0f-eb56-5274-86f4-3b2816383a12
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb3210>
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_11874c1b846a56c259e46af3acc4284d.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_11874c1b846a56c259e46af3acc4284d.jpg saved to cache
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9e16a0f-eb56-5274-86f4-3b2816383a12
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e77010>
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_230d21692bbf4d239161e5caa3476a66.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_230d21692bbf4d239161e5caa3476a66.jpg saved to cache
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-30 10:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_c2991d9e4093609ecf099ada62953f24.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_71c53ada8bfa645b3d07bf92e2e0147d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_c725739cdb16af5da46a5783fa95af81.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_44647d994ebe5bdbf37326a665e2baa8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_2ab75358a6784de050df8b44878463c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb0550>
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_c2991d9e4093609ecf099ada62953f24.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_c2991d9e4093609ecf099ada62953f24.jpg saved to cache
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-30 10:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_c4a9524c4043435ed2b4b7a209614f11.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_3c3afad9e38a40b3c17aefd01e8c92d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dbb390>
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_71c53ada8bfa645b3d07bf92e2e0147d.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_71c53ada8bfa645b3d07bf92e2e0147d.jpg saved to cache
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0f850>
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_c725739cdb16af5da46a5783fa95af81.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_c725739cdb16af5da46a5783fa95af81.jpg saved to cache
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-30 10:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_aa0b6ae6694ffc464713d2ccb2788de9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ec0690>
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_44647d994ebe5bdbf37326a665e2baa8.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_44647d994ebe5bdbf37326a665e2baa8.jpg saved to cache
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7a510>
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_2ab75358a6784de050df8b44878463c1.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_2ab75358a6784de050df8b44878463c1.jpg saved to cache
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-30 10:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_f1d3a7ec651cf26f90c9b15702d6c510.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_9e39b87e1e19d3306ea18f9bac42ff34.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef78861d0>
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_c4a9524c4043435ed2b4b7a209614f11.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_c4a9524c4043435ed2b4b7a209614f11.jpg saved to cache
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508f810>
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_3c3afad9e38a40b3c17aefd01e8c92d6.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_3c3afad9e38a40b3c17aefd01e8c92d6.jpg saved to cache
2026-03-30 10:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-30 10:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_f2db3c59fa1571f9786416b4f88c95ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b09290>
2026-03-30 10:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_aa0b6ae6694ffc464713d2ccb2788de9.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_aa0b6ae6694ffc464713d2ccb2788de9.jpg saved to cache
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b0a9d0>
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fbf%252F12bf2acd3f4b6fd258c28ddf87e10856%252Fpa%252FZJ35248_f1d3a7ec651cf26f90c9b15702d6c510.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_f1d3a7ec651cf26f90c9b15702d6c510.jpg saved to cache
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-30 10:51:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6f353d6-f828-52d6-8f35-8ce9b635c49d, skipping ID generation
2026-03-30 10:51:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f353d6-f828-52d6-8f35-8ce9b635c49d with scrape type 1
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6f353d6-f828-52d6-8f35-8ce9b635c49d sending to next pipeline
2026-03-30 10:51:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6f353d6-f828-52d6-8f35-8ce9b635c49d, identifier: ZJ35248
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fc85d0>
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_9e39b87e1e19d3306ea18f9bac42ff34.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_9e39b87e1e19d3306ea18f9bac42ff34.jpg saved to cache
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9e16a0f-eb56-5274-86f4-3b2816383a12
2026-03-30 10:51:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6f353d6-f828-52d6-8f35-8ce9b635c49d with identifier: ZJ35248
2026-03-30 10:51:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6f353d6-f828-52d6-8f35-8ce9b635c49d with identifier: ZJ35248
2026-03-30 10:51:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6f353d6-f828-52d6-8f35-8ce9b635c49d with identifier: ZJ35248 to the API
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_f1d3a7ec651cf26f90c9b15702d6c510.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:06:19Z',
 'fuel_type': 'electro',
 'id': 'c6f353d6-f828-52d6-8f35-8ce9b635c49d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ35248',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 13,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_230d21692bbf4d239161e5caa3476a66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_f1d3a7ec651cf26f90c9b15702d6c510.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_3c3afad9e38a40b3c17aefd01e8c92d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_c4a9524c4043435ed2b4b7a209614f11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_71c53ada8bfa645b3d07bf92e2e0147d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_c2991d9e4093609ecf099ada62953f24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_c725739cdb16af5da46a5783fa95af81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_2ab75358a6784de050df8b44878463c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_aa0b6ae6694ffc464713d2ccb2788de9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/bf/12bf2acd3f4b6fd258c28ddf87e10856/pa/ZJ35248_44647d994ebe5bdbf37326a665e2baa8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ35248%27 HTTP/1.1" 200 None
2026-03-30 10:51:25 [auto1.de] INFO: Saving data for ZJ35248: {'created_time': 1774867885.666959, 'last_price_update_time': 1774867885.66697, 'auction_closing_time': 1774969579.0}
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ35248') HTTP/1.1" 204 0
2026-03-30 10:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_c0af3d6f940febbaf544288dfcd5acd6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA80798> (referer: https://www.auto1.com/v1/car-details-view/DA80798/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK74966/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7c02e10>
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_f2db3c59fa1571f9786416b4f88c95ea.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_f2db3c59fa1571f9786416b4f88c95ea.jpg saved to cache
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9e16a0f-eb56-5274-86f4-3b2816383a12
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b0a650>
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F04%252F3404ee63d33d4f13dcbc891a0595c40f%252Fpa%252FCH70727_c0af3d6f940febbaf544288dfcd5acd6.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_c0af3d6f940febbaf544288dfcd5acd6.jpg saved to cache
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9e16a0f-eb56-5274-86f4-3b2816383a12
2026-03-30 10:51:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9e16a0f-eb56-5274-86f4-3b2816383a12, skipping ID generation
2026-03-30 10:51:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e16a0f-eb56-5274-86f4-3b2816383a12 with scrape type 1
2026-03-30 10:51:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9e16a0f-eb56-5274-86f4-3b2816383a12 sending to next pipeline
2026-03-30 10:51:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9e16a0f-eb56-5274-86f4-3b2816383a12, identifier: CH70727
2026-03-30 10:51:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9e16a0f-eb56-5274-86f4-3b2816383a12 with identifier: CH70727
2026-03-30 10:51:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9e16a0f-eb56-5274-86f4-3b2816383a12 with identifier: CH70727
2026-03-30 10:51:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9e16a0f-eb56-5274-86f4-3b2816383a12 with identifier: CH70727 to the API
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_c0af3d6f940febbaf544288dfcd5acd6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:14:28Z',
 'fuel_type': 'petrol',
 'id': 'c9e16a0f-eb56-5274-86f4-3b2816383a12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH70727',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 116615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_c0af3d6f940febbaf544288dfcd5acd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_f2db3c59fa1571f9786416b4f88c95ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_9e39b87e1e19d3306ea18f9bac42ff34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_8204b30ebcf61d58a27530ddd292f987.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_92c0dd35fb64ed3fd8b7ba75b4a0912d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_11874c1b846a56c259e46af3acc4284d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_bbda25694d4a92fcf108cee2bb9145df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_9a7440cb7779e458f7e931f4ff7f37f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_4f5163418c40a7c4ef43d4f23641696b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e16a0f-eb56-5274-86f4-3b2816383a12/c9e16a0f-eb56-5274-86f4-3b2816383a12_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/04/3404ee63d33d4f13dcbc891a0595c40f/pa/CH70727_b76937243d7d6fb3487b8276d1be04b6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2016}
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH70727%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [auto1.de] INFO: Saving data for CH70727: {'created_time': 1774867886.275332, 'last_price_update_time': 1774867886.275341, 'auction_closing_time': 1774970068.0}
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH70727') HTTP/1.1" 204 0
2026-03-30 10:51:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2 with identifier: DA80798
2026-03-30 10:51:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2 with scrape type 1
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fc3%252F3ec3cf2b7acc147914e5cf746e0c96bf%252Fpa%252FDA80798_fca14bbd7a75c451dc4da7bbcbf5a0a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/c3/3ec3cf2b7acc147914e5cf746e0c96bf/pa/DA80798_fca14bbd7a75c451dc4da7bbcbf5a0a8.jpg already downloaded
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fc3%252F3ec3cf2b7acc147914e5cf746e0c96bf%252Fpa%252FDA80798_4ab05b80b3b319f95dc2e4ed90540bf5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/c3/3ec3cf2b7acc147914e5cf746e0c96bf/pa/DA80798_4ab05b80b3b319f95dc2e4ed90540bf5.jpg already downloaded
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fc3%252F3ec3cf2b7acc147914e5cf746e0c96bf%252Fpa%252FDA80798_4a47c5943c28903af654db23922c766b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/c3/3ec3cf2b7acc147914e5cf746e0c96bf/pa/DA80798_4a47c5943c28903af654db23922c766b.jpg already downloaded
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fc3%252F3ec3cf2b7acc147914e5cf746e0c96bf%252Fpa%252FDA80798_14a9bd403056a3e99de9c6246125cf02.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/c3/3ec3cf2b7acc147914e5cf746e0c96bf/pa/DA80798_14a9bd403056a3e99de9c6246125cf02.jpg already downloaded
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fc3%252F3ec3cf2b7acc147914e5cf746e0c96bf%252Fpa%252FDA80798_e71c1abfd0620ec4fc08824fa6a48138.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/c3/3ec3cf2b7acc147914e5cf746e0c96bf/pa/DA80798_e71c1abfd0620ec4fc08824fa6a48138.jpg already downloaded
2026-03-30 10:51:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2, identifier: DA80798
2026-03-30 10:51:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2 with identifier: DA80798
2026-03-30 10:51:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2 with identifier: DA80798
2026-03-30 10:51:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2 with identifier: DA80798 to the API
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DA80798>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:29:49Z',
 'fuel_type': 'petrol',
 'id': '6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA80798',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 159827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img3e/c3/3ec3cf2b7acc147914e5cf746e0c96bf/pa/DA80798_fca14bbd7a75c451dc4da7bbcbf5a0a8.jpg',
                'https://img-pa.auto1.com/img3e/c3/3ec3cf2b7acc147914e5cf746e0c96bf/pa/DA80798_4ab05b80b3b319f95dc2e4ed90540bf5.jpg',
                'https://img-pa.auto1.com/img3e/c3/3ec3cf2b7acc147914e5cf746e0c96bf/pa/DA80798_4a47c5943c28903af654db23922c766b.jpg',
                'https://img-pa.auto1.com/img3e/c3/3ec3cf2b7acc147914e5cf746e0c96bf/pa/DA80798_14a9bd403056a3e99de9c6246125cf02.jpg',
                'https://img-pa.auto1.com/img3e/c3/3ec3cf2b7acc147914e5cf746e0c96bf/pa/DA80798_e71c1abfd0620ec4fc08824fa6a48138.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2/6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/c3/3ec3cf2b7acc147914e5cf746e0c96bf/pa/DA80798_fca14bbd7a75c451dc4da7bbcbf5a0a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2/6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/c3/3ec3cf2b7acc147914e5cf746e0c96bf/pa/DA80798_4ab05b80b3b319f95dc2e4ed90540bf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2/6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/c3/3ec3cf2b7acc147914e5cf746e0c96bf/pa/DA80798_4a47c5943c28903af654db23922c766b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2/6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/c3/3ec3cf2b7acc147914e5cf746e0c96bf/pa/DA80798_14a9bd403056a3e99de9c6246125cf02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2/6e04c68c-da22-5b5d-9e7c-b11e2c1d0ac2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/c3/3ec3cf2b7acc147914e5cf746e0c96bf/pa/DA80798_e71c1abfd0620ec4fc08824fa6a48138.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA80798%27 HTTP/1.1" 200 None
2026-03-30 10:51:26 [auto1.de] INFO: Saving data for DA80798: {'created_time': 1774867886.82056, 'last_price_update_time': 1774867886.820574, 'auction_closing_time': 1774970989.0}
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA80798') HTTP/1.1" 204 0
2026-03-30 10:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP32279> (referer: https://www.auto1.com/v1/car-details-view/DP32279/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7546744c-7801-5ea3-8f4e-6b8c006a64c0 with identifier: DP32279
2026-03-30 10:51:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7546744c-7801-5ea3-8f4e-6b8c006a64c0 with scrape type 1
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7546744c-7801-5ea3-8f4e-6b8c006a64c0
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_f26170f5edc82c1d413fe6e6eee24642.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_f26170f5edc82c1d413fe6e6eee24642.jpg not downloaded yet
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_a3938ed4185f688e07f2b2e668aad1a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_a3938ed4185f688e07f2b2e668aad1a7.jpg not downloaded yet
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_dda45bc9bcefddc1865a38df1bd71d01.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_dda45bc9bcefddc1865a38df1bd71d01.jpg not downloaded yet
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_b75ba43c933ba14bbe8f59d20cd64c54.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_b75ba43c933ba14bbe8f59d20cd64c54.jpg not downloaded yet
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_89c367729a2cac0a021640a64fb97f9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_89c367729a2cac0a021640a64fb97f9f.jpg not downloaded yet
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_fd81f68d9ec37928252259bc1bc9a441.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_fd81f68d9ec37928252259bc1bc9a441.jpg not downloaded yet
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_051585062b8f9f87b80eb35e03c4ce07.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_051585062b8f9f87b80eb35e03c4ce07.jpg not downloaded yet
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_86caa9e284ff8207b9dd3bbf8c6f82b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_86caa9e284ff8207b9dd3bbf8c6f82b5.jpg not downloaded yet
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_3f2308fdd757d71f40e644e2776acbc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_3f2308fdd757d71f40e644e2776acbc9.jpg not downloaded yet
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_80615dbfcac2f9327c61b31665659377.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_80615dbfcac2f9327c61b31665659377.jpg not downloaded yet
2026-03-30 10:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ12630> (referer: https://www.auto1.com/v1/car-details-view/UZ12630/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bdd0096-ad93-52e4-902b-b82cf1361f4d with identifier: UZ12630
2026-03-30 10:51:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bdd0096-ad93-52e4-902b-b82cf1361f4d with scrape type 1
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6bdd0096-ad93-52e4-902b-b82cf1361f4d
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_25361166fb86943dd564c471de69061f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_25361166fb86943dd564c471de69061f.jpg not downloaded yet
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_f5b864262582127a5678ce80a31a1bad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_f5b864262582127a5678ce80a31a1bad.jpg not downloaded yet
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_2fc092b23552851a60412d1c16b3e835.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_2fc092b23552851a60412d1c16b3e835.jpg not downloaded yet
2026-03-30 10:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_05a0a73fa1b8a4e31139be1a88a055c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_05a0a73fa1b8a4e31139be1a88a055c6.jpg not downloaded yet
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_99ff1ef88bc046da48663efa296f990e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_99ff1ef88bc046da48663efa296f990e.jpg not downloaded yet
2026-03-30 10:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_80615dbfcac2f9327c61b31665659377.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_32316888df19b5213a4a39879d6e79dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_32316888df19b5213a4a39879d6e79dc.jpg not downloaded yet
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_1220e4ea8a0a5f2d23500cdfbf3526b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_1220e4ea8a0a5f2d23500cdfbf3526b4.jpg not downloaded yet
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_fa45adf42140df69c879ea07f89d02be.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_fa45adf42140df69c879ea07f89d02be.jpg not downloaded yet
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_dacb838f91d8aa7f11f14dd95bdd5eef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_dacb838f91d8aa7f11f14dd95bdd5eef.jpg not downloaded yet
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_10797ab3a15e21ded4f347a7d57879e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_10797ab3a15e21ded4f347a7d57879e2.jpg not downloaded yet
2026-03-30 10:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50e7650>
2026-03-30 10:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_80615dbfcac2f9327c61b31665659377.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_80615dbfcac2f9327c61b31665659377.jpg saved to cache
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7546744c-7801-5ea3-8f4e-6b8c006a64c0
2026-03-30 10:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ29706> (referer: https://www.auto1.com/v1/car-details-view/EJ29706/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecac2567-3be3-5b55-b73d-5eb705a1dc54 with identifier: EJ29706
2026-03-30 10:51:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecac2567-3be3-5b55-b73d-5eb705a1dc54 with scrape type 1
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_7d00db8b39df2c6acb0d1f295348352f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_7d00db8b39df2c6acb0d1f295348352f.jpg not downloaded yet
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_ae2584695dad71989d150f75bba9096e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_ae2584695dad71989d150f75bba9096e.jpg not downloaded yet
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_2fe11e0b9a9519de53aef7ee517d9bd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_2fe11e0b9a9519de53aef7ee517d9bd9.jpg not downloaded yet
2026-03-30 10:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_99ff1ef88bc046da48663efa296f990e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_246ee392b194e5f5f664f170a76ae4b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_246ee392b194e5f5f664f170a76ae4b8.jpg not downloaded yet
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_eb9021efc976cd8232720abd58596863.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_eb9021efc976cd8232720abd58596863.jpg not downloaded yet
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_355fd199c0a166159d52d5fe3f66927e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_355fd199c0a166159d52d5fe3f66927e.jpg not downloaded yet
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_62ab3515129975e552c4bccdcef47c0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_62ab3515129975e552c4bccdcef47c0c.jpg not downloaded yet
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_d870f2c5e52569091d53b2698d838b57.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_d870f2c5e52569091d53b2698d838b57.jpg not downloaded yet
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_7406248cdfe9672e8c23cb1ca5e2108b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_7406248cdfe9672e8c23cb1ca5e2108b.jpg not downloaded yet
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_81516bce456a4cd29a447e232c7294b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_81516bce456a4cd29a447e232c7294b1.jpg not downloaded yet
2026-03-30 10:51:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8f5d0>
2026-03-30 10:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_99ff1ef88bc046da48663efa296f990e.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_99ff1ef88bc046da48663efa296f990e.jpg saved to cache
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6bdd0096-ad93-52e4-902b-b82cf1361f4d
2026-03-30 10:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR07619> (referer: https://www.auto1.com/v1/car-details-view/CR07619/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_10797ab3a15e21ded4f347a7d57879e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_2fe11e0b9a9519de53aef7ee517d9bd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_81516bce456a4cd29a447e232c7294b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_7406248cdfe9672e8c23cb1ca5e2108b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_d870f2c5e52569091d53b2698d838b57.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c59366c-fc7c-5064-a84e-aad4c6f81d89 with identifier: CR07619
2026-03-30 10:51:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c59366c-fc7c-5064-a84e-aad4c6f81d89 with scrape type 1
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c59366c-fc7c-5064-a84e-aad4c6f81d89
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_47a8faf3eb8ce1db9efc60aa0395a6d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_47a8faf3eb8ce1db9efc60aa0395a6d9.jpg not downloaded yet
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_d719f05dff55dee7d946d6d29444ba60.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_d719f05dff55dee7d946d6d29444ba60.jpg not downloaded yet
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_afd009e55d747d7fcaf614084f853d6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_afd009e55d747d7fcaf614084f853d6c.jpg not downloaded yet
2026-03-30 10:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_eb9021efc976cd8232720abd58596863.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a78350>
2026-03-30 10:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_10797ab3a15e21ded4f347a7d57879e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_10797ab3a15e21ded4f347a7d57879e2.jpg saved to cache
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6bdd0096-ad93-52e4-902b-b82cf1361f4d
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50a7a10>
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_2fe11e0b9a9519de53aef7ee517d9bd9.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_2fe11e0b9a9519de53aef7ee517d9bd9.jpg saved to cache
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_4d9800fd0bdedc1ce472ebc2c339a232.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_4d9800fd0bdedc1ce472ebc2c339a232.jpg not downloaded yet
2026-03-30 10:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_355fd199c0a166159d52d5fe3f66927e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_62ab3515129975e552c4bccdcef47c0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_38de6bc16acd36031dd21ef4e571a379.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_38de6bc16acd36031dd21ef4e571a379.jpg not downloaded yet
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef79f9bd0>
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_81516bce456a4cd29a447e232c7294b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_81516bce456a4cd29a447e232c7294b1.jpg saved to cache
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6ee90>
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_7406248cdfe9672e8c23cb1ca5e2108b.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_7406248cdfe9672e8c23cb1ca5e2108b.jpg saved to cache
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef785f910>
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_d870f2c5e52569091d53b2698d838b57.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_d870f2c5e52569091d53b2698d838b57.jpg saved to cache
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef79fb510>
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_eb9021efc976cd8232720abd58596863.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_eb9021efc976cd8232720abd58596863.jpg saved to cache
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_dd4ee956aa17b3af4ee6ea51da481804.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_dd4ee956aa17b3af4ee6ea51da481804.jpg not downloaded yet
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ad5b50>
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_355fd199c0a166159d52d5fe3f66927e.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_355fd199c0a166159d52d5fe3f66927e.jpg saved to cache
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7905190>
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_62ab3515129975e552c4bccdcef47c0c.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_62ab3515129975e552c4bccdcef47c0c.jpg saved to cache
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_138d783e8d6424f632923faba0e99ce8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_138d783e8d6424f632923faba0e99ce8.jpg not downloaded yet
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_729f6edd7808efba87ad7693cac87016.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_729f6edd7808efba87ad7693cac87016.jpg not downloaded yet
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_1bb0ee0bb78b057de504a96437efa910.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_1bb0ee0bb78b057de504a96437efa910.jpg not downloaded yet
2026-03-30 10:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_afd009e55d747d7fcaf614084f853d6c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_7e43e5703cd79134d3d55fa756dd2a5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_7e43e5703cd79134d3d55fa756dd2a5a.jpg not downloaded yet
2026-03-30 10:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_d719f05dff55dee7d946d6d29444ba60.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_4d9800fd0bdedc1ce472ebc2c339a232.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50763d0>
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_afd009e55d747d7fcaf614084f853d6c.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_afd009e55d747d7fcaf614084f853d6c.jpg saved to cache
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c59366c-fc7c-5064-a84e-aad4c6f81d89
2026-03-30 10:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_729f6edd7808efba87ad7693cac87016.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8ae50>
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_d719f05dff55dee7d946d6d29444ba60.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_d719f05dff55dee7d946d6d29444ba60.jpg saved to cache
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c59366c-fc7c-5064-a84e-aad4c6f81d89
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d78890>
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_4d9800fd0bdedc1ce472ebc2c339a232.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_4d9800fd0bdedc1ce472ebc2c339a232.jpg saved to cache
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c59366c-fc7c-5064-a84e-aad4c6f81d89
2026-03-30 10:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_138d783e8d6424f632923faba0e99ce8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ece410>
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_729f6edd7808efba87ad7693cac87016.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_729f6edd7808efba87ad7693cac87016.jpg saved to cache
2026-03-30 10:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c59366c-fc7c-5064-a84e-aad4c6f81d89
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5091790>
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_138d783e8d6424f632923faba0e99ce8.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_138d783e8d6424f632923faba0e99ce8.jpg saved to cache
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c59366c-fc7c-5064-a84e-aad4c6f81d89
2026-03-30 10:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ85196> (referer: https://www.auto1.com/v1/car-details-view/UZ85196/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_7e43e5703cd79134d3d55fa756dd2a5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_dd4ee956aa17b3af4ee6ea51da481804.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_47a8faf3eb8ce1db9efc60aa0395a6d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6142157-fbb3-56cc-918a-a06643d4d3d3 with identifier: UZ85196
2026-03-30 10:51:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6142157-fbb3-56cc-918a-a06643d4d3d3 with scrape type 1
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6142157-fbb3-56cc-918a-a06643d4d3d3
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_6e1a241953d1bf6a5e85fdb5159a3254.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_6e1a241953d1bf6a5e85fdb5159a3254.jpg not downloaded yet
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_024145e557ddfafb0239c66d7e96083e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_024145e557ddfafb0239c66d7e96083e.jpg not downloaded yet
2026-03-30 10:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_ae2584695dad71989d150f75bba9096e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_0e1d186ec3c56c85b7ccf18f99dd5b8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_0e1d186ec3c56c85b7ccf18f99dd5b8a.jpg not downloaded yet
2026-03-30 10:51:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e74790>
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_7e43e5703cd79134d3d55fa756dd2a5a.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_7e43e5703cd79134d3d55fa756dd2a5a.jpg saved to cache
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c59366c-fc7c-5064-a84e-aad4c6f81d89
2026-03-30 10:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_38de6bc16acd36031dd21ef4e571a379.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_2f0936ed808749fc5032779e969019b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_2f0936ed808749fc5032779e969019b4.jpg not downloaded yet
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8ed50>
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_dd4ee956aa17b3af4ee6ea51da481804.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_dd4ee956aa17b3af4ee6ea51da481804.jpg saved to cache
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c59366c-fc7c-5064-a84e-aad4c6f81d89
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e68990>
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_47a8faf3eb8ce1db9efc60aa0395a6d9.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_47a8faf3eb8ce1db9efc60aa0395a6d9.jpg saved to cache
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c59366c-fc7c-5064-a84e-aad4c6f81d89
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2bc10>
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_ae2584695dad71989d150f75bba9096e.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_ae2584695dad71989d150f75bba9096e.jpg saved to cache
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_246ee392b194e5f5f664f170a76ae4b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_2501c092e7fa158038ac1375b7ae5442.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_2501c092e7fa158038ac1375b7ae5442.jpg not downloaded yet
2026-03-30 10:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_024145e557ddfafb0239c66d7e96083e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_0389646ac7e465ae385aae1cda2fd793.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_0389646ac7e465ae385aae1cda2fd793.jpg not downloaded yet
2026-03-30 10:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH45611> (referer: https://www.auto1.com/v1/car-details-view/BH45611/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da3450>
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_38de6bc16acd36031dd21ef4e571a379.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_38de6bc16acd36031dd21ef4e571a379.jpg saved to cache
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c59366c-fc7c-5064-a84e-aad4c6f81d89
2026-03-30 10:51:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_c53d9cd81716c86b3be47efb71d23d4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_c53d9cd81716c86b3be47efb71d23d4e.jpg not downloaded yet
2026-03-30 10:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_1bb0ee0bb78b057de504a96437efa910.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_952222e8d98cf65d592bd9b7c508f11f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_952222e8d98cf65d592bd9b7c508f11f.jpg not downloaded yet
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_5990ac72c8605411139cd37ab5fd6b91.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_5990ac72c8605411139cd37ab5fd6b91.jpg not downloaded yet
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef593cb50>
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_246ee392b194e5f5f664f170a76ae4b8.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_246ee392b194e5f5f664f170a76ae4b8.jpg saved to cache
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dfbc90>
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_024145e557ddfafb0239c66d7e96083e.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_024145e557ddfafb0239c66d7e96083e.jpg saved to cache
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6142157-fbb3-56cc-918a-a06643d4d3d3
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_53c0efe47fa900d55312dc7c93d7325f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_53c0efe47fa900d55312dc7c93d7325f.jpg not downloaded yet
2026-03-30 10:51:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05932ade-70a7-543b-a484-94b16298a00d with identifier: BH45611
2026-03-30 10:51:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05932ade-70a7-543b-a484-94b16298a00d with scrape type 1
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05932ade-70a7-543b-a484-94b16298a00d
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_8a63487c313009e4affee58ddb9ff599.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_8a63487c313009e4affee58ddb9ff599.jpg not downloaded yet
2026-03-30 10:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_2f0936ed808749fc5032779e969019b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_370d6083630fdf24690abaf8df97ef88.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_370d6083630fdf24690abaf8df97ef88.jpg not downloaded yet
2026-03-30 10:51:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5104290>
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Ffa%252Fc2fa5f248b43a733f9598b9ec9a9e944%252Fpa%252FCR07619_1bb0ee0bb78b057de504a96437efa910.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_1bb0ee0bb78b057de504a96437efa910.jpg saved to cache
2026-03-30 10:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c59366c-fc7c-5064-a84e-aad4c6f81d89
2026-03-30 10:51:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c59366c-fc7c-5064-a84e-aad4c6f81d89, skipping ID generation
2026-03-30 10:51:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c59366c-fc7c-5064-a84e-aad4c6f81d89 with scrape type 1
2026-03-30 10:51:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c59366c-fc7c-5064-a84e-aad4c6f81d89 sending to next pipeline
2026-03-30 10:51:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c59366c-fc7c-5064-a84e-aad4c6f81d89, identifier: CR07619
2026-03-30 10:51:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c59366c-fc7c-5064-a84e-aad4c6f81d89 with identifier: CR07619
2026-03-30 10:51:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c59366c-fc7c-5064-a84e-aad4c6f81d89 with identifier: CR07619
2026-03-30 10:51:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c59366c-fc7c-5064-a84e-aad4c6f81d89 with identifier: CR07619 to the API
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_1bb0ee0bb78b057de504a96437efa910.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:13:11Z',
 'fuel_type': 'petrol',
 'id': '9c59366c-fc7c-5064-a84e-aad4c6f81d89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR07619',
 'listing': 'auction',
 'location': 'DE, Hanau',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 177062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_47a8faf3eb8ce1db9efc60aa0395a6d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3004576,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_d719f05dff55dee7d946d6d29444ba60.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_afd009e55d747d7fcaf614084f853d6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_4d9800fd0bdedc1ce472ebc2c339a232.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_38de6bc16acd36031dd21ef4e571a379.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_dd4ee956aa17b3af4ee6ea51da481804.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_138d783e8d6424f632923faba0e99ce8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_729f6edd7808efba87ad7693cac87016.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3124665,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_1bb0ee0bb78b057de504a96437efa910.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c59366c-fc7c-5064-a84e-aad4c6f81d89/9c59366c-fc7c-5064-a84e-aad4c6f81d89_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2867294,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/fa/c2fa5f248b43a733f9598b9ec9a9e944/pa/CR07619_7e43e5703cd79134d3d55fa756dd2a5a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.6 GDI FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2015}
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR07619%27 HTTP/1.1" 200 None
2026-03-30 10:51:32 [auto1.de] INFO: Saving data for CR07619: {'created_time': 1774867892.625353, 'last_price_update_time': 1774867892.625365, 'auction_closing_time': 1774969991.0}
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR07619') HTTP/1.1" 204 0
2026-03-30 10:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_0389646ac7e465ae385aae1cda2fd793.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_0efe0fdb27a89f23d2e95f86e05d739a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_0efe0fdb27a89f23d2e95f86e05d739a.jpg not downloaded yet
2026-03-30 10:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU57543> (referer: https://www.auto1.com/v1/car-details-view/TU57543/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL38495/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VA91828> (referer: https://www.auto1.com/v1/car-details-view/VA91828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_5990ac72c8605411139cd37ab5fd6b91.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_7ed9ecd35bdfea1c5b69badc2fbab78d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_7ed9ecd35bdfea1c5b69badc2fbab78d.jpg not downloaded yet
2026-03-30 10:51:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e52d10>
2026-03-30 10:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_2f0936ed808749fc5032779e969019b4.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_2f0936ed808749fc5032779e969019b4.jpg saved to cache
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6142157-fbb3-56cc-918a-a06643d4d3d3
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_2d10e4b198a63c0a103a01269652644a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_2d10e4b198a63c0a103a01269652644a.jpg not downloaded yet
2026-03-30 10:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_370d6083630fdf24690abaf8df97ef88.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_2fb6e74ffa1f964e71671ed256f23ab2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_2fb6e74ffa1f964e71671ed256f23ab2.jpg not downloaded yet
2026-03-30 10:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6f650>
2026-03-30 10:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_0389646ac7e465ae385aae1cda2fd793.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_0389646ac7e465ae385aae1cda2fd793.jpg saved to cache
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6142157-fbb3-56cc-918a-a06643d4d3d3
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_1d1341879c29bcb35646db479c131cc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_1d1341879c29bcb35646db479c131cc0.jpg not downloaded yet
2026-03-30 10:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_0efe0fdb27a89f23d2e95f86e05d739a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_8a63487c313009e4affee58ddb9ff599.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892 with identifier: TU57543
2026-03-30 10:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892 with scrape type 1
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_9c705b304924d5bf4cbbbbabc7e913f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_9c705b304924d5bf4cbbbbabc7e913f0.jpg not downloaded yet
2026-03-30 10:51:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e772c538-d047-5110-a07c-5cb71de7930b with identifier: VA91828
2026-03-30 10:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e772c538-d047-5110-a07c-5cb71de7930b with scrape type 1
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e772c538-d047-5110-a07c-5cb71de7930b
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_fd0c7b691015b8da90952d29744e4126.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_fd0c7b691015b8da90952d29744e4126.jpg not downloaded yet
2026-03-30 10:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5071ad0>
2026-03-30 10:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_5990ac72c8605411139cd37ab5fd6b91.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_5990ac72c8605411139cd37ab5fd6b91.jpg saved to cache
2026-03-30 10:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6142157-fbb3-56cc-918a-a06643d4d3d3
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_c2e8bc76cecca39b16540eecced38f61.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_c2e8bc76cecca39b16540eecced38f61.jpg not downloaded yet
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_0cf379780d52395c7d7d78ca2979cbca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_0cf379780d52395c7d7d78ca2979cbca.jpg not downloaded yet
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_59ac6274e88322761e22eb58885b5f14.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_59ac6274e88322761e22eb58885b5f14.jpg not downloaded yet
2026-03-30 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_2d10e4b198a63c0a103a01269652644a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_53c0efe47fa900d55312dc7c93d7325f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_38669cb4e0d0b40261fd74fe86e0af4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_38669cb4e0d0b40261fd74fe86e0af4e.jpg not downloaded yet
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f80fd0>
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_370d6083630fdf24690abaf8df97ef88.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_370d6083630fdf24690abaf8df97ef88.jpg saved to cache
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05932ade-70a7-543b-a484-94b16298a00d
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5aaf4d0>
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_0efe0fdb27a89f23d2e95f86e05d739a.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_0efe0fdb27a89f23d2e95f86e05d739a.jpg saved to cache
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05932ade-70a7-543b-a484-94b16298a00d
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b208d0>
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_8a63487c313009e4affee58ddb9ff599.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_8a63487c313009e4affee58ddb9ff599.jpg saved to cache
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05932ade-70a7-543b-a484-94b16298a00d
2026-03-30 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_952222e8d98cf65d592bd9b7c508f11f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_5ccecd6449235a91f45661f83c1a74ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_5ccecd6449235a91f45661f83c1a74ab.jpg not downloaded yet
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_4863a6f280859691616719f837d9ec73.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_4863a6f280859691616719f837d9ec73.jpg not downloaded yet
2026-03-30 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_2fb6e74ffa1f964e71671ed256f23ab2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_7ed9ecd35bdfea1c5b69badc2fbab78d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_4f307f395bff5a8f045b20a5e65c5c1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_4f307f395bff5a8f045b20a5e65c5c1b.jpg not downloaded yet
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_19c54620b17bacded2671a0a85791245.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_19c54620b17bacded2671a0a85791245.jpg not downloaded yet
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_f8f04e6266dd670bbc87eaf5a2f21c3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_f8f04e6266dd670bbc87eaf5a2f21c3e.jpg not downloaded yet
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db81d0>
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_2d10e4b198a63c0a103a01269652644a.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_2d10e4b198a63c0a103a01269652644a.jpg saved to cache
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05932ade-70a7-543b-a484-94b16298a00d
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef505fc90>
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_53c0efe47fa900d55312dc7c93d7325f.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_53c0efe47fa900d55312dc7c93d7325f.jpg saved to cache
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6142157-fbb3-56cc-918a-a06643d4d3d3
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_22fef60de311d0c20664f8ac6f15e6e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_22fef60de311d0c20664f8ac6f15e6e2.jpg not downloaded yet
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_b3eac7bc1bf4da9d28c7738e9d98c554.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_b3eac7bc1bf4da9d28c7738e9d98c554.jpg not downloaded yet
2026-03-30 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_fd0c7b691015b8da90952d29744e4126.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_c2e8bc76cecca39b16540eecced38f61.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_59ac6274e88322761e22eb58885b5f14.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_535cf838e971ff74b9eec48593d7a8ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_535cf838e971ff74b9eec48593d7a8ab.jpg not downloaded yet
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_d12026b3383fa163e6ac8a149e0e9081.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_d12026b3383fa163e6ac8a149e0e9081.jpg not downloaded yet
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef596f6d0>
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_952222e8d98cf65d592bd9b7c508f11f.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_952222e8d98cf65d592bd9b7c508f11f.jpg saved to cache
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6142157-fbb3-56cc-918a-a06643d4d3d3
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5051790>
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_2fb6e74ffa1f964e71671ed256f23ab2.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_2fb6e74ffa1f964e71671ed256f23ab2.jpg saved to cache
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05932ade-70a7-543b-a484-94b16298a00d
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fc9f10>
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_7ed9ecd35bdfea1c5b69badc2fbab78d.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_7ed9ecd35bdfea1c5b69badc2fbab78d.jpg saved to cache
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05932ade-70a7-543b-a484-94b16298a00d
2026-03-30 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_38669cb4e0d0b40261fd74fe86e0af4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_89015f6cec83a1c87f3351ae1c0faf82.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_89015f6cec83a1c87f3351ae1c0faf82.jpg not downloaded yet
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_b009758ca1cb0533f435d5e6a8c2fa7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_b009758ca1cb0533f435d5e6a8c2fa7f.jpg not downloaded yet
2026-03-30 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_0cf379780d52395c7d7d78ca2979cbca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG69292/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_543e6153db1fdd832de9dd97dfec6ec3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_543e6153db1fdd832de9dd97dfec6ec3.jpg not downloaded yet
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_ad85fa036849f6fba90ffb647a9fff4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_ad85fa036849f6fba90ffb647a9fff4b.jpg not downloaded yet
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d66310>
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_fd0c7b691015b8da90952d29744e4126.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_fd0c7b691015b8da90952d29744e4126.jpg saved to cache
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e772c538-d047-5110-a07c-5cb71de7930b
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef596f810>
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_c2e8bc76cecca39b16540eecced38f61.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_c2e8bc76cecca39b16540eecced38f61.jpg saved to cache
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05932ade-70a7-543b-a484-94b16298a00d
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dfb390>
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_59ac6274e88322761e22eb58885b5f14.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_59ac6274e88322761e22eb58885b5f14.jpg saved to cache
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e772c538-d047-5110-a07c-5cb71de7930b
2026-03-30 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_d12026b3383fa163e6ac8a149e0e9081.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_9ddcb772fd527840c5e1985e9bb7f4e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_9ddcb772fd527840c5e1985e9bb7f4e7.jpg not downloaded yet
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_6e7ed0ddc2ede2bd4525acaeec4e3a95.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_6e7ed0ddc2ede2bd4525acaeec4e3a95.jpg not downloaded yet
2026-03-30 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_19c54620b17bacded2671a0a85791245.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_f8f04e6266dd670bbc87eaf5a2f21c3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_4f307f395bff5a8f045b20a5e65c5c1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_f3cd77313ffb2100e6c07b1ea9252e87.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_f3cd77313ffb2100e6c07b1ea9252e87.jpg not downloaded yet
2026-03-30 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_c5319314c4c01b9b7f1ab181d80120f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_c5319314c4c01b9b7f1ab181d80120f0.jpg not downloaded yet
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c4c950>
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_38669cb4e0d0b40261fd74fe86e0af4e.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_38669cb4e0d0b40261fd74fe86e0af4e.jpg saved to cache
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05932ade-70a7-543b-a484-94b16298a00d
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef501c850>
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_0cf379780d52395c7d7d78ca2979cbca.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_0cf379780d52395c7d7d78ca2979cbca.jpg saved to cache
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892
2026-03-30 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_535cf838e971ff74b9eec48593d7a8ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XH62328/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a95710>
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_d12026b3383fa163e6ac8a149e0e9081.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_d12026b3383fa163e6ac8a149e0e9081.jpg saved to cache
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e772c538-d047-5110-a07c-5cb71de7930b
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea3290>
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_19c54620b17bacded2671a0a85791245.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_19c54620b17bacded2671a0a85791245.jpg saved to cache
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a36d10>
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_f8f04e6266dd670bbc87eaf5a2f21c3e.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_f8f04e6266dd670bbc87eaf5a2f21c3e.jpg saved to cache
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e772c538-d047-5110-a07c-5cb71de7930b
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e6a790>
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_4f307f395bff5a8f045b20a5e65c5c1b.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_4f307f395bff5a8f045b20a5e65c5c1b.jpg saved to cache
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05932ade-70a7-543b-a484-94b16298a00d
2026-03-30 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_0e1d186ec3c56c85b7ccf18f99dd5b8a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_b3eac7bc1bf4da9d28c7738e9d98c554.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_ad85fa036849f6fba90ffb647a9fff4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_89015f6cec83a1c87f3351ae1c0faf82.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_543e6153db1fdd832de9dd97dfec6ec3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ72237/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_2501c092e7fa158038ac1375b7ae5442.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e274d0>
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_535cf838e971ff74b9eec48593d7a8ab.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_535cf838e971ff74b9eec48593d7a8ab.jpg saved to cache
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892
2026-03-30 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_6e1a241953d1bf6a5e85fdb5159a3254.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fef290>
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_0e1d186ec3c56c85b7ccf18f99dd5b8a.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_0e1d186ec3c56c85b7ccf18f99dd5b8a.jpg saved to cache
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6142157-fbb3-56cc-918a-a06643d4d3d3
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b03950>
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_b3eac7bc1bf4da9d28c7738e9d98c554.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_b3eac7bc1bf4da9d28c7738e9d98c554.jpg saved to cache
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e772c538-d047-5110-a07c-5cb71de7930b
2026-03-30 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_6e7ed0ddc2ede2bd4525acaeec4e3a95.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_22fef60de311d0c20664f8ac6f15e6e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_f3cd77313ffb2100e6c07b1ea9252e87.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_9ddcb772fd527840c5e1985e9bb7f4e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ded310>
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_ad85fa036849f6fba90ffb647a9fff4b.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_ad85fa036849f6fba90ffb647a9fff4b.jpg saved to cache
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e772c538-d047-5110-a07c-5cb71de7930b
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fed3d0>
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_89015f6cec83a1c87f3351ae1c0faf82.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_89015f6cec83a1c87f3351ae1c0faf82.jpg saved to cache
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2a090>
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_543e6153db1fdd832de9dd97dfec6ec3.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_543e6153db1fdd832de9dd97dfec6ec3.jpg saved to cache
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892
2026-03-30 10:51:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fed290>
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_2501c092e7fa158038ac1375b7ae5442.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_2501c092e7fa158038ac1375b7ae5442.jpg saved to cache
2026-03-30 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6142157-fbb3-56cc-918a-a06643d4d3d3
2026-03-30 10:51:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5051050>
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_6e1a241953d1bf6a5e85fdb5159a3254.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_6e1a241953d1bf6a5e85fdb5159a3254.jpg saved to cache
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6142157-fbb3-56cc-918a-a06643d4d3d3
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e97f10>
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_6e7ed0ddc2ede2bd4525acaeec4e3a95.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_6e7ed0ddc2ede2bd4525acaeec4e3a95.jpg saved to cache
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e772c538-d047-5110-a07c-5cb71de7930b
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee6bd0>
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_22fef60de311d0c20664f8ac6f15e6e2.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_22fef60de311d0c20664f8ac6f15e6e2.jpg saved to cache
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e77610>
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_f3cd77313ffb2100e6c07b1ea9252e87.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_f3cd77313ffb2100e6c07b1ea9252e87.jpg saved to cache
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b34e90>
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_9ddcb772fd527840c5e1985e9bb7f4e7.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_9ddcb772fd527840c5e1985e9bb7f4e7.jpg saved to cache
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892
2026-03-30 10:51:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_b009758ca1cb0533f435d5e6a8c2fa7f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_c5319314c4c01b9b7f1ab181d80120f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_4863a6f280859691616719f837d9ec73.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_1d1341879c29bcb35646db479c131cc0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_9c705b304924d5bf4cbbbbabc7e913f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_7d00db8b39df2c6acb0d1f295348352f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e21e10>
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_b009758ca1cb0533f435d5e6a8c2fa7f.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_b009758ca1cb0533f435d5e6a8c2fa7f.jpg saved to cache
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e772c538-d047-5110-a07c-5cb71de7930b
2026-03-30 10:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_c53d9cd81716c86b3be47efb71d23d4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK74966> (referer: https://www.auto1.com/v1/car-details-view/SK74966/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG69292> (referer: https://www.auto1.com/v1/car-details-view/AG69292/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c73d0>
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_c5319314c4c01b9b7f1ab181d80120f0.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_c5319314c4c01b9b7f1ab181d80120f0.jpg saved to cache
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e772c538-d047-5110-a07c-5cb71de7930b
2026-03-30 10:51:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e53c10>
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F12%252F3012626d67f0a3fb8f3f982e7ad92363%252Fpa%252FVA91828_4863a6f280859691616719f837d9ec73.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_4863a6f280859691616719f837d9ec73.jpg saved to cache
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e772c538-d047-5110-a07c-5cb71de7930b
2026-03-30 10:51:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e772c538-d047-5110-a07c-5cb71de7930b, skipping ID generation
2026-03-30 10:51:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e772c538-d047-5110-a07c-5cb71de7930b with scrape type 1
2026-03-30 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e772c538-d047-5110-a07c-5cb71de7930b sending to next pipeline
2026-03-30 10:51:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e772c538-d047-5110-a07c-5cb71de7930b, identifier: VA91828
2026-03-30 10:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8dad0>
2026-03-30 10:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F4f%252F564ffa9d170aa2d1307694b2fcecd90c%252Fpa%252FBH45611_1d1341879c29bcb35646db479c131cc0.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_1d1341879c29bcb35646db479c131cc0.jpg saved to cache
2026-03-30 10:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05932ade-70a7-543b-a484-94b16298a00d
2026-03-30 10:51:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05932ade-70a7-543b-a484-94b16298a00d, skipping ID generation
2026-03-30 10:51:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05932ade-70a7-543b-a484-94b16298a00d with scrape type 1
2026-03-30 10:51:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05932ade-70a7-543b-a484-94b16298a00d sending to next pipeline
2026-03-30 10:51:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05932ade-70a7-543b-a484-94b16298a00d, identifier: BH45611
2026-03-30 10:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50de990>
2026-03-30 10:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_9c705b304924d5bf4cbbbbabc7e913f0.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_9c705b304924d5bf4cbbbbabc7e913f0.jpg saved to cache
2026-03-30 10:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892
2026-03-30 10:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e7ab50>
2026-03-30 10:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F19%252F7019598ddbe75da260caa3b7e621b2f9%252Fpa%252FEJ29706_7d00db8b39df2c6acb0d1f295348352f.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_7d00db8b39df2c6acb0d1f295348352f.jpg saved to cache
2026-03-30 10:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecac2567-3be3-5b55-b73d-5eb705a1dc54
2026-03-30 10:51:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecac2567-3be3-5b55-b73d-5eb705a1dc54, skipping ID generation
2026-03-30 10:51:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecac2567-3be3-5b55-b73d-5eb705a1dc54 with scrape type 1
2026-03-30 10:51:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecac2567-3be3-5b55-b73d-5eb705a1dc54 sending to next pipeline
2026-03-30 10:51:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecac2567-3be3-5b55-b73d-5eb705a1dc54, identifier: EJ29706
2026-03-30 10:51:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e772c538-d047-5110-a07c-5cb71de7930b with identifier: VA91828
2026-03-30 10:51:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e772c538-d047-5110-a07c-5cb71de7930b with identifier: VA91828
2026-03-30 10:51:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e772c538-d047-5110-a07c-5cb71de7930b with identifier: VA91828 to the API
2026-03-30 10:51:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_4863a6f280859691616719f837d9ec73.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:12:21Z',
 'fuel_type': 'petrol',
 'id': 'e772c538-d047-5110-a07c-5cb71de7930b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA91828',
 'listing': 'auction',
 'location': 'DE, Schwerin',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 87144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_fd0c7b691015b8da90952d29744e4126.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_59ac6274e88322761e22eb58885b5f14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2619825,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_4863a6f280859691616719f837d9ec73.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_f8f04e6266dd670bbc87eaf5a2f21c3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_b3eac7bc1bf4da9d28c7738e9d98c554.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_d12026b3383fa163e6ac8a149e0e9081.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2683779,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_b009758ca1cb0533f435d5e6a8c2fa7f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_ad85fa036849f6fba90ffb647a9fff4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_6e7ed0ddc2ede2bd4525acaeec4e3a95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e772c538-d047-5110-a07c-5cb71de7930b/e772c538-d047-5110-a07c-5cb71de7930b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2674086,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/12/3012626d67f0a3fb8f3f982e7ad92363/pa/VA91828_c5319314c4c01b9b7f1ab181d80120f0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2002}
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA91828%27 HTTP/1.1" 200 None
2026-03-30 10:51:37 [auto1.de] INFO: Saving data for VA91828: {'created_time': 1774867897.381917, 'last_price_update_time': 1774867897.381931, 'auction_closing_time': 1774969941.0}
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA91828') HTTP/1.1" 204 0
2026-03-30 10:51:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05932ade-70a7-543b-a484-94b16298a00d with identifier: BH45611
2026-03-30 10:51:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05932ade-70a7-543b-a484-94b16298a00d with identifier: BH45611
2026-03-30 10:51:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05932ade-70a7-543b-a484-94b16298a00d with identifier: BH45611 to the API
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_1d1341879c29bcb35646db479c131cc0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 224,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.4L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:53:36Z',
 'fuel_type': 'diesel',
 'id': '05932ade-70a7-543b-a484-94b16298a00d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH45611',
 'listing': 'auction',
 'location': 'DE, Hamburg',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 297520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_8a63487c313009e4affee58ddb9ff599.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_370d6083630fdf24690abaf8df97ef88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_0efe0fdb27a89f23d2e95f86e05d739a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_7ed9ecd35bdfea1c5b69badc2fbab78d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_2d10e4b198a63c0a103a01269652644a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_2fb6e74ffa1f964e71671ed256f23ab2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_1d1341879c29bcb35646db479c131cc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_c2e8bc76cecca39b16540eecced38f61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_38669cb4e0d0b40261fd74fe86e0af4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05932ade-70a7-543b-a484-94b16298a00d/05932ade-70a7-543b-a484-94b16298a00d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/4f/564ffa9d170aa2d1307694b2fcecd90c/pa/BH45611_4f307f395bff5a8f045b20a5e65c5c1b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-10-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volvo XC90 2.4 D5 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2008}
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH45611%27 HTTP/1.1" 200 None
2026-03-30 10:51:37 [auto1.de] INFO: Saving data for BH45611: {'created_time': 1774867897.803584, 'last_price_update_time': 1774867897.803596, 'auction_closing_time': 1774972416.0}
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH45611') HTTP/1.1" 204 0
2026-03-30 10:51:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecac2567-3be3-5b55-b73d-5eb705a1dc54 with identifier: EJ29706
2026-03-30 10:51:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecac2567-3be3-5b55-b73d-5eb705a1dc54 with identifier: EJ29706
2026-03-30 10:51:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecac2567-3be3-5b55-b73d-5eb705a1dc54 with identifier: EJ29706 to the API
2026-03-30 10:51:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_7d00db8b39df2c6acb0d1f295348352f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:55:42Z',
 'fuel_type': 'electro',
 'id': 'ecac2567-3be3-5b55-b73d-5eb705a1dc54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ29706',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 14,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_7d00db8b39df2c6acb0d1f295348352f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_ae2584695dad71989d150f75bba9096e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_2fe11e0b9a9519de53aef7ee517d9bd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_246ee392b194e5f5f664f170a76ae4b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_eb9021efc976cd8232720abd58596863.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_355fd199c0a166159d52d5fe3f66927e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_62ab3515129975e552c4bccdcef47c0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_d870f2c5e52569091d53b2698d838b57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_7406248cdfe9672e8c23cb1ca5e2108b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecac2567-3be3-5b55-b73d-5eb705a1dc54/ecac2567-3be3-5b55-b73d-5eb705a1dc54_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/19/7019598ddbe75da260caa3b7e621b2f9/pa/EJ29706_81516bce456a4cd29a447e232c7294b1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ29706%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [auto1.de] INFO: Saving data for EJ29706: {'created_time': 1774867898.13686, 'last_price_update_time': 1774867898.13687, 'auction_closing_time': 1774972542.0}
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ29706') HTTP/1.1" 204 0
2026-03-30 10:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN14015/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8d990>
2026-03-30 10:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fa2%252F66a28c16b85c86eceba37ddf0dd382aa%252Fpa%252FUZ85196_c53d9cd81716c86b3be47efb71d23d4e.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_c53d9cd81716c86b3be47efb71d23d4e.jpg saved to cache
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6142157-fbb3-56cc-918a-a06643d4d3d3
2026-03-30 10:51:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6142157-fbb3-56cc-918a-a06643d4d3d3, skipping ID generation
2026-03-30 10:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6142157-fbb3-56cc-918a-a06643d4d3d3 with scrape type 1
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6142157-fbb3-56cc-918a-a06643d4d3d3 sending to next pipeline
2026-03-30 10:51:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6142157-fbb3-56cc-918a-a06643d4d3d3, identifier: UZ85196
2026-03-30 10:51:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37abc846-a139-52a9-aa03-e234924fead9 with identifier: SK74966
2026-03-30 10:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37abc846-a139-52a9-aa03-e234924fead9 with scrape type 1
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37abc846-a139-52a9-aa03-e234924fead9
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_32096f06b0aec5d8216f318d6a119452.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_32096f06b0aec5d8216f318d6a119452.jpg not downloaded yet
2026-03-30 10:51:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c01c5b49-f4fc-598b-bad3-d897a9331f7c with identifier: AG69292
2026-03-30 10:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c01c5b49-f4fc-598b-bad3-d897a9331f7c with scrape type 1
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c01c5b49-f4fc-598b-bad3-d897a9331f7c
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F85%252Faf85fd60086f97a2533d4ec72f7d3681%252Fpa%252FAG69292_6b45515a51b96f120924acc54b0a4b20.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_6b45515a51b96f120924acc54b0a4b20.jpg already downloaded
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F85%252Faf85fd60086f97a2533d4ec72f7d3681%252Fpa%252FAG69292_87b3fcea5b58f153f0ee8baee70ce052.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_87b3fcea5b58f153f0ee8baee70ce052.jpg already downloaded
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F85%252Faf85fd60086f97a2533d4ec72f7d3681%252Fpa%252FAG69292_049e19120ba58265c3573581d7239f9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_049e19120ba58265c3573581d7239f9c.jpg already downloaded
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F85%252Faf85fd60086f97a2533d4ec72f7d3681%252Fpa%252FAG69292_74ba877df69b081b936eb46ccf454929.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_74ba877df69b081b936eb46ccf454929.jpg already downloaded
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F85%252Faf85fd60086f97a2533d4ec72f7d3681%252Fpa%252FAG69292_d995007f44262190db20b7827814e23b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_d995007f44262190db20b7827814e23b.jpg already downloaded
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F85%252Faf85fd60086f97a2533d4ec72f7d3681%252Fpa%252FAG69292_80c633742fa7448fe918ca0f601869d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_80c633742fa7448fe918ca0f601869d3.jpg already downloaded
2026-03-30 10:51:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c01c5b49-f4fc-598b-bad3-d897a9331f7c, identifier: AG69292
2026-03-30 10:51:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6142157-fbb3-56cc-918a-a06643d4d3d3 with identifier: UZ85196
2026-03-30 10:51:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6142157-fbb3-56cc-918a-a06643d4d3d3 with identifier: UZ85196
2026-03-30 10:51:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6142157-fbb3-56cc-918a-a06643d4d3d3 with identifier: UZ85196 to the API
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_c53d9cd81716c86b3be47efb71d23d4e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:25:54Z',
 'fuel_type': 'petrol',
 'id': 'c6142157-fbb3-56cc-918a-a06643d4d3d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ85196',
 'listing': 'auction',
 'location': 'DE, Osnabrück',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 89927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2965446,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_6e1a241953d1bf6a5e85fdb5159a3254.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_024145e557ddfafb0239c66d7e96083e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2911866,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_0e1d186ec3c56c85b7ccf18f99dd5b8a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_2f0936ed808749fc5032779e969019b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2824037,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_2501c092e7fa158038ac1375b7ae5442.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_0389646ac7e465ae385aae1cda2fd793.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_c53d9cd81716c86b3be47efb71d23d4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_952222e8d98cf65d592bd9b7c508f11f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_5990ac72c8605411139cd37ab5fd6b91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6142157-fbb3-56cc-918a-a06643d4d3d3/c6142157-fbb3-56cc-918a-a06643d4d3d3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/a2/66a28c16b85c86eceba37ddf0dd382aa/pa/UZ85196_53c0efe47fa900d55312dc7c93d7325f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.6 Ti-VCT SYNC Edition',
 'transmission': 'manual',
 'trim': 'SYNC Edition',
 'year': 2013}
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ85196%27 HTTP/1.1" 200 None
2026-03-30 10:51:38 [auto1.de] INFO: Saving data for UZ85196: {'created_time': 1774867898.995831, 'last_price_update_time': 1774867898.995841, 'auction_closing_time': 1774970754.0}
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ85196') HTTP/1.1" 204 0
2026-03-30 10:51:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c01c5b49-f4fc-598b-bad3-d897a9331f7c with identifier: AG69292
2026-03-30 10:51:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c01c5b49-f4fc-598b-bad3-d897a9331f7c with identifier: AG69292
2026-03-30 10:51:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c01c5b49-f4fc-598b-bad3-d897a9331f7c with identifier: AG69292 to the API
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AG69292>
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-31T15:32:12Z',
 'fuel_type': 'petrol',
 'id': 'c01c5b49-f4fc-598b-bad3-d897a9331f7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG69292',
 'listing': 'auction',
 'location': 'DE, Kitzingen',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 223086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_6b45515a51b96f120924acc54b0a4b20.jpg',
                'https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_87b3fcea5b58f153f0ee8baee70ce052.jpg',
                'https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_049e19120ba58265c3573581d7239f9c.jpg',
                'https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_74ba877df69b081b936eb46ccf454929.jpg',
                'https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_d995007f44262190db20b7827814e23b.jpg',
                'https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_80c633742fa7448fe918ca0f601869d3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c01c5b49-f4fc-598b-bad3-d897a9331f7c/c01c5b49-f4fc-598b-bad3-d897a9331f7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_6b45515a51b96f120924acc54b0a4b20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c01c5b49-f4fc-598b-bad3-d897a9331f7c/c01c5b49-f4fc-598b-bad3-d897a9331f7c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_87b3fcea5b58f153f0ee8baee70ce052.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c01c5b49-f4fc-598b-bad3-d897a9331f7c/c01c5b49-f4fc-598b-bad3-d897a9331f7c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_049e19120ba58265c3573581d7239f9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c01c5b49-f4fc-598b-bad3-d897a9331f7c/c01c5b49-f4fc-598b-bad3-d897a9331f7c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_74ba877df69b081b936eb46ccf454929.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c01c5b49-f4fc-598b-bad3-d897a9331f7c/c01c5b49-f4fc-598b-bad3-d897a9331f7c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_d995007f44262190db20b7827814e23b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c01c5b49-f4fc-598b-bad3-d897a9331f7c/c01c5b49-f4fc-598b-bad3-d897a9331f7c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/85/af85fd60086f97a2533d4ec72f7d3681/pa/AG69292_80c633742fa7448fe918ca0f601869d3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-09-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 Flexifuel Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2008}
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG69292%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [auto1.de] INFO: Saving data for AG69292: {'created_time': 1774867899.374912, 'last_price_update_time': 1774867899.374922, 'auction_closing_time': 1774971132.0}
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG69292') HTTP/1.1" 204 0
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_a4cad4980ad0556b00034ed9bd36e6c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_a4cad4980ad0556b00034ed9bd36e6c3.jpg not downloaded yet
2026-03-30 10:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_05a0a73fa1b8a4e31139be1a88a055c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_2fc092b23552851a60412d1c16b3e835.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ72237> (referer: https://www.auto1.com/v1/car-details-view/VZ72237/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_32316888df19b5213a4a39879d6e79dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_f5b864262582127a5678ce80a31a1bad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_e49a002eae7fd8bc6ff6ea6891f5d382.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_e49a002eae7fd8bc6ff6ea6891f5d382.jpg not downloaded yet
2026-03-30 10:51:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_ee4654cf5fa7cf1c7e42de0198e3e984.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_ee4654cf5fa7cf1c7e42de0198e3e984.jpg not downloaded yet
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_9266c13ee81969390d8c5ab3fb2a09fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_9266c13ee81969390d8c5ab3fb2a09fb.jpg not downloaded yet
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_a22521885d43296730adcab071a48aef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_a22521885d43296730adcab071a48aef.jpg not downloaded yet
2026-03-30 10:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_25361166fb86943dd564c471de69061f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_58a6756ccbeb1a08d1a0c811950261ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_58a6756ccbeb1a08d1a0c811950261ae.jpg not downloaded yet
2026-03-30 10:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_32096f06b0aec5d8216f318d6a119452.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_13caa52fed7ab38130811b184a38d5ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_13caa52fed7ab38130811b184a38d5ea.jpg not downloaded yet
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_c6e59884a9fccb9de500c6aaf01d6fca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_c6e59884a9fccb9de500c6aaf01d6fca.jpg not downloaded yet
2026-03-30 10:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef501eed0>
2026-03-30 10:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_05a0a73fa1b8a4e31139be1a88a055c6.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_05a0a73fa1b8a4e31139be1a88a055c6.jpg saved to cache
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6bdd0096-ad93-52e4-902b-b82cf1361f4d
2026-03-30 10:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d64e10>
2026-03-30 10:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_2fc092b23552851a60412d1c16b3e835.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_2fc092b23552851a60412d1c16b3e835.jpg saved to cache
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6bdd0096-ad93-52e4-902b-b82cf1361f4d
2026-03-30 10:51:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9daf090-1762-5710-8a10-74b851452931 with identifier: VZ72237
2026-03-30 10:51:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9daf090-1762-5710-8a10-74b851452931 with scrape type 1
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9daf090-1762-5710-8a10-74b851452931
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbd%252Fa9bd298d98cb03c6da15b843728bc601%252Fpa%252FVZ72237_982415998ba46624901997bd1fa7fe71.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_982415998ba46624901997bd1fa7fe71.jpg already downloaded
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbd%252Fa9bd298d98cb03c6da15b843728bc601%252Fpa%252FVZ72237_22f132b15e8347eec109cc8201787e66.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_22f132b15e8347eec109cc8201787e66.jpg already downloaded
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbd%252Fa9bd298d98cb03c6da15b843728bc601%252Fpa%252FVZ72237_9874c3380839c80132b3c89fd7d6299c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_9874c3380839c80132b3c89fd7d6299c.jpg already downloaded
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbd%252Fa9bd298d98cb03c6da15b843728bc601%252Fpa%252FVZ72237_82a8892de9268780211d2e474123e085.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_82a8892de9268780211d2e474123e085.jpg already downloaded
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbd%252Fa9bd298d98cb03c6da15b843728bc601%252Fpa%252FVZ72237_df0801abdc4288efd01fe9d709eb9ffb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_df0801abdc4288efd01fe9d709eb9ffb.jpg already downloaded
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbd%252Fa9bd298d98cb03c6da15b843728bc601%252Fpa%252FVZ72237_ebb51bedded3e3687cc22397da36ec44.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_ebb51bedded3e3687cc22397da36ec44.jpg already downloaded
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbd%252Fa9bd298d98cb03c6da15b843728bc601%252Fpa%252FVZ72237_f2ae7a461dc1bb938be7d06dcc6a76c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_f2ae7a461dc1bb938be7d06dcc6a76c8.jpg already downloaded
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbd%252Fa9bd298d98cb03c6da15b843728bc601%252Fpa%252FVZ72237_2fed9fe51a384efc5e59d9c7e94965e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_2fed9fe51a384efc5e59d9c7e94965e4.jpg already downloaded
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbd%252Fa9bd298d98cb03c6da15b843728bc601%252Fpa%252FVZ72237_8eca2b0628f43fbb13fb58a445731e96.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_8eca2b0628f43fbb13fb58a445731e96.jpg already downloaded
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbd%252Fa9bd298d98cb03c6da15b843728bc601%252Fpa%252FVZ72237_9dec4ed8cee282dbf9ace8ede6977e45.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_9dec4ed8cee282dbf9ace8ede6977e45.jpg already downloaded
2026-03-30 10:51:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9daf090-1762-5710-8a10-74b851452931, identifier: VZ72237
2026-03-30 10:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e60510>
2026-03-30 10:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_32316888df19b5213a4a39879d6e79dc.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_32316888df19b5213a4a39879d6e79dc.jpg saved to cache
2026-03-30 10:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6bdd0096-ad93-52e4-902b-b82cf1361f4d
2026-03-30 10:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a32110>
2026-03-30 10:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_f5b864262582127a5678ce80a31a1bad.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_f5b864262582127a5678ce80a31a1bad.jpg saved to cache
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6bdd0096-ad93-52e4-902b-b82cf1361f4d
2026-03-30 10:51:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9daf090-1762-5710-8a10-74b851452931 with identifier: VZ72237
2026-03-30 10:51:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9daf090-1762-5710-8a10-74b851452931 with identifier: VZ72237
2026-03-30 10:51:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9daf090-1762-5710-8a10-74b851452931 with identifier: VZ72237 to the API
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VZ72237>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 262,
 'expiration_date': '2026-03-31T15:48:04Z',
 'fuel_type': 'diesel',
 'id': 'a9daf090-1762-5710-8a10-74b851452931',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ72237',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 109249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_982415998ba46624901997bd1fa7fe71.jpg',
                'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_22f132b15e8347eec109cc8201787e66.jpg',
                'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_9874c3380839c80132b3c89fd7d6299c.jpg',
                'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_82a8892de9268780211d2e474123e085.jpg',
                'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_df0801abdc4288efd01fe9d709eb9ffb.jpg',
                'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_ebb51bedded3e3687cc22397da36ec44.jpg',
                'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_f2ae7a461dc1bb938be7d06dcc6a76c8.jpg',
                'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_2fed9fe51a384efc5e59d9c7e94965e4.jpg',
                'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_8eca2b0628f43fbb13fb58a445731e96.jpg',
                'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_9dec4ed8cee282dbf9ace8ede6977e45.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9daf090-1762-5710-8a10-74b851452931/a9daf090-1762-5710-8a10-74b851452931_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2527347,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_982415998ba46624901997bd1fa7fe71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9daf090-1762-5710-8a10-74b851452931/a9daf090-1762-5710-8a10-74b851452931_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2547895,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_22f132b15e8347eec109cc8201787e66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9daf090-1762-5710-8a10-74b851452931/a9daf090-1762-5710-8a10-74b851452931_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2599528,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_9874c3380839c80132b3c89fd7d6299c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9daf090-1762-5710-8a10-74b851452931/a9daf090-1762-5710-8a10-74b851452931_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2287814,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_82a8892de9268780211d2e474123e085.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9daf090-1762-5710-8a10-74b851452931/a9daf090-1762-5710-8a10-74b851452931_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3058543,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_df0801abdc4288efd01fe9d709eb9ffb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9daf090-1762-5710-8a10-74b851452931/a9daf090-1762-5710-8a10-74b851452931_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2970958,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_ebb51bedded3e3687cc22397da36ec44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9daf090-1762-5710-8a10-74b851452931/a9daf090-1762-5710-8a10-74b851452931_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2858627,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_f2ae7a461dc1bb938be7d06dcc6a76c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9daf090-1762-5710-8a10-74b851452931/a9daf090-1762-5710-8a10-74b851452931_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2692586,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_2fed9fe51a384efc5e59d9c7e94965e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9daf090-1762-5710-8a10-74b851452931/a9daf090-1762-5710-8a10-74b851452931_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2753626,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_8eca2b0628f43fbb13fb58a445731e96.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9daf090-1762-5710-8a10-74b851452931/a9daf090-1762-5710-8a10-74b851452931_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2937752,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bd/a9bd298d98cb03c6da15b843728bc601/pa/VZ72237_9dec4ed8cee282dbf9ace8ede6977e45.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion Terrain Tech',
 'transmission': 'automatic',
 'trim': 'BlueMotion Terrain Tech',
 'year': 2016}
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ72237%27 HTTP/1.1" 200 None
2026-03-30 10:51:40 [auto1.de] INFO: Saving data for VZ72237: {'created_time': 1774867900.353177, 'last_price_update_time': 1774867900.353187, 'auction_closing_time': 1774972084.0}
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ72237') HTTP/1.1" 204 0
2026-03-30 10:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_051585062b8f9f87b80eb35e03c4ce07.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_08ff929b8264624d1f4bd171f0d77826.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_08ff929b8264624d1f4bd171f0d77826.jpg not downloaded yet
2026-03-30 10:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_86caa9e284ff8207b9dd3bbf8c6f82b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_a4cad4980ad0556b00034ed9bd36e6c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_3f2308fdd757d71f40e644e2776acbc9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fff3d0>
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_25361166fb86943dd564c471de69061f.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_25361166fb86943dd564c471de69061f.jpg saved to cache
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bdd0096-ad93-52e4-902b-b82cf1361f4d
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee23d0>
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_32096f06b0aec5d8216f318d6a119452.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_32096f06b0aec5d8216f318d6a119452.jpg saved to cache
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37abc846-a139-52a9-aa03-e234924fead9
2026-03-30 10:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_a22521885d43296730adcab071a48aef.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_58a6756ccbeb1a08d1a0c811950261ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_c6e59884a9fccb9de500c6aaf01d6fca.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f09050>
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_051585062b8f9f87b80eb35e03c4ce07.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_051585062b8f9f87b80eb35e03c4ce07.jpg saved to cache
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7546744c-7801-5ea3-8f4e-6b8c006a64c0
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c4e6d0>
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_86caa9e284ff8207b9dd3bbf8c6f82b5.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_86caa9e284ff8207b9dd3bbf8c6f82b5.jpg saved to cache
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7546744c-7801-5ea3-8f4e-6b8c006a64c0
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6c950>
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_a4cad4980ad0556b00034ed9bd36e6c3.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_a4cad4980ad0556b00034ed9bd36e6c3.jpg saved to cache
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37abc846-a139-52a9-aa03-e234924fead9
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7884050>
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_3f2308fdd757d71f40e644e2776acbc9.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_3f2308fdd757d71f40e644e2776acbc9.jpg saved to cache
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7546744c-7801-5ea3-8f4e-6b8c006a64c0
2026-03-30 10:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_13caa52fed7ab38130811b184a38d5ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XH62328> (referer: https://www.auto1.com/v1/car-details-view/XH62328/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef51252d0>
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_a22521885d43296730adcab071a48aef.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_a22521885d43296730adcab071a48aef.jpg saved to cache
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37abc846-a139-52a9-aa03-e234924fead9
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0f710>
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_58a6756ccbeb1a08d1a0c811950261ae.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_58a6756ccbeb1a08d1a0c811950261ae.jpg saved to cache
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37abc846-a139-52a9-aa03-e234924fead9
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ed16d0>
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_c6e59884a9fccb9de500c6aaf01d6fca.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_c6e59884a9fccb9de500c6aaf01d6fca.jpg saved to cache
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37abc846-a139-52a9-aa03-e234924fead9
2026-03-30 10:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_5ccecd6449235a91f45661f83c1a74ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_ee4654cf5fa7cf1c7e42de0198e3e984.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_9266c13ee81969390d8c5ab3fb2a09fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_08ff929b8264624d1f4bd171f0d77826.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0e190>
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_13caa52fed7ab38130811b184a38d5ea.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_13caa52fed7ab38130811b184a38d5ea.jpg saved to cache
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37abc846-a139-52a9-aa03-e234924fead9
2026-03-30 10:51:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b67b633-d850-5696-a59b-5095b7d09494 with identifier: XH62328
2026-03-30 10:51:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b67b633-d850-5696-a59b-5095b7d09494 with scrape type 1
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b67b633-d850-5696-a59b-5095b7d09494
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_3eb6118bb1b402ed74b5ee6fca660077.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_3eb6118bb1b402ed74b5ee6fca660077.jpg not downloaded yet
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_2e5778dbc507e60bd824029ec67e7d39.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_2e5778dbc507e60bd824029ec67e7d39.jpg not downloaded yet
2026-03-30 10:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_f4e794d4bf4c2232690d49b368182f1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_f4e794d4bf4c2232690d49b368182f1c.jpg not downloaded yet
2026-03-30 10:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_fa45adf42140df69c879ea07f89d02be.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_1220e4ea8a0a5f2d23500cdfbf3526b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_ff2742f26c20d337cb2c5871a7f01809.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_ff2742f26c20d337cb2c5871a7f01809.jpg not downloaded yet
2026-03-30 10:51:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eccf10>
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F2d%252F2c2d0ac81a43aea71037f7f66fb812cc%252Fpa%252FTU57543_5ccecd6449235a91f45661f83c1a74ab.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_5ccecd6449235a91f45661f83c1a74ab.jpg saved to cache
2026-03-30 10:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892
2026-03-30 10:51:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892, skipping ID generation
2026-03-30 10:51:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892 with scrape type 1
2026-03-30 10:51:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892 sending to next pipeline
2026-03-30 10:51:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892, identifier: TU57543
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5070350>
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_ee4654cf5fa7cf1c7e42de0198e3e984.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_ee4654cf5fa7cf1c7e42de0198e3e984.jpg saved to cache
2026-03-30 10:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37abc846-a139-52a9-aa03-e234924fead9
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5107150>
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_9266c13ee81969390d8c5ab3fb2a09fb.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_9266c13ee81969390d8c5ab3fb2a09fb.jpg saved to cache
2026-03-30 10:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37abc846-a139-52a9-aa03-e234924fead9
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e8b510>
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_08ff929b8264624d1f4bd171f0d77826.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_08ff929b8264624d1f4bd171f0d77826.jpg saved to cache
2026-03-30 10:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37abc846-a139-52a9-aa03-e234924fead9
2026-03-30 10:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_b75ba43c933ba14bbe8f59d20cd64c54.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_aaa3e1629fb7f29c602c68188355b37b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_aaa3e1629fb7f29c602c68188355b37b.jpg not downloaded yet
2026-03-30 10:51:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892 with identifier: TU57543
2026-03-30 10:51:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892 with identifier: TU57543
2026-03-30 10:51:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c45b70b-cafb-5277-8f8e-8e6c0c5f0892 with identifier: TU57543 to the API
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_5ccecd6449235a91f45661f83c1a74ab.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:28:04Z',
 'fuel_type': 'petrol',
 'id': '6c45b70b-cafb-5277-8f8e-8e6c0c5f0892',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU57543',
 'listing': 'auction',
 'location': 'DE, Mainz',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 50994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_9c705b304924d5bf4cbbbbabc7e913f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_0cf379780d52395c7d7d78ca2979cbca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2648169,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_5ccecd6449235a91f45661f83c1a74ab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_19c54620b17bacded2671a0a85791245.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_22fef60de311d0c20664f8ac6f15e6e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_535cf838e971ff74b9eec48593d7a8ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_89015f6cec83a1c87f3351ae1c0faf82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_543e6153db1fdd832de9dd97dfec6ec3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_9ddcb772fd527840c5e1985e9bb7f4e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c45b70b-cafb-5277-8f8e-8e6c0c5f0892/6c45b70b-cafb-5277-8f8e-8e6c0c5f0892_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/2d/2c2d0ac81a43aea71037f7f66fb812cc/pa/TU57543_f3cd77313ffb2100e6c07b1ea9252e87.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-24',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.2 TCe Energy BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2018}
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU57543%27 HTTP/1.1" 200 None
2026-03-30 10:51:41 [auto1.de] INFO: Saving data for TU57543: {'created_time': 1774867901.845166, 'last_price_update_time': 1774867901.845176, 'auction_closing_time': 1774970884.0}
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU57543') HTTP/1.1" 204 0
2026-03-30 10:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_89c367729a2cac0a021640a64fb97f9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_e49a002eae7fd8bc6ff6ea6891f5d382.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_dda45bc9bcefddc1865a38df1bd71d01.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_f0aa0c88188f2fe8e67fc9380bc1883d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_f0aa0c88188f2fe8e67fc9380bc1883d.jpg not downloaded yet
2026-03-30 10:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_dacb838f91d8aa7f11f14dd95bdd5eef.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN14015> (referer: https://www.auto1.com/v1/car-details-view/BN14015/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_1536f5586b6b9f11957a0b9c04df685c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_1536f5586b6b9f11957a0b9c04df685c.jpg not downloaded yet
2026-03-30 10:51:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595f510>
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_fa45adf42140df69c879ea07f89d02be.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_fa45adf42140df69c879ea07f89d02be.jpg saved to cache
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6bdd0096-ad93-52e4-902b-b82cf1361f4d
2026-03-30 10:51:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a79890>
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_1220e4ea8a0a5f2d23500cdfbf3526b4.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_1220e4ea8a0a5f2d23500cdfbf3526b4.jpg saved to cache
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6bdd0096-ad93-52e4-902b-b82cf1361f4d
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6c3d0>
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_b75ba43c933ba14bbe8f59d20cd64c54.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_b75ba43c933ba14bbe8f59d20cd64c54.jpg saved to cache
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7546744c-7801-5ea3-8f4e-6b8c006a64c0
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_a8fd0cd827c95968aab601811b791e36.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_a8fd0cd827c95968aab601811b791e36.jpg not downloaded yet
2026-03-30 10:51:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_1f825989ab38c0f4a61bbbb59b36646a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_1f825989ab38c0f4a61bbbb59b36646a.jpg not downloaded yet
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d79490>
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_89c367729a2cac0a021640a64fb97f9f.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_89c367729a2cac0a021640a64fb97f9f.jpg saved to cache
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7546744c-7801-5ea3-8f4e-6b8c006a64c0
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6cb10>
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F17%252Fe217f41560b1fecd4ca5c519d714fecc%252Fpa%252FSK74966_e49a002eae7fd8bc6ff6ea6891f5d382.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_e49a002eae7fd8bc6ff6ea6891f5d382.jpg saved to cache
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37abc846-a139-52a9-aa03-e234924fead9
2026-03-30 10:51:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37abc846-a139-52a9-aa03-e234924fead9, skipping ID generation
2026-03-30 10:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37abc846-a139-52a9-aa03-e234924fead9 with scrape type 1
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37abc846-a139-52a9-aa03-e234924fead9 sending to next pipeline
2026-03-30 10:51:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37abc846-a139-52a9-aa03-e234924fead9, identifier: SK74966
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5982690>
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_dda45bc9bcefddc1865a38df1bd71d01.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_dda45bc9bcefddc1865a38df1bd71d01.jpg saved to cache
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7546744c-7801-5ea3-8f4e-6b8c006a64c0
2026-03-30 10:51:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db4750>
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F16%252Fa5162ad938bee39afa4b7a4a14e72a66%252Fpa%252FUZ12630_dacb838f91d8aa7f11f14dd95bdd5eef.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_dacb838f91d8aa7f11f14dd95bdd5eef.jpg saved to cache
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6bdd0096-ad93-52e4-902b-b82cf1361f4d
2026-03-30 10:51:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bdd0096-ad93-52e4-902b-b82cf1361f4d, skipping ID generation
2026-03-30 10:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bdd0096-ad93-52e4-902b-b82cf1361f4d with scrape type 1
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bdd0096-ad93-52e4-902b-b82cf1361f4d sending to next pipeline
2026-03-30 10:51:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bdd0096-ad93-52e4-902b-b82cf1361f4d, identifier: UZ12630
2026-03-30 10:51:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1 with identifier: BN14015
2026-03-30 10:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1 with scrape type 1
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F19%252F9a19da941f47a7e5147b42f27e1d26d8%252Fpa%252FBN14015_c4dda5558c3d58029c2c47a05781de53.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_c4dda5558c3d58029c2c47a05781de53.jpg not downloaded yet
2026-03-30 10:51:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37abc846-a139-52a9-aa03-e234924fead9 with identifier: SK74966
2026-03-30 10:51:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37abc846-a139-52a9-aa03-e234924fead9 with identifier: SK74966
2026-03-30 10:51:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37abc846-a139-52a9-aa03-e234924fead9 with identifier: SK74966 to the API
2026-03-30 10:51:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_e49a002eae7fd8bc6ff6ea6891f5d382.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:50:24Z',
 'fuel_type': 'diesel',
 'id': '37abc846-a139-52a9-aa03-e234924fead9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK74966',
 'listing': 'auction',
 'location': 'DE, Arnsberg',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 180063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_32096f06b0aec5d8216f318d6a119452.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_a4cad4980ad0556b00034ed9bd36e6c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_e49a002eae7fd8bc6ff6ea6891f5d382.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_ee4654cf5fa7cf1c7e42de0198e3e984.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_9266c13ee81969390d8c5ab3fb2a09fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_a22521885d43296730adcab071a48aef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_58a6756ccbeb1a08d1a0c811950261ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_13caa52fed7ab38130811b184a38d5ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_c6e59884a9fccb9de500c6aaf01d6fca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37abc846-a139-52a9-aa03-e234924fead9/37abc846-a139-52a9-aa03-e234924fead9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/17/e217f41560b1fecd4ca5c519d714fecc/pa/SK74966_08ff929b8264624d1f4bd171f0d77826.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 CRDi Style AWD',
 'transmission': 'automatic',
 'trim': 'Style AWD',
 'year': 2015}
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK74966%27 HTTP/1.1" 200 None
2026-03-30 10:51:43 [auto1.de] INFO: Saving data for SK74966: {'created_time': 1774867903.16783, 'last_price_update_time': 1774867903.167841, 'auction_closing_time': 1774972224.0}
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK74966') HTTP/1.1" 204 0
2026-03-30 10:51:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bdd0096-ad93-52e4-902b-b82cf1361f4d with identifier: UZ12630
2026-03-30 10:51:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bdd0096-ad93-52e4-902b-b82cf1361f4d with identifier: UZ12630
2026-03-30 10:51:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bdd0096-ad93-52e4-902b-b82cf1361f4d with identifier: UZ12630 to the API
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_dacb838f91d8aa7f11f14dd95bdd5eef.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:52:23Z',
 'fuel_type': 'petrol',
 'id': '6bdd0096-ad93-52e4-902b-b82cf1361f4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ12630',
 'listing': 'auction',
 'location': 'DE, Oldenburg',
 'make': 'Fiat',
 'model': '500',
 'odometer': 38084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_25361166fb86943dd564c471de69061f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_f5b864262582127a5678ce80a31a1bad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_2fc092b23552851a60412d1c16b3e835.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_05a0a73fa1b8a4e31139be1a88a055c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2619685,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_99ff1ef88bc046da48663efa296f990e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_32316888df19b5213a4a39879d6e79dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2233346,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_1220e4ea8a0a5f2d23500cdfbf3526b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2213374,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_fa45adf42140df69c879ea07f89d02be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2573994,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_dacb838f91d8aa7f11f14dd95bdd5eef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bdd0096-ad93-52e4-902b-b82cf1361f4d/6bdd0096-ad93-52e4-902b-b82cf1361f4d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2700890,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/16/a5162ad938bee39afa4b7a4a14e72a66/pa/UZ12630_10797ab3a15e21ded4f347a7d57879e2.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2020}
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ12630%27 HTTP/1.1" 200 None
2026-03-30 10:51:43 [auto1.de] INFO: Saving data for UZ12630: {'created_time': 1774867903.83964, 'last_price_update_time': 1774867903.83965, 'auction_closing_time': 1774972343.0}
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ12630') HTTP/1.1" 204 0
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_89c9f8a9158ef03c64cb0797d1cf0491.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_89c9f8a9158ef03c64cb0797d1cf0491.jpg not downloaded yet
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F19%252F9a19da941f47a7e5147b42f27e1d26d8%252Fpa%252FBN14015_5271272b01f7269278282d8cf1272e15.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_5271272b01f7269278282d8cf1272e15.jpg not downloaded yet
2026-03-30 10:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD89807/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_aaa3e1629fb7f29c602c68188355b37b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_f4e794d4bf4c2232690d49b368182f1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_1536f5586b6b9f11957a0b9c04df685c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_f0aa0c88188f2fe8e67fc9380bc1883d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_ff2742f26c20d337cb2c5871a7f01809.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F19%252F9a19da941f47a7e5147b42f27e1d26d8%252Fpa%252FBN14015_d9f51048f9a0cabd827b6a994d715bdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_d9f51048f9a0cabd827b6a994d715bdf.jpg not downloaded yet
2026-03-30 10:51:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F19%252F9a19da941f47a7e5147b42f27e1d26d8%252Fpa%252FBN14015_09a9e77e31c868c1d1d322b09aded04f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_09a9e77e31c868c1d1d322b09aded04f.jpg not downloaded yet
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F19%252F9a19da941f47a7e5147b42f27e1d26d8%252Fpa%252FBN14015_af1cd38d2e3a1e98e0838d90c4ef9583.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_af1cd38d2e3a1e98e0838d90c4ef9583.jpg not downloaded yet
2026-03-30 10:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_fd81f68d9ec37928252259bc1bc9a441.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_a3938ed4185f688e07f2b2e668aad1a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_f26170f5edc82c1d413fe6e6eee24642.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_3eb6118bb1b402ed74b5ee6fca660077.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_2e5778dbc507e60bd824029ec67e7d39.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50a7290>
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_aaa3e1629fb7f29c602c68188355b37b.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_aaa3e1629fb7f29c602c68188355b37b.jpg saved to cache
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b67b633-d850-5696-a59b-5095b7d09494
2026-03-30 10:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_c4dda5558c3d58029c2c47a05781de53.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_1f825989ab38c0f4a61bbbb59b36646a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_a8fd0cd827c95968aab601811b791e36.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_af1cd38d2e3a1e98e0838d90c4ef9583.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fea650>
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_f4e794d4bf4c2232690d49b368182f1c.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_f4e794d4bf4c2232690d49b368182f1c.jpg saved to cache
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b67b633-d850-5696-a59b-5095b7d09494
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f82b10>
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_1536f5586b6b9f11957a0b9c04df685c.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_1536f5586b6b9f11957a0b9c04df685c.jpg saved to cache
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b67b633-d850-5696-a59b-5095b7d09494
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a8edd0>
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_f0aa0c88188f2fe8e67fc9380bc1883d.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_f0aa0c88188f2fe8e67fc9380bc1883d.jpg saved to cache
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b67b633-d850-5696-a59b-5095b7d09494
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5071050>
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_ff2742f26c20d337cb2c5871a7f01809.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_ff2742f26c20d337cb2c5871a7f01809.jpg saved to cache
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b67b633-d850-5696-a59b-5095b7d09494
2026-03-30 10:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_89c9f8a9158ef03c64cb0797d1cf0491.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_5271272b01f7269278282d8cf1272e15.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b36550>
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_fd81f68d9ec37928252259bc1bc9a441.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_fd81f68d9ec37928252259bc1bc9a441.jpg saved to cache
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7546744c-7801-5ea3-8f4e-6b8c006a64c0
2026-03-30 10:51:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef599f9d0>
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_a3938ed4185f688e07f2b2e668aad1a7.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_a3938ed4185f688e07f2b2e668aad1a7.jpg saved to cache
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7546744c-7801-5ea3-8f4e-6b8c006a64c0
2026-03-30 10:51:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5118a90>
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbe%252Fa9beba0881f0f434080766d485892c5d%252Fpa%252FDP32279_f26170f5edc82c1d413fe6e6eee24642.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_f26170f5edc82c1d413fe6e6eee24642.jpg saved to cache
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7546744c-7801-5ea3-8f4e-6b8c006a64c0
2026-03-30 10:51:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7546744c-7801-5ea3-8f4e-6b8c006a64c0, skipping ID generation
2026-03-30 10:51:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7546744c-7801-5ea3-8f4e-6b8c006a64c0 with scrape type 1
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7546744c-7801-5ea3-8f4e-6b8c006a64c0 sending to next pipeline
2026-03-30 10:51:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7546744c-7801-5ea3-8f4e-6b8c006a64c0, identifier: DP32279
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e4acd0>
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_3eb6118bb1b402ed74b5ee6fca660077.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_3eb6118bb1b402ed74b5ee6fca660077.jpg saved to cache
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b67b633-d850-5696-a59b-5095b7d09494
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a25790>
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_2e5778dbc507e60bd824029ec67e7d39.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_2e5778dbc507e60bd824029ec67e7d39.jpg saved to cache
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b67b633-d850-5696-a59b-5095b7d09494
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e29e10>
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1/36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F19%252F9a19da941f47a7e5147b42f27e1d26d8%252Fpa%252FBN14015_c4dda5558c3d58029c2c47a05781de53.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_c4dda5558c3d58029c2c47a05781de53.jpg saved to cache
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef511a5d0>
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_1f825989ab38c0f4a61bbbb59b36646a.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_1f825989ab38c0f4a61bbbb59b36646a.jpg saved to cache
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b67b633-d850-5696-a59b-5095b7d09494
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dbafd0>
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_a8fd0cd827c95968aab601811b791e36.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_a8fd0cd827c95968aab601811b791e36.jpg saved to cache
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b67b633-d850-5696-a59b-5095b7d09494
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef599d090>
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1/36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F19%252F9a19da941f47a7e5147b42f27e1d26d8%252Fpa%252FBN14015_af1cd38d2e3a1e98e0838d90c4ef9583.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_af1cd38d2e3a1e98e0838d90c4ef9583.jpg saved to cache
2026-03-30 10:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1
2026-03-30 10:51:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7546744c-7801-5ea3-8f4e-6b8c006a64c0 with identifier: DP32279
2026-03-30 10:51:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7546744c-7801-5ea3-8f4e-6b8c006a64c0 with identifier: DP32279
2026-03-30 10:51:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7546744c-7801-5ea3-8f4e-6b8c006a64c0 with identifier: DP32279 to the API
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_f26170f5edc82c1d413fe6e6eee24642.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:59:38Z',
 'fuel_type': 'petrol',
 'id': '7546744c-7801-5ea3-8f4e-6b8c006a64c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP32279',
 'listing': 'auction',
 'location': 'DE, Gütersloh',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 173117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2977004,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_f26170f5edc82c1d413fe6e6eee24642.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2981866,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_a3938ed4185f688e07f2b2e668aad1a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_dda45bc9bcefddc1865a38df1bd71d01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_b75ba43c933ba14bbe8f59d20cd64c54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_89c367729a2cac0a021640a64fb97f9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3034243,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_fd81f68d9ec37928252259bc1bc9a441.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_051585062b8f9f87b80eb35e03c4ce07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_86caa9e284ff8207b9dd3bbf8c6f82b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_3f2308fdd757d71f40e644e2776acbc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7546744c-7801-5ea3-8f4e-6b8c006a64c0/7546744c-7801-5ea3-8f4e-6b8c006a64c0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/be/a9beba0881f0f434080766d485892c5d/pa/DP32279_80615dbfcac2f9327c61b31665659377.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda CR-V 2.0 VTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2011}
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP32279%27 HTTP/1.1" 200 None
2026-03-30 10:51:45 [auto1.de] INFO: Saving data for DP32279: {'created_time': 1774867905.376668, 'last_price_update_time': 1774867905.376677, 'auction_closing_time': 1774972778.0}
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP32279') HTTP/1.1" 204 0
2026-03-30 10:51:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2b310>
2026-03-30 10:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fc0%252F6dc02ac5682fe6b2ff6645564b6846f7%252Fpa%252FXH62328_89c9f8a9158ef03c64cb0797d1cf0491.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_89c9f8a9158ef03c64cb0797d1cf0491.jpg saved to cache
2026-03-30 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b67b633-d850-5696-a59b-5095b7d09494
2026-03-30 10:51:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b67b633-d850-5696-a59b-5095b7d09494, skipping ID generation
2026-03-30 10:51:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b67b633-d850-5696-a59b-5095b7d09494 with scrape type 1
2026-03-30 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b67b633-d850-5696-a59b-5095b7d09494 sending to next pipeline
2026-03-30 10:51:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b67b633-d850-5696-a59b-5095b7d09494, identifier: XH62328
2026-03-30 10:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7e610>
2026-03-30 10:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1/36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F19%252F9a19da941f47a7e5147b42f27e1d26d8%252Fpa%252FBN14015_5271272b01f7269278282d8cf1272e15.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_5271272b01f7269278282d8cf1272e15.jpg saved to cache
2026-03-30 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1
2026-03-30 10:51:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b67b633-d850-5696-a59b-5095b7d09494 with identifier: XH62328
2026-03-30 10:51:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b67b633-d850-5696-a59b-5095b7d09494 with identifier: XH62328
2026-03-30 10:51:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b67b633-d850-5696-a59b-5095b7d09494 with identifier: XH62328 to the API
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_89c9f8a9158ef03c64cb0797d1cf0491.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:02:57Z',
 'fuel_type': 'diesel',
 'id': '9b67b633-d850-5696-a59b-5095b7d09494',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH62328',
 'listing': 'auction',
 'location': 'DE, Kaufbeuren',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 139776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_3eb6118bb1b402ed74b5ee6fca660077.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_2e5778dbc507e60bd824029ec67e7d39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_f4e794d4bf4c2232690d49b368182f1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_ff2742f26c20d337cb2c5871a7f01809.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_aaa3e1629fb7f29c602c68188355b37b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_f0aa0c88188f2fe8e67fc9380bc1883d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_1536f5586b6b9f11957a0b9c04df685c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_a8fd0cd827c95968aab601811b791e36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_1f825989ab38c0f4a61bbbb59b36646a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b67b633-d850-5696-a59b-5095b7d09494/9b67b633-d850-5696-a59b-5095b7d09494_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/c0/6dc02ac5682fe6b2ff6645564b6846f7/pa/XH62328_89c9f8a9158ef03c64cb0797d1cf0491.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH62328%27 HTTP/1.1" 200 None
2026-03-30 10:51:45 [auto1.de] INFO: Saving data for XH62328: {'created_time': 1774867905.992488, 'last_price_update_time': 1774867905.9925, 'auction_closing_time': 1774969377.0}
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH62328') HTTP/1.1" 204 0
2026-03-30 10:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_09a9e77e31c868c1d1d322b09aded04f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_d9f51048f9a0cabd827b6a994d715bdf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c3fcd0>
2026-03-30 10:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1/36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F19%252F9a19da941f47a7e5147b42f27e1d26d8%252Fpa%252FBN14015_09a9e77e31c868c1d1d322b09aded04f.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_09a9e77e31c868c1d1d322b09aded04f.jpg saved to cache
2026-03-30 10:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1
2026-03-30 10:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef78a8ad0>
2026-03-30 10:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1/36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F19%252F9a19da941f47a7e5147b42f27e1d26d8%252Fpa%252FBN14015_d9f51048f9a0cabd827b6a994d715bdf.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_d9f51048f9a0cabd827b6a994d715bdf.jpg saved to cache
2026-03-30 10:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1
2026-03-30 10:51:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1, skipping ID generation
2026-03-30 10:51:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1 with scrape type 1
2026-03-30 10:51:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1 sending to next pipeline
2026-03-30 10:51:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1, identifier: BN14015
2026-03-30 10:51:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1 with identifier: BN14015
2026-03-30 10:51:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1 with identifier: BN14015
2026-03-30 10:51:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1 with identifier: BN14015 to the API
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_d9f51048f9a0cabd827b6a994d715bdf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:15:53Z',
 'fuel_type': 'diesel',
 'id': '36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN14015',
 'listing': 'auction',
 'location': 'DE, Delmenhorst',
 'make': 'Chrysler',
 'model': '300 C',
 'odometer': 237881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1/36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_c4dda5558c3d58029c2c47a05781de53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1/36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_5271272b01f7269278282d8cf1272e15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1/36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_d9f51048f9a0cabd827b6a994d715bdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1/36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_09a9e77e31c868c1d1d322b09aded04f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1/36a5e9d8-3fdd-5487-80c1-5e3eb61a65d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/19/9a19da941f47a7e5147b42f27e1d26d8/pa/BN14015_af1cd38d2e3a1e98e0838d90c4ef9583.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-01-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Chrysler 300 C 3.0 CRD',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN14015%27 HTTP/1.1" 200 None
2026-03-30 10:51:46 [auto1.de] INFO: Saving data for BN14015: {'created_time': 1774867906.899169, 'last_price_update_time': 1774867906.899183, 'auction_closing_time': 1774970153.0}
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN14015') HTTP/1.1" 204 0
2026-03-30 10:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR52532/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_01e9d686ed6d423cda6c0e897814517d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50fc710>
2026-03-30 10:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_01e9d686ed6d423cda6c0e897814517d.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_01e9d686ed6d423cda6c0e897814517d.jpg saved to cache
2026-03-30 10:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fda08c46-4c8e-527d-acf5-bec11a7e521c
2026-03-30 10:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC12973/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD89807> (referer: https://www.auto1.com/v1/car-details-view/MD89807/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM23326/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2e6e57b-81cd-50ba-88c6-2592c4bb6495 with identifier: MD89807
2026-03-30 10:51:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2e6e57b-81cd-50ba-88c6-2592c4bb6495 with scrape type 1
2026-03-30 10:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2e6e57b-81cd-50ba-88c6-2592c4bb6495
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_40463c3ef266890055b3b8ce28b41a54.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_40463c3ef266890055b3b8ce28b41a54.jpg not downloaded yet
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_41f01fb3b2324cccbe24c0ec0bdade1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_41f01fb3b2324cccbe24c0ec0bdade1b.jpg not downloaded yet
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_bb9e0dec5cf29350b04c0dd0fd18cda6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_bb9e0dec5cf29350b04c0dd0fd18cda6.jpg not downloaded yet
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_975bfa43ad7cb8f195b9d107afb1f66d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_975bfa43ad7cb8f195b9d107afb1f66d.jpg not downloaded yet
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_bb7556e783eb27b95a56d1420c40ce91.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_bb7556e783eb27b95a56d1420c40ce91.jpg not downloaded yet
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_f141c02db8fb7e860ede092f6b7317f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_f141c02db8fb7e860ede092f6b7317f5.jpg not downloaded yet
2026-03-30 10:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS69347> (referer: https://www.auto1.com/v1/car-details-view/BS69347/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_c7cf2d4ce9879bd36a384915dc3cae76.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_c7cf2d4ce9879bd36a384915dc3cae76.jpg not downloaded yet
2026-03-30 10:51:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_8702b657ca10d1f221eb10780719166b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_8702b657ca10d1f221eb10780719166b.jpg not downloaded yet
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_ac8fdc480d40ad892838698c1a728d4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_ac8fdc480d40ad892838698c1a728d4b.jpg not downloaded yet
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_ed78ea7edde0f8dbd26cb2b656984b71.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_ed78ea7edde0f8dbd26cb2b656984b71.jpg not downloaded yet
2026-03-30 10:51:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 309b69f4-c26f-52ba-8290-1848dda00512 with identifier: BS69347
2026-03-30 10:51:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 309b69f4-c26f-52ba-8290-1848dda00512 with scrape type 1
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 309b69f4-c26f-52ba-8290-1848dda00512
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_37e0b6ba776fbd3f0aa9c27fe1c5e851.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_37e0b6ba776fbd3f0aa9c27fe1c5e851.jpg not downloaded yet
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_0d643f96c29bb857eb496ee2abe4d537.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_0d643f96c29bb857eb496ee2abe4d537.jpg not downloaded yet
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_f7ef10d90c95b0285e8a39949cf453c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_f7ef10d90c95b0285e8a39949cf453c3.jpg not downloaded yet
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_5420093dbf7770c300af9c8bd3836daa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_5420093dbf7770c300af9c8bd3836daa.jpg not downloaded yet
2026-03-30 10:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_dcad9d354f72f2e20083222722e40220.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_9e9cad428b45e353126428a4dcd68753.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_9e9cad428b45e353126428a4dcd68753.jpg not downloaded yet
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_dba34d8512153b4be82441b1a27eacc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_dba34d8512153b4be82441b1a27eacc9.jpg not downloaded yet
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_f96e09574410fc3b8092c163405fdf3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_f96e09574410fc3b8092c163405fdf3e.jpg not downloaded yet
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_a787d961440a8df5866052310a949f70.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_a787d961440a8df5866052310a949f70.jpg not downloaded yet
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_1c9d95be81f08786fbe136909ca485b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_1c9d95be81f08786fbe136909ca485b4.jpg not downloaded yet
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_dacb242babef8bd65d398b74506d03f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_dacb242babef8bd65d398b74506d03f3.jpg not downloaded yet
2026-03-30 10:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_4fb795a42d614d203ffebb06d5768b6c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e4ac50>
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_dcad9d354f72f2e20083222722e40220.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_dcad9d354f72f2e20083222722e40220.jpg saved to cache
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fda08c46-4c8e-527d-acf5-bec11a7e521c
2026-03-30 10:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_f7ef10d90c95b0285e8a39949cf453c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd2a10>
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_4fb795a42d614d203ffebb06d5768b6c.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_4fb795a42d614d203ffebb06d5768b6c.jpg saved to cache
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fda08c46-4c8e-527d-acf5-bec11a7e521c
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dee550>
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_f7ef10d90c95b0285e8a39949cf453c3.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_f7ef10d90c95b0285e8a39949cf453c3.jpg saved to cache
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 309b69f4-c26f-52ba-8290-1848dda00512
2026-03-30 10:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR13013/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_f141c02db8fb7e860ede092f6b7317f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_1c9d95be81f08786fbe136909ca485b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_dba34d8512153b4be82441b1a27eacc9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_dacb242babef8bd65d398b74506d03f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fd3550>
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_f141c02db8fb7e860ede092f6b7317f5.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_f141c02db8fb7e860ede092f6b7317f5.jpg saved to cache
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2e6e57b-81cd-50ba-88c6-2592c4bb6495
2026-03-30 10:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_9e9cad428b45e353126428a4dcd68753.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_f96e09574410fc3b8092c163405fdf3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_a787d961440a8df5866052310a949f70.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_5420093dbf7770c300af9c8bd3836daa.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b31110>
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_1c9d95be81f08786fbe136909ca485b4.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_1c9d95be81f08786fbe136909ca485b4.jpg saved to cache
2026-03-30 10:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 309b69f4-c26f-52ba-8290-1848dda00512
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a78e10>
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_dba34d8512153b4be82441b1a27eacc9.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_dba34d8512153b4be82441b1a27eacc9.jpg saved to cache
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 309b69f4-c26f-52ba-8290-1848dda00512
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a35490>
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_dacb242babef8bd65d398b74506d03f3.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_dacb242babef8bd65d398b74506d03f3.jpg saved to cache
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 309b69f4-c26f-52ba-8290-1848dda00512
2026-03-30 10:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL38495> (referer: https://www.auto1.com/v1/car-details-view/NL38495/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5091ad0>
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_9e9cad428b45e353126428a4dcd68753.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_9e9cad428b45e353126428a4dcd68753.jpg saved to cache
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 309b69f4-c26f-52ba-8290-1848dda00512
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f08050>
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_f96e09574410fc3b8092c163405fdf3e.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_f96e09574410fc3b8092c163405fdf3e.jpg saved to cache
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 309b69f4-c26f-52ba-8290-1848dda00512
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6af90>
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_a787d961440a8df5866052310a949f70.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_a787d961440a8df5866052310a949f70.jpg saved to cache
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 309b69f4-c26f-52ba-8290-1848dda00512
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f09050>
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_5420093dbf7770c300af9c8bd3836daa.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_5420093dbf7770c300af9c8bd3836daa.jpg saved to cache
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 309b69f4-c26f-52ba-8290-1848dda00512
2026-03-30 10:51:49 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 9508 | hits on page: 40
2026-03-30 10:51:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_ac8fdc480d40ad892838698c1a728d4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: HK63697
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK63697%27 HTTP/1.1" 200 None
2026-03-30 10:51:49 [auto1.de] INFO: Scrape type for HK63697: 0
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: VZ61460
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: MJ46471
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ46471%27 HTTP/1.1" 200 None
2026-03-30 10:51:49 [auto1.de] INFO: Scrape type for MJ46471: 1
2026-03-30 10:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_37e0b6ba776fbd3f0aa9c27fe1c5e851.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_0d643f96c29bb857eb496ee2abe4d537.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: PT32058
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: BP66630
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP66630%27 HTTP/1.1" 200 None
2026-03-30 10:51:49 [auto1.de] INFO: Scrape type for BP66630: 1
2026-03-30 10:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bb30c04-f922-5d65-8448-05eca6dc9e25 with identifier: NL38495
2026-03-30 10:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bb30c04-f922-5d65-8448-05eca6dc9e25 with scrape type 1
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6bb30c04-f922-5d65-8448-05eca6dc9e25
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F1f%252F4e1fca55ea210105aa0a04a0ce9a51bb%252Fpa%252FNL38495_be272d87064b90b5eb62dbdcb9697ea0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_be272d87064b90b5eb62dbdcb9697ea0.jpg not downloaded yet
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: MJ72325
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ72325%27 HTTP/1.1" 200 None
2026-03-30 10:51:49 [auto1.de] INFO: Scrape type for MJ72325: 1
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F1f%252F4e1fca55ea210105aa0a04a0ce9a51bb%252Fpa%252FNL38495_589ff361871e5434fb27ab027430f149.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_589ff361871e5434fb27ab027430f149.jpg not downloaded yet
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a94190>
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_ac8fdc480d40ad892838698c1a728d4b.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_ac8fdc480d40ad892838698c1a728d4b.jpg saved to cache
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2e6e57b-81cd-50ba-88c6-2592c4bb6495
2026-03-30 10:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS03545/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:49 [auto1.de] INFO: Found listing with ID: SP39385
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP39385%27 HTTP/1.1" 200 None
2026-03-30 10:51:49 [auto1.de] INFO: Scrape type for SP39385: 2
2026-03-30 10:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a7453c-d7f7-55dc-ba53-4dd582bbda5a with identifier: SP39385
2026-03-30 10:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a7453c-d7f7-55dc-ba53-4dd582bbda5a with scrape type 2
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40a7453c-d7f7-55dc-ba53-4dd582bbda5a with scrape type 2
2026-03-30 10:51:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40a7453c-d7f7-55dc-ba53-4dd582bbda5a, identifier: SP39385
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F1f%252F4e1fca55ea210105aa0a04a0ce9a51bb%252Fpa%252FNL38495_f35a46c49d0091964cb0525431734a19.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_f35a46c49d0091964cb0525431734a19.jpg not downloaded yet
2026-03-30 10:51:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40a7453c-d7f7-55dc-ba53-4dd582bbda5a with identifier: SP39385
2026-03-30 10:51:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40a7453c-d7f7-55dc-ba53-4dd582bbda5a with identifier: SP39385
2026-03-30 10:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40a7453c-d7f7-55dc-ba53-4dd582bbda5a with identifier: SP39385 to the API
2026-03-30 10:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-31T15:53:18Z',
 'fuel_type': 'petrol',
 'id': '40a7453c-d7f7-55dc-ba53-4dd582bbda5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP39385',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 102707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-26',
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.6 PureTech Be Chic',
 'transmission': 'automatic',
 'trim': 'Be Chic',
 'year': 2019}
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP39385%27 HTTP/1.1" 200 None
2026-03-30 10:51:50 [auto1.de] INFO: Saving data for SP39385: {'auction_closing_time': 1774972398.0, 'created_time': 1774292532.357115, 'last_price_update_time': 1774867910.212434}
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP39385') HTTP/1.1" 204 0
2026-03-30 10:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7d3d0>
2026-03-30 10:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_37e0b6ba776fbd3f0aa9c27fe1c5e851.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_37e0b6ba776fbd3f0aa9c27fe1c5e851.jpg saved to cache
2026-03-30 10:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 309b69f4-c26f-52ba-8290-1848dda00512
2026-03-30 10:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b01090>
2026-03-30 10:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F4e%252F4a4ed415a0ccb8771a11c13b9d94759e%252Fpa%252FBS69347_0d643f96c29bb857eb496ee2abe4d537.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_0d643f96c29bb857eb496ee2abe4d537.jpg saved to cache
2026-03-30 10:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 309b69f4-c26f-52ba-8290-1848dda00512
2026-03-30 10:51:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 309b69f4-c26f-52ba-8290-1848dda00512, skipping ID generation
2026-03-30 10:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 309b69f4-c26f-52ba-8290-1848dda00512 with scrape type 1
2026-03-30 10:51:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 309b69f4-c26f-52ba-8290-1848dda00512 sending to next pipeline
2026-03-30 10:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 309b69f4-c26f-52ba-8290-1848dda00512, identifier: BS69347
2026-03-30 10:51:50 [auto1.de] INFO: Found listing with ID: YZ91982
2026-03-30 10:51:50 [auto1.de] INFO: Found listing with ID: ZA18764
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA18764%27 HTTP/1.1" 200 None
2026-03-30 10:51:50 [auto1.de] INFO: Scrape type for ZA18764: 2
2026-03-30 10:51:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95bef06b-f272-5a52-8fe0-71530d5ed584 with identifier: ZA18764
2026-03-30 10:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95bef06b-f272-5a52-8fe0-71530d5ed584 with scrape type 2
2026-03-30 10:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95bef06b-f272-5a52-8fe0-71530d5ed584 with scrape type 2
2026-03-30 10:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95bef06b-f272-5a52-8fe0-71530d5ed584, identifier: ZA18764
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F1f%252F4e1fca55ea210105aa0a04a0ce9a51bb%252Fpa%252FNL38495_21f9c179da3c94b210e5ea38f559f303.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_21f9c179da3c94b210e5ea38f559f303.jpg not downloaded yet
2026-03-30 10:51:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 309b69f4-c26f-52ba-8290-1848dda00512 with identifier: BS69347
2026-03-30 10:51:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 309b69f4-c26f-52ba-8290-1848dda00512 with identifier: BS69347
2026-03-30 10:51:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 309b69f4-c26f-52ba-8290-1848dda00512 with identifier: BS69347 to the API
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_0d643f96c29bb857eb496ee2abe4d537.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:57:25Z',
 'fuel_type': 'petrol',
 'id': '309b69f4-c26f-52ba-8290-1848dda00512',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS69347',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 70527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_37e0b6ba776fbd3f0aa9c27fe1c5e851.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_0d643f96c29bb857eb496ee2abe4d537.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_f7ef10d90c95b0285e8a39949cf453c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_5420093dbf7770c300af9c8bd3836daa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_9e9cad428b45e353126428a4dcd68753.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_dba34d8512153b4be82441b1a27eacc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_f96e09574410fc3b8092c163405fdf3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_a787d961440a8df5866052310a949f70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_1c9d95be81f08786fbe136909ca485b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_309b69f4-c26f-52ba-8290-1848dda00512/309b69f4-c26f-52ba-8290-1848dda00512_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/4e/4a4ed415a0ccb8771a11c13b9d94759e/pa/BS69347_dacb242babef8bd65d398b74506d03f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2020}
2026-03-30 10:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS69347%27 HTTP/1.1" 200 None
2026-03-30 10:51:51 [auto1.de] INFO: Saving data for BS69347: {'created_time': 1774867911.007724, 'last_price_update_time': 1774867911.007733, 'auction_closing_time': 1774972645.0}
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS69347') HTTP/1.1" 204 0
2026-03-30 10:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_c7cf2d4ce9879bd36a384915dc3cae76.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_bb7556e783eb27b95a56d1420c40ce91.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95bef06b-f272-5a52-8fe0-71530d5ed584 with identifier: ZA18764
2026-03-30 10:51:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95bef06b-f272-5a52-8fe0-71530d5ed584 with identifier: ZA18764
2026-03-30 10:51:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95bef06b-f272-5a52-8fe0-71530d5ed584 with identifier: ZA18764 to the API
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:23:10Z',
 'fuel_type': 'diesel',
 'id': '95bef06b-f272-5a52-8fe0-71530d5ed584',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA18764',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 281166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-22',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA18764%27 HTTP/1.1" 200 None
2026-03-30 10:51:51 [auto1.de] INFO: Saving data for ZA18764: {'auction_closing_time': 1774970590.0, 'created_time': 1773725769.581657, 'last_price_update_time': 1774867911.384228}
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA18764') HTTP/1.1" 204 0
2026-03-30 10:51:51 [auto1.de] INFO: Found listing with ID: RP13899
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP13899%27 HTTP/1.1" 200 None
2026-03-30 10:51:51 [auto1.de] INFO: Scrape type for RP13899: 1
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F1f%252F4e1fca55ea210105aa0a04a0ce9a51bb%252Fpa%252FNL38495_0e90766f03f8d5b2da015a61a19e183e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_0e90766f03f8d5b2da015a61a19e183e.jpg not downloaded yet
2026-03-30 10:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP95979/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_589ff361871e5434fb27ab027430f149.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:51 [auto1.de] INFO: Found listing with ID: SC15486
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC15486%27 HTTP/1.1" 200 None
2026-03-30 10:51:51 [auto1.de] INFO: Scrape type for SC15486: 2
2026-03-30 10:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea093f56-6ceb-561d-b61a-e2883be64073 with identifier: SC15486
2026-03-30 10:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea093f56-6ceb-561d-b61a-e2883be64073 with scrape type 2
2026-03-30 10:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea093f56-6ceb-561d-b61a-e2883be64073 with scrape type 2
2026-03-30 10:51:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea093f56-6ceb-561d-b61a-e2883be64073, identifier: SC15486
2026-03-30 10:51:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea093f56-6ceb-561d-b61a-e2883be64073 with identifier: SC15486
2026-03-30 10:51:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea093f56-6ceb-561d-b61a-e2883be64073 with identifier: SC15486
2026-03-30 10:51:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea093f56-6ceb-561d-b61a-e2883be64073 with identifier: SC15486 to the API
2026-03-30 10:51:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:17:10Z',
 'fuel_type': 'petrol',
 'id': 'ea093f56-6ceb-561d-b61a-e2883be64073',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC15486',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 157030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TSI GTI',
 'transmission': 'manual',
 'trim': 'GTI',
 'year': 2011}
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC15486%27 HTTP/1.1" 200 None
2026-03-30 10:51:52 [auto1.de] INFO: Saving data for SC15486: {'auction_closing_time': 1774970230.0, 'created_time': 1773135354.314331, 'last_price_update_time': 1774867912.256278}
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC15486') HTTP/1.1" 204 0
2026-03-30 10:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee1910>
2026-03-30 10:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_c7cf2d4ce9879bd36a384915dc3cae76.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_c7cf2d4ce9879bd36a384915dc3cae76.jpg saved to cache
2026-03-30 10:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2e6e57b-81cd-50ba-88c6-2592c4bb6495
2026-03-30 10:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ad5d50>
2026-03-30 10:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_bb7556e783eb27b95a56d1420c40ce91.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_bb7556e783eb27b95a56d1420c40ce91.jpg saved to cache
2026-03-30 10:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2e6e57b-81cd-50ba-88c6-2592c4bb6495
2026-03-30 10:51:52 [auto1.de] INFO: Found listing with ID: SS95122
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS95122%27 HTTP/1.1" 200 None
2026-03-30 10:51:52 [auto1.de] INFO: Scrape type for SS95122: 1
2026-03-30 10:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_f35a46c49d0091964cb0525431734a19.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e76bd0>
2026-03-30 10:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bb30c04-f922-5d65-8448-05eca6dc9e25/6bb30c04-f922-5d65-8448-05eca6dc9e25_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F1f%252F4e1fca55ea210105aa0a04a0ce9a51bb%252Fpa%252FNL38495_589ff361871e5434fb27ab027430f149.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_589ff361871e5434fb27ab027430f149.jpg saved to cache
2026-03-30 10:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6bb30c04-f922-5d65-8448-05eca6dc9e25
2026-03-30 10:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_21f9c179da3c94b210e5ea38f559f303.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:52 [auto1.de] INFO: Found listing with ID: WA56629
2026-03-30 10:51:52 [auto1.de] INFO: Found listing with ID: JL46781
2026-03-30 10:51:52 [auto1.de] INFO: Found listing with ID: BB80176
2026-03-30 10:51:52 [auto1.de] INFO: Found listing with ID: JT25474
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT25474%27 HTTP/1.1" 200 None
2026-03-30 10:51:52 [auto1.de] INFO: Scrape type for JT25474: 2
2026-03-30 10:51:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a57bed6-6a39-541d-92ed-2612f9974ee2 with identifier: JT25474
2026-03-30 10:51:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a57bed6-6a39-541d-92ed-2612f9974ee2 with scrape type 2
2026-03-30 10:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a57bed6-6a39-541d-92ed-2612f9974ee2 with scrape type 2
2026-03-30 10:51:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a57bed6-6a39-541d-92ed-2612f9974ee2, identifier: JT25474
2026-03-30 10:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MK63509/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a57bed6-6a39-541d-92ed-2612f9974ee2 with identifier: JT25474
2026-03-30 10:51:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a57bed6-6a39-541d-92ed-2612f9974ee2 with identifier: JT25474
2026-03-30 10:51:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a57bed6-6a39-541d-92ed-2612f9974ee2 with identifier: JT25474 to the API
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:02:03Z',
 'fuel_type': 'petrol',
 'id': '9a57bed6-6a39-541d-92ed-2612f9974ee2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT25474',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 134958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-02',
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT25474%27 HTTP/1.1" 200 None
2026-03-30 10:51:52 [auto1.de] INFO: Saving data for JT25474: {'auction_closing_time': 1774969323.0, 'created_time': 1774294220.143459, 'last_price_update_time': 1774867912.9759}
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT25474') HTTP/1.1" 204 0
2026-03-30 10:51:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:53 [auto1.de] INFO: Found listing with ID: NU82917
2026-03-30 10:51:53 [auto1.de] INFO: Found listing with ID: HV98245
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV98245%27 HTTP/1.1" 200 None
2026-03-30 10:51:53 [auto1.de] INFO: Scrape type for HV98245: 2
2026-03-30 10:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a26c884-d131-5efe-bc3c-859092e925ac with identifier: HV98245
2026-03-30 10:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a26c884-d131-5efe-bc3c-859092e925ac with scrape type 2
2026-03-30 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a26c884-d131-5efe-bc3c-859092e925ac with scrape type 2
2026-03-30 10:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a26c884-d131-5efe-bc3c-859092e925ac, identifier: HV98245
2026-03-30 10:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a26c884-d131-5efe-bc3c-859092e925ac with identifier: HV98245
2026-03-30 10:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a26c884-d131-5efe-bc3c-859092e925ac with identifier: HV98245
2026-03-30 10:51:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a26c884-d131-5efe-bc3c-859092e925ac with identifier: HV98245 to the API
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:31:36Z',
 'fuel_type': 'petrol',
 'id': '8a26c884-d131-5efe-bc3c-859092e925ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV98245',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 74067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2023}
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV98245%27 HTTP/1.1" 200 None
2026-03-30 10:51:53 [auto1.de] INFO: Saving data for HV98245: {'auction_closing_time': 1774971096.0, 'created_time': 1773230205.597262, 'last_price_update_time': 1774867913.551668}
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV98245') HTTP/1.1" 204 0
2026-03-30 10:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_0e90766f03f8d5b2da015a61a19e183e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:53 [auto1.de] INFO: Found listing with ID: PN04057
2026-03-30 10:51:53 [auto1.de] INFO: Found listing with ID: XJ50079
2026-03-30 10:51:53 [auto1.de] INFO: Found listing with ID: YX18346
2026-03-30 10:51:53 [auto1.de] INFO: Found listing with ID: WZ74602
2026-03-30 10:51:53 [auto1.de] INFO: Found listing with ID: XA87570
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA87570%27 HTTP/1.1" 200 None
2026-03-30 10:51:53 [auto1.de] INFO: Scrape type for XA87570: 2
2026-03-30 10:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: febb91e1-5022-5dbf-a75f-53b832a20920 with identifier: XA87570
2026-03-30 10:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item febb91e1-5022-5dbf-a75f-53b832a20920 with scrape type 2
2026-03-30 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item febb91e1-5022-5dbf-a75f-53b832a20920 with scrape type 2
2026-03-30 10:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: febb91e1-5022-5dbf-a75f-53b832a20920, identifier: XA87570
2026-03-30 10:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c42a10>
2026-03-30 10:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bb30c04-f922-5d65-8448-05eca6dc9e25/6bb30c04-f922-5d65-8448-05eca6dc9e25_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F1f%252F4e1fca55ea210105aa0a04a0ce9a51bb%252Fpa%252FNL38495_f35a46c49d0091964cb0525431734a19.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_f35a46c49d0091964cb0525431734a19.jpg saved to cache
2026-03-30 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6bb30c04-f922-5d65-8448-05eca6dc9e25
2026-03-30 10:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5050b90>
2026-03-30 10:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bb30c04-f922-5d65-8448-05eca6dc9e25/6bb30c04-f922-5d65-8448-05eca6dc9e25_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F1f%252F4e1fca55ea210105aa0a04a0ce9a51bb%252Fpa%252FNL38495_21f9c179da3c94b210e5ea38f559f303.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_21f9c179da3c94b210e5ea38f559f303.jpg saved to cache
2026-03-30 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6bb30c04-f922-5d65-8448-05eca6dc9e25
2026-03-30 10:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: febb91e1-5022-5dbf-a75f-53b832a20920 with identifier: XA87570
2026-03-30 10:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: febb91e1-5022-5dbf-a75f-53b832a20920 with identifier: XA87570
2026-03-30 10:51:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: febb91e1-5022-5dbf-a75f-53b832a20920 with identifier: XA87570 to the API
2026-03-30 10:51:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:56:18Z',
 'fuel_type': 'diesel',
 'id': 'febb91e1-5022-5dbf-a75f-53b832a20920',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA87570',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 422550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-18',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2010}
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA87570%27 HTTP/1.1" 200 None
2026-03-30 10:51:54 [auto1.de] INFO: Saving data for XA87570: {'auction_closing_time': 1774972578.0, 'created_time': 1773341629.730274, 'last_price_update_time': 1774867914.191726}
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA87570') HTTP/1.1" 204 0
2026-03-30 10:51:54 [auto1.de] INFO: Found listing with ID: VT43145
2026-03-30 10:51:54 [auto1.de] INFO: Found listing with ID: GF38956
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF38956%27 HTTP/1.1" 200 None
2026-03-30 10:51:54 [auto1.de] INFO: Scrape type for GF38956: 2
2026-03-30 10:51:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9c7ab95-bb2f-5e80-ad16-36aa6d948d41 with identifier: GF38956
2026-03-30 10:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9c7ab95-bb2f-5e80-ad16-36aa6d948d41 with scrape type 2
2026-03-30 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9c7ab95-bb2f-5e80-ad16-36aa6d948d41 with scrape type 2
2026-03-30 10:51:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9c7ab95-bb2f-5e80-ad16-36aa6d948d41, identifier: GF38956
2026-03-30 10:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM81124> (referer: https://www.auto1.com/v1/car-details-view/DM81124/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR52532> (referer: https://www.auto1.com/v1/car-details-view/AR52532/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9c7ab95-bb2f-5e80-ad16-36aa6d948d41 with identifier: GF38956
2026-03-30 10:51:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9c7ab95-bb2f-5e80-ad16-36aa6d948d41 with identifier: GF38956
2026-03-30 10:51:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9c7ab95-bb2f-5e80-ad16-36aa6d948d41 with identifier: GF38956 to the API
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:21:28Z',
 'fuel_type': 'petrol',
 'id': 'e9c7ab95-bb2f-5e80-ad16-36aa6d948d41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF38956',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 257320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-05',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2007}
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF38956%27 HTTP/1.1" 200 None
2026-03-30 10:51:54 [auto1.de] INFO: Saving data for GF38956: {'auction_closing_time': 1774970488.0, 'created_time': 1773306885.830994, 'last_price_update_time': 1774867914.754393}
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF38956') HTTP/1.1" 204 0
2026-03-30 10:51:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:54 [auto1.de] INFO: Found listing with ID: AL88930
2026-03-30 10:51:54 [auto1.de] INFO: Found listing with ID: VS83958
2026-03-30 10:51:54 [auto1.de] INFO: Found listing with ID: FF76143
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF76143%27 HTTP/1.1" 200 None
2026-03-30 10:51:54 [auto1.de] INFO: Scrape type for FF76143: 1
2026-03-30 10:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b2fd10>
2026-03-30 10:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bb30c04-f922-5d65-8448-05eca6dc9e25/6bb30c04-f922-5d65-8448-05eca6dc9e25_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F1f%252F4e1fca55ea210105aa0a04a0ce9a51bb%252Fpa%252FNL38495_0e90766f03f8d5b2da015a61a19e183e.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_0e90766f03f8d5b2da015a61a19e183e.jpg saved to cache
2026-03-30 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6bb30c04-f922-5d65-8448-05eca6dc9e25
2026-03-30 10:51:54 [auto1.de] INFO: Found listing with ID: YG75934
2026-03-30 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG75934%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [auto1.de] INFO: Scrape type for YG75934: 1
2026-03-30 10:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY54602> (referer: https://www.auto1.com/v1/car-details-view/AY54602/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af516880-8934-58d4-8f84-eb5031f2d0ce with identifier: DM81124
2026-03-30 10:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af516880-8934-58d4-8f84-eb5031f2d0ce with scrape type 1
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item af516880-8934-58d4-8f84-eb5031f2d0ce
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F93%252Fcc93b2cf9a26b9a5bbbc7631d5154a70%252Fpa%252FDM81124_b02fb97029870182ac42b2969d814026.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_b02fb97029870182ac42b2969d814026.jpg already downloaded
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F93%252Fcc93b2cf9a26b9a5bbbc7631d5154a70%252Fpa%252FDM81124_2e26f3eae8dc935c3b982264b93ebb9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_2e26f3eae8dc935c3b982264b93ebb9e.jpg already downloaded
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F93%252Fcc93b2cf9a26b9a5bbbc7631d5154a70%252Fpa%252FDM81124_876c6fe88e7e1d461f2d7ef7b67c547e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_876c6fe88e7e1d461f2d7ef7b67c547e.jpg already downloaded
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F93%252Fcc93b2cf9a26b9a5bbbc7631d5154a70%252Fpa%252FDM81124_19a6fea908e250dadcebbacd51959a09.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_19a6fea908e250dadcebbacd51959a09.jpg already downloaded
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F93%252Fcc93b2cf9a26b9a5bbbc7631d5154a70%252Fpa%252FDM81124_2cad3c15fe6d7f1a89529c1d863208d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_2cad3c15fe6d7f1a89529c1d863208d5.jpg already downloaded
2026-03-30 10:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af516880-8934-58d4-8f84-eb5031f2d0ce, identifier: DM81124
2026-03-30 10:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 982d0de4-2132-598f-a498-dcb9e2a8021b with identifier: AR52532
2026-03-30 10:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 982d0de4-2132-598f-a498-dcb9e2a8021b with scrape type 1
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 982d0de4-2132-598f-a498-dcb9e2a8021b
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb2%252Fe9b25fce1afd91d3be3a07a7d8e6d44b%252Fpa%252FAR52532_14ea1764f3a0507687046e70d31789f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_14ea1764f3a0507687046e70d31789f8.jpg already downloaded
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb2%252Fe9b25fce1afd91d3be3a07a7d8e6d44b%252Fpa%252FAR52532_56795b9370a0d26e9aaea2a805882649.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_56795b9370a0d26e9aaea2a805882649.jpg already downloaded
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb2%252Fe9b25fce1afd91d3be3a07a7d8e6d44b%252Fpa%252FAR52532_b27710e3745a2bf84ba51cc5ff0a679b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_b27710e3745a2bf84ba51cc5ff0a679b.jpg already downloaded
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb2%252Fe9b25fce1afd91d3be3a07a7d8e6d44b%252Fpa%252FAR52532_4f033a89d7387bfc3b9bbe217d81369c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_4f033a89d7387bfc3b9bbe217d81369c.jpg already downloaded
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb2%252Fe9b25fce1afd91d3be3a07a7d8e6d44b%252Fpa%252FAR52532_6c328e9d729c3d866df90e6261d677b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_6c328e9d729c3d866df90e6261d677b8.jpg already downloaded
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb2%252Fe9b25fce1afd91d3be3a07a7d8e6d44b%252Fpa%252FAR52532_3d70c3bb095d0e590a04cde9e5336c88.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_3d70c3bb095d0e590a04cde9e5336c88.jpg already downloaded
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb2%252Fe9b25fce1afd91d3be3a07a7d8e6d44b%252Fpa%252FAR52532_4883a7307cee93c8e5eafff1165ec382.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_4883a7307cee93c8e5eafff1165ec382.jpg already downloaded
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb2%252Fe9b25fce1afd91d3be3a07a7d8e6d44b%252Fpa%252FAR52532_18a616da635f3e8632b537271ed61d16.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_18a616da635f3e8632b537271ed61d16.jpg already downloaded
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb2%252Fe9b25fce1afd91d3be3a07a7d8e6d44b%252Fpa%252FAR52532_79fe847d1f7e3a25a5eac9e487c5885b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_79fe847d1f7e3a25a5eac9e487c5885b.jpg already downloaded
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb2%252Fe9b25fce1afd91d3be3a07a7d8e6d44b%252Fpa%252FAR52532_8c5872185ab00108822d56d7ada45dd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_8c5872185ab00108822d56d7ada45dd9.jpg already downloaded
2026-03-30 10:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 982d0de4-2132-598f-a498-dcb9e2a8021b, identifier: AR52532
2026-03-30 10:51:55 [auto1.de] INFO: Found listing with ID: TL58821
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL58821%27 HTTP/1.1" 200 None
2026-03-30 10:51:55 [auto1.de] INFO: Scrape type for TL58821: 2
2026-03-30 10:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cc9b778-4c89-57a6-93ed-b5ac4730631c with identifier: TL58821
2026-03-30 10:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cc9b778-4c89-57a6-93ed-b5ac4730631c with scrape type 2
2026-03-30 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cc9b778-4c89-57a6-93ed-b5ac4730631c with scrape type 2
2026-03-30 10:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cc9b778-4c89-57a6-93ed-b5ac4730631c, identifier: TL58821
2026-03-30 10:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af516880-8934-58d4-8f84-eb5031f2d0ce with identifier: DM81124
2026-03-30 10:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af516880-8934-58d4-8f84-eb5031f2d0ce with identifier: DM81124
2026-03-30 10:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af516880-8934-58d4-8f84-eb5031f2d0ce with identifier: DM81124 to the API
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DM81124>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:29:50Z',
 'fuel_type': 'petrol',
 'id': 'af516880-8934-58d4-8f84-eb5031f2d0ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM81124',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 135390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_b02fb97029870182ac42b2969d814026.jpg',
                'https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_2e26f3eae8dc935c3b982264b93ebb9e.jpg',
                'https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_876c6fe88e7e1d461f2d7ef7b67c547e.jpg',
                'https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_19a6fea908e250dadcebbacd51959a09.jpg',
                'https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_2cad3c15fe6d7f1a89529c1d863208d5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af516880-8934-58d4-8f84-eb5031f2d0ce/af516880-8934-58d4-8f84-eb5031f2d0ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_b02fb97029870182ac42b2969d814026.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af516880-8934-58d4-8f84-eb5031f2d0ce/af516880-8934-58d4-8f84-eb5031f2d0ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_2e26f3eae8dc935c3b982264b93ebb9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af516880-8934-58d4-8f84-eb5031f2d0ce/af516880-8934-58d4-8f84-eb5031f2d0ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_876c6fe88e7e1d461f2d7ef7b67c547e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af516880-8934-58d4-8f84-eb5031f2d0ce/af516880-8934-58d4-8f84-eb5031f2d0ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_19a6fea908e250dadcebbacd51959a09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af516880-8934-58d4-8f84-eb5031f2d0ce/af516880-8934-58d4-8f84-eb5031f2d0ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/93/cc93b2cf9a26b9a5bbbc7631d5154a70/pa/DM81124_2cad3c15fe6d7f1a89529c1d863208d5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM81124%27 HTTP/1.1" 200 None
2026-03-30 10:51:56 [auto1.de] INFO: Saving data for DM81124: {'created_time': 1774867916.072433, 'last_price_update_time': 1774867916.072447, 'auction_closing_time': 1774970990.0}
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM81124') HTTP/1.1" 204 0
2026-03-30 10:51:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 982d0de4-2132-598f-a498-dcb9e2a8021b with identifier: AR52532
2026-03-30 10:51:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 982d0de4-2132-598f-a498-dcb9e2a8021b with identifier: AR52532
2026-03-30 10:51:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 982d0de4-2132-598f-a498-dcb9e2a8021b with identifier: AR52532 to the API
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AR52532>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:29:23Z',
 'fuel_type': 'petrol',
 'id': '982d0de4-2132-598f-a498-dcb9e2a8021b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR52532',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 95833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_14ea1764f3a0507687046e70d31789f8.jpg',
                'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_56795b9370a0d26e9aaea2a805882649.jpg',
                'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_b27710e3745a2bf84ba51cc5ff0a679b.jpg',
                'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_4f033a89d7387bfc3b9bbe217d81369c.jpg',
                'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_6c328e9d729c3d866df90e6261d677b8.jpg',
                'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_3d70c3bb095d0e590a04cde9e5336c88.jpg',
                'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_4883a7307cee93c8e5eafff1165ec382.jpg',
                'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_18a616da635f3e8632b537271ed61d16.jpg',
                'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_79fe847d1f7e3a25a5eac9e487c5885b.jpg',
                'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_8c5872185ab00108822d56d7ada45dd9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982d0de4-2132-598f-a498-dcb9e2a8021b/982d0de4-2132-598f-a498-dcb9e2a8021b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_14ea1764f3a0507687046e70d31789f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982d0de4-2132-598f-a498-dcb9e2a8021b/982d0de4-2132-598f-a498-dcb9e2a8021b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2900565,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_56795b9370a0d26e9aaea2a805882649.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982d0de4-2132-598f-a498-dcb9e2a8021b/982d0de4-2132-598f-a498-dcb9e2a8021b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_b27710e3745a2bf84ba51cc5ff0a679b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982d0de4-2132-598f-a498-dcb9e2a8021b/982d0de4-2132-598f-a498-dcb9e2a8021b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2453048,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_4f033a89d7387bfc3b9bbe217d81369c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982d0de4-2132-598f-a498-dcb9e2a8021b/982d0de4-2132-598f-a498-dcb9e2a8021b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2653457,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_6c328e9d729c3d866df90e6261d677b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982d0de4-2132-598f-a498-dcb9e2a8021b/982d0de4-2132-598f-a498-dcb9e2a8021b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2245379,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_3d70c3bb095d0e590a04cde9e5336c88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982d0de4-2132-598f-a498-dcb9e2a8021b/982d0de4-2132-598f-a498-dcb9e2a8021b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_4883a7307cee93c8e5eafff1165ec382.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982d0de4-2132-598f-a498-dcb9e2a8021b/982d0de4-2132-598f-a498-dcb9e2a8021b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_18a616da635f3e8632b537271ed61d16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982d0de4-2132-598f-a498-dcb9e2a8021b/982d0de4-2132-598f-a498-dcb9e2a8021b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_79fe847d1f7e3a25a5eac9e487c5885b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982d0de4-2132-598f-a498-dcb9e2a8021b/982d0de4-2132-598f-a498-dcb9e2a8021b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2705761,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b2/e9b25fce1afd91d3be3a07a7d8e6d44b/pa/AR52532_8c5872185ab00108822d56d7ada45dd9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Clubman One',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR52532%27 HTTP/1.1" 200 None
2026-03-30 10:51:56 [auto1.de] INFO: Saving data for AR52532: {'created_time': 1774867916.568914, 'last_price_update_time': 1774867916.568929, 'auction_closing_time': 1774970963.0}
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR52532') HTTP/1.1" 204 0
2026-03-30 10:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_be272d87064b90b5eb62dbdcb9697ea0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cc9b778-4c89-57a6-93ed-b5ac4730631c with identifier: TL58821
2026-03-30 10:51:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cc9b778-4c89-57a6-93ed-b5ac4730631c with identifier: TL58821
2026-03-30 10:51:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cc9b778-4c89-57a6-93ed-b5ac4730631c with identifier: TL58821 to the API
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:55:11Z',
 'fuel_type': 'petrol',
 'id': '8cc9b778-4c89-57a6-93ed-b5ac4730631c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL58821',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 31939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL58821%27 HTTP/1.1" 200 None
2026-03-30 10:51:56 [auto1.de] INFO: Saving data for TL58821: {'auction_closing_time': 1774972511.0, 'created_time': 1774349812.774349, 'last_price_update_time': 1774867916.960623}
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL58821') HTTP/1.1" 204 0
2026-03-30 10:51:56 [auto1.de] INFO: Found listing with ID: SG04043
2026-03-30 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG04043%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [auto1.de] INFO: Scrape type for SG04043: 1
2026-03-30 10:51:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b8f916b-4b7d-571c-9dce-34b27ed20fb4 with identifier: AY54602
2026-03-30 10:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b8f916b-4b7d-571c-9dce-34b27ed20fb4 with scrape type 1
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b8f916b-4b7d-571c-9dce-34b27ed20fb4
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_ec794746eeb4ffc52ef6741bb939f1c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_ec794746eeb4ffc52ef6741bb939f1c5.jpg not downloaded yet
2026-03-30 10:51:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR13013> (referer: https://www.auto1.com/v1/car-details-view/TR13013/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:57 [auto1.de] INFO: Found listing with ID: HU65226
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU65226%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [auto1.de] INFO: Scrape type for HU65226: 1
2026-03-30 10:51:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_0b8de501a0d59ccd48f63722d72be3a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_0b8de501a0d59ccd48f63722d72be3a5.jpg not downloaded yet
2026-03-30 10:51:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e494d0>
2026-03-30 10:51:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bb30c04-f922-5d65-8448-05eca6dc9e25/6bb30c04-f922-5d65-8448-05eca6dc9e25_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F1f%252F4e1fca55ea210105aa0a04a0ce9a51bb%252Fpa%252FNL38495_be272d87064b90b5eb62dbdcb9697ea0.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_be272d87064b90b5eb62dbdcb9697ea0.jpg saved to cache
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bb30c04-f922-5d65-8448-05eca6dc9e25
2026-03-30 10:51:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bb30c04-f922-5d65-8448-05eca6dc9e25, skipping ID generation
2026-03-30 10:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bb30c04-f922-5d65-8448-05eca6dc9e25 with scrape type 1
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bb30c04-f922-5d65-8448-05eca6dc9e25 sending to next pipeline
2026-03-30 10:51:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bb30c04-f922-5d65-8448-05eca6dc9e25, identifier: NL38495
2026-03-30 10:51:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bb30c04-f922-5d65-8448-05eca6dc9e25 with identifier: NL38495
2026-03-30 10:51:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bb30c04-f922-5d65-8448-05eca6dc9e25 with identifier: NL38495
2026-03-30 10:51:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bb30c04-f922-5d65-8448-05eca6dc9e25 with identifier: NL38495 to the API
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_be272d87064b90b5eb62dbdcb9697ea0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:39:41Z',
 'fuel_type': 'petrol',
 'id': '6bb30c04-f922-5d65-8448-05eca6dc9e25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL38495',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 68224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bb30c04-f922-5d65-8448-05eca6dc9e25/6bb30c04-f922-5d65-8448-05eca6dc9e25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_be272d87064b90b5eb62dbdcb9697ea0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bb30c04-f922-5d65-8448-05eca6dc9e25/6bb30c04-f922-5d65-8448-05eca6dc9e25_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_589ff361871e5434fb27ab027430f149.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bb30c04-f922-5d65-8448-05eca6dc9e25/6bb30c04-f922-5d65-8448-05eca6dc9e25_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_f35a46c49d0091964cb0525431734a19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bb30c04-f922-5d65-8448-05eca6dc9e25/6bb30c04-f922-5d65-8448-05eca6dc9e25_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_21f9c179da3c94b210e5ea38f559f303.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bb30c04-f922-5d65-8448-05eca6dc9e25/6bb30c04-f922-5d65-8448-05eca6dc9e25_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/1f/4e1fca55ea210105aa0a04a0ce9a51bb/pa/NL38495_0e90766f03f8d5b2da015a61a19e183e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL38495%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [auto1.de] INFO: Saving data for NL38495: {'created_time': 1774867917.603917, 'last_price_update_time': 1774867917.603927, 'auction_closing_time': 1774971581.0}
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL38495') HTTP/1.1" 204 0
2026-03-30 10:51:57 [auto1.de] INFO: Found listing with ID: WS10443
2026-03-30 10:51:57 [auto1.de] INFO: Found listing with ID: WP98376
2026-03-30 10:51:57 [auto1.de] INFO: Found listing with ID: JV19654
2026-03-30 10:51:57 [auto1.de] INFO: Found listing with ID: SN93122
2026-03-30 10:51:57 [auto1.de] INFO: Found listing with ID: GB96559
2026-03-30 10:51:57 [auto1.de] INFO: Found listing with ID: EV09512
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV09512%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [auto1.de] INFO: Scrape type for EV09512: 1
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_dcaaa8ba9a25bb099eb81812dd522a9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_dcaaa8ba9a25bb099eb81812dd522a9d.jpg not downloaded yet
2026-03-30 10:51:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9fdc70e-e6bb-5005-941a-65687d1c42d9 with identifier: TR13013
2026-03-30 10:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9fdc70e-e6bb-5005-941a-65687d1c42d9 with scrape type 1
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9fdc70e-e6bb-5005-941a-65687d1c42d9
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fa1%252Fa4a1cf647e4b4c25a3e16c8371e82f88%252Fpa%252FTR13013_785f2af9ff53c98b7bd4f5b7f3776152.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_785f2af9ff53c98b7bd4f5b7f3776152.jpg already downloaded
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fa1%252Fa4a1cf647e4b4c25a3e16c8371e82f88%252Fpa%252FTR13013_18f02488c3bb1ab9bf41a66166f44c4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_18f02488c3bb1ab9bf41a66166f44c4a.jpg already downloaded
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fa1%252Fa4a1cf647e4b4c25a3e16c8371e82f88%252Fpa%252FTR13013_fb6554ff29e8a173bf604f4a32715709.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_fb6554ff29e8a173bf604f4a32715709.jpg already downloaded
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fa1%252Fa4a1cf647e4b4c25a3e16c8371e82f88%252Fpa%252FTR13013_1eb56db7350caf02849a6025eadee3d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_1eb56db7350caf02849a6025eadee3d6.jpg already downloaded
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fa1%252Fa4a1cf647e4b4c25a3e16c8371e82f88%252Fpa%252FTR13013_32c99add0e58693a3260a84af08c6086.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_32c99add0e58693a3260a84af08c6086.jpg already downloaded
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fa1%252Fa4a1cf647e4b4c25a3e16c8371e82f88%252Fpa%252FTR13013_0c70a6e2fa56ad8cba2c119b041ac42c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_0c70a6e2fa56ad8cba2c119b041ac42c.jpg already downloaded
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fa1%252Fa4a1cf647e4b4c25a3e16c8371e82f88%252Fpa%252FTR13013_61376371a936b034734ae7f7d4a98492.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_61376371a936b034734ae7f7d4a98492.jpg already downloaded
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fa1%252Fa4a1cf647e4b4c25a3e16c8371e82f88%252Fpa%252FTR13013_62b9f9b588aebbc442a3432635cd9df1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_62b9f9b588aebbc442a3432635cd9df1.jpg already downloaded
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fa1%252Fa4a1cf647e4b4c25a3e16c8371e82f88%252Fpa%252FTR13013_08299f2564c0bf2bb95f21d56ee0f873.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_08299f2564c0bf2bb95f21d56ee0f873.jpg already downloaded
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fa1%252Fa4a1cf647e4b4c25a3e16c8371e82f88%252Fpa%252FTR13013_768b2c48325392c94cab3faeefd8b789.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_768b2c48325392c94cab3faeefd8b789.jpg already downloaded
2026-03-30 10:51:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9fdc70e-e6bb-5005-941a-65687d1c42d9, identifier: TR13013
2026-03-30 10:51:58 [auto1.de] INFO: Found listing with ID: RE55721
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE55721%27 HTTP/1.1" 200 None
2026-03-30 10:51:58 [auto1.de] INFO: Scrape type for RE55721: 2
2026-03-30 10:51:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 193e7590-74a4-5cbc-ae87-a19505b390e1 with identifier: RE55721
2026-03-30 10:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 193e7590-74a4-5cbc-ae87-a19505b390e1 with scrape type 2
2026-03-30 10:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 193e7590-74a4-5cbc-ae87-a19505b390e1 with scrape type 2
2026-03-30 10:51:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 193e7590-74a4-5cbc-ae87-a19505b390e1, identifier: RE55721
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_6bf38763ee53687551da4641b9f3efc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_6bf38763ee53687551da4641b9f3efc2.jpg not downloaded yet
2026-03-30 10:51:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9fdc70e-e6bb-5005-941a-65687d1c42d9 with identifier: TR13013
2026-03-30 10:51:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9fdc70e-e6bb-5005-941a-65687d1c42d9 with identifier: TR13013
2026-03-30 10:51:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9fdc70e-e6bb-5005-941a-65687d1c42d9 with identifier: TR13013 to the API
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TR13013>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 280,
 'expiration_date': '2026-03-31T15:43:05Z',
 'fuel_type': 'petrol',
 'id': 'f9fdc70e-e6bb-5005-941a-65687d1c42d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR13013',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 94998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_785f2af9ff53c98b7bd4f5b7f3776152.jpg',
                'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_18f02488c3bb1ab9bf41a66166f44c4a.jpg',
                'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_fb6554ff29e8a173bf604f4a32715709.jpg',
                'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_1eb56db7350caf02849a6025eadee3d6.jpg',
                'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_32c99add0e58693a3260a84af08c6086.jpg',
                'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_0c70a6e2fa56ad8cba2c119b041ac42c.jpg',
                'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_61376371a936b034734ae7f7d4a98492.jpg',
                'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_62b9f9b588aebbc442a3432635cd9df1.jpg',
                'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_08299f2564c0bf2bb95f21d56ee0f873.jpg',
                'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_768b2c48325392c94cab3faeefd8b789.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9fdc70e-e6bb-5005-941a-65687d1c42d9/f9fdc70e-e6bb-5005-941a-65687d1c42d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_785f2af9ff53c98b7bd4f5b7f3776152.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9fdc70e-e6bb-5005-941a-65687d1c42d9/f9fdc70e-e6bb-5005-941a-65687d1c42d9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_18f02488c3bb1ab9bf41a66166f44c4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9fdc70e-e6bb-5005-941a-65687d1c42d9/f9fdc70e-e6bb-5005-941a-65687d1c42d9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_fb6554ff29e8a173bf604f4a32715709.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9fdc70e-e6bb-5005-941a-65687d1c42d9/f9fdc70e-e6bb-5005-941a-65687d1c42d9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_1eb56db7350caf02849a6025eadee3d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9fdc70e-e6bb-5005-941a-65687d1c42d9/f9fdc70e-e6bb-5005-941a-65687d1c42d9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_32c99add0e58693a3260a84af08c6086.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9fdc70e-e6bb-5005-941a-65687d1c42d9/f9fdc70e-e6bb-5005-941a-65687d1c42d9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_0c70a6e2fa56ad8cba2c119b041ac42c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9fdc70e-e6bb-5005-941a-65687d1c42d9/f9fdc70e-e6bb-5005-941a-65687d1c42d9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_61376371a936b034734ae7f7d4a98492.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9fdc70e-e6bb-5005-941a-65687d1c42d9/f9fdc70e-e6bb-5005-941a-65687d1c42d9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_62b9f9b588aebbc442a3432635cd9df1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9fdc70e-e6bb-5005-941a-65687d1c42d9/f9fdc70e-e6bb-5005-941a-65687d1c42d9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_08299f2564c0bf2bb95f21d56ee0f873.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9fdc70e-e6bb-5005-941a-65687d1c42d9/f9fdc70e-e6bb-5005-941a-65687d1c42d9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/a1/a4a1cf647e4b4c25a3e16c8371e82f88/pa/TR13013_768b2c48325392c94cab3faeefd8b789.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 2.3 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2020}
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13013%27 HTTP/1.1" 200 None
2026-03-30 10:51:58 [auto1.de] INFO: Saving data for TR13013: {'created_time': 1774867918.495497, 'last_price_update_time': 1774867918.495509, 'auction_closing_time': 1774971785.0}
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR13013') HTTP/1.1" 204 0
2026-03-30 10:51:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 193e7590-74a4-5cbc-ae87-a19505b390e1 with identifier: RE55721
2026-03-30 10:51:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 193e7590-74a4-5cbc-ae87-a19505b390e1 with identifier: RE55721
2026-03-30 10:51:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 193e7590-74a4-5cbc-ae87-a19505b390e1 with identifier: RE55721 to the API
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:51:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:34:21Z',
 'fuel_type': 'diesel',
 'id': '193e7590-74a4-5cbc-ae87-a19505b390e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE55721',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 116276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-14',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE55721%27 HTTP/1.1" 200 None
2026-03-30 10:51:58 [auto1.de] INFO: Saving data for RE55721: {'auction_closing_time': 1774971261.0, 'created_time': 1772727334.092875, 'last_price_update_time': 1774867918.899209}
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE55721') HTTP/1.1" 204 0
2026-03-30 10:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_ec794746eeb4ffc52ef6741bb939f1c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:58 [auto1.de] INFO: Found listing with ID: LD73259
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD73259%27 HTTP/1.1" 200 None
2026-03-30 10:51:58 [auto1.de] INFO: Scrape type for LD73259: 1
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_0a650b6313ca5101e839801ad1d7d3af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_0a650b6313ca5101e839801ad1d7d3af.jpg not downloaded yet
2026-03-30 10:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS03545> (referer: https://www.auto1.com/v1/car-details-view/TS03545/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_b564442d4227ef0af3ba255c9f9ee9a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_b564442d4227ef0af3ba255c9f9ee9a4.jpg not downloaded yet
2026-03-30 10:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FE58121/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:51:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_77341de9cef0f3a087b74ea469af1085.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_77341de9cef0f3a087b74ea469af1085.jpg not downloaded yet
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_01591dc2c23d59c297b2cc2833bead36.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_01591dc2c23d59c297b2cc2833bead36.jpg not downloaded yet
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_2feb26080ba1bcf2c8749d0383599a7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_2feb26080ba1bcf2c8749d0383599a7b.jpg not downloaded yet
2026-03-30 10:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef51243d0>
2026-03-30 10:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_ec794746eeb4ffc52ef6741bb939f1c5.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_ec794746eeb4ffc52ef6741bb939f1c5.jpg saved to cache
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b8f916b-4b7d-571c-9dce-34b27ed20fb4
2026-03-30 10:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_ed78ea7edde0f8dbd26cb2b656984b71.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_ba537ab04f4b67cabc26f1a7461b6fae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_ba537ab04f4b67cabc26f1a7461b6fae.jpg not downloaded yet
2026-03-30 10:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_dcaaa8ba9a25bb099eb81812dd522a9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87fe0456-e89d-5ff7-8f00-7c636da01fe6 with identifier: TS03545
2026-03-30 10:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87fe0456-e89d-5ff7-8f00-7c636da01fe6 with scrape type 1
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87fe0456-e89d-5ff7-8f00-7c636da01fe6
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_1e9ea677677012d3c994938ab52f5e4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_1e9ea677677012d3c994938ab52f5e4a.jpg not downloaded yet
2026-03-30 10:51:59 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 9509 | hits on page: 40
2026-03-30 10:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_8702b657ca10d1f221eb10780719166b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_ff2c4b0942bafacf5caae696152f6cc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_ff2c4b0942bafacf5caae696152f6cc5.jpg not downloaded yet
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: LD73259
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_e7427fb447b2ee05c5a82f2f4f533c29.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_e7427fb447b2ee05c5a82f2f4f533c29.jpg not downloaded yet
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: UP63503
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: ZP04224
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: LW34128
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW34128%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [auto1.de] INFO: Scrape type for LW34128: 1
2026-03-30 10:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_6bf38763ee53687551da4641b9f3efc2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_2feb26080ba1bcf2c8749d0383599a7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_4e3eec7e75e955bb36e2897d905baa69.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_4e3eec7e75e955bb36e2897d905baa69.jpg not downloaded yet
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: MM56350
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: DE11265
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE11265%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [auto1.de] INFO: Scrape type for DE11265: 1
2026-03-30 10:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_0a650b6313ca5101e839801ad1d7d3af.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_ae373c8aa79bab17f9ecaafefdff9c26.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_ae373c8aa79bab17f9ecaafefdff9c26.jpg not downloaded yet
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: DT27807
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: NY24901
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: LD79008
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD79008%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [auto1.de] INFO: Scrape type for LD79008: 1
2026-03-30 10:51:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a42bd0>
2026-03-30 10:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_ed78ea7edde0f8dbd26cb2b656984b71.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_ed78ea7edde0f8dbd26cb2b656984b71.jpg saved to cache
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2e6e57b-81cd-50ba-88c6-2592c4bb6495
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_ca1d35dfc600b8e2cfe6471ad09545d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_ca1d35dfc600b8e2cfe6471ad09545d1.jpg not downloaded yet
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: UB71876
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: XE47955
2026-03-30 10:51:59 [auto1.de] INFO: Found listing with ID: MU52688
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU52688%27 HTTP/1.1" 200 None
2026-03-30 10:51:59 [auto1.de] INFO: Scrape type for MU52688: 2
2026-03-30 10:51:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0755af4b-0184-5f7d-9d59-5b496178dd08 with identifier: MU52688
2026-03-30 10:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0755af4b-0184-5f7d-9d59-5b496178dd08 with scrape type 2
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0755af4b-0184-5f7d-9d59-5b496178dd08 with scrape type 2
2026-03-30 10:51:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0755af4b-0184-5f7d-9d59-5b496178dd08, identifier: MU52688
2026-03-30 10:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5070c90>
2026-03-30 10:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_dcaaa8ba9a25bb099eb81812dd522a9d.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_dcaaa8ba9a25bb099eb81812dd522a9d.jpg saved to cache
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b8f916b-4b7d-571c-9dce-34b27ed20fb4
2026-03-30 10:51:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fca810>
2026-03-30 10:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_8702b657ca10d1f221eb10780719166b.jpg') HTTP/1.1" 204 0
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_8702b657ca10d1f221eb10780719166b.jpg saved to cache
2026-03-30 10:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2e6e57b-81cd-50ba-88c6-2592c4bb6495
2026-03-30 10:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_01591dc2c23d59c297b2cc2833bead36.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:51:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0755af4b-0184-5f7d-9d59-5b496178dd08 with identifier: MU52688
2026-03-30 10:51:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0755af4b-0184-5f7d-9d59-5b496178dd08 with identifier: MU52688
2026-03-30 10:51:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0755af4b-0184-5f7d-9d59-5b496178dd08 with identifier: MU52688 to the API
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:09:44Z',
 'fuel_type': 'petrol',
 'id': '0755af4b-0184-5f7d-9d59-5b496178dd08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU52688',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 38496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-24',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU52688%27 HTTP/1.1" 200 None
2026-03-30 10:52:00 [auto1.de] INFO: Saving data for MU52688: {'auction_closing_time': 1774969784.0, 'created_time': 1773688914.780056, 'last_price_update_time': 1774867920.265335}
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU52688') HTTP/1.1" 204 0
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_f4c23cd627915366ad5064063d62d7a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_f4c23cd627915366ad5064063d62d7a7.jpg not downloaded yet
2026-03-30 10:52:00 [auto1.de] INFO: Found listing with ID: UW30611
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW30611%27 HTTP/1.1" 200 None
2026-03-30 10:52:00 [auto1.de] INFO: Scrape type for UW30611: 2
2026-03-30 10:52:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5db3157-cce0-5e2c-a059-9cbb433f9c5d with identifier: UW30611
2026-03-30 10:52:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5db3157-cce0-5e2c-a059-9cbb433f9c5d with scrape type 2
2026-03-30 10:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5db3157-cce0-5e2c-a059-9cbb433f9c5d with scrape type 2
2026-03-30 10:52:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5db3157-cce0-5e2c-a059-9cbb433f9c5d, identifier: UW30611
2026-03-30 10:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fca850>
2026-03-30 10:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_6bf38763ee53687551da4641b9f3efc2.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_6bf38763ee53687551da4641b9f3efc2.jpg saved to cache
2026-03-30 10:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b8f916b-4b7d-571c-9dce-34b27ed20fb4
2026-03-30 10:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50e6e10>
2026-03-30 10:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_2feb26080ba1bcf2c8749d0383599a7b.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_2feb26080ba1bcf2c8749d0383599a7b.jpg saved to cache
2026-03-30 10:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b8f916b-4b7d-571c-9dce-34b27ed20fb4
2026-03-30 10:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c15d0>
2026-03-30 10:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_0a650b6313ca5101e839801ad1d7d3af.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_0a650b6313ca5101e839801ad1d7d3af.jpg saved to cache
2026-03-30 10:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b8f916b-4b7d-571c-9dce-34b27ed20fb4
2026-03-30 10:52:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5db3157-cce0-5e2c-a059-9cbb433f9c5d with identifier: UW30611
2026-03-30 10:52:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5db3157-cce0-5e2c-a059-9cbb433f9c5d with identifier: UW30611
2026-03-30 10:52:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5db3157-cce0-5e2c-a059-9cbb433f9c5d with identifier: UW30611 to the API
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:45:22Z',
 'fuel_type': 'petrol',
 'id': 'f5db3157-cce0-5e2c-a059-9cbb433f9c5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW30611',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Tonale',
 'odometer': 50883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-03',
 'seller_name': None,
 'title': 'Alfa Romeo Tonale 1.5 VGT Ti',
 'transmission': 'automatic',
 'trim': 'Ti',
 'year': 2022}
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW30611%27 HTTP/1.1" 200 None
2026-03-30 10:52:00 [auto1.de] INFO: Saving data for UW30611: {'auction_closing_time': 1774971922.0, 'created_time': 1774380394.233038, 'last_price_update_time': 1774867920.953704}
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW30611') HTTP/1.1" 204 0
2026-03-30 10:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS95122/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ72325/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_ea9caebeee93703cfbf978af9d69dfe0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_ea9caebeee93703cfbf978af9d69dfe0.jpg not downloaded yet
2026-03-30 10:52:00 [auto1.de] INFO: Found listing with ID: AA93259
2026-03-30 10:52:00 [auto1.de] INFO: Found listing with ID: ZK65162
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK65162%27 HTTP/1.1" 200 None
2026-03-30 10:52:01 [auto1.de] INFO: Scrape type for ZK65162: 2
2026-03-30 10:52:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b058c1c8-f272-51ab-b45f-4b27afaec6a6 with identifier: ZK65162
2026-03-30 10:52:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b058c1c8-f272-51ab-b45f-4b27afaec6a6 with scrape type 2
2026-03-30 10:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b058c1c8-f272-51ab-b45f-4b27afaec6a6 with scrape type 2
2026-03-30 10:52:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b058c1c8-f272-51ab-b45f-4b27afaec6a6, identifier: ZK65162
2026-03-30 10:52:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MK63509> (referer: https://www.auto1.com/v1/car-details-view/MK63509/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP95979> (referer: https://www.auto1.com/v1/car-details-view/YP95979/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RP13899/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_ae373c8aa79bab17f9ecaafefdff9c26.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b058c1c8-f272-51ab-b45f-4b27afaec6a6 with identifier: ZK65162
2026-03-30 10:52:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b058c1c8-f272-51ab-b45f-4b27afaec6a6 with identifier: ZK65162
2026-03-30 10:52:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b058c1c8-f272-51ab-b45f-4b27afaec6a6 with identifier: ZK65162 to the API
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:17:33Z',
 'fuel_type': 'petrol',
 'id': 'b058c1c8-f272-51ab-b45f-4b27afaec6a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK65162',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLC-Klasse',
 'odometer': 42313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-11',
 'seller_name': None,
 'title': 'Mercedes-Benz CLC-Klasse CLC 180 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK65162%27 HTTP/1.1" 200 None
2026-03-30 10:52:01 [auto1.de] INFO: Saving data for ZK65162: {'auction_closing_time': 1774970253.0, 'created_time': 1774292808.089954, 'last_price_update_time': 1774867921.518999}
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK65162') HTTP/1.1" 204 0
2026-03-30 10:52:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eb4890>
2026-03-30 10:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_01591dc2c23d59c297b2cc2833bead36.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_01591dc2c23d59c297b2cc2833bead36.jpg saved to cache
2026-03-30 10:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b8f916b-4b7d-571c-9dce-34b27ed20fb4
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_40e82aa4c5b39f29d9e872075072078c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_40e82aa4c5b39f29d9e872075072078c.jpg not downloaded yet
2026-03-30 10:52:01 [auto1.de] INFO: Found listing with ID: PW27553
2026-03-30 10:52:01 [auto1.de] INFO: Found listing with ID: ZK45501
2026-03-30 10:52:01 [auto1.de] INFO: Found listing with ID: ZE40043
2026-03-30 10:52:01 [auto1.de] INFO: Found listing with ID: BM56205
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM56205%27 HTTP/1.1" 200 None
2026-03-30 10:52:01 [auto1.de] INFO: Scrape type for BM56205: 2
2026-03-30 10:52:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68858e50-9b41-5154-8a17-7b4a602778cd with identifier: BM56205
2026-03-30 10:52:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68858e50-9b41-5154-8a17-7b4a602778cd with scrape type 2
2026-03-30 10:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68858e50-9b41-5154-8a17-7b4a602778cd with scrape type 2
2026-03-30 10:52:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68858e50-9b41-5154-8a17-7b4a602778cd, identifier: BM56205
2026-03-30 10:52:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68858e50-9b41-5154-8a17-7b4a602778cd with identifier: BM56205
2026-03-30 10:52:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68858e50-9b41-5154-8a17-7b4a602778cd with identifier: BM56205
2026-03-30 10:52:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68858e50-9b41-5154-8a17-7b4a602778cd with identifier: BM56205 to the API
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:33:33Z',
 'fuel_type': 'petrol',
 'id': '68858e50-9b41-5154-8a17-7b4a602778cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM56205',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 142143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-31',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 1.4 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM56205%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [auto1.de] INFO: Saving data for BM56205: {'auction_closing_time': 1774971213.0, 'created_time': 1774262678.636843, 'last_price_update_time': 1774867922.066386}
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM56205') HTTP/1.1" 204 0
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_d5ab595dbc74f06b640099dd4f20d9f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_d5ab595dbc74f06b640099dd4f20d9f9.jpg not downloaded yet
2026-03-30 10:52:02 [auto1.de] INFO: Found listing with ID: YS37212
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS37212%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [auto1.de] INFO: Scrape type for YS37212: 1
2026-03-30 10:52:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eebcb25-7045-5e15-a33e-2aad132b99f5 with identifier: MK63509
2026-03-30 10:52:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eebcb25-7045-5e15-a33e-2aad132b99f5 with scrape type 1
2026-03-30 10:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4eebcb25-7045-5e15-a33e-2aad132b99f5
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F49%252F1b4901b7750040ba92e9aebf71115bb0%252Fpa%252FMK63509_39e289e699a79f4e8d011d80ff8deebe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_39e289e699a79f4e8d011d80ff8deebe.jpg already downloaded
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F49%252F1b4901b7750040ba92e9aebf71115bb0%252Fpa%252FMK63509_52d43f8e2ce032d9dbea34f8352dc576.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_52d43f8e2ce032d9dbea34f8352dc576.jpg already downloaded
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F49%252F1b4901b7750040ba92e9aebf71115bb0%252Fpa%252FMK63509_eb765f587b22a4df4a7a47abb31c0a59.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_eb765f587b22a4df4a7a47abb31c0a59.jpg already downloaded
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F49%252F1b4901b7750040ba92e9aebf71115bb0%252Fpa%252FMK63509_4a986863a7a5bab0bd5ce56e76fa01e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_4a986863a7a5bab0bd5ce56e76fa01e2.jpg already downloaded
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F49%252F1b4901b7750040ba92e9aebf71115bb0%252Fpa%252FMK63509_ed9cf8462430201d28d0b0ce09bdc4a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_ed9cf8462430201d28d0b0ce09bdc4a4.jpg already downloaded
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F49%252F1b4901b7750040ba92e9aebf71115bb0%252Fpa%252FMK63509_b8be432d47cd98a0cd797a985dfb5a5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_b8be432d47cd98a0cd797a985dfb5a5b.jpg already downloaded
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F49%252F1b4901b7750040ba92e9aebf71115bb0%252Fpa%252FMK63509_82c53ad42b7e90f09a94fefec57a2b68.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_82c53ad42b7e90f09a94fefec57a2b68.jpg already downloaded
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F49%252F1b4901b7750040ba92e9aebf71115bb0%252Fpa%252FMK63509_cd1b087ed611a6c4e850876e88c45027.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_cd1b087ed611a6c4e850876e88c45027.jpg already downloaded
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F49%252F1b4901b7750040ba92e9aebf71115bb0%252Fpa%252FMK63509_da56274b6c848789ac6c41c7cc85ad4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_da56274b6c848789ac6c41c7cc85ad4f.jpg already downloaded
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F49%252F1b4901b7750040ba92e9aebf71115bb0%252Fpa%252FMK63509_8b8056f249b79527fb58600ba3efd794.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_8b8056f249b79527fb58600ba3efd794.jpg already downloaded
2026-03-30 10:52:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4eebcb25-7045-5e15-a33e-2aad132b99f5, identifier: MK63509
2026-03-30 10:52:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da3edb5-533e-566e-83ea-6c01e2626b99 with identifier: YP95979
2026-03-30 10:52:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da3edb5-533e-566e-83ea-6c01e2626b99 with scrape type 1
2026-03-30 10:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5da3edb5-533e-566e-83ea-6c01e2626b99
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_93edc3a9dc93a276d3aaaddc9a01ec18.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_93edc3a9dc93a276d3aaaddc9a01ec18.jpg not downloaded yet
2026-03-30 10:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50353d0>
2026-03-30 10:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_ae373c8aa79bab17f9ecaafefdff9c26.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_ae373c8aa79bab17f9ecaafefdff9c26.jpg saved to cache
2026-03-30 10:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87fe0456-e89d-5ff7-8f00-7c636da01fe6
2026-03-30 10:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_4e3eec7e75e955bb36e2897d905baa69.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_e7427fb447b2ee05c5a82f2f4f533c29.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4eebcb25-7045-5e15-a33e-2aad132b99f5 with identifier: MK63509
2026-03-30 10:52:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4eebcb25-7045-5e15-a33e-2aad132b99f5 with identifier: MK63509
2026-03-30 10:52:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4eebcb25-7045-5e15-a33e-2aad132b99f5 with identifier: MK63509 to the API
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MK63509>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:22:03Z',
 'fuel_type': 'petrol',
 'id': '4eebcb25-7045-5e15-a33e-2aad132b99f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK63509',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 114754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_39e289e699a79f4e8d011d80ff8deebe.jpg',
                'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_52d43f8e2ce032d9dbea34f8352dc576.jpg',
                'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_eb765f587b22a4df4a7a47abb31c0a59.jpg',
                'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_4a986863a7a5bab0bd5ce56e76fa01e2.jpg',
                'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_ed9cf8462430201d28d0b0ce09bdc4a4.jpg',
                'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_b8be432d47cd98a0cd797a985dfb5a5b.jpg',
                'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_82c53ad42b7e90f09a94fefec57a2b68.jpg',
                'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_cd1b087ed611a6c4e850876e88c45027.jpg',
                'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_da56274b6c848789ac6c41c7cc85ad4f.jpg',
                'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_8b8056f249b79527fb58600ba3efd794.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eebcb25-7045-5e15-a33e-2aad132b99f5/4eebcb25-7045-5e15-a33e-2aad132b99f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_39e289e699a79f4e8d011d80ff8deebe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eebcb25-7045-5e15-a33e-2aad132b99f5/4eebcb25-7045-5e15-a33e-2aad132b99f5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_52d43f8e2ce032d9dbea34f8352dc576.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eebcb25-7045-5e15-a33e-2aad132b99f5/4eebcb25-7045-5e15-a33e-2aad132b99f5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_eb765f587b22a4df4a7a47abb31c0a59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eebcb25-7045-5e15-a33e-2aad132b99f5/4eebcb25-7045-5e15-a33e-2aad132b99f5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_4a986863a7a5bab0bd5ce56e76fa01e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eebcb25-7045-5e15-a33e-2aad132b99f5/4eebcb25-7045-5e15-a33e-2aad132b99f5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_ed9cf8462430201d28d0b0ce09bdc4a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eebcb25-7045-5e15-a33e-2aad132b99f5/4eebcb25-7045-5e15-a33e-2aad132b99f5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_b8be432d47cd98a0cd797a985dfb5a5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eebcb25-7045-5e15-a33e-2aad132b99f5/4eebcb25-7045-5e15-a33e-2aad132b99f5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_82c53ad42b7e90f09a94fefec57a2b68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eebcb25-7045-5e15-a33e-2aad132b99f5/4eebcb25-7045-5e15-a33e-2aad132b99f5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_cd1b087ed611a6c4e850876e88c45027.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eebcb25-7045-5e15-a33e-2aad132b99f5/4eebcb25-7045-5e15-a33e-2aad132b99f5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_da56274b6c848789ac6c41c7cc85ad4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eebcb25-7045-5e15-a33e-2aad132b99f5/4eebcb25-7045-5e15-a33e-2aad132b99f5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/49/1b4901b7750040ba92e9aebf71115bb0/pa/MK63509_8b8056f249b79527fb58600ba3efd794.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Megane 1.4 TCe Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK63509%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [auto1.de] INFO: Saving data for MK63509: {'created_time': 1774867922.950431, 'last_price_update_time': 1774867922.950441, 'auction_closing_time': 1774970523.0}
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK63509') HTTP/1.1" 204 0
2026-03-30 10:52:02 [auto1.de] INFO: Found listing with ID: CA33728
2026-03-30 10:52:02 [auto1.de] INFO: Found listing with ID: BZ49239
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ49239%27 HTTP/1.1" 200 None
2026-03-30 10:52:02 [auto1.de] INFO: Scrape type for BZ49239: 1
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_fc1245af9eee0f5b3e19c99065f3abb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_fc1245af9eee0f5b3e19c99065f3abb2.jpg not downloaded yet
2026-03-30 10:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB76983/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_f4c23cd627915366ad5064063d62d7a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:03 [auto1.de] INFO: Found listing with ID: XT33273
2026-03-30 10:52:03 [auto1.de] INFO: Found listing with ID: TW14426
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW14426%27 HTTP/1.1" 200 None
2026-03-30 10:52:03 [auto1.de] INFO: Scrape type for TW14426: 1
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_ef768aaa188c92f3abfed08d8948553f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_ef768aaa188c92f3abfed08d8948553f.jpg not downloaded yet
2026-03-30 10:52:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_ca1d35dfc600b8e2cfe6471ad09545d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_ff2c4b0942bafacf5caae696152f6cc5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e72e50>
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_4e3eec7e75e955bb36e2897d905baa69.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_4e3eec7e75e955bb36e2897d905baa69.jpg saved to cache
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87fe0456-e89d-5ff7-8f00-7c636da01fe6
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50dea50>
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_e7427fb447b2ee05c5a82f2f4f533c29.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_e7427fb447b2ee05c5a82f2f4f533c29.jpg saved to cache
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87fe0456-e89d-5ff7-8f00-7c636da01fe6
2026-03-30 10:52:03 [auto1.de] INFO: Found listing with ID: VG43555
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG43555%27 HTTP/1.1" 200 None
2026-03-30 10:52:03 [auto1.de] INFO: Scrape type for VG43555: 1
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_da32d5fe513fdc49f29c961e605dada2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_da32d5fe513fdc49f29c961e605dada2.jpg not downloaded yet
2026-03-30 10:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_93edc3a9dc93a276d3aaaddc9a01ec18.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:03 [auto1.de] INFO: Found listing with ID: KS92375
2026-03-30 10:52:03 [auto1.de] INFO: Found listing with ID: BR48226
2026-03-30 10:52:03 [auto1.de] INFO: Found listing with ID: YM49760
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM49760%27 HTTP/1.1" 200 None
2026-03-30 10:52:03 [auto1.de] INFO: Scrape type for YM49760: 1
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_d767b86e6716b437803ac71b1650ec22.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_d767b86e6716b437803ac71b1650ec22.jpg not downloaded yet
2026-03-30 10:52:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5007ad0>
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_f4c23cd627915366ad5064063d62d7a7.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_f4c23cd627915366ad5064063d62d7a7.jpg saved to cache
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87fe0456-e89d-5ff7-8f00-7c636da01fe6
2026-03-30 10:52:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5020110>
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_ca1d35dfc600b8e2cfe6471ad09545d1.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_ca1d35dfc600b8e2cfe6471ad09545d1.jpg saved to cache
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87fe0456-e89d-5ff7-8f00-7c636da01fe6
2026-03-30 10:52:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f15190>
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_ff2c4b0942bafacf5caae696152f6cc5.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_ff2c4b0942bafacf5caae696152f6cc5.jpg saved to cache
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87fe0456-e89d-5ff7-8f00-7c636da01fe6
2026-03-30 10:52:03 [auto1.de] INFO: Found listing with ID: TW11648
2026-03-30 10:52:03 [auto1.de] INFO: Found listing with ID: YL97472
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL97472%27 HTTP/1.1" 200 None
2026-03-30 10:52:03 [auto1.de] INFO: Scrape type for YL97472: 2
2026-03-30 10:52:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b09c696c-1aa5-5916-8d57-20ef53e84289 with identifier: YL97472
2026-03-30 10:52:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b09c696c-1aa5-5916-8d57-20ef53e84289 with scrape type 2
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b09c696c-1aa5-5916-8d57-20ef53e84289 with scrape type 2
2026-03-30 10:52:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b09c696c-1aa5-5916-8d57-20ef53e84289, identifier: YL97472
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_0eca734820bf8e597eae73139a6c8728.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_0eca734820bf8e597eae73139a6c8728.jpg not downloaded yet
2026-03-30 10:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_fc1245af9eee0f5b3e19c99065f3abb2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b09c696c-1aa5-5916-8d57-20ef53e84289 with identifier: YL97472
2026-03-30 10:52:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b09c696c-1aa5-5916-8d57-20ef53e84289 with identifier: YL97472
2026-03-30 10:52:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b09c696c-1aa5-5916-8d57-20ef53e84289 with identifier: YL97472 to the API
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:28:03Z',
 'fuel_type': 'petrol',
 'id': 'b09c696c-1aa5-5916-8d57-20ef53e84289',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL97472',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 19838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-23',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2023}
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL97472%27 HTTP/1.1" 200 None
2026-03-30 10:52:04 [auto1.de] INFO: Saving data for YL97472: {'auction_closing_time': 1774970883.0, 'created_time': 1773772734.169876, 'last_price_update_time': 1774867924.091013}
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL97472') HTTP/1.1" 204 0
2026-03-30 10:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE11265/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ec2d10>
2026-03-30 10:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_93edc3a9dc93a276d3aaaddc9a01ec18.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_93edc3a9dc93a276d3aaaddc9a01ec18.jpg saved to cache
2026-03-30 10:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5da3edb5-533e-566e-83ea-6c01e2626b99
2026-03-30 10:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_da32d5fe513fdc49f29c961e605dada2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:04 [scrapy.extensions.logstats] INFO: Crawled 617 pages (at 63 pages/min), scraped 469 items (at 47 items/min)
2026-03-30 10:52:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-30 10:52:04 [auto1.de] INFO: Found listing with ID: FU73631
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU73631%27 HTTP/1.1" 200 None
2026-03-30 10:52:04 [auto1.de] INFO: Scrape type for FU73631: 1
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_28b59e4fdc6da933f7edb4937efe846a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_28b59e4fdc6da933f7edb4937efe846a.jpg not downloaded yet
2026-03-30 10:52:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YG75934/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:04 [auto1.de] INFO: Found listing with ID: JH65946
2026-03-30 10:52:04 [auto1.de] INFO: Found listing with ID: VV39146
2026-03-30 10:52:04 [auto1.de] INFO: Found listing with ID: VD77751
2026-03-30 10:52:04 [auto1.de] INFO: Found listing with ID: LK02148
2026-03-30 10:52:04 [auto1.de] INFO: Found listing with ID: LT03056
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT03056%27 HTTP/1.1" 200 None
2026-03-30 10:52:04 [auto1.de] INFO: Scrape type for LT03056: 1
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_4aee2fc2ff2777b48a252c6f08d44d0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_4aee2fc2ff2777b48a252c6f08d44d0a.jpg not downloaded yet
2026-03-30 10:52:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF76143/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LD79008/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EV09512/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c6dc90>
2026-03-30 10:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_fc1245af9eee0f5b3e19c99065f3abb2.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_fc1245af9eee0f5b3e19c99065f3abb2.jpg saved to cache
2026-03-30 10:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5da3edb5-533e-566e-83ea-6c01e2626b99
2026-03-30 10:52:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:04 [auto1.de] INFO: Found listing with ID: WC05131
2026-03-30 10:52:04 [auto1.de] INFO: Found listing with ID: WJ42337
2026-03-30 10:52:04 [auto1.de] INFO: Found listing with ID: RW28042
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW28042%27 HTTP/1.1" 200 None
2026-03-30 10:52:04 [auto1.de] INFO: Scrape type for RW28042: 2
2026-03-30 10:52:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52fc2ef8-ba2e-5f5c-8f38-a0958370c0c8 with identifier: RW28042
2026-03-30 10:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52fc2ef8-ba2e-5f5c-8f38-a0958370c0c8 with scrape type 2
2026-03-30 10:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52fc2ef8-ba2e-5f5c-8f38-a0958370c0c8 with scrape type 2
2026-03-30 10:52:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52fc2ef8-ba2e-5f5c-8f38-a0958370c0c8, identifier: RW28042
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_74155d87d855cc22f93cbdda8260d1f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_74155d87d855cc22f93cbdda8260d1f7.jpg not downloaded yet
2026-03-30 10:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52fc2ef8-ba2e-5f5c-8f38-a0958370c0c8 with identifier: RW28042
2026-03-30 10:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52fc2ef8-ba2e-5f5c-8f38-a0958370c0c8 with identifier: RW28042
2026-03-30 10:52:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52fc2ef8-ba2e-5f5c-8f38-a0958370c0c8 with identifier: RW28042 to the API
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:33:28Z',
 'fuel_type': 'petrol',
 'id': '52fc2ef8-ba2e-5f5c-8f38-a0958370c0c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW28042',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 205401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-22',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW28042%27 HTTP/1.1" 200 None
2026-03-30 10:52:04 [auto1.de] INFO: Saving data for RW28042: {'auction_closing_time': 1774971208.0, 'created_time': 1773773843.207088, 'last_price_update_time': 1774867924.94774}
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW28042') HTTP/1.1" 204 0
2026-03-30 10:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7906a50>
2026-03-30 10:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_da32d5fe513fdc49f29c961e605dada2.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_da32d5fe513fdc49f29c961e605dada2.jpg saved to cache
2026-03-30 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5da3edb5-533e-566e-83ea-6c01e2626b99
2026-03-30 10:52:05 [auto1.de] INFO: Found listing with ID: CK31014
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK31014%27 HTTP/1.1" 200 None
2026-03-30 10:52:05 [auto1.de] INFO: Scrape type for CK31014: 2
2026-03-30 10:52:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87e7fa0a-d046-53c5-838e-10c43330214b with identifier: CK31014
2026-03-30 10:52:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87e7fa0a-d046-53c5-838e-10c43330214b with scrape type 2
2026-03-30 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87e7fa0a-d046-53c5-838e-10c43330214b with scrape type 2
2026-03-30 10:52:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87e7fa0a-d046-53c5-838e-10c43330214b, identifier: CK31014
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_26b6c4ebd8b130d456e5d53971465e0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_26b6c4ebd8b130d456e5d53971465e0d.jpg not downloaded yet
2026-03-30 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_28b59e4fdc6da933f7edb4937efe846a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_d767b86e6716b437803ac71b1650ec22.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_0eca734820bf8e597eae73139a6c8728.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87e7fa0a-d046-53c5-838e-10c43330214b with identifier: CK31014
2026-03-30 10:52:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87e7fa0a-d046-53c5-838e-10c43330214b with identifier: CK31014
2026-03-30 10:52:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87e7fa0a-d046-53c5-838e-10c43330214b with identifier: CK31014 to the API
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:34:58Z',
 'fuel_type': 'petrol',
 'id': '87e7fa0a-d046-53c5-838e-10c43330214b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK31014',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 102836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-24',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2016}
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK31014%27 HTTP/1.1" 200 None
2026-03-30 10:52:05 [auto1.de] INFO: Saving data for CK31014: {'auction_closing_time': 1774971298.0, 'created_time': 1774262934.157187, 'last_price_update_time': 1774867925.449054}
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK31014') HTTP/1.1" 204 0
2026-03-30 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW34128/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e45dd0>
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_28b59e4fdc6da933f7edb4937efe846a.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_28b59e4fdc6da933f7edb4937efe846a.jpg saved to cache
2026-03-30 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5da3edb5-533e-566e-83ea-6c01e2626b99
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0a190>
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_d767b86e6716b437803ac71b1650ec22.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_d767b86e6716b437803ac71b1650ec22.jpg saved to cache
2026-03-30 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5da3edb5-533e-566e-83ea-6c01e2626b99
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c4c2d0>
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_0eca734820bf8e597eae73139a6c8728.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_0eca734820bf8e597eae73139a6c8728.jpg saved to cache
2026-03-30 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5da3edb5-533e-566e-83ea-6c01e2626b99
2026-03-30 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_74155d87d855cc22f93cbdda8260d1f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ddac10>
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_74155d87d855cc22f93cbdda8260d1f7.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_74155d87d855cc22f93cbdda8260d1f7.jpg saved to cache
2026-03-30 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5da3edb5-533e-566e-83ea-6c01e2626b99
2026-03-30 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_4aee2fc2ff2777b48a252c6f08d44d0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_26b6c4ebd8b130d456e5d53971465e0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4df8c50>
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_4aee2fc2ff2777b48a252c6f08d44d0a.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_4aee2fc2ff2777b48a252c6f08d44d0a.jpg saved to cache
2026-03-30 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5da3edb5-533e-566e-83ea-6c01e2626b99
2026-03-30 10:52:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ddb4d0>
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_26b6c4ebd8b130d456e5d53971465e0d.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_26b6c4ebd8b130d456e5d53971465e0d.jpg saved to cache
2026-03-30 10:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5da3edb5-533e-566e-83ea-6c01e2626b99
2026-03-30 10:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FE58121> (referer: https://www.auto1.com/v1/car-details-view/FE58121/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.920(s), this was the 1st time calling it.
2026-03-30 10:52:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.661378108011585 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:52:06 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 9511 | hits on page: 40
2026-03-30 10:52:06 [auto1.de] INFO: Found listing with ID: RW28042
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW28042%27 HTTP/1.1" 200 None
2026-03-30 10:52:06 [auto1.de] INFO: Scrape type for RW28042: 0
2026-03-30 10:52:06 [auto1.de] INFO: Found listing with ID: CK31014
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK31014%27 HTTP/1.1" 200 None
2026-03-30 10:52:06 [auto1.de] INFO: Scrape type for CK31014: 0
2026-03-30 10:52:06 [auto1.de] INFO: Found listing with ID: RX27248
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX27248%27 HTTP/1.1" 200 None
2026-03-30 10:52:06 [auto1.de] INFO: Scrape type for RX27248: 1
2026-03-30 10:52:06 [auto1.de] INFO: Found listing with ID: PU61252
2026-03-30 10:52:06 [auto1.de] INFO: Found listing with ID: XS62323
2026-03-30 10:52:06 [auto1.de] INFO: Found listing with ID: ZB77986
2026-03-30 10:52:06 [auto1.de] INFO: Found listing with ID: CH93356
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH93356%27 HTTP/1.1" 200 None
2026-03-30 10:52:06 [auto1.de] INFO: Scrape type for CH93356: 2
2026-03-30 10:52:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd96a41d-1271-58e5-a4be-39117f50f912 with identifier: CH93356
2026-03-30 10:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd96a41d-1271-58e5-a4be-39117f50f912 with scrape type 2
2026-03-30 10:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd96a41d-1271-58e5-a4be-39117f50f912 with scrape type 2
2026-03-30 10:52:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd96a41d-1271-58e5-a4be-39117f50f912, identifier: CH93356
2026-03-30 10:52:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd96a41d-1271-58e5-a4be-39117f50f912 with identifier: CH93356
2026-03-30 10:52:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd96a41d-1271-58e5-a4be-39117f50f912 with identifier: CH93356
2026-03-30 10:52:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd96a41d-1271-58e5-a4be-39117f50f912 with identifier: CH93356 to the API
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-31T15:18:25Z',
 'fuel_type': 'petrol',
 'id': 'fd96a41d-1271-58e5-a4be-39117f50f912',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH93356',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 126079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seller_name': None,
 'title': 'BMW X3 M Competition',
 'transmission': 'automatic',
 'trim': 'BW   Competition',
 'year': 2019}
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH93356%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [auto1.de] INFO: Saving data for CH93356: {'auction_closing_time': 1774970305.0, 'created_time': 1774465904.708923, 'last_price_update_time': 1774867927.050655}
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH93356') HTTP/1.1" 204 0
2026-03-30 10:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b3f3893-cb89-50de-bd25-52643d063ebb with identifier: FE58121
2026-03-30 10:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b3f3893-cb89-50de-bd25-52643d063ebb with scrape type 1
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b3f3893-cb89-50de-bd25-52643d063ebb
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F49%252F2a49bf216f78151eab21baa71f1caf22%252Fpa%252FFE58121_7401b15f695ea51254ffb7dc51743129.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_7401b15f695ea51254ffb7dc51743129.jpg already downloaded
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F49%252F2a49bf216f78151eab21baa71f1caf22%252Fpa%252FFE58121_801c809c8c9a55aec31aa928f1ce68ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_801c809c8c9a55aec31aa928f1ce68ed.jpg already downloaded
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F49%252F2a49bf216f78151eab21baa71f1caf22%252Fpa%252FFE58121_9e9aa0b2344cd8a919692290df06e823.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_9e9aa0b2344cd8a919692290df06e823.jpg already downloaded
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F49%252F2a49bf216f78151eab21baa71f1caf22%252Fpa%252FFE58121_a4e1977b38ef32335ead352458b4ce96.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_a4e1977b38ef32335ead352458b4ce96.jpg already downloaded
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F49%252F2a49bf216f78151eab21baa71f1caf22%252Fpa%252FFE58121_defb27783e620ae0f91e3e004704d372.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_defb27783e620ae0f91e3e004704d372.jpg already downloaded
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F49%252F2a49bf216f78151eab21baa71f1caf22%252Fpa%252FFE58121_dbb4299c520bb8be1aab31ad54f0f514.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_dbb4299c520bb8be1aab31ad54f0f514.jpg already downloaded
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F49%252F2a49bf216f78151eab21baa71f1caf22%252Fpa%252FFE58121_253ad0b055a583d20b28329ea62b269d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_253ad0b055a583d20b28329ea62b269d.jpg already downloaded
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F49%252F2a49bf216f78151eab21baa71f1caf22%252Fpa%252FFE58121_16cc90973b24562c7ea156f9a65da0b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_16cc90973b24562c7ea156f9a65da0b3.jpg already downloaded
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F49%252F2a49bf216f78151eab21baa71f1caf22%252Fpa%252FFE58121_5922cd5c68fca2877d1b41d3789d5b40.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_5922cd5c68fca2877d1b41d3789d5b40.jpg already downloaded
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F49%252F2a49bf216f78151eab21baa71f1caf22%252Fpa%252FFE58121_db36f56d399d94f8c526c77d5ebfe435.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_db36f56d399d94f8c526c77d5ebfe435.jpg already downloaded
2026-03-30 10:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b3f3893-cb89-50de-bd25-52643d063ebb, identifier: FE58121
2026-03-30 10:52:07 [auto1.de] INFO: Found listing with ID: HT15412
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT15412%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [auto1.de] INFO: Scrape type for HT15412: 2
2026-03-30 10:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6165d339-7a5e-53a5-87ac-247405a7aa94 with identifier: HT15412
2026-03-30 10:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6165d339-7a5e-53a5-87ac-247405a7aa94 with scrape type 2
2026-03-30 10:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6165d339-7a5e-53a5-87ac-247405a7aa94 with scrape type 2
2026-03-30 10:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6165d339-7a5e-53a5-87ac-247405a7aa94, identifier: HT15412
2026-03-30 10:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b3f3893-cb89-50de-bd25-52643d063ebb with identifier: FE58121
2026-03-30 10:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b3f3893-cb89-50de-bd25-52643d063ebb with identifier: FE58121
2026-03-30 10:52:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b3f3893-cb89-50de-bd25-52643d063ebb with identifier: FE58121 to the API
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FE58121>
{'auction_title': '',
 'c_o_2_emission_value': 232,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:20:02Z',
 'fuel_type': 'diesel',
 'id': '7b3f3893-cb89-50de-bd25-52643d063ebb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE58121',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 134676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_7401b15f695ea51254ffb7dc51743129.jpg',
                'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_801c809c8c9a55aec31aa928f1ce68ed.jpg',
                'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_9e9aa0b2344cd8a919692290df06e823.jpg',
                'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_a4e1977b38ef32335ead352458b4ce96.jpg',
                'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_defb27783e620ae0f91e3e004704d372.jpg',
                'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_dbb4299c520bb8be1aab31ad54f0f514.jpg',
                'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_253ad0b055a583d20b28329ea62b269d.jpg',
                'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_16cc90973b24562c7ea156f9a65da0b3.jpg',
                'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_5922cd5c68fca2877d1b41d3789d5b40.jpg',
                'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_db36f56d399d94f8c526c77d5ebfe435.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f3893-cb89-50de-bd25-52643d063ebb/7b3f3893-cb89-50de-bd25-52643d063ebb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2923963,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_7401b15f695ea51254ffb7dc51743129.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f3893-cb89-50de-bd25-52643d063ebb/7b3f3893-cb89-50de-bd25-52643d063ebb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_801c809c8c9a55aec31aa928f1ce68ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f3893-cb89-50de-bd25-52643d063ebb/7b3f3893-cb89-50de-bd25-52643d063ebb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_9e9aa0b2344cd8a919692290df06e823.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f3893-cb89-50de-bd25-52643d063ebb/7b3f3893-cb89-50de-bd25-52643d063ebb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_a4e1977b38ef32335ead352458b4ce96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f3893-cb89-50de-bd25-52643d063ebb/7b3f3893-cb89-50de-bd25-52643d063ebb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2845184,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_defb27783e620ae0f91e3e004704d372.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f3893-cb89-50de-bd25-52643d063ebb/7b3f3893-cb89-50de-bd25-52643d063ebb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_dbb4299c520bb8be1aab31ad54f0f514.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f3893-cb89-50de-bd25-52643d063ebb/7b3f3893-cb89-50de-bd25-52643d063ebb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_253ad0b055a583d20b28329ea62b269d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f3893-cb89-50de-bd25-52643d063ebb/7b3f3893-cb89-50de-bd25-52643d063ebb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2979238,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_16cc90973b24562c7ea156f9a65da0b3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f3893-cb89-50de-bd25-52643d063ebb/7b3f3893-cb89-50de-bd25-52643d063ebb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2956814,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_5922cd5c68fca2877d1b41d3789d5b40.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f3893-cb89-50de-bd25-52643d063ebb/7b3f3893-cb89-50de-bd25-52643d063ebb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2927398,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/49/2a49bf216f78151eab21baa71f1caf22/pa/FE58121_db36f56d399d94f8c526c77d5ebfe435.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Comfortline 4Motion',
 'transmission': 'automatic',
 'trim': 'Comfortline 4Motion',
 'year': 2011}
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE58121%27 HTTP/1.1" 200 None
2026-03-30 10:52:07 [auto1.de] INFO: Saving data for FE58121: {'created_time': 1774867927.963811, 'last_price_update_time': 1774867927.963826, 'auction_closing_time': 1774970402.0}
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE58121') HTTP/1.1" 204 0
2026-03-30 10:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6165d339-7a5e-53a5-87ac-247405a7aa94 with identifier: HT15412
2026-03-30 10:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6165d339-7a5e-53a5-87ac-247405a7aa94 with identifier: HT15412
2026-03-30 10:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6165d339-7a5e-53a5-87ac-247405a7aa94 with identifier: HT15412 to the API
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:29:03Z',
 'fuel_type': 'diesel',
 'id': '6165d339-7a5e-53a5-87ac-247405a7aa94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT15412',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 167548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-29',
 'seller_name': None,
 'title': 'Kia Sorento 2.5 CRDi VGT EX',
 'transmission': 'manual',
 'trim': 'VGT EX',
 'year': 2009}
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT15412%27 HTTP/1.1" 200 None
2026-03-30 10:52:08 [auto1.de] INFO: Saving data for HT15412: {'auction_closing_time': 1774970943.0, 'created_time': 1773661607.905129, 'last_price_update_time': 1774867928.32405}
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT15412') HTTP/1.1" 204 0
2026-03-30 10:52:08 [auto1.de] INFO: Found listing with ID: PG90707
2026-03-30 10:52:08 [auto1.de] INFO: Found listing with ID: NA40709
2026-03-30 10:52:08 [auto1.de] INFO: Found listing with ID: PM09523
2026-03-30 10:52:08 [auto1.de] INFO: Found listing with ID: UG67497
2026-03-30 10:52:08 [auto1.de] INFO: Found listing with ID: RL98194
2026-03-30 10:52:08 [auto1.de] INFO: Found listing with ID: VJ31329
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ31329%27 HTTP/1.1" 200 None
2026-03-30 10:52:08 [auto1.de] INFO: Scrape type for VJ31329: 1
2026-03-30 10:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RP13899> (referer: https://www.auto1.com/v1/car-details-view/RP13899/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:08 [auto1.de] INFO: Found listing with ID: RL00966
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL00966%27 HTTP/1.1" 200 None
2026-03-30 10:52:08 [auto1.de] INFO: Scrape type for RL00966: 2
2026-03-30 10:52:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52dd2b59-6b5d-52a2-a535-548362232f46 with identifier: RL00966
2026-03-30 10:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52dd2b59-6b5d-52a2-a535-548362232f46 with scrape type 2
2026-03-30 10:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52dd2b59-6b5d-52a2-a535-548362232f46 with scrape type 2
2026-03-30 10:52:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52dd2b59-6b5d-52a2-a535-548362232f46, identifier: RL00966
2026-03-30 10:52:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52dd2b59-6b5d-52a2-a535-548362232f46 with identifier: RL00966
2026-03-30 10:52:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52dd2b59-6b5d-52a2-a535-548362232f46 with identifier: RL00966
2026-03-30 10:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52dd2b59-6b5d-52a2-a535-548362232f46 with identifier: RL00966 to the API
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:58:49Z',
 'fuel_type': 'diesel',
 'id': '52dd2b59-6b5d-52a2-a535-548362232f46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL00966',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 121232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-22',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL00966%27 HTTP/1.1" 200 None
2026-03-30 10:52:08 [auto1.de] INFO: Saving data for RL00966: {'auction_closing_time': 1774972729.0, 'created_time': 1774294843.614101, 'last_price_update_time': 1774867928.846888}
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL00966') HTTP/1.1" 204 0
2026-03-30 10:52:08 [auto1.de] INFO: Found listing with ID: RD74576
2026-03-30 10:52:08 [auto1.de] INFO: Found listing with ID: NA95375
2026-03-30 10:52:08 [auto1.de] INFO: Found listing with ID: HN30434
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN30434%27 HTTP/1.1" 200 None
2026-03-30 10:52:08 [auto1.de] INFO: Scrape type for HN30434: 2
2026-03-30 10:52:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 288a95f0-a5ac-5e62-9a4a-ba7e7a538ec9 with identifier: HN30434
2026-03-30 10:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 288a95f0-a5ac-5e62-9a4a-ba7e7a538ec9 with scrape type 2
2026-03-30 10:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 288a95f0-a5ac-5e62-9a4a-ba7e7a538ec9 with scrape type 2
2026-03-30 10:52:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 288a95f0-a5ac-5e62-9a4a-ba7e7a538ec9, identifier: HN30434
2026-03-30 10:52:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 288a95f0-a5ac-5e62-9a4a-ba7e7a538ec9 with identifier: HN30434
2026-03-30 10:52:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 288a95f0-a5ac-5e62-9a4a-ba7e7a538ec9 with identifier: HN30434
2026-03-30 10:52:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 288a95f0-a5ac-5e62-9a4a-ba7e7a538ec9 with identifier: HN30434 to the API
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:03:40Z',
 'fuel_type': 'diesel',
 'id': '288a95f0-a5ac-5e62-9a4a-ba7e7a538ec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN30434',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 193430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-23',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2015}
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN30434%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [auto1.de] INFO: Saving data for HN30434: {'auction_closing_time': 1774969420.0, 'created_time': 1774468025.602828, 'last_price_update_time': 1774867929.293125}
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN30434') HTTP/1.1" 204 0
2026-03-30 10:52:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac5dba36-30ea-5c84-bcad-e020d48f782f with identifier: RP13899
2026-03-30 10:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac5dba36-30ea-5c84-bcad-e020d48f782f with scrape type 1
2026-03-30 10:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac5dba36-30ea-5c84-bcad-e020d48f782f
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1a%252F381a1e390b75091d4f0beae5cd09db4b%252Fpa%252FRP13899_a763612f8473003b55e255fb62aba5f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_a763612f8473003b55e255fb62aba5f1.jpg already downloaded
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1a%252F381a1e390b75091d4f0beae5cd09db4b%252Fpa%252FRP13899_b359c84d6b15593c0c26a9a1925c0bc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_b359c84d6b15593c0c26a9a1925c0bc2.jpg already downloaded
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1a%252F381a1e390b75091d4f0beae5cd09db4b%252Fpa%252FRP13899_7c6d919d68fbd5a274e516fe3d7a32d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_7c6d919d68fbd5a274e516fe3d7a32d3.jpg already downloaded
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1a%252F381a1e390b75091d4f0beae5cd09db4b%252Fpa%252FRP13899_db08632d1c4488da71552b2a3ee1ab81.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_db08632d1c4488da71552b2a3ee1ab81.jpg already downloaded
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1a%252F381a1e390b75091d4f0beae5cd09db4b%252Fpa%252FRP13899_3f4abe7bfbe6dd4da05e579eb8663c89.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_3f4abe7bfbe6dd4da05e579eb8663c89.jpg already downloaded
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1a%252F381a1e390b75091d4f0beae5cd09db4b%252Fpa%252FRP13899_284eff4f5c95b350f5f6000df03c994a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_284eff4f5c95b350f5f6000df03c994a.jpg already downloaded
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1a%252F381a1e390b75091d4f0beae5cd09db4b%252Fpa%252FRP13899_17fb4ea99bfaaeb83644d7d761060d26.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_17fb4ea99bfaaeb83644d7d761060d26.jpg already downloaded
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1a%252F381a1e390b75091d4f0beae5cd09db4b%252Fpa%252FRP13899_c49ca8b17541545779d87930e10a6801.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_c49ca8b17541545779d87930e10a6801.jpg already downloaded
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1a%252F381a1e390b75091d4f0beae5cd09db4b%252Fpa%252FRP13899_c453d0372595e06bae87ee24cbcdd899.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_c453d0372595e06bae87ee24cbcdd899.jpg already downloaded
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F1a%252F381a1e390b75091d4f0beae5cd09db4b%252Fpa%252FRP13899_a51f221e50573e4811920085fe260af8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_a51f221e50573e4811920085fe260af8.jpg already downloaded
2026-03-30 10:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac5dba36-30ea-5c84-bcad-e020d48f782f, identifier: RP13899
2026-03-30 10:52:09 [auto1.de] INFO: Found listing with ID: CB39322
2026-03-30 10:52:09 [auto1.de] INFO: Found listing with ID: CC70846
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC70846%27 HTTP/1.1" 200 None
2026-03-30 10:52:09 [auto1.de] INFO: Scrape type for CC70846: 2
2026-03-30 10:52:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d144628a-4656-5d46-a886-51bedf0a9c24 with identifier: CC70846
2026-03-30 10:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d144628a-4656-5d46-a886-51bedf0a9c24 with scrape type 2
2026-03-30 10:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d144628a-4656-5d46-a886-51bedf0a9c24 with scrape type 2
2026-03-30 10:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d144628a-4656-5d46-a886-51bedf0a9c24, identifier: CC70846
2026-03-30 10:52:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac5dba36-30ea-5c84-bcad-e020d48f782f with identifier: RP13899
2026-03-30 10:52:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac5dba36-30ea-5c84-bcad-e020d48f782f with identifier: RP13899
2026-03-30 10:52:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac5dba36-30ea-5c84-bcad-e020d48f782f with identifier: RP13899 to the API
2026-03-30 10:52:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RP13899>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:37:48Z',
 'fuel_type': 'petrol',
 'id': 'ac5dba36-30ea-5c84-bcad-e020d48f782f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP13899',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 262615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_a763612f8473003b55e255fb62aba5f1.jpg',
                'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_b359c84d6b15593c0c26a9a1925c0bc2.jpg',
                'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_7c6d919d68fbd5a274e516fe3d7a32d3.jpg',
                'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_db08632d1c4488da71552b2a3ee1ab81.jpg',
                'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_3f4abe7bfbe6dd4da05e579eb8663c89.jpg',
                'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_284eff4f5c95b350f5f6000df03c994a.jpg',
                'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_17fb4ea99bfaaeb83644d7d761060d26.jpg',
                'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_c49ca8b17541545779d87930e10a6801.jpg',
                'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_c453d0372595e06bae87ee24cbcdd899.jpg',
                'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_a51f221e50573e4811920085fe260af8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5dba36-30ea-5c84-bcad-e020d48f782f/ac5dba36-30ea-5c84-bcad-e020d48f782f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3295896,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_a763612f8473003b55e255fb62aba5f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5dba36-30ea-5c84-bcad-e020d48f782f/ac5dba36-30ea-5c84-bcad-e020d48f782f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_b359c84d6b15593c0c26a9a1925c0bc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5dba36-30ea-5c84-bcad-e020d48f782f/ac5dba36-30ea-5c84-bcad-e020d48f782f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_7c6d919d68fbd5a274e516fe3d7a32d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5dba36-30ea-5c84-bcad-e020d48f782f/ac5dba36-30ea-5c84-bcad-e020d48f782f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_db08632d1c4488da71552b2a3ee1ab81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5dba36-30ea-5c84-bcad-e020d48f782f/ac5dba36-30ea-5c84-bcad-e020d48f782f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_3f4abe7bfbe6dd4da05e579eb8663c89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5dba36-30ea-5c84-bcad-e020d48f782f/ac5dba36-30ea-5c84-bcad-e020d48f782f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2746496,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_284eff4f5c95b350f5f6000df03c994a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5dba36-30ea-5c84-bcad-e020d48f782f/ac5dba36-30ea-5c84-bcad-e020d48f782f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_17fb4ea99bfaaeb83644d7d761060d26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5dba36-30ea-5c84-bcad-e020d48f782f/ac5dba36-30ea-5c84-bcad-e020d48f782f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_c49ca8b17541545779d87930e10a6801.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5dba36-30ea-5c84-bcad-e020d48f782f/ac5dba36-30ea-5c84-bcad-e020d48f782f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_c453d0372595e06bae87ee24cbcdd899.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac5dba36-30ea-5c84-bcad-e020d48f782f/ac5dba36-30ea-5c84-bcad-e020d48f782f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/1a/381a1e390b75091d4f0beae5cd09db4b/pa/RP13899_a51f221e50573e4811920085fe260af8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Sports-Line AWD',
 'transmission': 'manual',
 'trim': 'Sports-Line AWD',
 'year': 2017}
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP13899%27 HTTP/1.1" 200 None
2026-03-30 10:52:10 [auto1.de] INFO: Saving data for RP13899: {'created_time': 1774867930.144641, 'last_price_update_time': 1774867930.144652, 'auction_closing_time': 1774971468.0}
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP13899') HTTP/1.1" 204 0
2026-03-30 10:52:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d144628a-4656-5d46-a886-51bedf0a9c24 with identifier: CC70846
2026-03-30 10:52:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d144628a-4656-5d46-a886-51bedf0a9c24 with identifier: CC70846
2026-03-30 10:52:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d144628a-4656-5d46-a886-51bedf0a9c24 with identifier: CC70846 to the API
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:17:13Z',
 'fuel_type': 'petrol',
 'id': 'd144628a-4656-5d46-a886-51bedf0a9c24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC70846',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 37280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-28',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2017}
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC70846%27 HTTP/1.1" 200 None
2026-03-30 10:52:10 [auto1.de] INFO: Saving data for CC70846: {'auction_closing_time': 1774970233.0, 'created_time': 1773775697.626687, 'last_price_update_time': 1774867930.484886}
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC70846') HTTP/1.1" 204 0
2026-03-30 10:52:10 [auto1.de] INFO: Found listing with ID: NJ97251
2026-03-30 10:52:10 [auto1.de] INFO: Found listing with ID: AJ07817
2026-03-30 10:52:10 [auto1.de] INFO: Found listing with ID: MR26269
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR26269%27 HTTP/1.1" 200 None
2026-03-30 10:52:10 [auto1.de] INFO: Scrape type for MR26269: 2
2026-03-30 10:52:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef8935d6-1401-5ea6-9a31-8b6579bc55f1 with identifier: MR26269
2026-03-30 10:52:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef8935d6-1401-5ea6-9a31-8b6579bc55f1 with scrape type 2
2026-03-30 10:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef8935d6-1401-5ea6-9a31-8b6579bc55f1 with scrape type 2
2026-03-30 10:52:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef8935d6-1401-5ea6-9a31-8b6579bc55f1, identifier: MR26269
2026-03-30 10:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB76983> (referer: https://www.auto1.com/v1/car-details-view/CB76983/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU73631/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ49239/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS95122> (referer: https://www.auto1.com/v1/car-details-view/SS95122/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef8935d6-1401-5ea6-9a31-8b6579bc55f1 with identifier: MR26269
2026-03-30 10:52:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef8935d6-1401-5ea6-9a31-8b6579bc55f1 with identifier: MR26269
2026-03-30 10:52:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef8935d6-1401-5ea6-9a31-8b6579bc55f1 with identifier: MR26269 to the API
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:56:29Z',
 'fuel_type': 'petrol',
 'id': 'ef8935d6-1401-5ea6-9a31-8b6579bc55f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR26269',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 208178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-18',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2010}
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR26269%27 HTTP/1.1" 200 None
2026-03-30 10:52:10 [auto1.de] INFO: Saving data for MR26269: {'auction_closing_time': 1774972589.0, 'created_time': 1773301975.073978, 'last_price_update_time': 1774867930.956965}
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR26269') HTTP/1.1" 204 0
2026-03-30 10:52:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:10 [auto1.de] INFO: Found listing with ID: PD71569
2026-03-30 10:52:10 [auto1.de] INFO: Found listing with ID: PS41324
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS41324%27 HTTP/1.1" 200 None
2026-03-30 10:52:11 [auto1.de] INFO: Scrape type for PS41324: 2
2026-03-30 10:52:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f72570d-01a0-5205-b2fb-dab63431c9a4 with identifier: PS41324
2026-03-30 10:52:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f72570d-01a0-5205-b2fb-dab63431c9a4 with scrape type 2
2026-03-30 10:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f72570d-01a0-5205-b2fb-dab63431c9a4 with scrape type 2
2026-03-30 10:52:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f72570d-01a0-5205-b2fb-dab63431c9a4, identifier: PS41324
2026-03-30 10:52:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f72570d-01a0-5205-b2fb-dab63431c9a4 with identifier: PS41324
2026-03-30 10:52:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f72570d-01a0-5205-b2fb-dab63431c9a4 with identifier: PS41324
2026-03-30 10:52:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f72570d-01a0-5205-b2fb-dab63431c9a4 with identifier: PS41324 to the API
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 710,
 'expiration_date': '2026-03-31T15:53:23Z',
 'fuel_type': 'petrol',
 'id': '8f72570d-01a0-5205-b2fb-dab63431c9a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS41324',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 136416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-27',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 6.2 V8 Trailhawk',
 'transmission': 'automatic',
 'trim': 'Trailhawk',
 'year': 2018}
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS41324%27 HTTP/1.1" 200 None
2026-03-30 10:52:11 [auto1.de] INFO: Saving data for PS41324: {'auction_closing_time': 1774972403.0, 'created_time': 1773775266.657383, 'last_price_update_time': 1774867931.419914}
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS41324') HTTP/1.1" 204 0
2026-03-30 10:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ72325> (referer: https://www.auto1.com/v1/car-details-view/MJ72325/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:11 [auto1.de] INFO: Found listing with ID: NJ32517
2026-03-30 10:52:11 [auto1.de] INFO: Found listing with ID: TY96424
2026-03-30 10:52:11 [auto1.de] INFO: Found listing with ID: CM85827
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM85827%27 HTTP/1.1" 200 None
2026-03-30 10:52:11 [auto1.de] INFO: Scrape type for CM85827: 2
2026-03-30 10:52:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53ebd26-a5e3-5bb6-8a34-1da79f65d08f with identifier: CM85827
2026-03-30 10:52:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53ebd26-a5e3-5bb6-8a34-1da79f65d08f with scrape type 2
2026-03-30 10:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e53ebd26-a5e3-5bb6-8a34-1da79f65d08f with scrape type 2
2026-03-30 10:52:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e53ebd26-a5e3-5bb6-8a34-1da79f65d08f, identifier: CM85827
2026-03-30 10:52:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e53ebd26-a5e3-5bb6-8a34-1da79f65d08f with identifier: CM85827
2026-03-30 10:52:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e53ebd26-a5e3-5bb6-8a34-1da79f65d08f with identifier: CM85827
2026-03-30 10:52:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e53ebd26-a5e3-5bb6-8a34-1da79f65d08f with identifier: CM85827 to the API
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:45:26Z',
 'fuel_type': 'petrol',
 'id': 'e53ebd26-a5e3-5bb6-8a34-1da79f65d08f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM85827',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 188348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2016}
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM85827%27 HTTP/1.1" 200 None
2026-03-30 10:52:11 [auto1.de] INFO: Saving data for CM85827: {'auction_closing_time': 1774971926.0, 'created_time': 1773772654.131175, 'last_price_update_time': 1774867931.868718}
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM85827') HTTP/1.1" 204 0
2026-03-30 10:52:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30816682-d2e8-579b-a464-211ad1f9fb76 with identifier: CB76983
2026-03-30 10:52:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30816682-d2e8-579b-a464-211ad1f9fb76 with scrape type 1
2026-03-30 10:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 30816682-d2e8-579b-a464-211ad1f9fb76
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F2f%252Fa92f6c21411b6caf526fc4dad15837a2%252Fpa%252FCB76983_af0c10a876b9a1979dd2345a9b437544.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_af0c10a876b9a1979dd2345a9b437544.jpg not downloaded yet
2026-03-30 10:52:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d720dca-15c0-5967-95f1-2edfdda2f671 with identifier: SS95122
2026-03-30 10:52:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d720dca-15c0-5967-95f1-2edfdda2f671 with scrape type 1
2026-03-30 10:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d720dca-15c0-5967-95f1-2edfdda2f671
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F20%252F1520f980908fb52b90a5f617dcb1b01d%252Fpa%252FSS95122_0855bbc9dd596ff661277f904a4fe2bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_0855bbc9dd596ff661277f904a4fe2bc.jpg already downloaded
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F20%252F1520f980908fb52b90a5f617dcb1b01d%252Fpa%252FSS95122_517f8c6ed4b54088ab2fa9ef84e52230.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_517f8c6ed4b54088ab2fa9ef84e52230.jpg already downloaded
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F20%252F1520f980908fb52b90a5f617dcb1b01d%252Fpa%252FSS95122_7faf8b65b47e5418d4d76cfdf8b9b6a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_7faf8b65b47e5418d4d76cfdf8b9b6a5.jpg already downloaded
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F20%252F1520f980908fb52b90a5f617dcb1b01d%252Fpa%252FSS95122_e1eaa5c6b0de536301523df47cd8fcfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_e1eaa5c6b0de536301523df47cd8fcfa.jpg already downloaded
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F20%252F1520f980908fb52b90a5f617dcb1b01d%252Fpa%252FSS95122_7e236ac9a629b0069ae8f53e587f9691.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_7e236ac9a629b0069ae8f53e587f9691.jpg already downloaded
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F20%252F1520f980908fb52b90a5f617dcb1b01d%252Fpa%252FSS95122_2ffed8901b72b75c3cd64ef8eebaf89e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_2ffed8901b72b75c3cd64ef8eebaf89e.jpg already downloaded
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F20%252F1520f980908fb52b90a5f617dcb1b01d%252Fpa%252FSS95122_82b37eb760f2f2b180913edd948e6b70.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_82b37eb760f2f2b180913edd948e6b70.jpg already downloaded
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F20%252F1520f980908fb52b90a5f617dcb1b01d%252Fpa%252FSS95122_a4150a2bc37fe50e5879999bcecd5df8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_a4150a2bc37fe50e5879999bcecd5df8.jpg already downloaded
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F20%252F1520f980908fb52b90a5f617dcb1b01d%252Fpa%252FSS95122_d217e3b2c746f3f5abfe87c8de56e684.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_d217e3b2c746f3f5abfe87c8de56e684.jpg already downloaded
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F20%252F1520f980908fb52b90a5f617dcb1b01d%252Fpa%252FSS95122_8d9404563c1ab4d77d60ea75619bf9ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_8d9404563c1ab4d77d60ea75619bf9ff.jpg already downloaded
2026-03-30 10:52:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d720dca-15c0-5967-95f1-2edfdda2f671, identifier: SS95122
2026-03-30 10:52:12 [auto1.de] INFO: Found listing with ID: JU24263
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU24263%27 HTTP/1.1" 200 None
2026-03-30 10:52:12 [auto1.de] INFO: Scrape type for JU24263: 2
2026-03-30 10:52:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 854afa04-7f6f-5c5a-b974-8c79561c488d with identifier: JU24263
2026-03-30 10:52:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 854afa04-7f6f-5c5a-b974-8c79561c488d with scrape type 2
2026-03-30 10:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 854afa04-7f6f-5c5a-b974-8c79561c488d with scrape type 2
2026-03-30 10:52:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 854afa04-7f6f-5c5a-b974-8c79561c488d, identifier: JU24263
2026-03-30 10:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM49760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d720dca-15c0-5967-95f1-2edfdda2f671 with identifier: SS95122
2026-03-30 10:52:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d720dca-15c0-5967-95f1-2edfdda2f671 with identifier: SS95122
2026-03-30 10:52:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d720dca-15c0-5967-95f1-2edfdda2f671 with identifier: SS95122 to the API
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SS95122>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:58:07Z',
 'fuel_type': 'diesel',
 'id': '1d720dca-15c0-5967-95f1-2edfdda2f671',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS95122',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 77209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_0855bbc9dd596ff661277f904a4fe2bc.jpg',
                'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_517f8c6ed4b54088ab2fa9ef84e52230.jpg',
                'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_7faf8b65b47e5418d4d76cfdf8b9b6a5.jpg',
                'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_e1eaa5c6b0de536301523df47cd8fcfa.jpg',
                'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_7e236ac9a629b0069ae8f53e587f9691.jpg',
                'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_2ffed8901b72b75c3cd64ef8eebaf89e.jpg',
                'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_82b37eb760f2f2b180913edd948e6b70.jpg',
                'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_a4150a2bc37fe50e5879999bcecd5df8.jpg',
                'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_d217e3b2c746f3f5abfe87c8de56e684.jpg',
                'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_8d9404563c1ab4d77d60ea75619bf9ff.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d720dca-15c0-5967-95f1-2edfdda2f671/1d720dca-15c0-5967-95f1-2edfdda2f671_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2552106,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_0855bbc9dd596ff661277f904a4fe2bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d720dca-15c0-5967-95f1-2edfdda2f671/1d720dca-15c0-5967-95f1-2edfdda2f671_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2577531,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_517f8c6ed4b54088ab2fa9ef84e52230.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d720dca-15c0-5967-95f1-2edfdda2f671/1d720dca-15c0-5967-95f1-2edfdda2f671_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2615491,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_7faf8b65b47e5418d4d76cfdf8b9b6a5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d720dca-15c0-5967-95f1-2edfdda2f671/1d720dca-15c0-5967-95f1-2edfdda2f671_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2656847,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_e1eaa5c6b0de536301523df47cd8fcfa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d720dca-15c0-5967-95f1-2edfdda2f671/1d720dca-15c0-5967-95f1-2edfdda2f671_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_7e236ac9a629b0069ae8f53e587f9691.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d720dca-15c0-5967-95f1-2edfdda2f671/1d720dca-15c0-5967-95f1-2edfdda2f671_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_2ffed8901b72b75c3cd64ef8eebaf89e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d720dca-15c0-5967-95f1-2edfdda2f671/1d720dca-15c0-5967-95f1-2edfdda2f671_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_82b37eb760f2f2b180913edd948e6b70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d720dca-15c0-5967-95f1-2edfdda2f671/1d720dca-15c0-5967-95f1-2edfdda2f671_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_a4150a2bc37fe50e5879999bcecd5df8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d720dca-15c0-5967-95f1-2edfdda2f671/1d720dca-15c0-5967-95f1-2edfdda2f671_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_d217e3b2c746f3f5abfe87c8de56e684.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d720dca-15c0-5967-95f1-2edfdda2f671/1d720dca-15c0-5967-95f1-2edfdda2f671_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/20/1520f980908fb52b90a5f617dcb1b01d/pa/SS95122_8d9404563c1ab4d77d60ea75619bf9ff.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-01',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Active L2',
 'transmission': 'manual',
 'trim': 'Active L2',
 'year': 2021}
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS95122%27 HTTP/1.1" 200 None
2026-03-30 10:52:12 [auto1.de] INFO: Saving data for SS95122: {'created_time': 1774867932.621533, 'last_price_update_time': 1774867932.621541, 'auction_closing_time': 1774972687.0}
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS95122') HTTP/1.1" 204 0
2026-03-30 10:52:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 854afa04-7f6f-5c5a-b974-8c79561c488d with identifier: JU24263
2026-03-30 10:52:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 854afa04-7f6f-5c5a-b974-8c79561c488d with identifier: JU24263
2026-03-30 10:52:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 854afa04-7f6f-5c5a-b974-8c79561c488d with identifier: JU24263 to the API
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:08:56Z',
 'fuel_type': 'diesel',
 'id': '854afa04-7f6f-5c5a-b974-8c79561c488d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU24263',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 167673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-25',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2011}
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU24263%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [auto1.de] INFO: Saving data for JU24263: {'auction_closing_time': 1774969736.0, 'created_time': 1774639173.454075, 'last_price_update_time': 1774867933.062917}
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU24263') HTTP/1.1" 204 0
2026-03-30 10:52:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F2f%252Fa92f6c21411b6caf526fc4dad15837a2%252Fpa%252FCB76983_08746606c3bf32ed84681ea47173c82f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_08746606c3bf32ed84681ea47173c82f.jpg not downloaded yet
2026-03-30 10:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11956c47-f345-5a17-aa0d-d5a796f6ecb9 with identifier: MJ72325
2026-03-30 10:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11956c47-f345-5a17-aa0d-d5a796f6ecb9 with scrape type 1
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 11956c47-f345-5a17-aa0d-d5a796f6ecb9
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F22%252Fdc2285ff2936991abba6b14e847f393e%252Fpa%252FMJ72325_238fecfa6cfe81c8a6894d6a19504738.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_238fecfa6cfe81c8a6894d6a19504738.jpg not downloaded yet
2026-03-30 10:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_ef768aaa188c92f3abfed08d8948553f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:13 [auto1.de] INFO: Found listing with ID: NH24337
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH24337%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [auto1.de] INFO: Scrape type for NH24337: 2
2026-03-30 10:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba8d92f7-0337-5897-98d9-f7a18ada4556 with identifier: NH24337
2026-03-30 10:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba8d92f7-0337-5897-98d9-f7a18ada4556 with scrape type 2
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba8d92f7-0337-5897-98d9-f7a18ada4556 with scrape type 2
2026-03-30 10:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba8d92f7-0337-5897-98d9-f7a18ada4556, identifier: NH24337
2026-03-30 10:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba8d92f7-0337-5897-98d9-f7a18ada4556 with identifier: NH24337
2026-03-30 10:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba8d92f7-0337-5897-98d9-f7a18ada4556 with identifier: NH24337
2026-03-30 10:52:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba8d92f7-0337-5897-98d9-f7a18ada4556 with identifier: NH24337 to the API
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-31T15:30:07Z',
 'fuel_type': 'petrol',
 'id': 'ba8d92f7-0337-5897-98d9-f7a18ada4556',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH24337',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 335565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-03-15',
 'seller_name': None,
 'title': 'Volvo V70 2.4 T',
 'transmission': 'automatic',
 'trim': '',
 'year': 1999}
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH24337%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [auto1.de] INFO: Saving data for NH24337: {'auction_closing_time': 1774971007.0, 'created_time': 1774638230.001542, 'last_price_update_time': 1774867933.605494}
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH24337') HTTP/1.1" 204 0
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F2f%252Fa92f6c21411b6caf526fc4dad15837a2%252Fpa%252FCB76983_02b025b8212f47aeee1d91fbd1e973e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_02b025b8212f47aeee1d91fbd1e973e0.jpg not downloaded yet
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F22%252Fdc2285ff2936991abba6b14e847f393e%252Fpa%252FMJ72325_856a420d2ca7353cc6b0adcd2e303a8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_856a420d2ca7353cc6b0adcd2e303a8e.jpg not downloaded yet
2026-03-30 10:52:13 [auto1.de] INFO: Found listing with ID: XT31842
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT31842%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [auto1.de] INFO: Scrape type for XT31842: 1
2026-03-30 10:52:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F2f%252Fa92f6c21411b6caf526fc4dad15837a2%252Fpa%252FCB76983_d42360321534ed8f775073af6b3d1c8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_d42360321534ed8f775073af6b3d1c8d.jpg not downloaded yet
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F22%252Fdc2285ff2936991abba6b14e847f393e%252Fpa%252FMJ72325_ee4b64ab64063fd7bf179f1253039caf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_ee4b64ab64063fd7bf179f1253039caf.jpg not downloaded yet
2026-03-30 10:52:13 [auto1.de] INFO: Found listing with ID: UU93742
2026-03-30 10:52:13 [auto1.de] INFO: Found listing with ID: UX23501
2026-03-30 10:52:13 [auto1.de] INFO: Found listing with ID: NE88394
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE88394%27 HTTP/1.1" 200 None
2026-03-30 10:52:13 [auto1.de] INFO: Scrape type for NE88394: 2
2026-03-30 10:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b9bf916-2b45-5a77-a3ea-74f6bd76dc53 with identifier: NE88394
2026-03-30 10:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b9bf916-2b45-5a77-a3ea-74f6bd76dc53 with scrape type 2
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b9bf916-2b45-5a77-a3ea-74f6bd76dc53 with scrape type 2
2026-03-30 10:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b9bf916-2b45-5a77-a3ea-74f6bd76dc53, identifier: NE88394
2026-03-30 10:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e955d0>
2026-03-30 10:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fd5%252F5ad527e21b2f64aa0a89a2612f9662d7%252Fpa%252FYP95979_ef768aaa188c92f3abfed08d8948553f.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_ef768aaa188c92f3abfed08d8948553f.jpg saved to cache
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5da3edb5-533e-566e-83ea-6c01e2626b99
2026-03-30 10:52:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5da3edb5-533e-566e-83ea-6c01e2626b99, skipping ID generation
2026-03-30 10:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da3edb5-533e-566e-83ea-6c01e2626b99 with scrape type 1
2026-03-30 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5da3edb5-533e-566e-83ea-6c01e2626b99 sending to next pipeline
2026-03-30 10:52:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5da3edb5-533e-566e-83ea-6c01e2626b99, identifier: YP95979
2026-03-30 10:52:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b9bf916-2b45-5a77-a3ea-74f6bd76dc53 with identifier: NE88394
2026-03-30 10:52:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b9bf916-2b45-5a77-a3ea-74f6bd76dc53 with identifier: NE88394
2026-03-30 10:52:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b9bf916-2b45-5a77-a3ea-74f6bd76dc53 with identifier: NE88394 to the API
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:55:04Z',
 'fuel_type': 'petrol',
 'id': '6b9bf916-2b45-5a77-a3ea-74f6bd76dc53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE88394',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 192031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2017}
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE88394%27 HTTP/1.1" 200 None
2026-03-30 10:52:14 [auto1.de] INFO: Saving data for NE88394: {'auction_closing_time': 1774972504.0, 'created_time': 1774349421.360799, 'last_price_update_time': 1774867934.431295}
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE88394') HTTP/1.1" 204 0
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F2f%252Fa92f6c21411b6caf526fc4dad15837a2%252Fpa%252FCB76983_056b50ec55d637824e65fd46cf99fcd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_056b50ec55d637824e65fd46cf99fcd8.jpg not downloaded yet
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F22%252Fdc2285ff2936991abba6b14e847f393e%252Fpa%252FMJ72325_b1bdf66396bdd7eeff84dca5ed0d3968.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_b1bdf66396bdd7eeff84dca5ed0d3968.jpg not downloaded yet
2026-03-30 10:52:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5da3edb5-533e-566e-83ea-6c01e2626b99 with identifier: YP95979
2026-03-30 10:52:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5da3edb5-533e-566e-83ea-6c01e2626b99 with identifier: YP95979
2026-03-30 10:52:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5da3edb5-533e-566e-83ea-6c01e2626b99 with identifier: YP95979 to the API
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_ef768aaa188c92f3abfed08d8948553f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:28:01Z',
 'fuel_type': 'petrol',
 'id': '5da3edb5-533e-566e-83ea-6c01e2626b99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP95979',
 'listing': 'auction',
 'location': 'DE, Landsberg am Lech',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 66963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_93edc3a9dc93a276d3aaaddc9a01ec18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_fc1245af9eee0f5b3e19c99065f3abb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_ef768aaa188c92f3abfed08d8948553f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_da32d5fe513fdc49f29c961e605dada2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_d767b86e6716b437803ac71b1650ec22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_0eca734820bf8e597eae73139a6c8728.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_28b59e4fdc6da933f7edb4937efe846a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_4aee2fc2ff2777b48a252c6f08d44d0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_74155d87d855cc22f93cbdda8260d1f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da3edb5-533e-566e-83ea-6c01e2626b99/5da3edb5-533e-566e-83ea-6c01e2626b99_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2765099,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/d5/5ad527e21b2f64aa0a89a2612f9662d7/pa/YP95979_26b6c4ebd8b130d456e5d53971465e0d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.6 TGDI Premium 4WD',
 'transmission': 'automatic',
 'trim': 'Premium 4WD',
 'year': 2018}
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP95979%27 HTTP/1.1" 200 None
2026-03-30 10:52:14 [auto1.de] INFO: Saving data for YP95979: {'created_time': 1774867934.894236, 'last_price_update_time': 1774867934.894248, 'auction_closing_time': 1774970881.0}
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP95979') HTTP/1.1" 204 0
2026-03-30 10:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_238fecfa6cfe81c8a6894d6a19504738.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:14 [auto1.de] INFO: Found listing with ID: VJ35492
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ35492%27 HTTP/1.1" 200 None
2026-03-30 10:52:14 [auto1.de] INFO: Scrape type for VJ35492: 2
2026-03-30 10:52:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08d94439-a7fa-521a-9783-0250cb71c8d1 with identifier: VJ35492
2026-03-30 10:52:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08d94439-a7fa-521a-9783-0250cb71c8d1 with scrape type 2
2026-03-30 10:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08d94439-a7fa-521a-9783-0250cb71c8d1 with scrape type 2
2026-03-30 10:52:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08d94439-a7fa-521a-9783-0250cb71c8d1, identifier: VJ35492
2026-03-30 10:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08d94439-a7fa-521a-9783-0250cb71c8d1 with identifier: VJ35492
2026-03-30 10:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08d94439-a7fa-521a-9783-0250cb71c8d1 with identifier: VJ35492
2026-03-30 10:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08d94439-a7fa-521a-9783-0250cb71c8d1 with identifier: VJ35492 to the API
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:36:28Z',
 'fuel_type': 'diesel',
 'id': '08d94439-a7fa-521a-9783-0250cb71c8d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ35492',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 199166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-26',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2014}
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ35492%27 HTTP/1.1" 200 None
2026-03-30 10:52:15 [auto1.de] INFO: Saving data for VJ35492: {'auction_closing_time': 1774971388.0, 'created_time': 1774262663.163971, 'last_price_update_time': 1774867935.362188}
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ35492') HTTP/1.1" 204 0
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F22%252Fdc2285ff2936991abba6b14e847f393e%252Fpa%252FMJ72325_9f7a86d8127b20da882bfca704e2cc4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_9f7a86d8127b20da882bfca704e2cc4f.jpg not downloaded yet
2026-03-30 10:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW34128> (referer: https://www.auto1.com/v1/car-details-view/LW34128/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE11265> (referer: https://www.auto1.com/v1/car-details-view/DE11265/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.618(s), this was the 1st time calling it.
2026-03-30 10:52:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.3203135380600743 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:52:15 [auto1.de] INFO: Found listing with ID: ZF59355
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF59355%27 HTTP/1.1" 200 None
2026-03-30 10:52:15 [auto1.de] INFO: Scrape type for ZF59355: 2
2026-03-30 10:52:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0fcfcee-47a1-5e17-b331-1e2462f0e79b with identifier: ZF59355
2026-03-30 10:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0fcfcee-47a1-5e17-b331-1e2462f0e79b with scrape type 2
2026-03-30 10:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0fcfcee-47a1-5e17-b331-1e2462f0e79b with scrape type 2
2026-03-30 10:52:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0fcfcee-47a1-5e17-b331-1e2462f0e79b, identifier: ZF59355
2026-03-30 10:52:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG43555/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EV09512> (referer: https://www.auto1.com/v1/car-details-view/EV09512/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0fcfcee-47a1-5e17-b331-1e2462f0e79b with identifier: ZF59355
2026-03-30 10:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0fcfcee-47a1-5e17-b331-1e2462f0e79b with identifier: ZF59355
2026-03-30 10:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0fcfcee-47a1-5e17-b331-1e2462f0e79b with identifier: ZF59355 to the API
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:50:21Z',
 'fuel_type': 'petrol',
 'id': 'b0fcfcee-47a1-5e17-b331-1e2462f0e79b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF59355',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 50837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-27',
 'seller_name': None,
 'title': 'Ford B-Max 1.4 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF59355%27 HTTP/1.1" 200 None
2026-03-30 10:52:15 [auto1.de] INFO: Saving data for ZF59355: {'auction_closing_time': 1774972221.0, 'created_time': 1774380790.595997, 'last_price_update_time': 1774867935.822351}
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF59355') HTTP/1.1" 204 0
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F22%252Fdc2285ff2936991abba6b14e847f393e%252Fpa%252FMJ72325_b17dabf8114c419b5c95ab47d34063bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_b17dabf8114c419b5c95ab47d34063bb.jpg not downloaded yet
2026-03-30 10:52:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a8d650>
2026-03-30 10:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11956c47-f345-5a17-aa0d-d5a796f6ecb9/11956c47-f345-5a17-aa0d-d5a796f6ecb9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F22%252Fdc2285ff2936991abba6b14e847f393e%252Fpa%252FMJ72325_238fecfa6cfe81c8a6894d6a19504738.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_238fecfa6cfe81c8a6894d6a19504738.jpg saved to cache
2026-03-30 10:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11956c47-f345-5a17-aa0d-d5a796f6ecb9
2026-03-30 10:52:15 [auto1.de] INFO: Found listing with ID: CV85999
2026-03-30 10:52:15 [auto1.de] INFO: Found listing with ID: HZ65828
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ65828%27 HTTP/1.1" 200 None
2026-03-30 10:52:15 [auto1.de] INFO: Scrape type for HZ65828: 2
2026-03-30 10:52:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a17deae-c16c-5cc2-90ee-2eff14ba8ed8 with identifier: HZ65828
2026-03-30 10:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a17deae-c16c-5cc2-90ee-2eff14ba8ed8 with scrape type 2
2026-03-30 10:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a17deae-c16c-5cc2-90ee-2eff14ba8ed8 with scrape type 2
2026-03-30 10:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a17deae-c16c-5cc2-90ee-2eff14ba8ed8, identifier: HZ65828
2026-03-30 10:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_ee4b64ab64063fd7bf179f1253039caf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a17deae-c16c-5cc2-90ee-2eff14ba8ed8 with identifier: HZ65828
2026-03-30 10:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a17deae-c16c-5cc2-90ee-2eff14ba8ed8 with identifier: HZ65828
2026-03-30 10:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a17deae-c16c-5cc2-90ee-2eff14ba8ed8 with identifier: HZ65828 to the API
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:49:27Z',
 'fuel_type': 'petrol',
 'id': '1a17deae-c16c-5cc2-90ee-2eff14ba8ed8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ65828',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 157712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-08',
 'seller_name': None,
 'title': 'Fiat Doblo 1.4 SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2013}
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ65828%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [auto1.de] INFO: Saving data for HZ65828: {'auction_closing_time': 1774972167.0, 'created_time': 1774381119.619163, 'last_price_update_time': 1774867936.342186}
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ65828') HTTP/1.1" 204 0
2026-03-30 10:52:16 [auto1.de] INFO: Found listing with ID: EY69917
2026-03-30 10:52:16 [auto1.de] INFO: Found listing with ID: CP53358
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP53358%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [auto1.de] INFO: Scrape type for CP53358: 2
2026-03-30 10:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb60e803-b15d-5500-8354-f96d34fa2758 with identifier: CP53358
2026-03-30 10:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb60e803-b15d-5500-8354-f96d34fa2758 with scrape type 2
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb60e803-b15d-5500-8354-f96d34fa2758 with scrape type 2
2026-03-30 10:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb60e803-b15d-5500-8354-f96d34fa2758, identifier: CP53358
2026-03-30 10:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 346cbdf4-9c71-50ea-b1e9-4bc50d33b195 with identifier: LW34128
2026-03-30 10:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 346cbdf4-9c71-50ea-b1e9-4bc50d33b195 with scrape type 1
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 346cbdf4-9c71-50ea-b1e9-4bc50d33b195
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_ab59c2930e71610b6ee0098089c6c5e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_ab59c2930e71610b6ee0098089c6c5e9.jpg not downloaded yet
2026-03-30 10:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef94debc-c55a-546a-a899-20e73f821f4a with identifier: DE11265
2026-03-30 10:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef94debc-c55a-546a-a899-20e73f821f4a with scrape type 1
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef94debc-c55a-546a-a899-20e73f821f4a
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_06438f7a05a4f0b0f7b8690f72764446.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_06438f7a05a4f0b0f7b8690f72764446.jpg not downloaded yet
2026-03-30 10:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49428f9a-8736-50ad-9592-546beaca3657 with identifier: EV09512
2026-03-30 10:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49428f9a-8736-50ad-9592-546beaca3657 with scrape type 1
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49428f9a-8736-50ad-9592-546beaca3657
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F02%252F220206ad00b13c3bdf1d99e170ae1f6e%252Fpa%252FEV09512_c8787b146c0630070ae6917ac7c2049f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_c8787b146c0630070ae6917ac7c2049f.jpg already downloaded
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F02%252F220206ad00b13c3bdf1d99e170ae1f6e%252Fpa%252FEV09512_f2200c8d9d4edf3a58d4117351b6e9a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_f2200c8d9d4edf3a58d4117351b6e9a3.jpg already downloaded
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F02%252F220206ad00b13c3bdf1d99e170ae1f6e%252Fpa%252FEV09512_f4678a9daedc976bf9e2de0fd8ef5b21.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_f4678a9daedc976bf9e2de0fd8ef5b21.jpg already downloaded
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F02%252F220206ad00b13c3bdf1d99e170ae1f6e%252Fpa%252FEV09512_5f7557d797db4c4784472a5ffbdcfd39.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_5f7557d797db4c4784472a5ffbdcfd39.jpg already downloaded
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F02%252F220206ad00b13c3bdf1d99e170ae1f6e%252Fpa%252FEV09512_41e2466ef0114897fec1278be31e3e5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_41e2466ef0114897fec1278be31e3e5c.jpg already downloaded
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F02%252F220206ad00b13c3bdf1d99e170ae1f6e%252Fpa%252FEV09512_5aa4ddc64a12fa63d4129c5a580cfb24.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_5aa4ddc64a12fa63d4129c5a580cfb24.jpg already downloaded
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F02%252F220206ad00b13c3bdf1d99e170ae1f6e%252Fpa%252FEV09512_d2860c6aa2f95a83d023f185d1098bd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_d2860c6aa2f95a83d023f185d1098bd4.jpg already downloaded
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F02%252F220206ad00b13c3bdf1d99e170ae1f6e%252Fpa%252FEV09512_bd2b4970801511969846bbeefd5da424.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_bd2b4970801511969846bbeefd5da424.jpg already downloaded
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F02%252F220206ad00b13c3bdf1d99e170ae1f6e%252Fpa%252FEV09512_c4129ba332ee264385286514831f1fe7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_c4129ba332ee264385286514831f1fe7.jpg already downloaded
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F02%252F220206ad00b13c3bdf1d99e170ae1f6e%252Fpa%252FEV09512_175deeca347c0d960ebd7193f4709340.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_175deeca347c0d960ebd7193f4709340.jpg already downloaded
2026-03-30 10:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49428f9a-8736-50ad-9592-546beaca3657, identifier: EV09512
2026-03-30 10:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb60e803-b15d-5500-8354-f96d34fa2758 with identifier: CP53358
2026-03-30 10:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb60e803-b15d-5500-8354-f96d34fa2758 with identifier: CP53358
2026-03-30 10:52:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb60e803-b15d-5500-8354-f96d34fa2758 with identifier: CP53358 to the API
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 401,
 'expiration_date': '2026-03-31T15:12:20Z',
 'fuel_type': 'petrol',
 'id': 'bb60e803-b15d-5500-8354-f96d34fa2758',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP53358',
 'listing': 'auction',
 'make': 'Dodge',
 'model': 'Ram 1500',
 'odometer': 83856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-12',
 'seller_name': None,
 'title': 'Dodge Ram 1500 5.7 V8 4x4',
 'transmission': 'automatic',
 'trim': '4x4',
 'year': 2017}
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP53358%27 HTTP/1.1" 200 None
2026-03-30 10:52:17 [auto1.de] INFO: Saving data for CP53358: {'auction_closing_time': 1774969940.0, 'created_time': 1774466806.538277, 'last_price_update_time': 1774867937.236389}
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP53358') HTTP/1.1" 204 0
2026-03-30 10:52:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49428f9a-8736-50ad-9592-546beaca3657 with identifier: EV09512
2026-03-30 10:52:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49428f9a-8736-50ad-9592-546beaca3657 with identifier: EV09512
2026-03-30 10:52:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49428f9a-8736-50ad-9592-546beaca3657 with identifier: EV09512 to the API
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EV09512>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:15:54Z',
 'fuel_type': 'petrol',
 'id': '49428f9a-8736-50ad-9592-546beaca3657',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV09512',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 122173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_c8787b146c0630070ae6917ac7c2049f.jpg',
                'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_f2200c8d9d4edf3a58d4117351b6e9a3.jpg',
                'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_f4678a9daedc976bf9e2de0fd8ef5b21.jpg',
                'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_5f7557d797db4c4784472a5ffbdcfd39.jpg',
                'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_41e2466ef0114897fec1278be31e3e5c.jpg',
                'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_5aa4ddc64a12fa63d4129c5a580cfb24.jpg',
                'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_d2860c6aa2f95a83d023f185d1098bd4.jpg',
                'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_bd2b4970801511969846bbeefd5da424.jpg',
                'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_c4129ba332ee264385286514831f1fe7.jpg',
                'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_175deeca347c0d960ebd7193f4709340.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49428f9a-8736-50ad-9592-546beaca3657/49428f9a-8736-50ad-9592-546beaca3657_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2676543,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_c8787b146c0630070ae6917ac7c2049f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49428f9a-8736-50ad-9592-546beaca3657/49428f9a-8736-50ad-9592-546beaca3657_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2713993,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_f2200c8d9d4edf3a58d4117351b6e9a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49428f9a-8736-50ad-9592-546beaca3657/49428f9a-8736-50ad-9592-546beaca3657_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_f4678a9daedc976bf9e2de0fd8ef5b21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49428f9a-8736-50ad-9592-546beaca3657/49428f9a-8736-50ad-9592-546beaca3657_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_5f7557d797db4c4784472a5ffbdcfd39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49428f9a-8736-50ad-9592-546beaca3657/49428f9a-8736-50ad-9592-546beaca3657_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2907846,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_41e2466ef0114897fec1278be31e3e5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49428f9a-8736-50ad-9592-546beaca3657/49428f9a-8736-50ad-9592-546beaca3657_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2789937,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_5aa4ddc64a12fa63d4129c5a580cfb24.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49428f9a-8736-50ad-9592-546beaca3657/49428f9a-8736-50ad-9592-546beaca3657_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3165161,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_d2860c6aa2f95a83d023f185d1098bd4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49428f9a-8736-50ad-9592-546beaca3657/49428f9a-8736-50ad-9592-546beaca3657_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2886841,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_bd2b4970801511969846bbeefd5da424.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49428f9a-8736-50ad-9592-546beaca3657/49428f9a-8736-50ad-9592-546beaca3657_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_c4129ba332ee264385286514831f1fe7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49428f9a-8736-50ad-9592-546beaca3657/49428f9a-8736-50ad-9592-546beaca3657_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2859854,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/02/220206ad00b13c3bdf1d99e170ae1f6e/pa/EV09512_175deeca347c0d960ebd7193f4709340.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2018}
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV09512%27 HTTP/1.1" 200 None
2026-03-30 10:52:17 [auto1.de] INFO: Saving data for EV09512: {'created_time': 1774867937.684783, 'last_price_update_time': 1774867937.684792, 'auction_closing_time': 1774970154.0}
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV09512') HTTP/1.1" 204 0
2026-03-30 10:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_b1bdf66396bdd7eeff84dca5ed0d3968.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_9f7a86d8127b20da882bfca704e2cc4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_d42360321534ed8f775073af6b3d1c8d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_8ba110814294c85aa1d711f3c7592b47.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_8ba110814294c85aa1d711f3c7592b47.jpg not downloaded yet
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_2a131e32346347cca6d8c3c58a530d58.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_2a131e32346347cca6d8c3c58a530d58.jpg not downloaded yet
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b09c90>
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11956c47-f345-5a17-aa0d-d5a796f6ecb9/11956c47-f345-5a17-aa0d-d5a796f6ecb9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F22%252Fdc2285ff2936991abba6b14e847f393e%252Fpa%252FMJ72325_ee4b64ab64063fd7bf179f1253039caf.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_ee4b64ab64063fd7bf179f1253039caf.jpg saved to cache
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11956c47-f345-5a17-aa0d-d5a796f6ecb9
2026-03-30 10:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_056b50ec55d637824e65fd46cf99fcd8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_b17dabf8114c419b5c95ab47d34063bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_88b94ef01fc2ae73cbadf8258a1e6a03.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_88b94ef01fc2ae73cbadf8258a1e6a03.jpg not downloaded yet
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_a339d50ca1901c820227b555f48c1c43.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_a339d50ca1901c820227b555f48c1c43.jpg not downloaded yet
2026-03-30 10:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF76143> (referer: https://www.auto1.com/v1/car-details-view/FF76143/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA81988> (referer: https://www.auto1.com/v1/car-details-view/XA81988/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_6b6f0238c83cbee3564c4481cc956e35.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_6b6f0238c83cbee3564c4481cc956e35.jpg not downloaded yet
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_47c6ae55fa21eb0f56ec86fc525fae19.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_47c6ae55fa21eb0f56ec86fc525fae19.jpg not downloaded yet
2026-03-30 10:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_ab59c2930e71610b6ee0098089c6c5e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_cbfca3a83135e332c211a0f4b7d791c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_cbfca3a83135e332c211a0f4b7d791c9.jpg not downloaded yet
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_2c8036b3664a173989ce6df0af1f51b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_2c8036b3664a173989ce6df0af1f51b2.jpg not downloaded yet
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef593cf50>
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11956c47-f345-5a17-aa0d-d5a796f6ecb9/11956c47-f345-5a17-aa0d-d5a796f6ecb9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F22%252Fdc2285ff2936991abba6b14e847f393e%252Fpa%252FMJ72325_b1bdf66396bdd7eeff84dca5ed0d3968.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_b1bdf66396bdd7eeff84dca5ed0d3968.jpg saved to cache
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11956c47-f345-5a17-aa0d-d5a796f6ecb9
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c69810>
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11956c47-f345-5a17-aa0d-d5a796f6ecb9/11956c47-f345-5a17-aa0d-d5a796f6ecb9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F22%252Fdc2285ff2936991abba6b14e847f393e%252Fpa%252FMJ72325_9f7a86d8127b20da882bfca704e2cc4f.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_9f7a86d8127b20da882bfca704e2cc4f.jpg saved to cache
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11956c47-f345-5a17-aa0d-d5a796f6ecb9
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e69350>
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30816682-d2e8-579b-a464-211ad1f9fb76/30816682-d2e8-579b-a464-211ad1f9fb76_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F2f%252Fa92f6c21411b6caf526fc4dad15837a2%252Fpa%252FCB76983_d42360321534ed8f775073af6b3d1c8d.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_d42360321534ed8f775073af6b3d1c8d.jpg saved to cache
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30816682-d2e8-579b-a464-211ad1f9fb76
2026-03-30 10:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_06438f7a05a4f0b0f7b8690f72764446.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_2a131e32346347cca6d8c3c58a530d58.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_8ba110814294c85aa1d711f3c7592b47.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_2179ed83de210cbe30fe34e02332b4c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_2179ed83de210cbe30fe34e02332b4c5.jpg not downloaded yet
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_6012e7c6424be5f97631942f60abc43b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_6012e7c6424be5f97631942f60abc43b.jpg not downloaded yet
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b1a90>
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30816682-d2e8-579b-a464-211ad1f9fb76/30816682-d2e8-579b-a464-211ad1f9fb76_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F2f%252Fa92f6c21411b6caf526fc4dad15837a2%252Fpa%252FCB76983_056b50ec55d637824e65fd46cf99fcd8.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_056b50ec55d637824e65fd46cf99fcd8.jpg saved to cache
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30816682-d2e8-579b-a464-211ad1f9fb76
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a7fb50>
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11956c47-f345-5a17-aa0d-d5a796f6ecb9/11956c47-f345-5a17-aa0d-d5a796f6ecb9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F22%252Fdc2285ff2936991abba6b14e847f393e%252Fpa%252FMJ72325_b17dabf8114c419b5c95ab47d34063bb.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_b17dabf8114c419b5c95ab47d34063bb.jpg saved to cache
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11956c47-f345-5a17-aa0d-d5a796f6ecb9
2026-03-30 10:52:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 115518fb-70f7-5f04-866d-268cdb6b3cf8 with identifier: FF76143
2026-03-30 10:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 115518fb-70f7-5f04-866d-268cdb6b3cf8 with scrape type 1
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 115518fb-70f7-5f04-866d-268cdb6b3cf8
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_d456cbc6e6bae3649ae11fb33cdea59b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_d456cbc6e6bae3649ae11fb33cdea59b.jpg not downloaded yet
2026-03-30 10:52:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16693ea5-36be-5d75-b0d3-a0c9c1af9e15 with identifier: XA81988
2026-03-30 10:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16693ea5-36be-5d75-b0d3-a0c9c1af9e15 with scrape type 1
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 16693ea5-36be-5d75-b0d3-a0c9c1af9e15
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_a04487eb3f94d8a28aced4ded6e2d556.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_a04487eb3f94d8a28aced4ded6e2d556.jpg not downloaded yet
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5087ad0>
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_ab59c2930e71610b6ee0098089c6c5e9.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_ab59c2930e71610b6ee0098089c6c5e9.jpg saved to cache
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 346cbdf4-9c71-50ea-b1e9-4bc50d33b195
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_cd7b935970590b8836ef5ec168b1ecb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_cd7b935970590b8836ef5ec168b1ecb7.jpg not downloaded yet
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_5c2ac1871a81266554544c4b195018ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_5c2ac1871a81266554544c4b195018ab.jpg not downloaded yet
2026-03-30 10:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_47c6ae55fa21eb0f56ec86fc525fae19.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_aad7b681b6e82a811cd0e6c49d3333ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_aad7b681b6e82a811cd0e6c49d3333ae.jpg not downloaded yet
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_9f8a2673aa0fe02556c481bfc4508efe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_9f8a2673aa0fe02556c481bfc4508efe.jpg not downloaded yet
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50744d0>
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_06438f7a05a4f0b0f7b8690f72764446.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_06438f7a05a4f0b0f7b8690f72764446.jpg saved to cache
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef94debc-c55a-546a-a899-20e73f821f4a
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59612d0>
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_2a131e32346347cca6d8c3c58a530d58.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_2a131e32346347cca6d8c3c58a530d58.jpg saved to cache
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef94debc-c55a-546a-a899-20e73f821f4a
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef595d750>
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_8ba110814294c85aa1d711f3c7592b47.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_8ba110814294c85aa1d711f3c7592b47.jpg saved to cache
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 346cbdf4-9c71-50ea-b1e9-4bc50d33b195
2026-03-30 10:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_a339d50ca1901c820227b555f48c1c43.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_f08e2222f0cec732a0b8cc6319a09df0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_f08e2222f0cec732a0b8cc6319a09df0.jpg not downloaded yet
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_f3df911cdc11d8a60ac5b42cdc325188.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_f3df911cdc11d8a60ac5b42cdc325188.jpg not downloaded yet
2026-03-30 10:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_6b6f0238c83cbee3564c4481cc956e35.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_2c8036b3664a173989ce6df0af1f51b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_08cec7f5a3e321bb5dcfb6b6de1a5a0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_08cec7f5a3e321bb5dcfb6b6de1a5a0b.jpg not downloaded yet
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_a4e7cc7c5b4de4591d74ffdb857f39d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_a4e7cc7c5b4de4591d74ffdb857f39d1.jpg not downloaded yet
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_ae3e8c0337092a9e492f1e292223d409.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_ae3e8c0337092a9e492f1e292223d409.jpg not downloaded yet
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_501899bbef0636d2102e7858dfa39931.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_501899bbef0636d2102e7858dfa39931.jpg not downloaded yet
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fbbc50>
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_47c6ae55fa21eb0f56ec86fc525fae19.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_47c6ae55fa21eb0f56ec86fc525fae19.jpg saved to cache
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef94debc-c55a-546a-a899-20e73f821f4a
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_c6658b142f0eaba32dee8c1b972cb08c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_c6658b142f0eaba32dee8c1b972cb08c.jpg not downloaded yet
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_b880e154e15dd63d71e4bfe83f781b3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_b880e154e15dd63d71e4bfe83f781b3e.jpg not downloaded yet
2026-03-30 10:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_a04487eb3f94d8a28aced4ded6e2d556.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_a5ad639f055ec850dff71119eade66c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_a5ad639f055ec850dff71119eade66c6.jpg not downloaded yet
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_b17a127644856b1b4e84b74139f7ab81.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_b17a127644856b1b4e84b74139f7ab81.jpg not downloaded yet
2026-03-30 10:52:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_5c2ac1871a81266554544c4b195018ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_220d9c7ea305b45cb664e516a4a56429.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_220d9c7ea305b45cb664e516a4a56429.jpg not downloaded yet
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_23a8abf516d7ca11603ccc8953d212c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_23a8abf516d7ca11603ccc8953d212c4.jpg not downloaded yet
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5119f10>
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_a339d50ca1901c820227b555f48c1c43.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_a339d50ca1901c820227b555f48c1c43.jpg saved to cache
2026-03-30 10:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef94debc-c55a-546a-a899-20e73f821f4a
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0ced0>
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_6b6f0238c83cbee3564c4481cc956e35.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_6b6f0238c83cbee3564c4481cc956e35.jpg saved to cache
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 346cbdf4-9c71-50ea-b1e9-4bc50d33b195
2026-03-30 10:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e50190>
2026-03-30 10:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_2c8036b3664a173989ce6df0af1f51b2.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_2c8036b3664a173989ce6df0af1f51b2.jpg saved to cache
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef94debc-c55a-546a-a899-20e73f821f4a
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_47bea493327c63de5eeb79aebd796a43.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_47bea493327c63de5eeb79aebd796a43.jpg not downloaded yet
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_d38431a1a80fb7f8cb6d143211492ea7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_d38431a1a80fb7f8cb6d143211492ea7.jpg not downloaded yet
2026-03-30 10:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LD79008> (referer: https://www.auto1.com/v1/car-details-view/LD79008/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_501899bbef0636d2102e7858dfa39931.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_3ab13255a9d873393b5f71e3be544e79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_3ab13255a9d873393b5f71e3be544e79.jpg not downloaded yet
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_78382e3f45d308d6311acc1427ab3664.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_78382e3f45d308d6311acc1427ab3664.jpg not downloaded yet
2026-03-30 10:52:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX27248/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YG75934> (referer: https://www.auto1.com/v1/car-details-view/YG75934/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5961010>
2026-03-30 10:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_a04487eb3f94d8a28aced4ded6e2d556.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_a04487eb3f94d8a28aced4ded6e2d556.jpg saved to cache
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16693ea5-36be-5d75-b0d3-a0c9c1af9e15
2026-03-30 10:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a31fd0>
2026-03-30 10:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_5c2ac1871a81266554544c4b195018ab.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_5c2ac1871a81266554544c4b195018ab.jpg saved to cache
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef94debc-c55a-546a-a899-20e73f821f4a
2026-03-30 10:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_b880e154e15dd63d71e4bfe83f781b3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_c870071f4fa0cc47b2eadf6685981fab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_c870071f4fa0cc47b2eadf6685981fab.jpg not downloaded yet
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_96a58669539890bf7ce00d151810669c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_96a58669539890bf7ce00d151810669c.jpg not downloaded yet
2026-03-30 10:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ31329/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_9a5da2fc8dc27eb42360a0c52605b2db.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_9a5da2fc8dc27eb42360a0c52605b2db.jpg not downloaded yet
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_e6b7a3b6ebff32a0792030345836bc47.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_e6b7a3b6ebff32a0792030345836bc47.jpg not downloaded yet
2026-03-30 10:52:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdfeff04-515e-5e43-9c4c-2eadb6efab77 with identifier: LD79008
2026-03-30 10:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdfeff04-515e-5e43-9c4c-2eadb6efab77 with scrape type 1
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cdfeff04-515e-5e43-9c4c-2eadb6efab77
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F76%252F0d7643c5915aaadf20a6dd15f232ddf7%252Fpa%252FLD79008_a3f54ee60331b856584cf21fee081cb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_a3f54ee60331b856584cf21fee081cb1.jpg already downloaded
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F76%252F0d7643c5915aaadf20a6dd15f232ddf7%252Fpa%252FLD79008_3f5583fe19f117b436023ce37cd64f40.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_3f5583fe19f117b436023ce37cd64f40.jpg already downloaded
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F76%252F0d7643c5915aaadf20a6dd15f232ddf7%252Fpa%252FLD79008_7a89c69d0a82cad1501de1455d796faf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_7a89c69d0a82cad1501de1455d796faf.jpg already downloaded
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F76%252F0d7643c5915aaadf20a6dd15f232ddf7%252Fpa%252FLD79008_1286654e2babd7fa6c29128254321f90.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_1286654e2babd7fa6c29128254321f90.jpg already downloaded
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F76%252F0d7643c5915aaadf20a6dd15f232ddf7%252Fpa%252FLD79008_8df11ee826d21dec78307db2cb1c1e94.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_8df11ee826d21dec78307db2cb1c1e94.jpg already downloaded
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F76%252F0d7643c5915aaadf20a6dd15f232ddf7%252Fpa%252FLD79008_3b5eb8da45ffb6121f6f23a2f27d31c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_3b5eb8da45ffb6121f6f23a2f27d31c5.jpg already downloaded
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F76%252F0d7643c5915aaadf20a6dd15f232ddf7%252Fpa%252FLD79008_907f7f93e0ff145511ce216e3e3967bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_907f7f93e0ff145511ce216e3e3967bd.jpg already downloaded
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F76%252F0d7643c5915aaadf20a6dd15f232ddf7%252Fpa%252FLD79008_fdf0a3eb23c749711b69bb17dabbfa84.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_fdf0a3eb23c749711b69bb17dabbfa84.jpg already downloaded
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F76%252F0d7643c5915aaadf20a6dd15f232ddf7%252Fpa%252FLD79008_3556078bdd1be044026f28533e34e51b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_3556078bdd1be044026f28533e34e51b.jpg already downloaded
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F76%252F0d7643c5915aaadf20a6dd15f232ddf7%252Fpa%252FLD79008_9dc4d9bf526f4ece6c581d262304fc13.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_9dc4d9bf526f4ece6c581d262304fc13.jpg already downloaded
2026-03-30 10:52:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdfeff04-515e-5e43-9c4c-2eadb6efab77, identifier: LD79008
2026-03-30 10:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5023450>
2026-03-30 10:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_501899bbef0636d2102e7858dfa39931.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_501899bbef0636d2102e7858dfa39931.jpg saved to cache
2026-03-30 10:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef94debc-c55a-546a-a899-20e73f821f4a
2026-03-30 10:52:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdfeff04-515e-5e43-9c4c-2eadb6efab77 with identifier: LD79008
2026-03-30 10:52:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdfeff04-515e-5e43-9c4c-2eadb6efab77 with identifier: LD79008
2026-03-30 10:52:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdfeff04-515e-5e43-9c4c-2eadb6efab77 with identifier: LD79008 to the API
2026-03-30 10:52:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LD79008>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.4L',
 'engine_horse_power': 215,
 'expiration_date': '2026-03-31T15:14:30Z',
 'fuel_type': 'diesel',
 'id': 'cdfeff04-515e-5e43-9c4c-2eadb6efab77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD79008',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 263744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_a3f54ee60331b856584cf21fee081cb1.jpg',
                'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_3f5583fe19f117b436023ce37cd64f40.jpg',
                'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_7a89c69d0a82cad1501de1455d796faf.jpg',
                'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_1286654e2babd7fa6c29128254321f90.jpg',
                'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_8df11ee826d21dec78307db2cb1c1e94.jpg',
                'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_3b5eb8da45ffb6121f6f23a2f27d31c5.jpg',
                'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_907f7f93e0ff145511ce216e3e3967bd.jpg',
                'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_fdf0a3eb23c749711b69bb17dabbfa84.jpg',
                'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_3556078bdd1be044026f28533e34e51b.jpg',
                'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_9dc4d9bf526f4ece6c581d262304fc13.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdfeff04-515e-5e43-9c4c-2eadb6efab77/cdfeff04-515e-5e43-9c4c-2eadb6efab77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_a3f54ee60331b856584cf21fee081cb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdfeff04-515e-5e43-9c4c-2eadb6efab77/cdfeff04-515e-5e43-9c4c-2eadb6efab77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_3f5583fe19f117b436023ce37cd64f40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdfeff04-515e-5e43-9c4c-2eadb6efab77/cdfeff04-515e-5e43-9c4c-2eadb6efab77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_7a89c69d0a82cad1501de1455d796faf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdfeff04-515e-5e43-9c4c-2eadb6efab77/cdfeff04-515e-5e43-9c4c-2eadb6efab77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_1286654e2babd7fa6c29128254321f90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdfeff04-515e-5e43-9c4c-2eadb6efab77/cdfeff04-515e-5e43-9c4c-2eadb6efab77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_8df11ee826d21dec78307db2cb1c1e94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdfeff04-515e-5e43-9c4c-2eadb6efab77/cdfeff04-515e-5e43-9c4c-2eadb6efab77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_3b5eb8da45ffb6121f6f23a2f27d31c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdfeff04-515e-5e43-9c4c-2eadb6efab77/cdfeff04-515e-5e43-9c4c-2eadb6efab77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_907f7f93e0ff145511ce216e3e3967bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdfeff04-515e-5e43-9c4c-2eadb6efab77/cdfeff04-515e-5e43-9c4c-2eadb6efab77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_fdf0a3eb23c749711b69bb17dabbfa84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdfeff04-515e-5e43-9c4c-2eadb6efab77/cdfeff04-515e-5e43-9c4c-2eadb6efab77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_3556078bdd1be044026f28533e34e51b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdfeff04-515e-5e43-9c4c-2eadb6efab77/cdfeff04-515e-5e43-9c4c-2eadb6efab77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/76/0d7643c5915aaadf20a6dd15f232ddf7/pa/LD79008_9dc4d9bf526f4ece6c581d262304fc13.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V70 2.4 D5 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2012}
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD79008%27 HTTP/1.1" 200 None
2026-03-30 10:52:20 [auto1.de] INFO: Saving data for LD79008: {'created_time': 1774867940.192994, 'last_price_update_time': 1774867940.193005, 'auction_closing_time': 1774970070.0}
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD79008') HTTP/1.1" 204 0
2026-03-30 10:52:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 960bc35c-f33c-5253-b0d7-48c173fe6300 with identifier: YG75934
2026-03-30 10:52:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 960bc35c-f33c-5253-b0d7-48c173fe6300 with scrape type 1
2026-03-30 10:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 960bc35c-f33c-5253-b0d7-48c173fe6300
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F18%252F62187664422259020c1963521f3d1715%252Fpa%252FYG75934_fdb9fca0368f3a1560f05a02cc01afc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_fdb9fca0368f3a1560f05a02cc01afc4.jpg already downloaded
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F18%252F62187664422259020c1963521f3d1715%252Fpa%252FYG75934_3b14ba129d4ea5e5472506f04591e96d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_3b14ba129d4ea5e5472506f04591e96d.jpg already downloaded
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F18%252F62187664422259020c1963521f3d1715%252Fpa%252FYG75934_7a9489027df451c8d822097557cf3a2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_7a9489027df451c8d822097557cf3a2a.jpg already downloaded
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F18%252F62187664422259020c1963521f3d1715%252Fpa%252FYG75934_68fda112dc2a60c59d6645e52f5a9dc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_68fda112dc2a60c59d6645e52f5a9dc0.jpg already downloaded
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F18%252F62187664422259020c1963521f3d1715%252Fpa%252FYG75934_5e36f1d91c94e26d03983dcbd92178a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_5e36f1d91c94e26d03983dcbd92178a7.jpg already downloaded
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F18%252F62187664422259020c1963521f3d1715%252Fpa%252FYG75934_48be2ec80a256f83f9e5454da1b09585.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_48be2ec80a256f83f9e5454da1b09585.jpg already downloaded
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F18%252F62187664422259020c1963521f3d1715%252Fpa%252FYG75934_ac511790cbea2b276d6877dd20e2139f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_ac511790cbea2b276d6877dd20e2139f.jpg already downloaded
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F18%252F62187664422259020c1963521f3d1715%252Fpa%252FYG75934_fe3fb01c788361c759d234f6c52a1b9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_fe3fb01c788361c759d234f6c52a1b9e.jpg already downloaded
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F18%252F62187664422259020c1963521f3d1715%252Fpa%252FYG75934_54cc0ee487151d2de27322d5df323fcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_54cc0ee487151d2de27322d5df323fcc.jpg already downloaded
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F18%252F62187664422259020c1963521f3d1715%252Fpa%252FYG75934_616db36f12d82d991cf0b91363c049c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_616db36f12d82d991cf0b91363c049c0.jpg already downloaded
2026-03-30 10:52:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 960bc35c-f33c-5253-b0d7-48c173fe6300, identifier: YG75934
2026-03-30 10:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_78382e3f45d308d6311acc1427ab3664.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_220d9c7ea305b45cb664e516a4a56429.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_23a8abf516d7ca11603ccc8953d212c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_77032025458ae0ff919ad3479f8fad5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_77032025458ae0ff919ad3479f8fad5e.jpg not downloaded yet
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_abc0eeae867dc2944b649cc0f034deb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_abc0eeae867dc2944b649cc0f034deb5.jpg not downloaded yet
2026-03-30 10:52:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 960bc35c-f33c-5253-b0d7-48c173fe6300 with identifier: YG75934
2026-03-30 10:52:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 960bc35c-f33c-5253-b0d7-48c173fe6300 with identifier: YG75934
2026-03-30 10:52:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 960bc35c-f33c-5253-b0d7-48c173fe6300 with identifier: YG75934 to the API
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YG75934>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:28:23Z',
 'fuel_type': 'diesel',
 'id': '960bc35c-f33c-5253-b0d7-48c173fe6300',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG75934',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 27591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_fdb9fca0368f3a1560f05a02cc01afc4.jpg',
                'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_3b14ba129d4ea5e5472506f04591e96d.jpg',
                'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_7a9489027df451c8d822097557cf3a2a.jpg',
                'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_68fda112dc2a60c59d6645e52f5a9dc0.jpg',
                'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_5e36f1d91c94e26d03983dcbd92178a7.jpg',
                'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_48be2ec80a256f83f9e5454da1b09585.jpg',
                'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_ac511790cbea2b276d6877dd20e2139f.jpg',
                'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_fe3fb01c788361c759d234f6c52a1b9e.jpg',
                'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_54cc0ee487151d2de27322d5df323fcc.jpg',
                'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_616db36f12d82d991cf0b91363c049c0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960bc35c-f33c-5253-b0d7-48c173fe6300/960bc35c-f33c-5253-b0d7-48c173fe6300_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2688605,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_fdb9fca0368f3a1560f05a02cc01afc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960bc35c-f33c-5253-b0d7-48c173fe6300/960bc35c-f33c-5253-b0d7-48c173fe6300_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_3b14ba129d4ea5e5472506f04591e96d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960bc35c-f33c-5253-b0d7-48c173fe6300/960bc35c-f33c-5253-b0d7-48c173fe6300_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2707783,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_7a9489027df451c8d822097557cf3a2a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960bc35c-f33c-5253-b0d7-48c173fe6300/960bc35c-f33c-5253-b0d7-48c173fe6300_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2726529,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_68fda112dc2a60c59d6645e52f5a9dc0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960bc35c-f33c-5253-b0d7-48c173fe6300/960bc35c-f33c-5253-b0d7-48c173fe6300_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2691287,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_5e36f1d91c94e26d03983dcbd92178a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960bc35c-f33c-5253-b0d7-48c173fe6300/960bc35c-f33c-5253-b0d7-48c173fe6300_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_48be2ec80a256f83f9e5454da1b09585.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960bc35c-f33c-5253-b0d7-48c173fe6300/960bc35c-f33c-5253-b0d7-48c173fe6300_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2744806,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_ac511790cbea2b276d6877dd20e2139f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960bc35c-f33c-5253-b0d7-48c173fe6300/960bc35c-f33c-5253-b0d7-48c173fe6300_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2641341,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_fe3fb01c788361c759d234f6c52a1b9e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960bc35c-f33c-5253-b0d7-48c173fe6300/960bc35c-f33c-5253-b0d7-48c173fe6300_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2797725,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_54cc0ee487151d2de27322d5df323fcc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_960bc35c-f33c-5253-b0d7-48c173fe6300/960bc35c-f33c-5253-b0d7-48c173fe6300_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2927205,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/18/62187664422259020c1963521f3d1715/pa/YG75934_616db36f12d82d991cf0b91363c049c0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d Mild-Hybrid 4Matic Edition AMG '
          'Line',
 'transmission': 'automatic',
 'trim': '4Matic Edition AMG Line',
 'year': 2024}
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG75934%27 HTTP/1.1" 200 None
2026-03-30 10:52:20 [auto1.de] INFO: Saving data for YG75934: {'created_time': 1774867940.917298, 'last_price_update_time': 1774867940.917308, 'auction_closing_time': 1774970903.0}
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YG75934') HTTP/1.1" 204 0
2026-03-30 10:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_d38431a1a80fb7f8cb6d143211492ea7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE59650/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT03056/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f3010>
2026-03-30 10:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_b880e154e15dd63d71e4bfe83f781b3e.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_b880e154e15dd63d71e4bfe83f781b3e.jpg saved to cache
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 16693ea5-36be-5d75-b0d3-a0c9c1af9e15
2026-03-30 10:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_96a58669539890bf7ce00d151810669c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW14426/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8b050>
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_78382e3f45d308d6311acc1427ab3664.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_78382e3f45d308d6311acc1427ab3664.jpg saved to cache
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 16693ea5-36be-5d75-b0d3-a0c9c1af9e15
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee7a10>
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_220d9c7ea305b45cb664e516a4a56429.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_220d9c7ea305b45cb664e516a4a56429.jpg saved to cache
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 115518fb-70f7-5f04-866d-268cdb6b3cf8
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fc8390>
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_23a8abf516d7ca11603ccc8953d212c4.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_23a8abf516d7ca11603ccc8953d212c4.jpg saved to cache
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 16693ea5-36be-5d75-b0d3-a0c9c1af9e15
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ecd310>
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_d38431a1a80fb7f8cb6d143211492ea7.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_d38431a1a80fb7f8cb6d143211492ea7.jpg saved to cache
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 16693ea5-36be-5d75-b0d3-a0c9c1af9e15
2026-03-30 10:52:21 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 9511 | hits on page: 40
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c4fa10>
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_96a58669539890bf7ce00d151810669c.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_96a58669539890bf7ce00d151810669c.jpg saved to cache
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 16693ea5-36be-5d75-b0d3-a0c9c1af9e15
2026-03-30 10:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_9a5da2fc8dc27eb42360a0c52605b2db.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_c870071f4fa0cc47b2eadf6685981fab.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_e6b7a3b6ebff32a0792030345836bc47.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:21 [auto1.de] INFO: Found listing with ID: WM77148
2026-03-30 10:52:21 [auto1.de] INFO: Found listing with ID: JJ72378
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ72378%27 HTTP/1.1" 200 None
2026-03-30 10:52:21 [auto1.de] INFO: Scrape type for JJ72378: 2
2026-03-30 10:52:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f55d79f-0580-5665-85e3-cf683d9447c8 with identifier: JJ72378
2026-03-30 10:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f55d79f-0580-5665-85e3-cf683d9447c8 with scrape type 2
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f55d79f-0580-5665-85e3-cf683d9447c8 with scrape type 2
2026-03-30 10:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f55d79f-0580-5665-85e3-cf683d9447c8, identifier: JJ72378
2026-03-30 10:52:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f55d79f-0580-5665-85e3-cf683d9447c8 with identifier: JJ72378
2026-03-30 10:52:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f55d79f-0580-5665-85e3-cf683d9447c8 with identifier: JJ72378
2026-03-30 10:52:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f55d79f-0580-5665-85e3-cf683d9447c8 with identifier: JJ72378 to the API
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:40:10Z',
 'fuel_type': 'diesel',
 'id': '0f55d79f-0580-5665-85e3-cf683d9447c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ72378',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 48242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI IQ-DRIVE',
 'transmission': 'manual',
 'trim': 'IQ-DRIVE',
 'year': 2019}
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ72378%27 HTTP/1.1" 200 None
2026-03-30 10:52:21 [auto1.de] INFO: Saving data for JJ72378: {'auction_closing_time': 1774971610.0, 'created_time': 1774348638.887516, 'last_price_update_time': 1774867941.734949}
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ72378') HTTP/1.1" 204 0
2026-03-30 10:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_abc0eeae867dc2944b649cc0f034deb5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:21 [auto1.de] INFO: Found listing with ID: HC12239
2026-03-30 10:52:21 [auto1.de] INFO: Found listing with ID: BS35535
2026-03-30 10:52:21 [auto1.de] INFO: Found listing with ID: WR71017
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR71017%27 HTTP/1.1" 200 None
2026-03-30 10:52:21 [auto1.de] INFO: Scrape type for WR71017: 2
2026-03-30 10:52:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d7887c6-d28b-5205-b924-46593e818010 with identifier: WR71017
2026-03-30 10:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d7887c6-d28b-5205-b924-46593e818010 with scrape type 2
2026-03-30 10:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d7887c6-d28b-5205-b924-46593e818010 with scrape type 2
2026-03-30 10:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d7887c6-d28b-5205-b924-46593e818010, identifier: WR71017
2026-03-30 10:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_b17a127644856b1b4e84b74139f7ab81.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_3ab13255a9d873393b5f71e3be544e79.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d7887c6-d28b-5205-b924-46593e818010 with identifier: WR71017
2026-03-30 10:52:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d7887c6-d28b-5205-b924-46593e818010 with identifier: WR71017
2026-03-30 10:52:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d7887c6-d28b-5205-b924-46593e818010 with identifier: WR71017 to the API
2026-03-30 10:52:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:31:27Z',
 'fuel_type': 'petrol',
 'id': '3d7887c6-d28b-5205-b924-46593e818010',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR71017',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 140614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-23',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR71017%27 HTTP/1.1" 200 None
2026-03-30 10:52:22 [auto1.de] INFO: Saving data for WR71017: {'auction_closing_time': 1774971087.0, 'created_time': 1774467659.377036, 'last_price_update_time': 1774867942.253996}
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR71017') HTTP/1.1" 204 0
2026-03-30 10:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dba250>
2026-03-30 10:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_9a5da2fc8dc27eb42360a0c52605b2db.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_9a5da2fc8dc27eb42360a0c52605b2db.jpg saved to cache
2026-03-30 10:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 115518fb-70f7-5f04-866d-268cdb6b3cf8
2026-03-30 10:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e6b090>
2026-03-30 10:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_c870071f4fa0cc47b2eadf6685981fab.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_c870071f4fa0cc47b2eadf6685981fab.jpg saved to cache
2026-03-30 10:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 115518fb-70f7-5f04-866d-268cdb6b3cf8
2026-03-30 10:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59bf850>
2026-03-30 10:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_e6b7a3b6ebff32a0792030345836bc47.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_e6b7a3b6ebff32a0792030345836bc47.jpg saved to cache
2026-03-30 10:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 16693ea5-36be-5d75-b0d3-a0c9c1af9e15
2026-03-30 10:52:22 [auto1.de] INFO: Found listing with ID: VX44094
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX44094%27 HTTP/1.1" 200 None
2026-03-30 10:52:22 [auto1.de] INFO: Scrape type for VX44094: 2
2026-03-30 10:52:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4623cfb3-4eeb-5891-9ef7-13b70fe5c5d9 with identifier: VX44094
2026-03-30 10:52:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4623cfb3-4eeb-5891-9ef7-13b70fe5c5d9 with scrape type 2
2026-03-30 10:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4623cfb3-4eeb-5891-9ef7-13b70fe5c5d9 with scrape type 2
2026-03-30 10:52:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4623cfb3-4eeb-5891-9ef7-13b70fe5c5d9, identifier: VX44094
2026-03-30 10:52:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4623cfb3-4eeb-5891-9ef7-13b70fe5c5d9 with identifier: VX44094
2026-03-30 10:52:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4623cfb3-4eeb-5891-9ef7-13b70fe5c5d9 with identifier: VX44094
2026-03-30 10:52:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4623cfb3-4eeb-5891-9ef7-13b70fe5c5d9 with identifier: VX44094 to the API
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:02:35Z',
 'fuel_type': 'petrol',
 'id': '4623cfb3-4eeb-5891-9ef7-13b70fe5c5d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX44094',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 198669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX44094%27 HTTP/1.1" 200 None
2026-03-30 10:52:22 [auto1.de] INFO: Saving data for VX44094: {'auction_closing_time': 1774969355.0, 'created_time': 1774464106.145648, 'last_price_update_time': 1774867942.855676}
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX44094') HTTP/1.1" 204 0
2026-03-30 10:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ49239> (referer: https://www.auto1.com/v1/car-details-view/BZ49239/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:22 [auto1.de] INFO: Found listing with ID: XE29778
2026-03-30 10:52:22 [auto1.de] INFO: Found listing with ID: UH83431
2026-03-30 10:52:22 [auto1.de] INFO: Found listing with ID: RV28657
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV28657%27 HTTP/1.1" 200 None
2026-03-30 10:52:22 [auto1.de] INFO: Scrape type for RV28657: 2
2026-03-30 10:52:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 949427c7-4c42-5bfa-9dac-42c9f5bccef9 with identifier: RV28657
2026-03-30 10:52:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 949427c7-4c42-5bfa-9dac-42c9f5bccef9 with scrape type 2
2026-03-30 10:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 949427c7-4c42-5bfa-9dac-42c9f5bccef9 with scrape type 2
2026-03-30 10:52:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 949427c7-4c42-5bfa-9dac-42c9f5bccef9, identifier: RV28657
2026-03-30 10:52:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT31842/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fffa50>
2026-03-30 10:52:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_abc0eeae867dc2944b649cc0f034deb5.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_abc0eeae867dc2944b649cc0f034deb5.jpg saved to cache
2026-03-30 10:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 16693ea5-36be-5d75-b0d3-a0c9c1af9e15
2026-03-30 10:52:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b28050>
2026-03-30 10:52:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_b17a127644856b1b4e84b74139f7ab81.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_b17a127644856b1b4e84b74139f7ab81.jpg saved to cache
2026-03-30 10:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef94debc-c55a-546a-a899-20e73f821f4a
2026-03-30 10:52:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fcb090>
2026-03-30 10:52:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_3ab13255a9d873393b5f71e3be544e79.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_3ab13255a9d873393b5f71e3be544e79.jpg saved to cache
2026-03-30 10:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 115518fb-70f7-5f04-866d-268cdb6b3cf8
2026-03-30 10:52:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_c6658b142f0eaba32dee8c1b972cb08c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 949427c7-4c42-5bfa-9dac-42c9f5bccef9 with identifier: RV28657
2026-03-30 10:52:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 949427c7-4c42-5bfa-9dac-42c9f5bccef9 with identifier: RV28657
2026-03-30 10:52:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 949427c7-4c42-5bfa-9dac-42c9f5bccef9 with identifier: RV28657 to the API
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:45:11Z',
 'fuel_type': 'petrol',
 'id': '949427c7-4c42-5bfa-9dac-42c9f5bccef9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV28657',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 142507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-12',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV28657%27 HTTP/1.1" 200 None
2026-03-30 10:52:23 [auto1.de] INFO: Saving data for RV28657: {'auction_closing_time': 1774971911.0, 'created_time': 1774464436.751305, 'last_price_update_time': 1774867943.509091}
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV28657') HTTP/1.1" 204 0
2026-03-30 10:52:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_a5ad639f055ec850dff71119eade66c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:23 [auto1.de] INFO: Found listing with ID: LP84561
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP84561%27 HTTP/1.1" 200 None
2026-03-30 10:52:23 [auto1.de] INFO: Scrape type for LP84561: 2
2026-03-30 10:52:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d15ad07e-eaae-559b-813d-513a88470308 with identifier: LP84561
2026-03-30 10:52:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d15ad07e-eaae-559b-813d-513a88470308 with scrape type 2
2026-03-30 10:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d15ad07e-eaae-559b-813d-513a88470308 with scrape type 2
2026-03-30 10:52:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d15ad07e-eaae-559b-813d-513a88470308, identifier: LP84561
2026-03-30 10:52:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG43555> (referer: https://www.auto1.com/v1/car-details-view/VG43555/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d15ad07e-eaae-559b-813d-513a88470308 with identifier: LP84561
2026-03-30 10:52:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d15ad07e-eaae-559b-813d-513a88470308 with identifier: LP84561
2026-03-30 10:52:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d15ad07e-eaae-559b-813d-513a88470308 with identifier: LP84561 to the API
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:27:53Z',
 'fuel_type': 'diesel',
 'id': 'd15ad07e-eaae-559b-813d-513a88470308',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP84561',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 379748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-13',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 415 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP84561%27 HTTP/1.1" 200 None
2026-03-30 10:52:24 [auto1.de] INFO: Saving data for LP84561: {'auction_closing_time': 1774970873.0, 'created_time': 1774639257.082744, 'last_price_update_time': 1774867944.052159}
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LP84561') HTTP/1.1" 204 0
2026-03-30 10:52:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 565f99bf-6753-521d-b7aa-08561e6891a3 with identifier: BZ49239
2026-03-30 10:52:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 565f99bf-6753-521d-b7aa-08561e6891a3 with scrape type 1
2026-03-30 10:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 565f99bf-6753-521d-b7aa-08561e6891a3
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F33%252F2333ff21d242349340ffc00c6add332e%252Fpa%252FBZ49239_3ccfeb3378d23d3b8025c5a690f4cafa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_3ccfeb3378d23d3b8025c5a690f4cafa.jpg already downloaded
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F33%252F2333ff21d242349340ffc00c6add332e%252Fpa%252FBZ49239_991b728176a5454fe5a3b2272adc111b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_991b728176a5454fe5a3b2272adc111b.jpg already downloaded
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F33%252F2333ff21d242349340ffc00c6add332e%252Fpa%252FBZ49239_b5f8002bf0dda24eb775352f2e219137.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_b5f8002bf0dda24eb775352f2e219137.jpg already downloaded
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F33%252F2333ff21d242349340ffc00c6add332e%252Fpa%252FBZ49239_1b93c735ce50828e909baba7459b018e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_1b93c735ce50828e909baba7459b018e.jpg already downloaded
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F33%252F2333ff21d242349340ffc00c6add332e%252Fpa%252FBZ49239_c4e77bd917b854729630a510b6289010.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_c4e77bd917b854729630a510b6289010.jpg already downloaded
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F33%252F2333ff21d242349340ffc00c6add332e%252Fpa%252FBZ49239_140af2c6f7489d103411530c5456182a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_140af2c6f7489d103411530c5456182a.jpg already downloaded
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F33%252F2333ff21d242349340ffc00c6add332e%252Fpa%252FBZ49239_878ab408637ba5fd9897359de8614353.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_878ab408637ba5fd9897359de8614353.jpg already downloaded
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F33%252F2333ff21d242349340ffc00c6add332e%252Fpa%252FBZ49239_276f859e1bafcafc0c65e28b267e3491.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_276f859e1bafcafc0c65e28b267e3491.jpg already downloaded
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F33%252F2333ff21d242349340ffc00c6add332e%252Fpa%252FBZ49239_27b89045fe7f27926d43d07db628b050.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_27b89045fe7f27926d43d07db628b050.jpg already downloaded
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F33%252F2333ff21d242349340ffc00c6add332e%252Fpa%252FBZ49239_d89a1b30d754c131a184cb291e93dcec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_d89a1b30d754c131a184cb291e93dcec.jpg already downloaded
2026-03-30 10:52:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 565f99bf-6753-521d-b7aa-08561e6891a3, identifier: BZ49239
2026-03-30 10:52:24 [auto1.de] INFO: Found listing with ID: CP09804
2026-03-30 10:52:24 [auto1.de] INFO: Found listing with ID: VA30007
2026-03-30 10:52:24 [auto1.de] INFO: Found listing with ID: EC56413
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC56413%27 HTTP/1.1" 200 None
2026-03-30 10:52:24 [auto1.de] INFO: Scrape type for EC56413: 2
2026-03-30 10:52:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db28b249-eabc-5aba-a9f5-01e90d401634 with identifier: EC56413
2026-03-30 10:52:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db28b249-eabc-5aba-a9f5-01e90d401634 with scrape type 2
2026-03-30 10:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db28b249-eabc-5aba-a9f5-01e90d401634 with scrape type 2
2026-03-30 10:52:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db28b249-eabc-5aba-a9f5-01e90d401634, identifier: EC56413
2026-03-30 10:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX27248> (referer: https://www.auto1.com/v1/car-details-view/RX27248/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 565f99bf-6753-521d-b7aa-08561e6891a3 with identifier: BZ49239
2026-03-30 10:52:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 565f99bf-6753-521d-b7aa-08561e6891a3 with identifier: BZ49239
2026-03-30 10:52:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 565f99bf-6753-521d-b7aa-08561e6891a3 with identifier: BZ49239 to the API
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BZ49239>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:13:14Z',
 'fuel_type': 'diesel',
 'id': '565f99bf-6753-521d-b7aa-08561e6891a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ49239',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 185335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_3ccfeb3378d23d3b8025c5a690f4cafa.jpg',
                'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_991b728176a5454fe5a3b2272adc111b.jpg',
                'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_b5f8002bf0dda24eb775352f2e219137.jpg',
                'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_1b93c735ce50828e909baba7459b018e.jpg',
                'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_c4e77bd917b854729630a510b6289010.jpg',
                'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_140af2c6f7489d103411530c5456182a.jpg',
                'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_878ab408637ba5fd9897359de8614353.jpg',
                'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_276f859e1bafcafc0c65e28b267e3491.jpg',
                'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_27b89045fe7f27926d43d07db628b050.jpg',
                'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_d89a1b30d754c131a184cb291e93dcec.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565f99bf-6753-521d-b7aa-08561e6891a3/565f99bf-6753-521d-b7aa-08561e6891a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353966,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_3ccfeb3378d23d3b8025c5a690f4cafa.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565f99bf-6753-521d-b7aa-08561e6891a3/565f99bf-6753-521d-b7aa-08561e6891a3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381120,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_991b728176a5454fe5a3b2272adc111b.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565f99bf-6753-521d-b7aa-08561e6891a3/565f99bf-6753-521d-b7aa-08561e6891a3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363361,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_b5f8002bf0dda24eb775352f2e219137.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565f99bf-6753-521d-b7aa-08561e6891a3/565f99bf-6753-521d-b7aa-08561e6891a3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_1b93c735ce50828e909baba7459b018e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565f99bf-6753-521d-b7aa-08561e6891a3/565f99bf-6753-521d-b7aa-08561e6891a3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_c4e77bd917b854729630a510b6289010.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565f99bf-6753-521d-b7aa-08561e6891a3/565f99bf-6753-521d-b7aa-08561e6891a3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_140af2c6f7489d103411530c5456182a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565f99bf-6753-521d-b7aa-08561e6891a3/565f99bf-6753-521d-b7aa-08561e6891a3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309476,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_878ab408637ba5fd9897359de8614353.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565f99bf-6753-521d-b7aa-08561e6891a3/565f99bf-6753-521d-b7aa-08561e6891a3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331950,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_276f859e1bafcafc0c65e28b267e3491.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565f99bf-6753-521d-b7aa-08561e6891a3/565f99bf-6753-521d-b7aa-08561e6891a3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346932,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_27b89045fe7f27926d43d07db628b050.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565f99bf-6753-521d-b7aa-08561e6891a3/565f99bf-6753-521d-b7aa-08561e6891a3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/33/2333ff21d242349340ffc00c6add332e/pa/BZ49239_d89a1b30d754c131a184cb291e93dcec.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ49239%27 HTTP/1.1" 200 None
2026-03-30 10:52:24 [auto1.de] INFO: Saving data for BZ49239: {'created_time': 1774867944.977217, 'last_price_update_time': 1774867944.97723, 'auction_closing_time': 1774969994.0}
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ49239') HTTP/1.1" 204 0
2026-03-30 10:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_08cec7f5a3e321bb5dcfb6b6de1a5a0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db28b249-eabc-5aba-a9f5-01e90d401634 with identifier: EC56413
2026-03-30 10:52:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db28b249-eabc-5aba-a9f5-01e90d401634 with identifier: EC56413
2026-03-30 10:52:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db28b249-eabc-5aba-a9f5-01e90d401634 with identifier: EC56413 to the API
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:52:25Z',
 'fuel_type': 'diesel',
 'id': 'db28b249-eabc-5aba-a9f5-01e90d401634',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC56413',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 233005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-21',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2019}
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC56413%27 HTTP/1.1" 200 None
2026-03-30 10:52:25 [auto1.de] INFO: Saving data for EC56413: {'auction_closing_time': 1774972345.0, 'created_time': 1774349056.862405, 'last_price_update_time': 1774867945.474666}
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC56413') HTTP/1.1" 204 0
2026-03-30 10:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7921f10>
2026-03-30 10:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_c6658b142f0eaba32dee8c1b972cb08c.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_c6658b142f0eaba32dee8c1b972cb08c.jpg saved to cache
2026-03-30 10:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 115518fb-70f7-5f04-866d-268cdb6b3cf8
2026-03-30 10:52:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50756d0>
2026-03-30 10:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_a5ad639f055ec850dff71119eade66c6.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_a5ad639f055ec850dff71119eade66c6.jpg saved to cache
2026-03-30 10:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 346cbdf4-9c71-50ea-b1e9-4bc50d33b195
2026-03-30 10:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_f3df911cdc11d8a60ac5b42cdc325188.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_ae3e8c0337092a9e492f1e292223d409.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_a4e7cc7c5b4de4591d74ffdb857f39d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:25 [auto1.de] INFO: Found listing with ID: AX98840
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX98840%27 HTTP/1.1" 200 None
2026-03-30 10:52:25 [auto1.de] INFO: Scrape type for AX98840: 2
2026-03-30 10:52:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2abd92aa-da91-5b61-bb54-0aa566752634 with identifier: AX98840
2026-03-30 10:52:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2abd92aa-da91-5b61-bb54-0aa566752634 with scrape type 2
2026-03-30 10:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2abd92aa-da91-5b61-bb54-0aa566752634 with scrape type 2
2026-03-30 10:52:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2abd92aa-da91-5b61-bb54-0aa566752634, identifier: AX98840
2026-03-30 10:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ31329> (referer: https://www.auto1.com/v1/car-details-view/VJ31329/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW14426> (referer: https://www.auto1.com/v1/car-details-view/TW14426/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2abd92aa-da91-5b61-bb54-0aa566752634 with identifier: AX98840
2026-03-30 10:52:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2abd92aa-da91-5b61-bb54-0aa566752634 with identifier: AX98840
2026-03-30 10:52:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2abd92aa-da91-5b61-bb54-0aa566752634 with identifier: AX98840 to the API
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-31T15:29:02Z',
 'fuel_type': 'petrol',
 'id': '2abd92aa-da91-5b61-bb54-0aa566752634',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX98840',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 173855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-02',
 'seller_name': None,
 'title': 'Ford Kuga 1.6 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2013}
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX98840%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [auto1.de] INFO: Saving data for AX98840: {'auction_closing_time': 1774970942.0, 'created_time': 1774377493.087476, 'last_price_update_time': 1774867946.099349}
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX98840') HTTP/1.1" 204 0
2026-03-30 10:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT03056> (referer: https://www.auto1.com/v1/car-details-view/LT03056/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 189773ac-37eb-5a4d-a09c-8ea7e6c041a9 with identifier: VG43555
2026-03-30 10:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 189773ac-37eb-5a4d-a09c-8ea7e6c041a9 with scrape type 1
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 189773ac-37eb-5a4d-a09c-8ea7e6c041a9
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F51%252Fe1516748f5c47eb8da66d574db573ecb%252Fpa%252FVG43555_0b561ca092618b99f1449a7fdb4f123b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_0b561ca092618b99f1449a7fdb4f123b.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F51%252Fe1516748f5c47eb8da66d574db573ecb%252Fpa%252FVG43555_94e4c201a5a3872e424b4f83b315a9fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_94e4c201a5a3872e424b4f83b315a9fe.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F51%252Fe1516748f5c47eb8da66d574db573ecb%252Fpa%252FVG43555_cf07f63e3e00ba0931c0db8c286be678.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_cf07f63e3e00ba0931c0db8c286be678.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F51%252Fe1516748f5c47eb8da66d574db573ecb%252Fpa%252FVG43555_4472c9a1e542560feccdf036dda16e75.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_4472c9a1e542560feccdf036dda16e75.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F51%252Fe1516748f5c47eb8da66d574db573ecb%252Fpa%252FVG43555_cd051f527cefe6d928bb9b031955cf34.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_cd051f527cefe6d928bb9b031955cf34.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F51%252Fe1516748f5c47eb8da66d574db573ecb%252Fpa%252FVG43555_5308e6d0871e26655d54eb8587e85f30.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_5308e6d0871e26655d54eb8587e85f30.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F51%252Fe1516748f5c47eb8da66d574db573ecb%252Fpa%252FVG43555_3ff93c54ef33416c8cc0f2729a28a239.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_3ff93c54ef33416c8cc0f2729a28a239.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F51%252Fe1516748f5c47eb8da66d574db573ecb%252Fpa%252FVG43555_dc6a93b83f9b29fa18c31e1185e04e08.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_dc6a93b83f9b29fa18c31e1185e04e08.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F51%252Fe1516748f5c47eb8da66d574db573ecb%252Fpa%252FVG43555_ed4ffa5e82e910bddc9d592a8aa8caa9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_ed4ffa5e82e910bddc9d592a8aa8caa9.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F51%252Fe1516748f5c47eb8da66d574db573ecb%252Fpa%252FVG43555_a9442d4dbd764318f860f8cba63b8a32.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_a9442d4dbd764318f860f8cba63b8a32.jpg already downloaded
2026-03-30 10:52:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 189773ac-37eb-5a4d-a09c-8ea7e6c041a9, identifier: VG43555
2026-03-30 10:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc with identifier: RX27248
2026-03-30 10:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc with scrape type 1
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fc2%252F49c2a26b3112a43fe655d087743e8bae%252Fpa%252FRX27248_11e49dfb8eeb0ac67fdd2379bc6da02c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_11e49dfb8eeb0ac67fdd2379bc6da02c.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fc2%252F49c2a26b3112a43fe655d087743e8bae%252Fpa%252FRX27248_f3a602f905dacf60b51b49b02901a858.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_f3a602f905dacf60b51b49b02901a858.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fc2%252F49c2a26b3112a43fe655d087743e8bae%252Fpa%252FRX27248_f567d0371029c7cc4eea4b24ec0388f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_f567d0371029c7cc4eea4b24ec0388f4.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fc2%252F49c2a26b3112a43fe655d087743e8bae%252Fpa%252FRX27248_f7e244dc2a9048a19687ca2d23bc37d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_f7e244dc2a9048a19687ca2d23bc37d9.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fc2%252F49c2a26b3112a43fe655d087743e8bae%252Fpa%252FRX27248_84d926ef3835b24d70c00b3e22e1f167.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_84d926ef3835b24d70c00b3e22e1f167.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fc2%252F49c2a26b3112a43fe655d087743e8bae%252Fpa%252FRX27248_e2eb9e5c1f6bcf6eb21e552378d1162f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_e2eb9e5c1f6bcf6eb21e552378d1162f.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fc2%252F49c2a26b3112a43fe655d087743e8bae%252Fpa%252FRX27248_c2dd68e25640aa881fe5a5378ec5b399.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_c2dd68e25640aa881fe5a5378ec5b399.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fc2%252F49c2a26b3112a43fe655d087743e8bae%252Fpa%252FRX27248_b21c6f5995895ed03f62692d0af19573.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_b21c6f5995895ed03f62692d0af19573.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fc2%252F49c2a26b3112a43fe655d087743e8bae%252Fpa%252FRX27248_39113d243976cc1aa7df53309e34c9bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_39113d243976cc1aa7df53309e34c9bb.jpg already downloaded
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fc2%252F49c2a26b3112a43fe655d087743e8bae%252Fpa%252FRX27248_bb81f816c796542399bdd932ceda76c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_bb81f816c796542399bdd932ceda76c1.jpg already downloaded
2026-03-30 10:52:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc, identifier: RX27248
2026-03-30 10:52:26 [auto1.de] INFO: Found listing with ID: EL91919
2026-03-30 10:52:26 [auto1.de] INFO: Found listing with ID: NG38920
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG38920%27 HTTP/1.1" 200 None
2026-03-30 10:52:26 [auto1.de] INFO: Scrape type for NG38920: 2
2026-03-30 10:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 209d66df-ad15-5c48-b943-fd9f10a4c89d with identifier: NG38920
2026-03-30 10:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 209d66df-ad15-5c48-b943-fd9f10a4c89d with scrape type 2
2026-03-30 10:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 209d66df-ad15-5c48-b943-fd9f10a4c89d with scrape type 2
2026-03-30 10:52:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 209d66df-ad15-5c48-b943-fd9f10a4c89d, identifier: NG38920
2026-03-30 10:52:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 189773ac-37eb-5a4d-a09c-8ea7e6c041a9 with identifier: VG43555
2026-03-30 10:52:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 189773ac-37eb-5a4d-a09c-8ea7e6c041a9 with identifier: VG43555
2026-03-30 10:52:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 189773ac-37eb-5a4d-a09c-8ea7e6c041a9 with identifier: VG43555 to the API
2026-03-30 10:52:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VG43555>
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 148,
 'expiration_date': '2026-03-31T15:23:35Z',
 'fuel_type': 'diesel',
 'id': '189773ac-37eb-5a4d-a09c-8ea7e6c041a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG43555',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 181570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_0b561ca092618b99f1449a7fdb4f123b.jpg',
                'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_94e4c201a5a3872e424b4f83b315a9fe.jpg',
                'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_cf07f63e3e00ba0931c0db8c286be678.jpg',
                'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_4472c9a1e542560feccdf036dda16e75.jpg',
                'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_cd051f527cefe6d928bb9b031955cf34.jpg',
                'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_5308e6d0871e26655d54eb8587e85f30.jpg',
                'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_3ff93c54ef33416c8cc0f2729a28a239.jpg',
                'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_dc6a93b83f9b29fa18c31e1185e04e08.jpg',
                'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_ed4ffa5e82e910bddc9d592a8aa8caa9.jpg',
                'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_a9442d4dbd764318f860f8cba63b8a32.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189773ac-37eb-5a4d-a09c-8ea7e6c041a9/189773ac-37eb-5a4d-a09c-8ea7e6c041a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2710529,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_0b561ca092618b99f1449a7fdb4f123b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189773ac-37eb-5a4d-a09c-8ea7e6c041a9/189773ac-37eb-5a4d-a09c-8ea7e6c041a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_94e4c201a5a3872e424b4f83b315a9fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189773ac-37eb-5a4d-a09c-8ea7e6c041a9/189773ac-37eb-5a4d-a09c-8ea7e6c041a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_cf07f63e3e00ba0931c0db8c286be678.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189773ac-37eb-5a4d-a09c-8ea7e6c041a9/189773ac-37eb-5a4d-a09c-8ea7e6c041a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463902,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_4472c9a1e542560feccdf036dda16e75.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189773ac-37eb-5a4d-a09c-8ea7e6c041a9/189773ac-37eb-5a4d-a09c-8ea7e6c041a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_cd051f527cefe6d928bb9b031955cf34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189773ac-37eb-5a4d-a09c-8ea7e6c041a9/189773ac-37eb-5a4d-a09c-8ea7e6c041a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2538368,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_5308e6d0871e26655d54eb8587e85f30.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189773ac-37eb-5a4d-a09c-8ea7e6c041a9/189773ac-37eb-5a4d-a09c-8ea7e6c041a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2438668,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_3ff93c54ef33416c8cc0f2729a28a239.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189773ac-37eb-5a4d-a09c-8ea7e6c041a9/189773ac-37eb-5a4d-a09c-8ea7e6c041a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2491375,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_dc6a93b83f9b29fa18c31e1185e04e08.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189773ac-37eb-5a4d-a09c-8ea7e6c041a9/189773ac-37eb-5a4d-a09c-8ea7e6c041a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2639264,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_ed4ffa5e82e910bddc9d592a8aa8caa9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189773ac-37eb-5a4d-a09c-8ea7e6c041a9/189773ac-37eb-5a4d-a09c-8ea7e6c041a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2715427,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/51/e1516748f5c47eb8da66d574db573ecb/pa/VG43555_a9442d4dbd764318f860f8cba63b8a32.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 2.2 DI-D Active+ 4WD',
 'transmission': 'automatic',
 'trim': 'Active+ 4WD',
 'year': 2019}
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG43555%27 HTTP/1.1" 200 None
2026-03-30 10:52:27 [auto1.de] INFO: Saving data for VG43555: {'created_time': 1774867947.237121, 'last_price_update_time': 1774867947.237135, 'auction_closing_time': 1774970615.0}
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG43555') HTTP/1.1" 204 0
2026-03-30 10:52:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc with identifier: RX27248
2026-03-30 10:52:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc with identifier: RX27248
2026-03-30 10:52:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc with identifier: RX27248 to the API
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RX27248>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:54:49Z',
 'fuel_type': 'petrol',
 'id': '5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX27248',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 84786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_11e49dfb8eeb0ac67fdd2379bc6da02c.jpg',
                'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_f3a602f905dacf60b51b49b02901a858.jpg',
                'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_f567d0371029c7cc4eea4b24ec0388f4.jpg',
                'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_f7e244dc2a9048a19687ca2d23bc37d9.jpg',
                'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_84d926ef3835b24d70c00b3e22e1f167.jpg',
                'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_e2eb9e5c1f6bcf6eb21e552378d1162f.jpg',
                'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_c2dd68e25640aa881fe5a5378ec5b399.jpg',
                'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_b21c6f5995895ed03f62692d0af19573.jpg',
                'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_39113d243976cc1aa7df53309e34c9bb.jpg',
                'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_bb81f816c796542399bdd932ceda76c1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc/5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_11e49dfb8eeb0ac67fdd2379bc6da02c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc/5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_f3a602f905dacf60b51b49b02901a858.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc/5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_f567d0371029c7cc4eea4b24ec0388f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc/5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_f7e244dc2a9048a19687ca2d23bc37d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc/5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_84d926ef3835b24d70c00b3e22e1f167.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc/5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_e2eb9e5c1f6bcf6eb21e552378d1162f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc/5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_c2dd68e25640aa881fe5a5378ec5b399.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc/5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_b21c6f5995895ed03f62692d0af19573.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc/5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_39113d243976cc1aa7df53309e34c9bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc/5f3b99e5-6c3e-5cbb-bc3a-e1124932dfbc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/c2/49c2a26b3112a43fe655d087743e8bae/pa/RX27248_bb81f816c796542399bdd932ceda76c1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2012}
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX27248%27 HTTP/1.1" 200 None
2026-03-30 10:52:27 [auto1.de] INFO: Saving data for RX27248: {'created_time': 1774867947.622564, 'last_price_update_time': 1774867947.622573, 'auction_closing_time': 1774972489.0}
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX27248') HTTP/1.1" 204 0
2026-03-30 10:52:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 209d66df-ad15-5c48-b943-fd9f10a4c89d with identifier: NG38920
2026-03-30 10:52:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 209d66df-ad15-5c48-b943-fd9f10a4c89d with identifier: NG38920
2026-03-30 10:52:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 209d66df-ad15-5c48-b943-fd9f10a4c89d with identifier: NG38920 to the API
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:17:18Z',
 'fuel_type': 'petrol',
 'id': '209d66df-ad15-5c48-b943-fd9f10a4c89d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG38920',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 150260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-31',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Best of',
 'transmission': 'manual',
 'trim': 'Best of',
 'year': 2008}
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG38920%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [auto1.de] INFO: Saving data for NG38920: {'auction_closing_time': 1774970238.0, 'created_time': 1774550685.572227, 'last_price_update_time': 1774867948.022729}
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG38920') HTTP/1.1" 204 0
2026-03-30 10:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_f08e2222f0cec732a0b8cc6319a09df0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:28 [auto1.de] INFO: Found listing with ID: LW90861
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW90861%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [auto1.de] INFO: Scrape type for LW90861: 2
2026-03-30 10:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caba387f-75f1-5437-ad43-0282046585f7 with identifier: LW90861
2026-03-30 10:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caba387f-75f1-5437-ad43-0282046585f7 with scrape type 2
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caba387f-75f1-5437-ad43-0282046585f7 with scrape type 2
2026-03-30 10:52:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caba387f-75f1-5437-ad43-0282046585f7, identifier: LW90861
2026-03-30 10:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM49760> (referer: https://www.auto1.com/v1/car-details-view/YM49760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE59650> (referer: https://www.auto1.com/v1/car-details-view/ZE59650/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c6f90>
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_08cec7f5a3e321bb5dcfb6b6de1a5a0b.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_08cec7f5a3e321bb5dcfb6b6de1a5a0b.jpg saved to cache
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 115518fb-70f7-5f04-866d-268cdb6b3cf8
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dfda10>
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_f3df911cdc11d8a60ac5b42cdc325188.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_f3df911cdc11d8a60ac5b42cdc325188.jpg saved to cache
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef94debc-c55a-546a-a899-20e73f821f4a
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d49b50>
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_ae3e8c0337092a9e492f1e292223d409.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_ae3e8c0337092a9e492f1e292223d409.jpg saved to cache
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 346cbdf4-9c71-50ea-b1e9-4bc50d33b195
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d75290>
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_a4e7cc7c5b4de4591d74ffdb857f39d1.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_a4e7cc7c5b4de4591d74ffdb857f39d1.jpg saved to cache
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 16693ea5-36be-5d75-b0d3-a0c9c1af9e15
2026-03-30 10:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86a88041-6fa6-5fdc-83a5-922e4a26f891 with identifier: VJ31329
2026-03-30 10:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86a88041-6fa6-5fdc-83a5-922e4a26f891 with scrape type 1
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 86a88041-6fa6-5fdc-83a5-922e4a26f891
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F35%252Fd93548e26cd93fcd017ce1583d278043%252Fpa%252FVJ31329_d0450210b0645a8f3ef4561f5556c8a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_d0450210b0645a8f3ef4561f5556c8a6.jpg not downloaded yet
2026-03-30 10:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e94e92e-4697-58ed-95ac-099301c933d7 with identifier: TW14426
2026-03-30 10:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e94e92e-4697-58ed-95ac-099301c933d7 with scrape type 1
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4e94e92e-4697-58ed-95ac-099301c933d7
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fa3%252F72a3e81e355ec19cf05b3e79da84156a%252Fpa%252FTW14426_a95130d925b0e8b6f2483845471a9824.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_a95130d925b0e8b6f2483845471a9824.jpg already downloaded
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fa3%252F72a3e81e355ec19cf05b3e79da84156a%252Fpa%252FTW14426_b32dd72418f6db732712f34d0da8666f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_b32dd72418f6db732712f34d0da8666f.jpg already downloaded
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fa3%252F72a3e81e355ec19cf05b3e79da84156a%252Fpa%252FTW14426_90d375f72937a8a0eb2fa53937591cc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_90d375f72937a8a0eb2fa53937591cc8.jpg already downloaded
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fa3%252F72a3e81e355ec19cf05b3e79da84156a%252Fpa%252FTW14426_657778ede856a8a9d39de463f4a29abd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_657778ede856a8a9d39de463f4a29abd.jpg already downloaded
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fa3%252F72a3e81e355ec19cf05b3e79da84156a%252Fpa%252FTW14426_bd3e7a94a173d217fdd1beeac8365dcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_bd3e7a94a173d217fdd1beeac8365dcc.jpg already downloaded
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fa3%252F72a3e81e355ec19cf05b3e79da84156a%252Fpa%252FTW14426_62bc427b67f494c83b288dbf8eb24976.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_62bc427b67f494c83b288dbf8eb24976.jpg already downloaded
2026-03-30 10:52:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e94e92e-4697-58ed-95ac-099301c933d7, identifier: TW14426
2026-03-30 10:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4 with identifier: LT03056
2026-03-30 10:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4 with scrape type 1
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F7f%252F3d7fec09774bb36b21177ba3f41d7e80%252Fpa%252FLT03056_6f9e0003332ac5a7cb3d1d15cc4c30e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_6f9e0003332ac5a7cb3d1d15cc4c30e9.jpg already downloaded
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F7f%252F3d7fec09774bb36b21177ba3f41d7e80%252Fpa%252FLT03056_afe931814bef70d04912dd7d12a574ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_afe931814bef70d04912dd7d12a574ec.jpg already downloaded
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F7f%252F3d7fec09774bb36b21177ba3f41d7e80%252Fpa%252FLT03056_4b728b5c74f8eb933ee94c94b5df0166.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_4b728b5c74f8eb933ee94c94b5df0166.jpg already downloaded
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F7f%252F3d7fec09774bb36b21177ba3f41d7e80%252Fpa%252FLT03056_13095cbcfa90a581f547952c5cc2eb8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_13095cbcfa90a581f547952c5cc2eb8e.jpg already downloaded
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F7f%252F3d7fec09774bb36b21177ba3f41d7e80%252Fpa%252FLT03056_c7936501f42400ff1ef851792ee721ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_c7936501f42400ff1ef851792ee721ca.jpg already downloaded
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F7f%252F3d7fec09774bb36b21177ba3f41d7e80%252Fpa%252FLT03056_35b6d5e3ccb256424ef6e9665f104c54.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_35b6d5e3ccb256424ef6e9665f104c54.jpg already downloaded
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F7f%252F3d7fec09774bb36b21177ba3f41d7e80%252Fpa%252FLT03056_561034b5a1e45f4b318dc2e39ffca6fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_561034b5a1e45f4b318dc2e39ffca6fa.jpg already downloaded
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F7f%252F3d7fec09774bb36b21177ba3f41d7e80%252Fpa%252FLT03056_bc8a0e81303b403232a026324900d212.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_bc8a0e81303b403232a026324900d212.jpg already downloaded
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F7f%252F3d7fec09774bb36b21177ba3f41d7e80%252Fpa%252FLT03056_ff527734823380325b6383bfb7f0a572.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_ff527734823380325b6383bfb7f0a572.jpg already downloaded
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F7f%252F3d7fec09774bb36b21177ba3f41d7e80%252Fpa%252FLT03056_31accd9054aea39f36f1b036a1802afe.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_31accd9054aea39f36f1b036a1802afe.jpg already downloaded
2026-03-30 10:52:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4, identifier: LT03056
2026-03-30 10:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_cd7b935970590b8836ef5ec168b1ecb7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caba387f-75f1-5437-ad43-0282046585f7 with identifier: LW90861
2026-03-30 10:52:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caba387f-75f1-5437-ad43-0282046585f7 with identifier: LW90861
2026-03-30 10:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caba387f-75f1-5437-ad43-0282046585f7 with identifier: LW90861 to the API
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:40:33Z',
 'fuel_type': 'petrol',
 'id': 'caba387f-75f1-5437-ad43-0282046585f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW90861',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 76143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-17',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Exclusive-Line',
 'transmission': 'manual',
 'trim': 'Exclusive-Line',
 'year': 2017}
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW90861%27 HTTP/1.1" 200 None
2026-03-30 10:52:29 [auto1.de] INFO: Saving data for LW90861: {'auction_closing_time': 1774971633.0, 'created_time': 1774349134.153016, 'last_price_update_time': 1774867949.232618}
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW90861') HTTP/1.1" 204 0
2026-03-30 10:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e94e92e-4697-58ed-95ac-099301c933d7 with identifier: TW14426
2026-03-30 10:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e94e92e-4697-58ed-95ac-099301c933d7 with identifier: TW14426
2026-03-30 10:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e94e92e-4697-58ed-95ac-099301c933d7 with identifier: TW14426 to the API
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TW14426>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:20:47Z',
 'fuel_type': 'petrol',
 'id': '4e94e92e-4697-58ed-95ac-099301c933d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW14426',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 187624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_a95130d925b0e8b6f2483845471a9824.jpg',
                'https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_b32dd72418f6db732712f34d0da8666f.jpg',
                'https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_90d375f72937a8a0eb2fa53937591cc8.jpg',
                'https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_657778ede856a8a9d39de463f4a29abd.jpg',
                'https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_bd3e7a94a173d217fdd1beeac8365dcc.jpg',
                'https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_62bc427b67f494c83b288dbf8eb24976.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e94e92e-4697-58ed-95ac-099301c933d7/4e94e92e-4697-58ed-95ac-099301c933d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_a95130d925b0e8b6f2483845471a9824.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e94e92e-4697-58ed-95ac-099301c933d7/4e94e92e-4697-58ed-95ac-099301c933d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_b32dd72418f6db732712f34d0da8666f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e94e92e-4697-58ed-95ac-099301c933d7/4e94e92e-4697-58ed-95ac-099301c933d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_90d375f72937a8a0eb2fa53937591cc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e94e92e-4697-58ed-95ac-099301c933d7/4e94e92e-4697-58ed-95ac-099301c933d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_657778ede856a8a9d39de463f4a29abd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e94e92e-4697-58ed-95ac-099301c933d7/4e94e92e-4697-58ed-95ac-099301c933d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_bd3e7a94a173d217fdd1beeac8365dcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e94e92e-4697-58ed-95ac-099301c933d7/4e94e92e-4697-58ed-95ac-099301c933d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/a3/72a3e81e355ec19cf05b3e79da84156a/pa/TW14426_62bc427b67f494c83b288dbf8eb24976.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW14426%27 HTTP/1.1" 200 None
2026-03-30 10:52:29 [auto1.de] INFO: Saving data for TW14426: {'created_time': 1774867949.561621, 'last_price_update_time': 1774867949.56163, 'auction_closing_time': 1774970447.0}
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW14426') HTTP/1.1" 204 0
2026-03-30 10:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4 with identifier: LT03056
2026-03-30 10:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4 with identifier: LT03056
2026-03-30 10:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4 with identifier: LT03056 to the API
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LT03056>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:16:19Z',
 'fuel_type': 'petrol',
 'id': '4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT03056',
 'listing': 'auction',
 'location': 'DE, Fockbek',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 14877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_6f9e0003332ac5a7cb3d1d15cc4c30e9.jpg',
                'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_afe931814bef70d04912dd7d12a574ec.jpg',
                'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_4b728b5c74f8eb933ee94c94b5df0166.jpg',
                'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_13095cbcfa90a581f547952c5cc2eb8e.jpg',
                'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_c7936501f42400ff1ef851792ee721ca.jpg',
                'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_35b6d5e3ccb256424ef6e9665f104c54.jpg',
                'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_561034b5a1e45f4b318dc2e39ffca6fa.jpg',
                'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_bc8a0e81303b403232a026324900d212.jpg',
                'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_ff527734823380325b6383bfb7f0a572.jpg',
                'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_31accd9054aea39f36f1b036a1802afe.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4/4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_6f9e0003332ac5a7cb3d1d15cc4c30e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4/4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_afe931814bef70d04912dd7d12a574ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4/4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_4b728b5c74f8eb933ee94c94b5df0166.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4/4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2262729,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_13095cbcfa90a581f547952c5cc2eb8e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4/4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2356673,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_c7936501f42400ff1ef851792ee721ca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4/4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_35b6d5e3ccb256424ef6e9665f104c54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4/4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2250003,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_561034b5a1e45f4b318dc2e39ffca6fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4/4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2362801,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_bc8a0e81303b403232a026324900d212.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4/4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2335049,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_ff527734823380325b6383bfb7f0a572.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4/4fa570f4-914d-57a1-bcb5-e6ec2bcd88f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/7f/3d7fec09774bb36b21177ba3f41d7e80/pa/LT03056_31accd9054aea39f36f1b036a1802afe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.3 TCe Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2020}
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT03056%27 HTTP/1.1" 200 None
2026-03-30 10:52:29 [auto1.de] INFO: Saving data for LT03056: {'created_time': 1774867949.914074, 'last_price_update_time': 1774867949.914085, 'auction_closing_time': 1774970179.0}
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT03056') HTTP/1.1" 204 0
2026-03-30 10:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_d456cbc6e6bae3649ae11fb33cdea59b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_6012e7c6424be5f97631942f60abc43b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:29 [auto1.de] INFO: Found listing with ID: AM86665
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM86665%27 HTTP/1.1" 200 None
2026-03-30 10:52:29 [auto1.de] INFO: Scrape type for AM86665: 2
2026-03-30 10:52:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb595eb7-9718-5ea1-9c90-3fbc9063e1d0 with identifier: AM86665
2026-03-30 10:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb595eb7-9718-5ea1-9c90-3fbc9063e1d0 with scrape type 2
2026-03-30 10:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb595eb7-9718-5ea1-9c90-3fbc9063e1d0 with scrape type 2
2026-03-30 10:52:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb595eb7-9718-5ea1-9c90-3fbc9063e1d0, identifier: AM86665
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F35%252Fd93548e26cd93fcd017ce1583d278043%252Fpa%252FVJ31329_511010e93e1358f818bf33923dd350ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_511010e93e1358f818bf33923dd350ad.jpg not downloaded yet
2026-03-30 10:52:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_9f8a2673aa0fe02556c481bfc4508efe.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb595eb7-9718-5ea1-9c90-3fbc9063e1d0 with identifier: AM86665
2026-03-30 10:52:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb595eb7-9718-5ea1-9c90-3fbc9063e1d0 with identifier: AM86665
2026-03-30 10:52:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb595eb7-9718-5ea1-9c90-3fbc9063e1d0 with identifier: AM86665 to the API
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:44:15Z',
 'fuel_type': 'diesel',
 'id': 'cb595eb7-9718-5ea1-9c90-3fbc9063e1d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM86665',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 95085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-23',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM86665%27 HTTP/1.1" 200 None
2026-03-30 10:52:30 [auto1.de] INFO: Saving data for AM86665: {'auction_closing_time': 1774971855.0, 'created_time': 1774463884.149096, 'last_price_update_time': 1774867950.397221}
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM86665') HTTP/1.1" 204 0
2026-03-30 10:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_2179ed83de210cbe30fe34e02332b4c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:30 [auto1.de] INFO: Found listing with ID: RZ82466
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ82466%27 HTTP/1.1" 200 None
2026-03-30 10:52:30 [auto1.de] INFO: Scrape type for RZ82466: 2
2026-03-30 10:52:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ce16c84-d761-50d3-98ea-bf1707f449b6 with identifier: RZ82466
2026-03-30 10:52:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ce16c84-d761-50d3-98ea-bf1707f449b6 with scrape type 2
2026-03-30 10:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ce16c84-d761-50d3-98ea-bf1707f449b6 with scrape type 2
2026-03-30 10:52:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ce16c84-d761-50d3-98ea-bf1707f449b6, identifier: RZ82466
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F35%252Fd93548e26cd93fcd017ce1583d278043%252Fpa%252FVJ31329_9f3ebf741ad5ea1a7d748c47006e049a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_9f3ebf741ad5ea1a7d748c47006e049a.jpg not downloaded yet
2026-03-30 10:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_cbfca3a83135e332c211a0f4b7d791c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ce16c84-d761-50d3-98ea-bf1707f449b6 with identifier: RZ82466
2026-03-30 10:52:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ce16c84-d761-50d3-98ea-bf1707f449b6 with identifier: RZ82466
2026-03-30 10:52:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ce16c84-d761-50d3-98ea-bf1707f449b6 with identifier: RZ82466 to the API
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:07:33Z',
 'fuel_type': 'diesel',
 'id': '1ce16c84-d761-50d3-98ea-bf1707f449b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ82466',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 197097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-23',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ82466%27 HTTP/1.1" 200 None
2026-03-30 10:52:30 [auto1.de] INFO: Saving data for RZ82466: {'auction_closing_time': 1774969653.0, 'created_time': 1773686268.8143, 'last_price_update_time': 1774867950.906492}
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ82466') HTTP/1.1" 204 0
2026-03-30 10:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d80890>
2026-03-30 10:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_f08e2222f0cec732a0b8cc6319a09df0.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_f08e2222f0cec732a0b8cc6319a09df0.jpg saved to cache
2026-03-30 10:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 346cbdf4-9c71-50ea-b1e9-4bc50d33b195
2026-03-30 10:52:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e36872a4-ec35-577a-9d0b-480f4707e6a4 with identifier: YM49760
2026-03-30 10:52:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e36872a4-ec35-577a-9d0b-480f4707e6a4 with scrape type 1
2026-03-30 10:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e36872a4-ec35-577a-9d0b-480f4707e6a4
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F4f%252Fd34feaf6effce651cf4f01c0e5116c72%252Fpa%252FYM49760_a45bc9943e7511cf2c1cd784770ce64a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_a45bc9943e7511cf2c1cd784770ce64a.jpg not downloaded yet
2026-03-30 10:52:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a63e63b-7a57-559f-9193-00d57544884c with identifier: ZE59650
2026-03-30 10:52:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a63e63b-7a57-559f-9193-00d57544884c with scrape type 1
2026-03-30 10:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a63e63b-7a57-559f-9193-00d57544884c
2026-03-30 10:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_5a47cfc5fcab9e3bbca137e7efb3b6d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_5a47cfc5fcab9e3bbca137e7efb3b6d7.jpg not downloaded yet
2026-03-30 10:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef51192d0>
2026-03-30 10:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_cd7b935970590b8836ef5ec168b1ecb7.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_cd7b935970590b8836ef5ec168b1ecb7.jpg saved to cache
2026-03-30 10:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 346cbdf4-9c71-50ea-b1e9-4bc50d33b195
2026-03-30 10:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e282d0>
2026-03-30 10:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_d456cbc6e6bae3649ae11fb33cdea59b.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_d456cbc6e6bae3649ae11fb33cdea59b.jpg saved to cache
2026-03-30 10:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 115518fb-70f7-5f04-866d-268cdb6b3cf8
2026-03-30 10:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508fe10>
2026-03-30 10:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff8%252F78f8d5597e4a7b7c5c0b5f1478005344%252Fpa%252FDE11265_6012e7c6424be5f97631942f60abc43b.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_6012e7c6424be5f97631942f60abc43b.jpg saved to cache
2026-03-30 10:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef94debc-c55a-546a-a899-20e73f821f4a
2026-03-30 10:52:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef94debc-c55a-546a-a899-20e73f821f4a, skipping ID generation
2026-03-30 10:52:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef94debc-c55a-546a-a899-20e73f821f4a with scrape type 1
2026-03-30 10:52:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef94debc-c55a-546a-a899-20e73f821f4a sending to next pipeline
2026-03-30 10:52:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef94debc-c55a-546a-a899-20e73f821f4a, identifier: DE11265
2026-03-30 10:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_aad7b681b6e82a811cd0e6c49d3333ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_856a420d2ca7353cc6b0adcd2e303a8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_88b94ef01fc2ae73cbadf8258a1e6a03.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:31 [auto1.de] INFO: Found listing with ID: RD11154
2026-03-30 10:52:31 [auto1.de] INFO: Found listing with ID: JU90963
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU90963%27 HTTP/1.1" 200 None
2026-03-30 10:52:31 [auto1.de] INFO: Scrape type for JU90963: 2
2026-03-30 10:52:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3363c0aa-d651-5a30-a826-e8cfaaf41de2 with identifier: JU90963
2026-03-30 10:52:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3363c0aa-d651-5a30-a826-e8cfaaf41de2 with scrape type 2
2026-03-30 10:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3363c0aa-d651-5a30-a826-e8cfaaf41de2 with scrape type 2
2026-03-30 10:52:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3363c0aa-d651-5a30-a826-e8cfaaf41de2, identifier: JU90963
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F35%252Fd93548e26cd93fcd017ce1583d278043%252Fpa%252FVJ31329_7f093ef12d94be6e5f705ae4ad56eea8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_7f093ef12d94be6e5f705ae4ad56eea8.jpg not downloaded yet
2026-03-30 10:52:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef94debc-c55a-546a-a899-20e73f821f4a with identifier: DE11265
2026-03-30 10:52:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef94debc-c55a-546a-a899-20e73f821f4a with identifier: DE11265
2026-03-30 10:52:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef94debc-c55a-546a-a899-20e73f821f4a with identifier: DE11265 to the API
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_6012e7c6424be5f97631942f60abc43b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 325,
 'expiration_date': '2026-03-31T15:15:24Z',
 'fuel_type': 'electro',
 'id': 'ef94debc-c55a-546a-a899-20e73f821f4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE11265',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 41083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_06438f7a05a4f0b0f7b8690f72764446.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_2a131e32346347cca6d8c3c58a530d58.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_a339d50ca1901c820227b555f48c1c43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_47c6ae55fa21eb0f56ec86fc525fae19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111600,
             'Height': 799,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_2c8036b3664a173989ce6df0af1f51b2.jpg',
             'Width': 1065},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_6012e7c6424be5f97631942f60abc43b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_5c2ac1871a81266554544c4b195018ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_f3df911cdc11d8a60ac5b42cdc325188.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_501899bbef0636d2102e7858dfa39931.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef94debc-c55a-546a-a899-20e73f821f4a/ef94debc-c55a-546a-a899-20e73f821f4a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f8/78f8d5597e4a7b7c5c0b5f1478005344/pa/DE11265_b17a127644856b1b4e84b74139f7ab81.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model 3 Standard Range Plus RWD',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE11265%27 HTTP/1.1" 200 None
2026-03-30 10:52:32 [auto1.de] INFO: Saving data for DE11265: {'created_time': 1774867952.016183, 'last_price_update_time': 1774867952.016194, 'auction_closing_time': 1774970124.0}
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE11265') HTTP/1.1" 204 0
2026-03-30 10:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_02b025b8212f47aeee1d91fbd1e973e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3363c0aa-d651-5a30-a826-e8cfaaf41de2 with identifier: JU90963
2026-03-30 10:52:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3363c0aa-d651-5a30-a826-e8cfaaf41de2 with identifier: JU90963
2026-03-30 10:52:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3363c0aa-d651-5a30-a826-e8cfaaf41de2 with identifier: JU90963 to the API
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:33:29Z',
 'fuel_type': 'petrol',
 'id': '3363c0aa-d651-5a30-a826-e8cfaaf41de2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU90963',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 50884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-29',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Edition',
 'transmission': 'automatic',
 'trim': 'Color Edition',
 'year': 2016}
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU90963%27 HTTP/1.1" 200 None
2026-03-30 10:52:32 [auto1.de] INFO: Saving data for JU90963: {'auction_closing_time': 1774971209.0, 'created_time': 1774349717.168894, 'last_price_update_time': 1774867952.38891}
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU90963') HTTP/1.1" 204 0
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F4f%252Fd34feaf6effce651cf4f01c0e5116c72%252Fpa%252FYM49760_d06e09b1acd18993b3cc260a8fb199a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_d06e09b1acd18993b3cc260a8fb199a7.jpg not downloaded yet
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_9f5376dd9f8d319a6bdd318fddc1d6cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_9f5376dd9f8d319a6bdd318fddc1d6cd.jpg not downloaded yet
2026-03-30 10:52:32 [auto1.de] INFO: Found listing with ID: XL53582
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL53582%27 HTTP/1.1" 200 None
2026-03-30 10:52:32 [auto1.de] INFO: Scrape type for XL53582: 2
2026-03-30 10:52:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10251f0a-d56e-5c1b-ba1a-e2c49a9df29d with identifier: XL53582
2026-03-30 10:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10251f0a-d56e-5c1b-ba1a-e2c49a9df29d with scrape type 2
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10251f0a-d56e-5c1b-ba1a-e2c49a9df29d with scrape type 2
2026-03-30 10:52:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10251f0a-d56e-5c1b-ba1a-e2c49a9df29d, identifier: XL53582
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F35%252Fd93548e26cd93fcd017ce1583d278043%252Fpa%252FVJ31329_f23fc307a90ab2d31d1e7e17f8124187.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_f23fc307a90ab2d31d1e7e17f8124187.jpg not downloaded yet
2026-03-30 10:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT31842> (referer: https://www.auto1.com/v1/car-details-view/XT31842/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef596c250>
2026-03-30 10:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F01%252Fec0148ebbe9a8c3b443fb08639d7484f%252Fpa%252FXA81988_9f8a2673aa0fe02556c481bfc4508efe.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_9f8a2673aa0fe02556c481bfc4508efe.jpg saved to cache
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 16693ea5-36be-5d75-b0d3-a0c9c1af9e15
2026-03-30 10:52:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16693ea5-36be-5d75-b0d3-a0c9c1af9e15, skipping ID generation
2026-03-30 10:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16693ea5-36be-5d75-b0d3-a0c9c1af9e15 with scrape type 1
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16693ea5-36be-5d75-b0d3-a0c9c1af9e15 sending to next pipeline
2026-03-30 10:52:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16693ea5-36be-5d75-b0d3-a0c9c1af9e15, identifier: XA81988
2026-03-30 10:52:32 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 9511 | hits on page: 40
2026-03-30 10:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da3610>
2026-03-30 10:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_2179ed83de210cbe30fe34e02332b4c5.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_2179ed83de210cbe30fe34e02332b4c5.jpg saved to cache
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 346cbdf4-9c71-50ea-b1e9-4bc50d33b195
2026-03-30 10:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b009d0>
2026-03-30 10:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_cbfca3a83135e332c211a0f4b7d791c9.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_cbfca3a83135e332c211a0f4b7d791c9.jpg saved to cache
2026-03-30 10:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 346cbdf4-9c71-50ea-b1e9-4bc50d33b195
2026-03-30 10:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_d5ab595dbc74f06b640099dd4f20d9f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_d0450210b0645a8f3ef4561f5556c8a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_08746606c3bf32ed84681ea47173c82f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10251f0a-d56e-5c1b-ba1a-e2c49a9df29d with identifier: XL53582
2026-03-30 10:52:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10251f0a-d56e-5c1b-ba1a-e2c49a9df29d with identifier: XL53582
2026-03-30 10:52:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10251f0a-d56e-5c1b-ba1a-e2c49a9df29d with identifier: XL53582 to the API
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:13:55Z',
 'fuel_type': 'diesel',
 'id': '10251f0a-d56e-5c1b-ba1a-e2c49a9df29d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL53582',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 161317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-22',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL53582%27 HTTP/1.1" 200 None
2026-03-30 10:52:33 [auto1.de] INFO: Saving data for XL53582: {'auction_closing_time': 1774970035.0, 'created_time': 1774503324.373093, 'last_price_update_time': 1774867953.278396}
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL53582') HTTP/1.1" 204 0
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F4f%252Fd34feaf6effce651cf4f01c0e5116c72%252Fpa%252FYM49760_d1963d6a59528e8450ad313fc8d5398e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_d1963d6a59528e8450ad313fc8d5398e.jpg not downloaded yet
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_45dda47c9cf9ab91c75f446ccad689ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_45dda47c9cf9ab91c75f446ccad689ef.jpg not downloaded yet
2026-03-30 10:52:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16693ea5-36be-5d75-b0d3-a0c9c1af9e15 with identifier: XA81988
2026-03-30 10:52:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16693ea5-36be-5d75-b0d3-a0c9c1af9e15 with identifier: XA81988
2026-03-30 10:52:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16693ea5-36be-5d75-b0d3-a0c9c1af9e15 with identifier: XA81988 to the API
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_9f8a2673aa0fe02556c481bfc4508efe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:09:34Z',
 'fuel_type': 'petrol',
 'id': '16693ea5-36be-5d75-b0d3-a0c9c1af9e15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA81988',
 'listing': 'auction',
 'location': 'DE, Bayreuth',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 56744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_a04487eb3f94d8a28aced4ded6e2d556.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2479446,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_9f8a2673aa0fe02556c481bfc4508efe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_a4e7cc7c5b4de4591d74ffdb857f39d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_b880e154e15dd63d71e4bfe83f781b3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_23a8abf516d7ca11603ccc8953d212c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_d38431a1a80fb7f8cb6d143211492ea7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_78382e3f45d308d6311acc1427ab3664.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_96a58669539890bf7ce00d151810669c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_e6b7a3b6ebff32a0792030345836bc47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16693ea5-36be-5d75-b0d3-a0c9c1af9e15/16693ea5-36be-5d75-b0d3-a0c9c1af9e15_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/01/ec0148ebbe9a8c3b443fb08639d7484f/pa/XA81988_abc0eeae867dc2944b649cc0f034deb5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2021}
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA81988%27 HTTP/1.1" 200 None
2026-03-30 10:52:33 [auto1.de] INFO: Saving data for XA81988: {'created_time': 1774867953.663064, 'last_price_update_time': 1774867953.663074, 'auction_closing_time': 1774969774.0}
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA81988') HTTP/1.1" 204 0
2026-03-30 10:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_511010e93e1358f818bf33923dd350ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_af0c10a876b9a1979dd2345a9b437544.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:33 [auto1.de] INFO: Found listing with ID: JW22409
2026-03-30 10:52:33 [auto1.de] INFO: Found listing with ID: KZ90725
2026-03-30 10:52:33 [auto1.de] INFO: Found listing with ID: JG32595
2026-03-30 10:52:33 [auto1.de] INFO: Found listing with ID: LY83688
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY83688%27 HTTP/1.1" 200 None
2026-03-30 10:52:33 [auto1.de] INFO: Scrape type for LY83688: 2
2026-03-30 10:52:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79db9579-224c-5499-a3d2-7d2ee60346e8 with identifier: LY83688
2026-03-30 10:52:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79db9579-224c-5499-a3d2-7d2ee60346e8 with scrape type 2
2026-03-30 10:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79db9579-224c-5499-a3d2-7d2ee60346e8 with scrape type 2
2026-03-30 10:52:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79db9579-224c-5499-a3d2-7d2ee60346e8, identifier: LY83688
2026-03-30 10:52:33 [auto1.de] INFO: Found listing with ID: FD63285
2026-03-30 10:52:33 [auto1.de] INFO: Found listing with ID: ZD44688
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD44688%27 HTTP/1.1" 200 None
2026-03-30 10:52:33 [auto1.de] INFO: Scrape type for ZD44688: 2
2026-03-30 10:52:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc199b3e-d220-5304-aabb-1d757b5c3ff4 with identifier: ZD44688
2026-03-30 10:52:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc199b3e-d220-5304-aabb-1d757b5c3ff4 with scrape type 2
2026-03-30 10:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc199b3e-d220-5304-aabb-1d757b5c3ff4 with scrape type 2
2026-03-30 10:52:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc199b3e-d220-5304-aabb-1d757b5c3ff4, identifier: ZD44688
2026-03-30 10:52:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50fd950>
2026-03-30 10:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_aad7b681b6e82a811cd0e6c49d3333ae.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_aad7b681b6e82a811cd0e6c49d3333ae.jpg saved to cache
2026-03-30 10:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 115518fb-70f7-5f04-866d-268cdb6b3cf8
2026-03-30 10:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ecd010>
2026-03-30 10:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11956c47-f345-5a17-aa0d-d5a796f6ecb9/11956c47-f345-5a17-aa0d-d5a796f6ecb9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F22%252Fdc2285ff2936991abba6b14e847f393e%252Fpa%252FMJ72325_856a420d2ca7353cc6b0adcd2e303a8e.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_856a420d2ca7353cc6b0adcd2e303a8e.jpg saved to cache
2026-03-30 10:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11956c47-f345-5a17-aa0d-d5a796f6ecb9
2026-03-30 10:52:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11956c47-f345-5a17-aa0d-d5a796f6ecb9, skipping ID generation
2026-03-30 10:52:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11956c47-f345-5a17-aa0d-d5a796f6ecb9 with scrape type 1
2026-03-30 10:52:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11956c47-f345-5a17-aa0d-d5a796f6ecb9 sending to next pipeline
2026-03-30 10:52:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11956c47-f345-5a17-aa0d-d5a796f6ecb9, identifier: MJ72325
2026-03-30 10:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7932810>
2026-03-30 10:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Ff8%252Fd5f8733f11442c26b9b1d8f4eb549157%252Fpa%252FLW34128_88b94ef01fc2ae73cbadf8258a1e6a03.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_88b94ef01fc2ae73cbadf8258a1e6a03.jpg saved to cache
2026-03-30 10:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 346cbdf4-9c71-50ea-b1e9-4bc50d33b195
2026-03-30 10:52:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 346cbdf4-9c71-50ea-b1e9-4bc50d33b195, skipping ID generation
2026-03-30 10:52:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 346cbdf4-9c71-50ea-b1e9-4bc50d33b195 with scrape type 1
2026-03-30 10:52:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 346cbdf4-9c71-50ea-b1e9-4bc50d33b195 sending to next pipeline
2026-03-30 10:52:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 346cbdf4-9c71-50ea-b1e9-4bc50d33b195, identifier: LW34128
2026-03-30 10:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f8b410>
2026-03-30 10:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30816682-d2e8-579b-a464-211ad1f9fb76/30816682-d2e8-579b-a464-211ad1f9fb76_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F2f%252Fa92f6c21411b6caf526fc4dad15837a2%252Fpa%252FCB76983_02b025b8212f47aeee1d91fbd1e973e0.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_02b025b8212f47aeee1d91fbd1e973e0.jpg saved to cache
2026-03-30 10:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30816682-d2e8-579b-a464-211ad1f9fb76
2026-03-30 10:52:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79db9579-224c-5499-a3d2-7d2ee60346e8 with identifier: LY83688
2026-03-30 10:52:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79db9579-224c-5499-a3d2-7d2ee60346e8 with identifier: LY83688
2026-03-30 10:52:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79db9579-224c-5499-a3d2-7d2ee60346e8 with identifier: LY83688 to the API
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:46:20Z',
 'fuel_type': 'petrol',
 'id': '79db9579-224c-5499-a3d2-7d2ee60346e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY83688',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 223025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-15',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY83688%27 HTTP/1.1" 200 None
2026-03-30 10:52:34 [auto1.de] INFO: Saving data for LY83688: {'auction_closing_time': 1774971980.0, 'created_time': 1773689116.937042, 'last_price_update_time': 1774867954.818417}
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LY83688') HTTP/1.1" 204 0
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F4f%252Fd34feaf6effce651cf4f01c0e5116c72%252Fpa%252FYM49760_0abcc2836197f2b33ddd7685e67d1bc6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_0abcc2836197f2b33ddd7685e67d1bc6.jpg not downloaded yet
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_aba278b4c9194786feae5aea9a558eb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_aba278b4c9194786feae5aea9a558eb2.jpg not downloaded yet
2026-03-30 10:52:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc199b3e-d220-5304-aabb-1d757b5c3ff4 with identifier: ZD44688
2026-03-30 10:52:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc199b3e-d220-5304-aabb-1d757b5c3ff4 with identifier: ZD44688
2026-03-30 10:52:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc199b3e-d220-5304-aabb-1d757b5c3ff4 with identifier: ZD44688 to the API
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-31T15:55:58Z',
 'fuel_type': 'petrol',
 'id': 'fc199b3e-d220-5304-aabb-1d757b5c3ff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD44688',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 42025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-21',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Mild-Hybrid Comfort 4x2',
 'transmission': 'manual',
 'trim': 'Comfort 4x2',
 'year': 2023}
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD44688%27 HTTP/1.1" 200 None
2026-03-30 10:52:35 [auto1.de] INFO: Saving data for ZD44688: {'auction_closing_time': 1774972558.0, 'created_time': 1773380919.806966, 'last_price_update_time': 1774867955.456955}
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD44688') HTTP/1.1" 204 0
2026-03-30 10:52:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11956c47-f345-5a17-aa0d-d5a796f6ecb9 with identifier: MJ72325
2026-03-30 10:52:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11956c47-f345-5a17-aa0d-d5a796f6ecb9 with identifier: MJ72325
2026-03-30 10:52:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11956c47-f345-5a17-aa0d-d5a796f6ecb9 with identifier: MJ72325 to the API
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_856a420d2ca7353cc6b0adcd2e303a8e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:11:46Z',
 'fuel_type': 'diesel',
 'id': '11956c47-f345-5a17-aa0d-d5a796f6ecb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ72325',
 'listing': 'auction',
 'location': 'DE, Ulm-Senden',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 281196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11956c47-f345-5a17-aa0d-d5a796f6ecb9/11956c47-f345-5a17-aa0d-d5a796f6ecb9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_238fecfa6cfe81c8a6894d6a19504738.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11956c47-f345-5a17-aa0d-d5a796f6ecb9/11956c47-f345-5a17-aa0d-d5a796f6ecb9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_856a420d2ca7353cc6b0adcd2e303a8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11956c47-f345-5a17-aa0d-d5a796f6ecb9/11956c47-f345-5a17-aa0d-d5a796f6ecb9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_ee4b64ab64063fd7bf179f1253039caf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11956c47-f345-5a17-aa0d-d5a796f6ecb9/11956c47-f345-5a17-aa0d-d5a796f6ecb9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_b1bdf66396bdd7eeff84dca5ed0d3968.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11956c47-f345-5a17-aa0d-d5a796f6ecb9/11956c47-f345-5a17-aa0d-d5a796f6ecb9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_9f7a86d8127b20da882bfca704e2cc4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11956c47-f345-5a17-aa0d-d5a796f6ecb9/11956c47-f345-5a17-aa0d-d5a796f6ecb9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/22/dc2285ff2936991abba6b14e847f393e/pa/MJ72325_b17dabf8114c419b5c95ab47d34063bb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2011}
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ72325%27 HTTP/1.1" 200 None
2026-03-30 10:52:35 [auto1.de] INFO: Saving data for MJ72325: {'created_time': 1774867955.856577, 'last_price_update_time': 1774867955.856591, 'auction_closing_time': 1774969906.0}
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ72325') HTTP/1.1" 204 0
2026-03-30 10:52:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 346cbdf4-9c71-50ea-b1e9-4bc50d33b195 with identifier: LW34128
2026-03-30 10:52:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 346cbdf4-9c71-50ea-b1e9-4bc50d33b195 with identifier: LW34128
2026-03-30 10:52:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 346cbdf4-9c71-50ea-b1e9-4bc50d33b195 with identifier: LW34128 to the API
2026-03-30 10:52:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_88b94ef01fc2ae73cbadf8258a1e6a03.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:50:18Z',
 'fuel_type': 'diesel',
 'id': '346cbdf4-9c71-50ea-b1e9-4bc50d33b195',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW34128',
 'listing': 'auction',
 'location': 'DE, Kassel',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 216725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_ab59c2930e71610b6ee0098089c6c5e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_8ba110814294c85aa1d711f3c7592b47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_88b94ef01fc2ae73cbadf8258a1e6a03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_6b6f0238c83cbee3564c4481cc956e35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_cbfca3a83135e332c211a0f4b7d791c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_2179ed83de210cbe30fe34e02332b4c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_cd7b935970590b8836ef5ec168b1ecb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_f08e2222f0cec732a0b8cc6319a09df0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_ae3e8c0337092a9e492f1e292223d409.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346cbdf4-9c71-50ea-b1e9-4bc50d33b195/346cbdf4-9c71-50ea-b1e9-4bc50d33b195_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/f8/d5f8733f11442c26b9b1d8f4eb549157/pa/LW34128_a5ad639f055ec850dff71119eade66c6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW34128%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [auto1.de] INFO: Saving data for LW34128: {'created_time': 1774867956.236285, 'last_price_update_time': 1774867956.236305, 'auction_closing_time': 1774972218.0}
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW34128') HTTP/1.1" 204 0
2026-03-30 10:52:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 407c4be8-0adc-5ae3-853b-ec51dc69219e with identifier: XT31842
2026-03-30 10:52:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 407c4be8-0adc-5ae3-853b-ec51dc69219e with scrape type 1
2026-03-30 10:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 407c4be8-0adc-5ae3-853b-ec51dc69219e
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F5f%252F695f8b008783ad975353d4964a342aec%252Fpa%252FXT31842_8cdc2c5972294d8374820f8c2422aabb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_8cdc2c5972294d8374820f8c2422aabb.jpg already downloaded
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F5f%252F695f8b008783ad975353d4964a342aec%252Fpa%252FXT31842_9d7a01cce28fb63b863ccc98676bfd26.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_9d7a01cce28fb63b863ccc98676bfd26.jpg already downloaded
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F5f%252F695f8b008783ad975353d4964a342aec%252Fpa%252FXT31842_bec7387fd55cf126e6ad84e6eae754ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_bec7387fd55cf126e6ad84e6eae754ef.jpg already downloaded
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F5f%252F695f8b008783ad975353d4964a342aec%252Fpa%252FXT31842_b4c02457e7e9d779bc316eaad87be8d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_b4c02457e7e9d779bc316eaad87be8d2.jpg already downloaded
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F5f%252F695f8b008783ad975353d4964a342aec%252Fpa%252FXT31842_1bd876618d147d1a70617b6a137d2132.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_1bd876618d147d1a70617b6a137d2132.jpg already downloaded
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F5f%252F695f8b008783ad975353d4964a342aec%252Fpa%252FXT31842_2a50339588120683a6777c9cbbdca70a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_2a50339588120683a6777c9cbbdca70a.jpg already downloaded
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F5f%252F695f8b008783ad975353d4964a342aec%252Fpa%252FXT31842_e7a0a3766aa073dfb2f4322af7e9ae9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_e7a0a3766aa073dfb2f4322af7e9ae9e.jpg already downloaded
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F5f%252F695f8b008783ad975353d4964a342aec%252Fpa%252FXT31842_e3ee1f17e78b106da058dddb7ad74422.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_e3ee1f17e78b106da058dddb7ad74422.jpg already downloaded
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F5f%252F695f8b008783ad975353d4964a342aec%252Fpa%252FXT31842_7ab9dc0972b716f4202dcfc1c094d0ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_7ab9dc0972b716f4202dcfc1c094d0ea.jpg already downloaded
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F5f%252F695f8b008783ad975353d4964a342aec%252Fpa%252FXT31842_24855cfd480f37ec0d39b15e7329e315.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_24855cfd480f37ec0d39b15e7329e315.jpg already downloaded
2026-03-30 10:52:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 407c4be8-0adc-5ae3-853b-ec51dc69219e, identifier: XT31842
2026-03-30 10:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_ea9caebeee93703cfbf978af9d69dfe0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:36 [auto1.de] INFO: Found listing with ID: FJ03790
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ03790%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [auto1.de] INFO: Scrape type for FJ03790: 2
2026-03-30 10:52:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22750cbe-2758-5439-8c5d-867e3f4a845f with identifier: FJ03790
2026-03-30 10:52:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22750cbe-2758-5439-8c5d-867e3f4a845f with scrape type 2
2026-03-30 10:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22750cbe-2758-5439-8c5d-867e3f4a845f with scrape type 2
2026-03-30 10:52:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22750cbe-2758-5439-8c5d-867e3f4a845f, identifier: FJ03790
2026-03-30 10:52:36 [auto1.de] INFO: Found listing with ID: UK45844
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK45844%27 HTTP/1.1" 200 None
2026-03-30 10:52:36 [auto1.de] INFO: Scrape type for UK45844: 2
2026-03-30 10:52:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eecc02e6-dd03-53ee-affd-3edf6cb7f29f with identifier: UK45844
2026-03-30 10:52:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eecc02e6-dd03-53ee-affd-3edf6cb7f29f with scrape type 2
2026-03-30 10:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eecc02e6-dd03-53ee-affd-3edf6cb7f29f with scrape type 2
2026-03-30 10:52:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eecc02e6-dd03-53ee-affd-3edf6cb7f29f, identifier: UK45844
2026-03-30 10:52:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 407c4be8-0adc-5ae3-853b-ec51dc69219e with identifier: XT31842
2026-03-30 10:52:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 407c4be8-0adc-5ae3-853b-ec51dc69219e with identifier: XT31842
2026-03-30 10:52:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 407c4be8-0adc-5ae3-853b-ec51dc69219e with identifier: XT31842 to the API
2026-03-30 10:52:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XT31842>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:19:58Z',
 'fuel_type': 'petrol',
 'id': '407c4be8-0adc-5ae3-853b-ec51dc69219e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT31842',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 141704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_8cdc2c5972294d8374820f8c2422aabb.jpg',
                'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_9d7a01cce28fb63b863ccc98676bfd26.jpg',
                'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_bec7387fd55cf126e6ad84e6eae754ef.jpg',
                'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_b4c02457e7e9d779bc316eaad87be8d2.jpg',
                'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_1bd876618d147d1a70617b6a137d2132.jpg',
                'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_2a50339588120683a6777c9cbbdca70a.jpg',
                'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_e7a0a3766aa073dfb2f4322af7e9ae9e.jpg',
                'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_e3ee1f17e78b106da058dddb7ad74422.jpg',
                'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_7ab9dc0972b716f4202dcfc1c094d0ea.jpg',
                'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_24855cfd480f37ec0d39b15e7329e315.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407c4be8-0adc-5ae3-853b-ec51dc69219e/407c4be8-0adc-5ae3-853b-ec51dc69219e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2931269,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_8cdc2c5972294d8374820f8c2422aabb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407c4be8-0adc-5ae3-853b-ec51dc69219e/407c4be8-0adc-5ae3-853b-ec51dc69219e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_9d7a01cce28fb63b863ccc98676bfd26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407c4be8-0adc-5ae3-853b-ec51dc69219e/407c4be8-0adc-5ae3-853b-ec51dc69219e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_bec7387fd55cf126e6ad84e6eae754ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407c4be8-0adc-5ae3-853b-ec51dc69219e/407c4be8-0adc-5ae3-853b-ec51dc69219e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_b4c02457e7e9d779bc316eaad87be8d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407c4be8-0adc-5ae3-853b-ec51dc69219e/407c4be8-0adc-5ae3-853b-ec51dc69219e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2345805,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_1bd876618d147d1a70617b6a137d2132.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407c4be8-0adc-5ae3-853b-ec51dc69219e/407c4be8-0adc-5ae3-853b-ec51dc69219e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2409966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_2a50339588120683a6777c9cbbdca70a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407c4be8-0adc-5ae3-853b-ec51dc69219e/407c4be8-0adc-5ae3-853b-ec51dc69219e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2510238,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_e7a0a3766aa073dfb2f4322af7e9ae9e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407c4be8-0adc-5ae3-853b-ec51dc69219e/407c4be8-0adc-5ae3-853b-ec51dc69219e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2334951,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_e3ee1f17e78b106da058dddb7ad74422.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407c4be8-0adc-5ae3-853b-ec51dc69219e/407c4be8-0adc-5ae3-853b-ec51dc69219e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2870310,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_7ab9dc0972b716f4202dcfc1c094d0ea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_407c4be8-0adc-5ae3-853b-ec51dc69219e/407c4be8-0adc-5ae3-853b-ec51dc69219e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/5f/695f8b008783ad975353d4964a342aec/pa/XT31842_24855cfd480f37ec0d39b15e7329e315.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford Galaxy 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT31842%27 HTTP/1.1" 200 None
2026-03-30 10:52:37 [auto1.de] INFO: Saving data for XT31842: {'created_time': 1774867957.163595, 'last_price_update_time': 1774867957.163609, 'auction_closing_time': 1774970398.0}
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT31842') HTTP/1.1" 204 0
2026-03-30 10:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0ac10>
2026-03-30 10:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_d5ab595dbc74f06b640099dd4f20d9f9.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_d5ab595dbc74f06b640099dd4f20d9f9.jpg saved to cache
2026-03-30 10:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87fe0456-e89d-5ff7-8f00-7c636da01fe6
2026-03-30 10:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0df10>
2026-03-30 10:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86a88041-6fa6-5fdc-83a5-922e4a26f891/86a88041-6fa6-5fdc-83a5-922e4a26f891_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F35%252Fd93548e26cd93fcd017ce1583d278043%252Fpa%252FVJ31329_d0450210b0645a8f3ef4561f5556c8a6.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_d0450210b0645a8f3ef4561f5556c8a6.jpg saved to cache
2026-03-30 10:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86a88041-6fa6-5fdc-83a5-922e4a26f891
2026-03-30 10:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a31d90>
2026-03-30 10:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30816682-d2e8-579b-a464-211ad1f9fb76/30816682-d2e8-579b-a464-211ad1f9fb76_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F2f%252Fa92f6c21411b6caf526fc4dad15837a2%252Fpa%252FCB76983_08746606c3bf32ed84681ea47173c82f.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_08746606c3bf32ed84681ea47173c82f.jpg saved to cache
2026-03-30 10:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30816682-d2e8-579b-a464-211ad1f9fb76
2026-03-30 10:52:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22750cbe-2758-5439-8c5d-867e3f4a845f with identifier: FJ03790
2026-03-30 10:52:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22750cbe-2758-5439-8c5d-867e3f4a845f with identifier: FJ03790
2026-03-30 10:52:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22750cbe-2758-5439-8c5d-867e3f4a845f with identifier: FJ03790 to the API
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:33:29Z',
 'fuel_type': 'petrol',
 'id': '22750cbe-2758-5439-8c5d-867e3f4a845f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ03790',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 100011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-10',
 'seller_name': None,
 'title': 'MINI One First',
 'transmission': 'manual',
 'trim': 'First',
 'year': 2015}
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ03790%27 HTTP/1.1" 200 None
2026-03-30 10:52:37 [auto1.de] INFO: Saving data for FJ03790: {'auction_closing_time': 1774971209.0, 'created_time': 1774436215.694721, 'last_price_update_time': 1774867957.642825}
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ03790') HTTP/1.1" 204 0
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F4f%252Fd34feaf6effce651cf4f01c0e5116c72%252Fpa%252FYM49760_a8be9d774dd7917045b58bc414cd4014.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_a8be9d774dd7917045b58bc414cd4014.jpg not downloaded yet
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_06545a74226e8ee50a86eea99356aa79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_06545a74226e8ee50a86eea99356aa79.jpg not downloaded yet
2026-03-30 10:52:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eecc02e6-dd03-53ee-affd-3edf6cb7f29f with identifier: UK45844
2026-03-30 10:52:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eecc02e6-dd03-53ee-affd-3edf6cb7f29f with identifier: UK45844
2026-03-30 10:52:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eecc02e6-dd03-53ee-affd-3edf6cb7f29f with identifier: UK45844 to the API
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:50:23Z',
 'fuel_type': 'diesel',
 'id': 'eecc02e6-dd03-53ee-affd-3edf6cb7f29f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK45844',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 100565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-07',
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Ocean Edition 4Motion',
 'transmission': 'automatic',
 'trim': 'Ocean Edition 4Motion',
 'year': 2018}
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK45844%27 HTTP/1.1" 200 None
2026-03-30 10:52:38 [auto1.de] INFO: Saving data for UK45844: {'auction_closing_time': 1774972223.0, 'created_time': 1773945320.96664, 'last_price_update_time': 1774867958.0279}
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK45844') HTTP/1.1" 204 0
2026-03-30 10:52:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5aca450>
2026-03-30 10:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86a88041-6fa6-5fdc-83a5-922e4a26f891/86a88041-6fa6-5fdc-83a5-922e4a26f891_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F35%252Fd93548e26cd93fcd017ce1583d278043%252Fpa%252FVJ31329_511010e93e1358f818bf33923dd350ad.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_511010e93e1358f818bf33923dd350ad.jpg saved to cache
2026-03-30 10:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86a88041-6fa6-5fdc-83a5-922e4a26f891
2026-03-30 10:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4cac310>
2026-03-30 10:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30816682-d2e8-579b-a464-211ad1f9fb76/30816682-d2e8-579b-a464-211ad1f9fb76_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F2f%252Fa92f6c21411b6caf526fc4dad15837a2%252Fpa%252FCB76983_af0c10a876b9a1979dd2345a9b437544.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_af0c10a876b9a1979dd2345a9b437544.jpg saved to cache
2026-03-30 10:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30816682-d2e8-579b-a464-211ad1f9fb76
2026-03-30 10:52:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30816682-d2e8-579b-a464-211ad1f9fb76, skipping ID generation
2026-03-30 10:52:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30816682-d2e8-579b-a464-211ad1f9fb76 with scrape type 1
2026-03-30 10:52:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30816682-d2e8-579b-a464-211ad1f9fb76 sending to next pipeline
2026-03-30 10:52:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30816682-d2e8-579b-a464-211ad1f9fb76, identifier: CB76983
2026-03-30 10:52:38 [auto1.de] INFO: Found listing with ID: YT23335
2026-03-30 10:52:38 [auto1.de] INFO: Found listing with ID: EN47002
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47002%27 HTTP/1.1" 200 None
2026-03-30 10:52:38 [auto1.de] INFO: Scrape type for EN47002: 2
2026-03-30 10:52:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adb398ef-a4c8-51cc-8801-3ec6785962cc with identifier: EN47002
2026-03-30 10:52:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adb398ef-a4c8-51cc-8801-3ec6785962cc with scrape type 2
2026-03-30 10:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adb398ef-a4c8-51cc-8801-3ec6785962cc with scrape type 2
2026-03-30 10:52:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adb398ef-a4c8-51cc-8801-3ec6785962cc, identifier: EN47002
2026-03-30 10:52:38 [auto1.de] INFO: Found listing with ID: UT70754
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT70754%27 HTTP/1.1" 200 None
2026-03-30 10:52:38 [auto1.de] INFO: Scrape type for UT70754: 2
2026-03-30 10:52:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83a063e9-e36b-535f-9883-573b2511edd8 with identifier: UT70754
2026-03-30 10:52:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83a063e9-e36b-535f-9883-573b2511edd8 with scrape type 2
2026-03-30 10:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83a063e9-e36b-535f-9883-573b2511edd8 with scrape type 2
2026-03-30 10:52:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83a063e9-e36b-535f-9883-573b2511edd8, identifier: UT70754
2026-03-30 10:52:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30816682-d2e8-579b-a464-211ad1f9fb76 with identifier: CB76983
2026-03-30 10:52:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30816682-d2e8-579b-a464-211ad1f9fb76 with identifier: CB76983
2026-03-30 10:52:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30816682-d2e8-579b-a464-211ad1f9fb76 with identifier: CB76983 to the API
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_af0c10a876b9a1979dd2345a9b437544.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:22:40Z',
 'fuel_type': 'petrol',
 'id': '30816682-d2e8-579b-a464-211ad1f9fb76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB76983',
 'listing': 'auction',
 'location': 'DE, Offenbach am Main',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 183503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30816682-d2e8-579b-a464-211ad1f9fb76/30816682-d2e8-579b-a464-211ad1f9fb76_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_af0c10a876b9a1979dd2345a9b437544.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30816682-d2e8-579b-a464-211ad1f9fb76/30816682-d2e8-579b-a464-211ad1f9fb76_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_08746606c3bf32ed84681ea47173c82f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30816682-d2e8-579b-a464-211ad1f9fb76/30816682-d2e8-579b-a464-211ad1f9fb76_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_02b025b8212f47aeee1d91fbd1e973e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30816682-d2e8-579b-a464-211ad1f9fb76/30816682-d2e8-579b-a464-211ad1f9fb76_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_d42360321534ed8f775073af6b3d1c8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30816682-d2e8-579b-a464-211ad1f9fb76/30816682-d2e8-579b-a464-211ad1f9fb76_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/2f/a92f6c21411b6caf526fc4dad15837a2/pa/CB76983_056b50ec55d637824e65fd46cf99fcd8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB76983%27 HTTP/1.1" 200 None
2026-03-30 10:52:38 [auto1.de] INFO: Saving data for CB76983: {'created_time': 1774867958.860408, 'last_price_update_time': 1774867958.860421, 'auction_closing_time': 1774970560.0}
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB76983') HTTP/1.1" 204 0
2026-03-30 10:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_40e82aa4c5b39f29d9e872075072078c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adb398ef-a4c8-51cc-8801-3ec6785962cc with identifier: EN47002
2026-03-30 10:52:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adb398ef-a4c8-51cc-8801-3ec6785962cc with identifier: EN47002
2026-03-30 10:52:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adb398ef-a4c8-51cc-8801-3ec6785962cc with identifier: EN47002 to the API
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:48:13Z',
 'fuel_type': 'petrol',
 'id': 'adb398ef-a4c8-51cc-8801-3ec6785962cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN47002',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 115925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-03',
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2016}
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47002%27 HTTP/1.1" 200 None
2026-03-30 10:52:39 [auto1.de] INFO: Saving data for EN47002: {'auction_closing_time': 1774972093.0, 'created_time': 1774467824.98333, 'last_price_update_time': 1774867959.240017}
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN47002') HTTP/1.1" 204 0
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_d62ec83b0a27c0ca43678019e4a15f7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_d62ec83b0a27c0ca43678019e4a15f7e.jpg not downloaded yet
2026-03-30 10:52:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83a063e9-e36b-535f-9883-573b2511edd8 with identifier: UT70754
2026-03-30 10:52:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83a063e9-e36b-535f-9883-573b2511edd8 with identifier: UT70754
2026-03-30 10:52:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83a063e9-e36b-535f-9883-573b2511edd8 with identifier: UT70754 to the API
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:16:36Z',
 'fuel_type': 'diesel',
 'id': '83a063e9-e36b-535f-9883-573b2511edd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT70754',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 279816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-26',
 'seller_name': None,
 'title': 'BMW 5er 535d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2015}
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT70754%27 HTTP/1.1" 200 None
2026-03-30 10:52:39 [auto1.de] INFO: Saving data for UT70754: {'auction_closing_time': 1774970196.0, 'created_time': 1773344705.118147, 'last_price_update_time': 1774867959.599644}
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT70754') HTTP/1.1" 204 0
2026-03-30 10:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef510ab10>
2026-03-30 10:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_ea9caebeee93703cfbf978af9d69dfe0.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_ea9caebeee93703cfbf978af9d69dfe0.jpg saved to cache
2026-03-30 10:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87fe0456-e89d-5ff7-8f00-7c636da01fe6
2026-03-30 10:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_47bea493327c63de5eeb79aebd796a43.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:39 [auto1.de] INFO: Found listing with ID: VW07628
2026-03-30 10:52:39 [auto1.de] INFO: Found listing with ID: SN07258
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN07258%27 HTTP/1.1" 200 None
2026-03-30 10:52:39 [auto1.de] INFO: Scrape type for SN07258: 2
2026-03-30 10:52:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cfba01d-12ea-5545-b7d3-280f56d15996 with identifier: SN07258
2026-03-30 10:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cfba01d-12ea-5545-b7d3-280f56d15996 with scrape type 2
2026-03-30 10:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cfba01d-12ea-5545-b7d3-280f56d15996 with scrape type 2
2026-03-30 10:52:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cfba01d-12ea-5545-b7d3-280f56d15996, identifier: SN07258
2026-03-30 10:52:39 [auto1.de] INFO: Found listing with ID: VF29678
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF29678%27 HTTP/1.1" 200 None
2026-03-30 10:52:39 [auto1.de] INFO: Scrape type for VF29678: 2
2026-03-30 10:52:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4949f32-3093-5d05-ade4-77728c0954ef with identifier: VF29678
2026-03-30 10:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4949f32-3093-5d05-ade4-77728c0954ef with scrape type 2
2026-03-30 10:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4949f32-3093-5d05-ade4-77728c0954ef with scrape type 2
2026-03-30 10:52:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4949f32-3093-5d05-ade4-77728c0954ef, identifier: VF29678
2026-03-30 10:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_f23fc307a90ab2d31d1e7e17f8124187.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cfba01d-12ea-5545-b7d3-280f56d15996 with identifier: SN07258
2026-03-30 10:52:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cfba01d-12ea-5545-b7d3-280f56d15996 with identifier: SN07258
2026-03-30 10:52:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cfba01d-12ea-5545-b7d3-280f56d15996 with identifier: SN07258 to the API
2026-03-30 10:52:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:44:37Z',
 'fuel_type': 'petrol',
 'id': '1cfba01d-12ea-5545-b7d3-280f56d15996',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN07258',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 229947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-23',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.8 TSI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN07258%27 HTTP/1.1" 200 None
2026-03-30 10:52:40 [auto1.de] INFO: Saving data for SN07258: {'auction_closing_time': 1774971877.0, 'created_time': 1773687641.719134, 'last_price_update_time': 1774867960.240868}
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN07258') HTTP/1.1" 204 0
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_52b738f3252f24574bf6f6fc5faa51f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_52b738f3252f24574bf6f6fc5faa51f6.jpg not downloaded yet
2026-03-30 10:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4949f32-3093-5d05-ade4-77728c0954ef with identifier: VF29678
2026-03-30 10:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4949f32-3093-5d05-ade4-77728c0954ef with identifier: VF29678
2026-03-30 10:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4949f32-3093-5d05-ade4-77728c0954ef with identifier: VF29678 to the API
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:33:14Z',
 'fuel_type': 'diesel',
 'id': 'a4949f32-3093-5d05-ade4-77728c0954ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF29678',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 194828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-28',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF29678%27 HTTP/1.1" 200 None
2026-03-30 10:52:40 [auto1.de] INFO: Saving data for VF29678: {'auction_closing_time': 1774971194.0, 'created_time': 1773657629.596361, 'last_price_update_time': 1774867960.617207}
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF29678') HTTP/1.1" 204 0
2026-03-30 10:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_d1963d6a59528e8450ad313fc8d5398e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_0abcc2836197f2b33ddd7685e67d1bc6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_aba278b4c9194786feae5aea9a558eb2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_45dda47c9cf9ab91c75f446ccad689ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:40 [auto1.de] INFO: Found listing with ID: PP91076
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP91076%27 HTTP/1.1" 200 None
2026-03-30 10:52:40 [auto1.de] INFO: Scrape type for PP91076: 2
2026-03-30 10:52:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5babb102-a6c0-5aae-a126-65aa027faf5b with identifier: PP91076
2026-03-30 10:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5babb102-a6c0-5aae-a126-65aa027faf5b with scrape type 2
2026-03-30 10:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5babb102-a6c0-5aae-a126-65aa027faf5b with scrape type 2
2026-03-30 10:52:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5babb102-a6c0-5aae-a126-65aa027faf5b, identifier: PP91076
2026-03-30 10:52:40 [auto1.de] INFO: Found listing with ID: CK03122
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK03122%27 HTTP/1.1" 200 None
2026-03-30 10:52:40 [auto1.de] INFO: Scrape type for CK03122: 2
2026-03-30 10:52:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eda9b08-a2f4-5431-9d40-531418e37450 with identifier: CK03122
2026-03-30 10:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eda9b08-a2f4-5431-9d40-531418e37450 with scrape type 2
2026-03-30 10:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0eda9b08-a2f4-5431-9d40-531418e37450 with scrape type 2
2026-03-30 10:52:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0eda9b08-a2f4-5431-9d40-531418e37450, identifier: CK03122
2026-03-30 10:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU73631> (referer: https://www.auto1.com/v1/car-details-view/FU73631/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5982b90>
2026-03-30 10:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_40e82aa4c5b39f29d9e872075072078c.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_40e82aa4c5b39f29d9e872075072078c.jpg saved to cache
2026-03-30 10:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87fe0456-e89d-5ff7-8f00-7c636da01fe6
2026-03-30 10:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_9f5376dd9f8d319a6bdd318fddc1d6cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5babb102-a6c0-5aae-a126-65aa027faf5b with identifier: PP91076
2026-03-30 10:52:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5babb102-a6c0-5aae-a126-65aa027faf5b with identifier: PP91076
2026-03-30 10:52:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5babb102-a6c0-5aae-a126-65aa027faf5b with identifier: PP91076 to the API
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:42:41Z',
 'fuel_type': 'petrol',
 'id': '5babb102-a6c0-5aae-a126-65aa027faf5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP91076',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 137870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Lounge BlueMotion Tech.',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech.',
 'year': 2015}
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP91076%27 HTTP/1.1" 200 None
2026-03-30 10:52:41 [auto1.de] INFO: Saving data for PP91076: {'auction_closing_time': 1774971761.0, 'created_time': 1774424130.989757, 'last_price_update_time': 1774867961.400227}
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP91076') HTTP/1.1" 204 0
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_d9a4713d0cd634bcc6aee85483a03d52.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_d9a4713d0cd634bcc6aee85483a03d52.jpg not downloaded yet
2026-03-30 10:52:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0eda9b08-a2f4-5431-9d40-531418e37450 with identifier: CK03122
2026-03-30 10:52:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0eda9b08-a2f4-5431-9d40-531418e37450 with identifier: CK03122
2026-03-30 10:52:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0eda9b08-a2f4-5431-9d40-531418e37450 with identifier: CK03122 to the API
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:42:46Z',
 'fuel_type': 'diesel',
 'id': '0eda9b08-a2f4-5431-9d40-531418e37450',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK03122',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 181673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-19',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2014}
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK03122%27 HTTP/1.1" 200 None
2026-03-30 10:52:41 [auto1.de] INFO: Saving data for CK03122: {'auction_closing_time': 1774971766.0, 'created_time': 1773812129.604072, 'last_price_update_time': 1774867961.737559}
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK03122') HTTP/1.1" 204 0
2026-03-30 10:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_7f093ef12d94be6e5f705ae4ad56eea8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_d06e09b1acd18993b3cc260a8fb199a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:41 [auto1.de] INFO: Found listing with ID: LM68672
2026-03-30 10:52:41 [auto1.de] INFO: Found listing with ID: TM22078
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM22078%27 HTTP/1.1" 200 None
2026-03-30 10:52:41 [auto1.de] INFO: Scrape type for TM22078: 2
2026-03-30 10:52:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b54512a-5b0f-5e2f-8335-5ebc762b259e with identifier: TM22078
2026-03-30 10:52:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b54512a-5b0f-5e2f-8335-5ebc762b259e with scrape type 2
2026-03-30 10:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b54512a-5b0f-5e2f-8335-5ebc762b259e with scrape type 2
2026-03-30 10:52:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b54512a-5b0f-5e2f-8335-5ebc762b259e, identifier: TM22078
2026-03-30 10:52:41 [auto1.de] INFO: Found listing with ID: RW07323
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW07323%27 HTTP/1.1" 200 None
2026-03-30 10:52:41 [auto1.de] INFO: Scrape type for RW07323: 2
2026-03-30 10:52:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3ab32f4-11c5-5e86-b871-77f886ddb2e0 with identifier: RW07323
2026-03-30 10:52:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3ab32f4-11c5-5e86-b871-77f886ddb2e0 with scrape type 2
2026-03-30 10:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3ab32f4-11c5-5e86-b871-77f886ddb2e0 with scrape type 2
2026-03-30 10:52:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3ab32f4-11c5-5e86-b871-77f886ddb2e0, identifier: RW07323
2026-03-30 10:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS37212/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c82e50>
2026-03-30 10:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_47bea493327c63de5eeb79aebd796a43.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_47bea493327c63de5eeb79aebd796a43.jpg saved to cache
2026-03-30 10:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 115518fb-70f7-5f04-866d-268cdb6b3cf8
2026-03-30 10:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5005c50>
2026-03-30 10:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86a88041-6fa6-5fdc-83a5-922e4a26f891/86a88041-6fa6-5fdc-83a5-922e4a26f891_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F35%252Fd93548e26cd93fcd017ce1583d278043%252Fpa%252FVJ31329_f23fc307a90ab2d31d1e7e17f8124187.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_f23fc307a90ab2d31d1e7e17f8124187.jpg saved to cache
2026-03-30 10:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86a88041-6fa6-5fdc-83a5-922e4a26f891
2026-03-30 10:52:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b54512a-5b0f-5e2f-8335-5ebc762b259e with identifier: TM22078
2026-03-30 10:52:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b54512a-5b0f-5e2f-8335-5ebc762b259e with identifier: TM22078
2026-03-30 10:52:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b54512a-5b0f-5e2f-8335-5ebc762b259e with identifier: TM22078 to the API
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:27:48Z',
 'fuel_type': 'diesel',
 'id': '2b54512a-5b0f-5e2f-8335-5ebc762b259e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM22078',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 146481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-23',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM22078%27 HTTP/1.1" 200 None
2026-03-30 10:52:42 [auto1.de] INFO: Saving data for TM22078: {'auction_closing_time': 1774970868.0, 'created_time': 1774349028.773484, 'last_price_update_time': 1774867962.528713}
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM22078') HTTP/1.1" 204 0
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_220c06157557e8016e1806e5caa97488.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_220c06157557e8016e1806e5caa97488.jpg not downloaded yet
2026-03-30 10:52:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3ab32f4-11c5-5e86-b871-77f886ddb2e0 with identifier: RW07323
2026-03-30 10:52:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3ab32f4-11c5-5e86-b871-77f886ddb2e0 with identifier: RW07323
2026-03-30 10:52:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3ab32f4-11c5-5e86-b871-77f886ddb2e0 with identifier: RW07323 to the API
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 530,
 'expiration_date': '2026-03-31T15:36:17Z',
 'fuel_type': 'petrol',
 'id': 'c3ab32f4-11c5-5e86-b871-77f886ddb2e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW07323',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 192135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-22',
 'seller_name': None,
 'title': 'BMW 7er 750i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2019}
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW07323%27 HTTP/1.1" 200 None
2026-03-30 10:52:42 [auto1.de] INFO: Saving data for RW07323: {'auction_closing_time': 1774971377.0, 'created_time': 1774435349.838479, 'last_price_update_time': 1774867962.980823}
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW07323') HTTP/1.1" 204 0
2026-03-30 10:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_a45bc9943e7511cf2c1cd784770ce64a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_5a47cfc5fcab9e3bbca137e7efb3b6d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_06545a74226e8ee50a86eea99356aa79.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:43 [auto1.de] INFO: Found listing with ID: XR50139
2026-03-30 10:52:43 [auto1.de] INFO: Found listing with ID: VZ82726
2026-03-30 10:52:43 [auto1.de] INFO: Found listing with ID: TN91877
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN91877%27 HTTP/1.1" 200 None
2026-03-30 10:52:43 [auto1.de] INFO: Scrape type for TN91877: 2
2026-03-30 10:52:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c486c0ee-42ce-5f7f-a832-bd3a0278c7bd with identifier: TN91877
2026-03-30 10:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c486c0ee-42ce-5f7f-a832-bd3a0278c7bd with scrape type 2
2026-03-30 10:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c486c0ee-42ce-5f7f-a832-bd3a0278c7bd with scrape type 2
2026-03-30 10:52:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c486c0ee-42ce-5f7f-a832-bd3a0278c7bd, identifier: TN91877
2026-03-30 10:52:43 [auto1.de] INFO: Found listing with ID: BV43542
2026-03-30 10:52:43 [auto1.de] INFO: Found listing with ID: DA98939
2026-03-30 10:52:43 [auto1.de] INFO: Found listing with ID: KS95343
2026-03-30 10:52:43 [auto1.de] INFO: Found listing with ID: KG16630
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG16630%27 HTTP/1.1" 200 None
2026-03-30 10:52:43 [auto1.de] INFO: Scrape type for KG16630: 2
2026-03-30 10:52:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef5a8218-94dd-515b-bc52-ca2efb51ec15 with identifier: KG16630
2026-03-30 10:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef5a8218-94dd-515b-bc52-ca2efb51ec15 with scrape type 2
2026-03-30 10:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef5a8218-94dd-515b-bc52-ca2efb51ec15 with scrape type 2
2026-03-30 10:52:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef5a8218-94dd-515b-bc52-ca2efb51ec15, identifier: KG16630
2026-03-30 10:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_a8be9d774dd7917045b58bc414cd4014.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c486c0ee-42ce-5f7f-a832-bd3a0278c7bd with identifier: TN91877
2026-03-30 10:52:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c486c0ee-42ce-5f7f-a832-bd3a0278c7bd with identifier: TN91877
2026-03-30 10:52:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c486c0ee-42ce-5f7f-a832-bd3a0278c7bd with identifier: TN91877 to the API
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-31T15:34:03Z',
 'fuel_type': 'diesel',
 'id': 'c486c0ee-42ce-5f7f-a832-bd3a0278c7bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN91877',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 163742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-26',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 e-HDi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN91877%27 HTTP/1.1" 200 None
2026-03-30 10:52:43 [auto1.de] INFO: Saving data for TN91877: {'auction_closing_time': 1774971243.0, 'created_time': 1773945327.069355, 'last_price_update_time': 1774867963.590361}
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN91877') HTTP/1.1" 204 0
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_60526a972ec181e56c86cc84dd25b6d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_60526a972ec181e56c86cc84dd25b6d6.jpg not downloaded yet
2026-03-30 10:52:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef5a8218-94dd-515b-bc52-ca2efb51ec15 with identifier: KG16630
2026-03-30 10:52:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef5a8218-94dd-515b-bc52-ca2efb51ec15 with identifier: KG16630
2026-03-30 10:52:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef5a8218-94dd-515b-bc52-ca2efb51ec15 with identifier: KG16630 to the API
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:17:44Z',
 'fuel_type': 'petrol',
 'id': 'ef5a8218-94dd-515b-bc52-ca2efb51ec15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG16630',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 41948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-04',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line Vignale',
 'transmission': 'automatic',
 'trim': 'ST-Line Vignale',
 'year': 2021}
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG16630%27 HTTP/1.1" 200 None
2026-03-30 10:52:43 [auto1.de] INFO: Saving data for KG16630: {'auction_closing_time': 1774970264.0, 'created_time': 1773308026.374011, 'last_price_update_time': 1774867963.975734}
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG16630') HTTP/1.1" 204 0
2026-03-30 10:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d7a690>
2026-03-30 10:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36872a4-ec35-577a-9d0b-480f4707e6a4/e36872a4-ec35-577a-9d0b-480f4707e6a4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F4f%252Fd34feaf6effce651cf4f01c0e5116c72%252Fpa%252FYM49760_d1963d6a59528e8450ad313fc8d5398e.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_d1963d6a59528e8450ad313fc8d5398e.jpg saved to cache
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e36872a4-ec35-577a-9d0b-480f4707e6a4
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ffc190>
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36872a4-ec35-577a-9d0b-480f4707e6a4/e36872a4-ec35-577a-9d0b-480f4707e6a4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F4f%252Fd34feaf6effce651cf4f01c0e5116c72%252Fpa%252FYM49760_0abcc2836197f2b33ddd7685e67d1bc6.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_0abcc2836197f2b33ddd7685e67d1bc6.jpg saved to cache
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e36872a4-ec35-577a-9d0b-480f4707e6a4
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e37c90>
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_aba278b4c9194786feae5aea9a558eb2.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_aba278b4c9194786feae5aea9a558eb2.jpg saved to cache
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a63e63b-7a57-559f-9193-00d57544884c
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dac890>
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_45dda47c9cf9ab91c75f446ccad689ef.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_45dda47c9cf9ab91c75f446ccad689ef.jpg saved to cache
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a63e63b-7a57-559f-9193-00d57544884c
2026-03-30 10:52:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df982b12-88ea-5cef-b9ca-4bd68769c20d with identifier: FU73631
2026-03-30 10:52:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df982b12-88ea-5cef-b9ca-4bd68769c20d with scrape type 1
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df982b12-88ea-5cef-b9ca-4bd68769c20d
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F7c%252F6b7c1656a6d47ab4bde892dc88c30d11%252Fpa%252FFU73631_f6f5fb937b8a9c37e9b492788e3fbe03.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_f6f5fb937b8a9c37e9b492788e3fbe03.jpg already downloaded
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F7c%252F6b7c1656a6d47ab4bde892dc88c30d11%252Fpa%252FFU73631_ae2f9b677ea6617b40d856e2431728a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_ae2f9b677ea6617b40d856e2431728a8.jpg already downloaded
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F7c%252F6b7c1656a6d47ab4bde892dc88c30d11%252Fpa%252FFU73631_13c547a1a6a38c040878a8ad7a8f31a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_13c547a1a6a38c040878a8ad7a8f31a4.jpg already downloaded
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F7c%252F6b7c1656a6d47ab4bde892dc88c30d11%252Fpa%252FFU73631_461f101520ff58d47556b2cabef9e26c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_461f101520ff58d47556b2cabef9e26c.jpg already downloaded
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F7c%252F6b7c1656a6d47ab4bde892dc88c30d11%252Fpa%252FFU73631_b773ed3c7242503d348185a921617538.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_b773ed3c7242503d348185a921617538.jpg already downloaded
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F7c%252F6b7c1656a6d47ab4bde892dc88c30d11%252Fpa%252FFU73631_865ea5cd70066a1ec5a08a85bba178dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_865ea5cd70066a1ec5a08a85bba178dc.jpg already downloaded
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F7c%252F6b7c1656a6d47ab4bde892dc88c30d11%252Fpa%252FFU73631_3b88fd1e5577fda40d3cdda3c9eb9b95.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_3b88fd1e5577fda40d3cdda3c9eb9b95.jpg already downloaded
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F7c%252F6b7c1656a6d47ab4bde892dc88c30d11%252Fpa%252FFU73631_8f24ff6d1a0114ed8f3d8a669b99badf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_8f24ff6d1a0114ed8f3d8a669b99badf.jpg already downloaded
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F7c%252F6b7c1656a6d47ab4bde892dc88c30d11%252Fpa%252FFU73631_df6312d9d3a8ac34f76ab2f47eccdcf5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_df6312d9d3a8ac34f76ab2f47eccdcf5.jpg already downloaded
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F7c%252F6b7c1656a6d47ab4bde892dc88c30d11%252Fpa%252FFU73631_324ff68da1dfbc828eb9e307a7aef526.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_324ff68da1dfbc828eb9e307a7aef526.jpg already downloaded
2026-03-30 10:52:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df982b12-88ea-5cef-b9ca-4bd68769c20d, identifier: FU73631
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7dffad0>
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_9f5376dd9f8d319a6bdd318fddc1d6cd.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_9f5376dd9f8d319a6bdd318fddc1d6cd.jpg saved to cache
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a63e63b-7a57-559f-9193-00d57544884c
2026-03-30 10:52:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59956d0>
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86a88041-6fa6-5fdc-83a5-922e4a26f891/86a88041-6fa6-5fdc-83a5-922e4a26f891_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F35%252Fd93548e26cd93fcd017ce1583d278043%252Fpa%252FVJ31329_7f093ef12d94be6e5f705ae4ad56eea8.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_7f093ef12d94be6e5f705ae4ad56eea8.jpg saved to cache
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86a88041-6fa6-5fdc-83a5-922e4a26f891
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b35690>
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36872a4-ec35-577a-9d0b-480f4707e6a4/e36872a4-ec35-577a-9d0b-480f4707e6a4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F4f%252Fd34feaf6effce651cf4f01c0e5116c72%252Fpa%252FYM49760_d06e09b1acd18993b3cc260a8fb199a7.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_d06e09b1acd18993b3cc260a8fb199a7.jpg saved to cache
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e36872a4-ec35-577a-9d0b-480f4707e6a4
2026-03-30 10:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_d62ec83b0a27c0ca43678019e4a15f7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_9f3ebf741ad5ea1a7d748c47006e049a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:44 [auto1.de] INFO: Found listing with ID: LU41152
2026-03-30 10:52:44 [auto1.de] INFO: Found listing with ID: XE44885
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE44885%27 HTTP/1.1" 200 None
2026-03-30 10:52:44 [auto1.de] INFO: Scrape type for XE44885: 2
2026-03-30 10:52:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 499e44f2-6ae4-5135-90d4-f97989024a8e with identifier: XE44885
2026-03-30 10:52:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 499e44f2-6ae4-5135-90d4-f97989024a8e with scrape type 2
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 499e44f2-6ae4-5135-90d4-f97989024a8e with scrape type 2
2026-03-30 10:52:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 499e44f2-6ae4-5135-90d4-f97989024a8e, identifier: XE44885
2026-03-30 10:52:44 [auto1.de] INFO: Found listing with ID: KT16474
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT16474%27 HTTP/1.1" 200 None
2026-03-30 10:52:44 [auto1.de] INFO: Scrape type for KT16474: 2
2026-03-30 10:52:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c334b7f-ba08-5aca-892b-ea2a7ca243fe with identifier: KT16474
2026-03-30 10:52:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c334b7f-ba08-5aca-892b-ea2a7ca243fe with scrape type 2
2026-03-30 10:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c334b7f-ba08-5aca-892b-ea2a7ca243fe with scrape type 2
2026-03-30 10:52:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c334b7f-ba08-5aca-892b-ea2a7ca243fe, identifier: KT16474
2026-03-30 10:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df982b12-88ea-5cef-b9ca-4bd68769c20d with identifier: FU73631
2026-03-30 10:52:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df982b12-88ea-5cef-b9ca-4bd68769c20d with identifier: FU73631
2026-03-30 10:52:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df982b12-88ea-5cef-b9ca-4bd68769c20d with identifier: FU73631 to the API
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FU73631>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:32:19Z',
 'fuel_type': 'diesel',
 'id': 'df982b12-88ea-5cef-b9ca-4bd68769c20d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU73631',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 199754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_f6f5fb937b8a9c37e9b492788e3fbe03.jpg',
                'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_ae2f9b677ea6617b40d856e2431728a8.jpg',
                'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_13c547a1a6a38c040878a8ad7a8f31a4.jpg',
                'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_461f101520ff58d47556b2cabef9e26c.jpg',
                'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_b773ed3c7242503d348185a921617538.jpg',
                'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_865ea5cd70066a1ec5a08a85bba178dc.jpg',
                'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_3b88fd1e5577fda40d3cdda3c9eb9b95.jpg',
                'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_8f24ff6d1a0114ed8f3d8a669b99badf.jpg',
                'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_df6312d9d3a8ac34f76ab2f47eccdcf5.jpg',
                'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_324ff68da1dfbc828eb9e307a7aef526.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df982b12-88ea-5cef-b9ca-4bd68769c20d/df982b12-88ea-5cef-b9ca-4bd68769c20d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_f6f5fb937b8a9c37e9b492788e3fbe03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df982b12-88ea-5cef-b9ca-4bd68769c20d/df982b12-88ea-5cef-b9ca-4bd68769c20d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_ae2f9b677ea6617b40d856e2431728a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df982b12-88ea-5cef-b9ca-4bd68769c20d/df982b12-88ea-5cef-b9ca-4bd68769c20d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_13c547a1a6a38c040878a8ad7a8f31a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df982b12-88ea-5cef-b9ca-4bd68769c20d/df982b12-88ea-5cef-b9ca-4bd68769c20d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_461f101520ff58d47556b2cabef9e26c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df982b12-88ea-5cef-b9ca-4bd68769c20d/df982b12-88ea-5cef-b9ca-4bd68769c20d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_b773ed3c7242503d348185a921617538.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df982b12-88ea-5cef-b9ca-4bd68769c20d/df982b12-88ea-5cef-b9ca-4bd68769c20d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_865ea5cd70066a1ec5a08a85bba178dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df982b12-88ea-5cef-b9ca-4bd68769c20d/df982b12-88ea-5cef-b9ca-4bd68769c20d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_3b88fd1e5577fda40d3cdda3c9eb9b95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df982b12-88ea-5cef-b9ca-4bd68769c20d/df982b12-88ea-5cef-b9ca-4bd68769c20d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_8f24ff6d1a0114ed8f3d8a669b99badf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df982b12-88ea-5cef-b9ca-4bd68769c20d/df982b12-88ea-5cef-b9ca-4bd68769c20d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_df6312d9d3a8ac34f76ab2f47eccdcf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df982b12-88ea-5cef-b9ca-4bd68769c20d/df982b12-88ea-5cef-b9ca-4bd68769c20d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/7c/6b7c1656a6d47ab4bde892dc88c30d11/pa/FU73631_324ff68da1dfbc828eb9e307a7aef526.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU73631%27 HTTP/1.1" 200 None
2026-03-30 10:52:45 [auto1.de] INFO: Saving data for FU73631: {'created_time': 1774867965.2971, 'last_price_update_time': 1774867965.29711, 'auction_closing_time': 1774971139.0}
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU73631') HTTP/1.1" 204 0
2026-03-30 10:52:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 499e44f2-6ae4-5135-90d4-f97989024a8e with identifier: XE44885
2026-03-30 10:52:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 499e44f2-6ae4-5135-90d4-f97989024a8e with identifier: XE44885
2026-03-30 10:52:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 499e44f2-6ae4-5135-90d4-f97989024a8e with identifier: XE44885 to the API
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:12:25Z',
 'fuel_type': 'hybrid',
 'id': '499e44f2-6ae4-5135-90d4-f97989024a8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE44885',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 84088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-15',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium X',
 'transmission': 'automatic',
 'trim': 'Titanium X',
 'year': 2022}
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE44885%27 HTTP/1.1" 200 None
2026-03-30 10:52:45 [auto1.de] INFO: Saving data for XE44885: {'auction_closing_time': 1774969945.0, 'created_time': 1774463907.323821, 'last_price_update_time': 1774867965.652234}
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE44885') HTTP/1.1" 204 0
2026-03-30 10:52:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c334b7f-ba08-5aca-892b-ea2a7ca243fe with identifier: KT16474
2026-03-30 10:52:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c334b7f-ba08-5aca-892b-ea2a7ca243fe with identifier: KT16474
2026-03-30 10:52:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c334b7f-ba08-5aca-892b-ea2a7ca243fe with identifier: KT16474 to the API
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:32:55Z',
 'fuel_type': 'petrol',
 'id': '1c334b7f-ba08-5aca-892b-ea2a7ca243fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT16474',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 130315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-17',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 SCe Ice 4x2',
 'transmission': 'manual',
 'trim': 'Ice 4x2',
 'year': 2015}
2026-03-30 10:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT16474%27 HTTP/1.1" 200 None
2026-03-30 10:52:46 [auto1.de] INFO: Saving data for KT16474: {'auction_closing_time': 1774971175.0, 'created_time': 1773658371.279015, 'last_price_update_time': 1774867966.00494}
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT16474') HTTP/1.1" 204 0
2026-03-30 10:52:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c98d10>
2026-03-30 10:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36872a4-ec35-577a-9d0b-480f4707e6a4/e36872a4-ec35-577a-9d0b-480f4707e6a4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F4f%252Fd34feaf6effce651cf4f01c0e5116c72%252Fpa%252FYM49760_a45bc9943e7511cf2c1cd784770ce64a.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_a45bc9943e7511cf2c1cd784770ce64a.jpg saved to cache
2026-03-30 10:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e36872a4-ec35-577a-9d0b-480f4707e6a4
2026-03-30 10:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d7d490>
2026-03-30 10:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_5a47cfc5fcab9e3bbca137e7efb3b6d7.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_5a47cfc5fcab9e3bbca137e7efb3b6d7.jpg saved to cache
2026-03-30 10:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a63e63b-7a57-559f-9193-00d57544884c
2026-03-30 10:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d4e350>
2026-03-30 10:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_06545a74226e8ee50a86eea99356aa79.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_06545a74226e8ee50a86eea99356aa79.jpg saved to cache
2026-03-30 10:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a63e63b-7a57-559f-9193-00d57544884c
2026-03-30 10:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_ba537ab04f4b67cabc26f1a7461b6fae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:46 [auto1.de] INFO: Found listing with ID: XN01413
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN01413%27 HTTP/1.1" 200 None
2026-03-30 10:52:46 [auto1.de] INFO: Scrape type for XN01413: 2
2026-03-30 10:52:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e3b005b-3df4-5583-9075-79dcf3e63644 with identifier: XN01413
2026-03-30 10:52:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e3b005b-3df4-5583-9075-79dcf3e63644 with scrape type 2
2026-03-30 10:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e3b005b-3df4-5583-9075-79dcf3e63644 with scrape type 2
2026-03-30 10:52:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e3b005b-3df4-5583-9075-79dcf3e63644, identifier: XN01413
2026-03-30 10:52:46 [auto1.de] INFO: Found listing with ID: JV44337
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV44337%27 HTTP/1.1" 200 None
2026-03-30 10:52:46 [auto1.de] INFO: Scrape type for JV44337: 2
2026-03-30 10:52:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42afc635-95d7-5cc6-9e1e-85b98e221cd8 with identifier: JV44337
2026-03-30 10:52:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42afc635-95d7-5cc6-9e1e-85b98e221cd8 with scrape type 2
2026-03-30 10:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42afc635-95d7-5cc6-9e1e-85b98e221cd8 with scrape type 2
2026-03-30 10:52:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42afc635-95d7-5cc6-9e1e-85b98e221cd8, identifier: JV44337
2026-03-30 10:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_77032025458ae0ff919ad3479f8fad5e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_1e9ea677677012d3c994938ab52f5e4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_77341de9cef0f3a087b74ea469af1085.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_52b738f3252f24574bf6f6fc5faa51f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_b564442d4227ef0af3ba255c9f9ee9a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e3b005b-3df4-5583-9075-79dcf3e63644 with identifier: XN01413
2026-03-30 10:52:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e3b005b-3df4-5583-9075-79dcf3e63644 with identifier: XN01413
2026-03-30 10:52:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e3b005b-3df4-5583-9075-79dcf3e63644 with identifier: XN01413 to the API
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-31T15:56:31Z',
 'fuel_type': 'hybrid',
 'id': '8e3b005b-3df4-5583-9075-79dcf3e63644',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN01413',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 62560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-15',
 'seller_name': None,
 'title': 'Audi Q5 55 TFSIe quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2020}
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN01413%27 HTTP/1.1" 200 None
2026-03-30 10:52:46 [auto1.de] INFO: Saving data for XN01413: {'auction_closing_time': 1774972591.0, 'created_time': 1773307476.66184, 'last_price_update_time': 1774867966.780757}
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN01413') HTTP/1.1" 204 0
2026-03-30 10:52:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42afc635-95d7-5cc6-9e1e-85b98e221cd8 with identifier: JV44337
2026-03-30 10:52:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42afc635-95d7-5cc6-9e1e-85b98e221cd8 with identifier: JV44337
2026-03-30 10:52:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42afc635-95d7-5cc6-9e1e-85b98e221cd8 with identifier: JV44337 to the API
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:19:37Z',
 'fuel_type': 'diesel',
 'id': '42afc635-95d7-5cc6-9e1e-85b98e221cd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV44337',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 297065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-30',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV44337%27 HTTP/1.1" 200 None
2026-03-30 10:52:47 [auto1.de] INFO: Saving data for JV44337: {'auction_closing_time': 1774970377.0, 'created_time': 1774293416.978376, 'last_price_update_time': 1774867967.345338}
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV44337') HTTP/1.1" 204 0
2026-03-30 10:52:47 [auto1.de] INFO: Found listing with ID: XY75153
2026-03-30 10:52:47 [auto1.de] INFO: Found listing with ID: TV61303
2026-03-30 10:52:47 [auto1.de] INFO: Found listing with ID: VF93957
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF93957%27 HTTP/1.1" 200 None
2026-03-30 10:52:47 [auto1.de] INFO: Scrape type for VF93957: 2
2026-03-30 10:52:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cec26e83-cc20-548d-9ec3-f179f2bec125 with identifier: VF93957
2026-03-30 10:52:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cec26e83-cc20-548d-9ec3-f179f2bec125 with scrape type 2
2026-03-30 10:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cec26e83-cc20-548d-9ec3-f179f2bec125 with scrape type 2
2026-03-30 10:52:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cec26e83-cc20-548d-9ec3-f179f2bec125, identifier: VF93957
2026-03-30 10:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef78a8ad0>
2026-03-30 10:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36872a4-ec35-577a-9d0b-480f4707e6a4/e36872a4-ec35-577a-9d0b-480f4707e6a4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F4f%252Fd34feaf6effce651cf4f01c0e5116c72%252Fpa%252FYM49760_a8be9d774dd7917045b58bc414cd4014.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_a8be9d774dd7917045b58bc414cd4014.jpg saved to cache
2026-03-30 10:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e36872a4-ec35-577a-9d0b-480f4707e6a4
2026-03-30 10:52:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e36872a4-ec35-577a-9d0b-480f4707e6a4, skipping ID generation
2026-03-30 10:52:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e36872a4-ec35-577a-9d0b-480f4707e6a4 with scrape type 1
2026-03-30 10:52:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e36872a4-ec35-577a-9d0b-480f4707e6a4 sending to next pipeline
2026-03-30 10:52:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e36872a4-ec35-577a-9d0b-480f4707e6a4, identifier: YM49760
2026-03-30 10:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4cc7410>
2026-03-30 10:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_d62ec83b0a27c0ca43678019e4a15f7e.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_d62ec83b0a27c0ca43678019e4a15f7e.jpg saved to cache
2026-03-30 10:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a63e63b-7a57-559f-9193-00d57544884c
2026-03-30 10:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ce2850>
2026-03-30 10:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86a88041-6fa6-5fdc-83a5-922e4a26f891/86a88041-6fa6-5fdc-83a5-922e4a26f891_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F35%252Fd93548e26cd93fcd017ce1583d278043%252Fpa%252FVJ31329_9f3ebf741ad5ea1a7d748c47006e049a.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_9f3ebf741ad5ea1a7d748c47006e049a.jpg saved to cache
2026-03-30 10:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86a88041-6fa6-5fdc-83a5-922e4a26f891
2026-03-30 10:52:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86a88041-6fa6-5fdc-83a5-922e4a26f891, skipping ID generation
2026-03-30 10:52:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86a88041-6fa6-5fdc-83a5-922e4a26f891 with scrape type 1
2026-03-30 10:52:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86a88041-6fa6-5fdc-83a5-922e4a26f891 sending to next pipeline
2026-03-30 10:52:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86a88041-6fa6-5fdc-83a5-922e4a26f891, identifier: VJ31329
2026-03-30 10:52:47 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 9512 | hits on page: 40
2026-03-30 10:52:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_d9a4713d0cd634bcc6aee85483a03d52.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cec26e83-cc20-548d-9ec3-f179f2bec125 with identifier: VF93957
2026-03-30 10:52:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cec26e83-cc20-548d-9ec3-f179f2bec125 with identifier: VF93957
2026-03-30 10:52:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cec26e83-cc20-548d-9ec3-f179f2bec125 with identifier: VF93957 to the API
2026-03-30 10:52:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-31T15:49:00Z',
 'fuel_type': 'petrol',
 'id': 'cec26e83-cc20-548d-9ec3-f179f2bec125',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF93957',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 61587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-17',
 'seller_name': None,
 'title': 'BMW X3 M Competition',
 'transmission': 'automatic',
 'trim': 'BW   Competition',
 'year': 2021}
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF93957%27 HTTP/1.1" 200 None
2026-03-30 10:52:48 [auto1.de] INFO: Saving data for VF93957: {'auction_closing_time': 1774972140.0, 'created_time': 1773658640.049736, 'last_price_update_time': 1774867968.15707}
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF93957') HTTP/1.1" 204 0
2026-03-30 10:52:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e36872a4-ec35-577a-9d0b-480f4707e6a4 with identifier: YM49760
2026-03-30 10:52:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e36872a4-ec35-577a-9d0b-480f4707e6a4 with identifier: YM49760
2026-03-30 10:52:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e36872a4-ec35-577a-9d0b-480f4707e6a4 with identifier: YM49760 to the API
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_a8be9d774dd7917045b58bc414cd4014.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:59:16Z',
 'fuel_type': 'petrol',
 'id': 'e36872a4-ec35-577a-9d0b-480f4707e6a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM49760',
 'listing': 'auction',
 'location': 'DE, Wuppertal',
 'make': 'BMW',
 'model': '3er',
 'odometer': 184459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36872a4-ec35-577a-9d0b-480f4707e6a4/e36872a4-ec35-577a-9d0b-480f4707e6a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_a45bc9943e7511cf2c1cd784770ce64a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36872a4-ec35-577a-9d0b-480f4707e6a4/e36872a4-ec35-577a-9d0b-480f4707e6a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_d06e09b1acd18993b3cc260a8fb199a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36872a4-ec35-577a-9d0b-480f4707e6a4/e36872a4-ec35-577a-9d0b-480f4707e6a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_d1963d6a59528e8450ad313fc8d5398e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36872a4-ec35-577a-9d0b-480f4707e6a4/e36872a4-ec35-577a-9d0b-480f4707e6a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_0abcc2836197f2b33ddd7685e67d1bc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36872a4-ec35-577a-9d0b-480f4707e6a4/e36872a4-ec35-577a-9d0b-480f4707e6a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/4f/d34feaf6effce651cf4f01c0e5116c72/pa/YM49760_a8be9d774dd7917045b58bc414cd4014.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-03-23',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 3er 318Ci',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM49760%27 HTTP/1.1" 200 None
2026-03-30 10:52:48 [auto1.de] INFO: Saving data for YM49760: {'created_time': 1774867968.564688, 'last_price_update_time': 1774867968.564702, 'auction_closing_time': 1774972756.0}
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM49760') HTTP/1.1" 204 0
2026-03-30 10:52:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86a88041-6fa6-5fdc-83a5-922e4a26f891 with identifier: VJ31329
2026-03-30 10:52:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86a88041-6fa6-5fdc-83a5-922e4a26f891 with identifier: VJ31329
2026-03-30 10:52:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86a88041-6fa6-5fdc-83a5-922e4a26f891 with identifier: VJ31329 to the API
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_9f3ebf741ad5ea1a7d748c47006e049a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 3',
 'engine': '2.5L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-31T15:56:44Z',
 'fuel_type': 'petrol',
 'id': '86a88041-6fa6-5fdc-83a5-922e4a26f891',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ31329',
 'listing': 'auction',
 'location': 'DE, Waiblingen',
 'make': 'BMW',
 'model': '3er',
 'odometer': 293832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86a88041-6fa6-5fdc-83a5-922e4a26f891/86a88041-6fa6-5fdc-83a5-922e4a26f891_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_d0450210b0645a8f3ef4561f5556c8a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86a88041-6fa6-5fdc-83a5-922e4a26f891/86a88041-6fa6-5fdc-83a5-922e4a26f891_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_511010e93e1358f818bf33923dd350ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86a88041-6fa6-5fdc-83a5-922e4a26f891/86a88041-6fa6-5fdc-83a5-922e4a26f891_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_9f3ebf741ad5ea1a7d748c47006e049a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86a88041-6fa6-5fdc-83a5-922e4a26f891/86a88041-6fa6-5fdc-83a5-922e4a26f891_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_7f093ef12d94be6e5f705ae4ad56eea8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86a88041-6fa6-5fdc-83a5-922e4a26f891/86a88041-6fa6-5fdc-83a5-922e4a26f891_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/35/d93548e26cd93fcd017ce1583d278043/pa/VJ31329_f23fc307a90ab2d31d1e7e17f8124187.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 325Ci',
 'transmission': 'automatic',
 'trim': '',
 'year': 2000}
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ31329%27 HTTP/1.1" 200 None
2026-03-30 10:52:48 [auto1.de] INFO: Saving data for VJ31329: {'created_time': 1774867968.965895, 'last_price_update_time': 1774867968.965906, 'auction_closing_time': 1774972604.0}
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ31329') HTTP/1.1" 204 0
2026-03-30 10:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_0b8de501a0d59ccd48f63722d72be3a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_220c06157557e8016e1806e5caa97488.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:49 [auto1.de] INFO: Found listing with ID: FK10195
2026-03-30 10:52:49 [auto1.de] INFO: Found listing with ID: ZL86875
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL86875%27 HTTP/1.1" 200 None
2026-03-30 10:52:49 [auto1.de] INFO: Scrape type for ZL86875: 2
2026-03-30 10:52:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b17624f-afbe-5fdd-b0d8-34afdee2b3f8 with identifier: ZL86875
2026-03-30 10:52:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b17624f-afbe-5fdd-b0d8-34afdee2b3f8 with scrape type 2
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b17624f-afbe-5fdd-b0d8-34afdee2b3f8 with scrape type 2
2026-03-30 10:52:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b17624f-afbe-5fdd-b0d8-34afdee2b3f8, identifier: ZL86875
2026-03-30 10:52:49 [auto1.de] INFO: Found listing with ID: TE24428
2026-03-30 10:52:49 [auto1.de] INFO: Found listing with ID: ZW65017
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW65017%27 HTTP/1.1" 200 None
2026-03-30 10:52:49 [auto1.de] INFO: Scrape type for ZW65017: 2
2026-03-30 10:52:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 222bcf26-cbe3-5197-b071-2af0c59a4380 with identifier: ZW65017
2026-03-30 10:52:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222bcf26-cbe3-5197-b071-2af0c59a4380 with scrape type 2
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 222bcf26-cbe3-5197-b071-2af0c59a4380 with scrape type 2
2026-03-30 10:52:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 222bcf26-cbe3-5197-b071-2af0c59a4380, identifier: ZW65017
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0c910>
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_ba537ab04f4b67cabc26f1a7461b6fae.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_ba537ab04f4b67cabc26f1a7461b6fae.jpg saved to cache
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b8f916b-4b7d-571c-9dce-34b27ed20fb4
2026-03-30 10:52:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c85010>
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fd1%252F67d103c1fcd5d5b9d6b7d342e0697803%252Fpa%252FFF76143_77032025458ae0ff919ad3479f8fad5e.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_77032025458ae0ff919ad3479f8fad5e.jpg saved to cache
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 115518fb-70f7-5f04-866d-268cdb6b3cf8
2026-03-30 10:52:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 115518fb-70f7-5f04-866d-268cdb6b3cf8, skipping ID generation
2026-03-30 10:52:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 115518fb-70f7-5f04-866d-268cdb6b3cf8 with scrape type 1
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 115518fb-70f7-5f04-866d-268cdb6b3cf8 sending to next pipeline
2026-03-30 10:52:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 115518fb-70f7-5f04-866d-268cdb6b3cf8, identifier: FF76143
2026-03-30 10:52:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eccbd0>
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F26%252F67263b47cdfa69c20065230a0c3b4b47%252Fpa%252FTS03545_1e9ea677677012d3c994938ab52f5e4a.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_1e9ea677677012d3c994938ab52f5e4a.jpg saved to cache
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87fe0456-e89d-5ff7-8f00-7c636da01fe6
2026-03-30 10:52:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87fe0456-e89d-5ff7-8f00-7c636da01fe6, skipping ID generation
2026-03-30 10:52:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87fe0456-e89d-5ff7-8f00-7c636da01fe6 with scrape type 1
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87fe0456-e89d-5ff7-8f00-7c636da01fe6 sending to next pipeline
2026-03-30 10:52:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87fe0456-e89d-5ff7-8f00-7c636da01fe6, identifier: TS03545
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c98cd0>
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_77341de9cef0f3a087b74ea469af1085.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_77341de9cef0f3a087b74ea469af1085.jpg saved to cache
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b8f916b-4b7d-571c-9dce-34b27ed20fb4
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50fe290>
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_52b738f3252f24574bf6f6fc5faa51f6.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_52b738f3252f24574bf6f6fc5faa51f6.jpg saved to cache
2026-03-30 10:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a63e63b-7a57-559f-9193-00d57544884c
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5034a50>
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_b564442d4227ef0af3ba255c9f9ee9a4.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_b564442d4227ef0af3ba255c9f9ee9a4.jpg saved to cache
2026-03-30 10:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b8f916b-4b7d-571c-9dce-34b27ed20fb4
2026-03-30 10:52:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b17624f-afbe-5fdd-b0d8-34afdee2b3f8 with identifier: ZL86875
2026-03-30 10:52:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b17624f-afbe-5fdd-b0d8-34afdee2b3f8 with identifier: ZL86875
2026-03-30 10:52:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b17624f-afbe-5fdd-b0d8-34afdee2b3f8 with identifier: ZL86875 to the API
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:28:52Z',
 'fuel_type': 'diesel',
 'id': '3b17624f-afbe-5fdd-b0d8-34afdee2b3f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL86875',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 179438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-15',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2014}
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL86875%27 HTTP/1.1" 200 None
2026-03-30 10:52:50 [auto1.de] INFO: Saving data for ZL86875: {'auction_closing_time': 1774970932.0, 'created_time': 1774381371.698104, 'last_price_update_time': 1774867970.333368}
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL86875') HTTP/1.1" 204 0
2026-03-30 10:52:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 222bcf26-cbe3-5197-b071-2af0c59a4380 with identifier: ZW65017
2026-03-30 10:52:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 222bcf26-cbe3-5197-b071-2af0c59a4380 with identifier: ZW65017
2026-03-30 10:52:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 222bcf26-cbe3-5197-b071-2af0c59a4380 with identifier: ZW65017 to the API
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:50:34Z',
 'fuel_type': 'petrol',
 'id': '222bcf26-cbe3-5197-b071-2af0c59a4380',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW65017',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 222004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-26',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2015}
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW65017%27 HTTP/1.1" 200 None
2026-03-30 10:52:50 [auto1.de] INFO: Saving data for ZW65017: {'auction_closing_time': 1774972234.0, 'created_time': 1774379578.105334, 'last_price_update_time': 1774867970.652731}
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW65017') HTTP/1.1" 204 0
2026-03-30 10:52:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 115518fb-70f7-5f04-866d-268cdb6b3cf8 with identifier: FF76143
2026-03-30 10:52:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 115518fb-70f7-5f04-866d-268cdb6b3cf8 with identifier: FF76143
2026-03-30 10:52:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 115518fb-70f7-5f04-866d-268cdb6b3cf8 with identifier: FF76143 to the API
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_77032025458ae0ff919ad3479f8fad5e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:31:34Z',
 'fuel_type': 'petrol',
 'id': '115518fb-70f7-5f04-866d-268cdb6b3cf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF76143',
 'listing': 'auction',
 'location': 'DE, Dresden',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 16487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_d456cbc6e6bae3649ae11fb33cdea59b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2638633,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_aad7b681b6e82a811cd0e6c49d3333ae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_08cec7f5a3e321bb5dcfb6b6de1a5a0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_c6658b142f0eaba32dee8c1b972cb08c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_220d9c7ea305b45cb664e516a4a56429.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2674655,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_47bea493327c63de5eeb79aebd796a43.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_3ab13255a9d873393b5f71e3be544e79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_c870071f4fa0cc47b2eadf6685981fab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_9a5da2fc8dc27eb42360a0c52605b2db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115518fb-70f7-5f04-866d-268cdb6b3cf8/115518fb-70f7-5f04-866d-268cdb6b3cf8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2825316,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/d1/67d103c1fcd5d5b9d6b7d342e0697803/pa/FF76143_77032025458ae0ff919ad3479f8fad5e.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Smart forfour 1.0 Basis Prime',
 'transmission': 'automatic',
 'trim': 'Basis Prime',
 'year': 2016}
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF76143%27 HTTP/1.1" 200 None
2026-03-30 10:52:51 [auto1.de] INFO: Saving data for FF76143: {'created_time': 1774867971.043712, 'last_price_update_time': 1774867971.043723, 'auction_closing_time': 1774971094.0}
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF76143') HTTP/1.1" 204 0
2026-03-30 10:52:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87fe0456-e89d-5ff7-8f00-7c636da01fe6 with identifier: TS03545
2026-03-30 10:52:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87fe0456-e89d-5ff7-8f00-7c636da01fe6 with identifier: TS03545
2026-03-30 10:52:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87fe0456-e89d-5ff7-8f00-7c636da01fe6 with identifier: TS03545 to the API
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_1e9ea677677012d3c994938ab52f5e4a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 262,
 'expiration_date': '2026-03-31T15:33:19Z',
 'fuel_type': 'diesel',
 'id': '87fe0456-e89d-5ff7-8f00-7c636da01fe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS03545',
 'listing': 'auction',
 'location': 'DE, Kaarst',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 63348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316288,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_1e9ea677677012d3c994938ab52f5e4a.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306438,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_ff2c4b0942bafacf5caae696152f6cc5.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57899,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_e7427fb447b2ee05c5a82f2f4f533c29.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276474,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_4e3eec7e75e955bb36e2897d905baa69.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54079,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_ae373c8aa79bab17f9ecaafefdff9c26.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272137,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_ca1d35dfc600b8e2cfe6471ad09545d1.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253333,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_f4c23cd627915366ad5064063d62d7a7.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48677,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_ea9caebeee93703cfbf978af9d69dfe0.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290733,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_40e82aa4c5b39f29d9e872075072078c.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fe0456-e89d-5ff7-8f00-7c636da01fe6/87fe0456-e89d-5ff7-8f00-7c636da01fe6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51966,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img67/26/67263b47cdfa69c20065230a0c3b4b47/pa/TS03545_d5ab595dbc74f06b640099dd4f20d9f9.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion Terrain Tech',
 'transmission': 'automatic',
 'trim': 'BlueMotion Terrain Tech',
 'year': 2015}
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS03545%27 HTTP/1.1" 200 None
2026-03-30 10:52:51 [auto1.de] INFO: Saving data for TS03545: {'created_time': 1774867971.642705, 'last_price_update_time': 1774867971.642715, 'auction_closing_time': 1774971199.0}
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS03545') HTTP/1.1" 204 0
2026-03-30 10:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_60526a972ec181e56c86cc84dd25b6d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:51 [auto1.de] INFO: Found listing with ID: GG51597
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG51597%27 HTTP/1.1" 200 None
2026-03-30 10:52:51 [auto1.de] INFO: Scrape type for GG51597: 2
2026-03-30 10:52:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02b2e781-62ac-5a27-a4b7-fc1127086194 with identifier: GG51597
2026-03-30 10:52:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02b2e781-62ac-5a27-a4b7-fc1127086194 with scrape type 2
2026-03-30 10:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02b2e781-62ac-5a27-a4b7-fc1127086194 with scrape type 2
2026-03-30 10:52:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02b2e781-62ac-5a27-a4b7-fc1127086194, identifier: GG51597
2026-03-30 10:52:51 [auto1.de] INFO: Found listing with ID: PH75397
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH75397%27 HTTP/1.1" 200 None
2026-03-30 10:52:51 [auto1.de] INFO: Scrape type for PH75397: 2
2026-03-30 10:52:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 881a04f9-e53b-5490-8f28-20c419f58ecc with identifier: PH75397
2026-03-30 10:52:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 881a04f9-e53b-5490-8f28-20c419f58ecc with scrape type 2
2026-03-30 10:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 881a04f9-e53b-5490-8f28-20c419f58ecc with scrape type 2
2026-03-30 10:52:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 881a04f9-e53b-5490-8f28-20c419f58ecc, identifier: PH75397
2026-03-30 10:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_40463c3ef266890055b3b8ce28b41a54.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_41f01fb3b2324cccbe24c0ec0bdade1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02b2e781-62ac-5a27-a4b7-fc1127086194 with identifier: GG51597
2026-03-30 10:52:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02b2e781-62ac-5a27-a4b7-fc1127086194 with identifier: GG51597
2026-03-30 10:52:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02b2e781-62ac-5a27-a4b7-fc1127086194 with identifier: GG51597 to the API
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:51:01Z',
 'fuel_type': 'petrol',
 'id': '02b2e781-62ac-5a27-a4b7-fc1127086194',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG51597',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 134532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-25',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI StylePlus',
 'transmission': 'manual',
 'trim': 'StylePlus',
 'year': 2014}
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG51597%27 HTTP/1.1" 200 None
2026-03-30 10:52:52 [auto1.de] INFO: Saving data for GG51597: {'auction_closing_time': 1774972261.0, 'created_time': 1773688850.378603, 'last_price_update_time': 1774867972.354178}
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG51597') HTTP/1.1" 204 0
2026-03-30 10:52:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 881a04f9-e53b-5490-8f28-20c419f58ecc with identifier: PH75397
2026-03-30 10:52:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 881a04f9-e53b-5490-8f28-20c419f58ecc with identifier: PH75397
2026-03-30 10:52:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 881a04f9-e53b-5490-8f28-20c419f58ecc with identifier: PH75397 to the API
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:30:25Z',
 'fuel_type': 'diesel',
 'id': '881a04f9-e53b-5490-8f28-20c419f58ecc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH75397',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 192336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-01',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 280 CDI Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2008}
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH75397%27 HTTP/1.1" 200 None
2026-03-30 10:52:52 [auto1.de] INFO: Saving data for PH75397: {'auction_closing_time': 1774971025.0, 'created_time': 1773520744.023938, 'last_price_update_time': 1774867972.769469}
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH75397') HTTP/1.1" 204 0
2026-03-30 10:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG04043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP66630/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS37212> (referer: https://www.auto1.com/v1/car-details-view/YS37212/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ46471/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LD73259/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ae3ed0>
2026-03-30 10:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_d9a4713d0cd634bcc6aee85483a03d52.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_d9a4713d0cd634bcc6aee85483a03d52.jpg saved to cache
2026-03-30 10:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a63e63b-7a57-559f-9193-00d57544884c
2026-03-30 10:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e6ad50>
2026-03-30 10:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fe6%252F22e63e31e91447c57d759bede3e1bf39%252Fpa%252FAY54602_0b8de501a0d59ccd48f63722d72be3a5.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_0b8de501a0d59ccd48f63722d72be3a5.jpg saved to cache
2026-03-30 10:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b8f916b-4b7d-571c-9dce-34b27ed20fb4
2026-03-30 10:52:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b8f916b-4b7d-571c-9dce-34b27ed20fb4, skipping ID generation
2026-03-30 10:52:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b8f916b-4b7d-571c-9dce-34b27ed20fb4 with scrape type 1
2026-03-30 10:52:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b8f916b-4b7d-571c-9dce-34b27ed20fb4 sending to next pipeline
2026-03-30 10:52:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b8f916b-4b7d-571c-9dce-34b27ed20fb4, identifier: AY54602
2026-03-30 10:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4eb4290>
2026-03-30 10:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_220c06157557e8016e1806e5caa97488.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_220c06157557e8016e1806e5caa97488.jpg saved to cache
2026-03-30 10:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a63e63b-7a57-559f-9193-00d57544884c
2026-03-30 10:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_e9408587343fa98690dee5c75be0a5ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:53 [auto1.de] INFO: Found listing with ID: WD56041
2026-03-30 10:52:53 [auto1.de] INFO: Found listing with ID: HR80015
2026-03-30 10:52:53 [auto1.de] INFO: Found listing with ID: BB20772
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20772%27 HTTP/1.1" 200 None
2026-03-30 10:52:53 [auto1.de] INFO: Scrape type for BB20772: 2
2026-03-30 10:52:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e465c13a-9f2d-50cf-8edd-8f6b530dcde7 with identifier: BB20772
2026-03-30 10:52:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e465c13a-9f2d-50cf-8edd-8f6b530dcde7 with scrape type 2
2026-03-30 10:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e465c13a-9f2d-50cf-8edd-8f6b530dcde7 with scrape type 2
2026-03-30 10:52:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e465c13a-9f2d-50cf-8edd-8f6b530dcde7, identifier: BB20772
2026-03-30 10:52:53 [auto1.de] INFO: Found listing with ID: XG61094
2026-03-30 10:52:53 [auto1.de] INFO: Found listing with ID: TJ05805
2026-03-30 10:52:53 [auto1.de] INFO: Found listing with ID: JN43536
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN43536%27 HTTP/1.1" 200 None
2026-03-30 10:52:53 [auto1.de] INFO: Scrape type for JN43536: 2
2026-03-30 10:52:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7ffc9fc-5fb7-50d3-a8a8-d7367dd6f8ec with identifier: JN43536
2026-03-30 10:52:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7ffc9fc-5fb7-50d3-a8a8-d7367dd6f8ec with scrape type 2
2026-03-30 10:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7ffc9fc-5fb7-50d3-a8a8-d7367dd6f8ec with scrape type 2
2026-03-30 10:52:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7ffc9fc-5fb7-50d3-a8a8-d7367dd6f8ec, identifier: JN43536
2026-03-30 10:52:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b8f916b-4b7d-571c-9dce-34b27ed20fb4 with identifier: AY54602
2026-03-30 10:52:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b8f916b-4b7d-571c-9dce-34b27ed20fb4 with identifier: AY54602
2026-03-30 10:52:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b8f916b-4b7d-571c-9dce-34b27ed20fb4 with identifier: AY54602 to the API
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_0b8de501a0d59ccd48f63722d72be3a5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:24:54Z',
 'fuel_type': 'petrol',
 'id': '4b8f916b-4b7d-571c-9dce-34b27ed20fb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY54602',
 'listing': 'auction',
 'location': 'DE',
 'make': 'BMW',
 'model': '1er',
 'odometer': 90115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 40,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_ec794746eeb4ffc52ef6741bb939f1c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_0b8de501a0d59ccd48f63722d72be3a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_dcaaa8ba9a25bb099eb81812dd522a9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_6bf38763ee53687551da4641b9f3efc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_0a650b6313ca5101e839801ad1d7d3af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_b564442d4227ef0af3ba255c9f9ee9a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_77341de9cef0f3a087b74ea469af1085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_01591dc2c23d59c297b2cc2833bead36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_2feb26080ba1bcf2c8749d0383599a7b.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8f916b-4b7d-571c-9dce-34b27ed20fb4/4b8f916b-4b7d-571c-9dce-34b27ed20fb4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/e6/22e63e31e91447c57d759bede3e1bf39/pa/AY54602_ba537ab04f4b67cabc26f1a7461b6fae.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY54602%27 HTTP/1.1" 200 None
2026-03-30 10:52:53 [auto1.de] INFO: Saving data for AY54602: {'created_time': 1774867973.661466, 'last_price_update_time': 1774867973.661476, 'auction_closing_time': 1774970694.0}
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY54602') HTTP/1.1" 204 0
2026-03-30 10:52:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e465c13a-9f2d-50cf-8edd-8f6b530dcde7 with identifier: BB20772
2026-03-30 10:52:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e465c13a-9f2d-50cf-8edd-8f6b530dcde7 with identifier: BB20772
2026-03-30 10:52:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e465c13a-9f2d-50cf-8edd-8f6b530dcde7 with identifier: BB20772 to the API
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:28:37Z',
 'fuel_type': 'diesel',
 'id': 'e465c13a-9f2d-50cf-8edd-8f6b530dcde7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB20772',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 202531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-09',
 'seller_name': None,
 'title': 'BMW 3er 330d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20772%27 HTTP/1.1" 200 None
2026-03-30 10:52:54 [auto1.de] INFO: Saving data for BB20772: {'auction_closing_time': 1774970917.0, 'created_time': 1773341857.251254, 'last_price_update_time': 1774867974.29684}
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB20772') HTTP/1.1" 204 0
2026-03-30 10:52:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7ffc9fc-5fb7-50d3-a8a8-d7367dd6f8ec with identifier: JN43536
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 10:52:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 10:52:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7ffc9fc-5fb7-50d3-a8a8-d7367dd6f8ec with identifier: JN43536
2026-03-30 10:52:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7ffc9fc-5fb7-50d3-a8a8-d7367dd6f8ec with identifier: JN43536 to the API
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:50:24Z',
 'fuel_type': 'petrol',
 'id': 'b7ffc9fc-5fb7-50d3-a8a8-d7367dd6f8ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN43536',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 56368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-28',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2016}
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN43536%27 HTTP/1.1" 200 None
2026-03-30 10:52:54 [auto1.de] INFO: Saving data for JN43536: {'auction_closing_time': 1774972224.0, 'created_time': 1773137367.79018, 'last_price_update_time': 1774867974.767223}
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN43536') HTTP/1.1" 204 0
2026-03-30 10:52:54 [auto1.de] INFO: Found listing with ID: EA72382
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA72382%27 HTTP/1.1" 200 None
2026-03-30 10:52:54 [auto1.de] INFO: Scrape type for EA72382: 2
2026-03-30 10:52:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78f3feb4-29ed-58e8-afe2-72f6f7cc25f9 with identifier: EA72382
2026-03-30 10:52:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78f3feb4-29ed-58e8-afe2-72f6f7cc25f9 with scrape type 2
2026-03-30 10:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78f3feb4-29ed-58e8-afe2-72f6f7cc25f9 with scrape type 2
2026-03-30 10:52:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78f3feb4-29ed-58e8-afe2-72f6f7cc25f9, identifier: EA72382
2026-03-30 10:52:54 [auto1.de] INFO: Found listing with ID: GE17394
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE17394%27 HTTP/1.1" 200 None
2026-03-30 10:52:54 [auto1.de] INFO: Scrape type for GE17394: 2
2026-03-30 10:52:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2da51a75-6fa1-5158-b84b-8717c1df0654 with identifier: GE17394
2026-03-30 10:52:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2da51a75-6fa1-5158-b84b-8717c1df0654 with scrape type 2
2026-03-30 10:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2da51a75-6fa1-5158-b84b-8717c1df0654 with scrape type 2
2026-03-30 10:52:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2da51a75-6fa1-5158-b84b-8717c1df0654, identifier: GE17394
2026-03-30 10:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU65226/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e68e90>
2026-03-30 10:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fbf%252F06bf9c468867cbea4f17a788d2fb8b39%252Fpa%252FZE59650_60526a972ec181e56c86cc84dd25b6d6.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_60526a972ec181e56c86cc84dd25b6d6.jpg saved to cache
2026-03-30 10:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a63e63b-7a57-559f-9193-00d57544884c
2026-03-30 10:52:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a63e63b-7a57-559f-9193-00d57544884c, skipping ID generation
2026-03-30 10:52:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a63e63b-7a57-559f-9193-00d57544884c with scrape type 1
2026-03-30 10:52:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a63e63b-7a57-559f-9193-00d57544884c sending to next pipeline
2026-03-30 10:52:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a63e63b-7a57-559f-9193-00d57544884c, identifier: ZE59650
2026-03-30 10:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4cfcc90>
2026-03-30 10:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_40463c3ef266890055b3b8ce28b41a54.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_40463c3ef266890055b3b8ce28b41a54.jpg saved to cache
2026-03-30 10:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2e6e57b-81cd-50ba-88c6-2592c4bb6495
2026-03-30 10:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5118950>
2026-03-30 10:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_41f01fb3b2324cccbe24c0ec0bdade1b.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_41f01fb3b2324cccbe24c0ec0bdade1b.jpg saved to cache
2026-03-30 10:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2e6e57b-81cd-50ba-88c6-2592c4bb6495
2026-03-30 10:52:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a15e061-917c-5434-86d3-85a3bf614c8f with identifier: YS37212
2026-03-30 10:52:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a15e061-917c-5434-86d3-85a3bf614c8f with scrape type 1
2026-03-30 10:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0a15e061-917c-5434-86d3-85a3bf614c8f
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fac%252Fd6ac60e495103bc6c826976695bdedf5%252Fpa%252FYS37212_08933b4fb26c3f2ad674f2d4e29f5f09.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_08933b4fb26c3f2ad674f2d4e29f5f09.jpg already downloaded
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fac%252Fd6ac60e495103bc6c826976695bdedf5%252Fpa%252FYS37212_3a6332be86c3fbd168a7ae44ec3af0f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_3a6332be86c3fbd168a7ae44ec3af0f1.jpg already downloaded
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fac%252Fd6ac60e495103bc6c826976695bdedf5%252Fpa%252FYS37212_6a8f13cf3edcee3b7ff51efe13c2d96d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_6a8f13cf3edcee3b7ff51efe13c2d96d.jpg already downloaded
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fac%252Fd6ac60e495103bc6c826976695bdedf5%252Fpa%252FYS37212_ade01e0dd8e982abe6bf62cc446922a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_ade01e0dd8e982abe6bf62cc446922a9.jpg already downloaded
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fac%252Fd6ac60e495103bc6c826976695bdedf5%252Fpa%252FYS37212_64b2e51ff9d12794ed28b768cab6a558.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_64b2e51ff9d12794ed28b768cab6a558.jpg already downloaded
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fac%252Fd6ac60e495103bc6c826976695bdedf5%252Fpa%252FYS37212_7476da24ec86dd656c13e5f663768e5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_7476da24ec86dd656c13e5f663768e5b.jpg already downloaded
2026-03-30 10:52:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a15e061-917c-5434-86d3-85a3bf614c8f, identifier: YS37212
2026-03-30 10:52:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78f3feb4-29ed-58e8-afe2-72f6f7cc25f9 with identifier: EA72382
2026-03-30 10:52:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78f3feb4-29ed-58e8-afe2-72f6f7cc25f9 with identifier: EA72382
2026-03-30 10:52:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78f3feb4-29ed-58e8-afe2-72f6f7cc25f9 with identifier: EA72382 to the API
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:03:34Z',
 'fuel_type': 'petrol',
 'id': '78f3feb4-29ed-58e8-afe2-72f6f7cc25f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA72382',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 157634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-27',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2014}
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA72382%27 HTTP/1.1" 200 None
2026-03-30 10:52:55 [auto1.de] INFO: Saving data for EA72382: {'auction_closing_time': 1774969414.0, 'created_time': 1774348801.379295, 'last_price_update_time': 1774867975.9605}
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA72382') HTTP/1.1" 204 0
2026-03-30 10:52:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2da51a75-6fa1-5158-b84b-8717c1df0654 with identifier: GE17394
2026-03-30 10:52:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2da51a75-6fa1-5158-b84b-8717c1df0654 with identifier: GE17394
2026-03-30 10:52:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2da51a75-6fa1-5158-b84b-8717c1df0654 with identifier: GE17394 to the API
2026-03-30 10:52:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:49:42Z',
 'fuel_type': 'petrol',
 'id': '2da51a75-6fa1-5158-b84b-8717c1df0654',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE17394',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 160074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-14',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 10:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE17394%27 HTTP/1.1" 200 None
2026-03-30 10:52:56 [auto1.de] INFO: Saving data for GE17394: {'auction_closing_time': 1774972182.0, 'created_time': 1773688749.646937, 'last_price_update_time': 1774867976.320677}
2026-03-30 10:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE17394') HTTP/1.1" 204 0
2026-03-30 10:52:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:52:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a63e63b-7a57-559f-9193-00d57544884c with identifier: ZE59650
2026-03-30 10:52:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a63e63b-7a57-559f-9193-00d57544884c with identifier: ZE59650
2026-03-30 10:52:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a63e63b-7a57-559f-9193-00d57544884c with identifier: ZE59650 to the API
2026-03-30 10:52:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_60526a972ec181e56c86cc84dd25b6d6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:21:04Z',
 'fuel_type': 'diesel',
 'id': '3a63e63b-7a57-559f-9193-00d57544884c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE59650',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 308183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_5a47cfc5fcab9e3bbca137e7efb3b6d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_9f5376dd9f8d319a6bdd318fddc1d6cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_45dda47c9cf9ab91c75f446ccad689ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_aba278b4c9194786feae5aea9a558eb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_06545a74226e8ee50a86eea99356aa79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_d62ec83b0a27c0ca43678019e4a15f7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_52b738f3252f24574bf6f6fc5faa51f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_d9a4713d0cd634bcc6aee85483a03d52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_220c06157557e8016e1806e5caa97488.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a63e63b-7a57-559f-9193-00d57544884c/3a63e63b-7a57-559f-9193-00d57544884c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/bf/06bf9c468867cbea4f17a788d2fb8b39/pa/ZE59650_60526a972ec181e56c86cc84dd25b6d6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d T Plus',
 'transmission': 'automatic',
 'trim': 'T Plus',
 'year': 2016}
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE59650%27 HTTP/1.1" 200 None
2026-03-30 10:52:57 [auto1.de] INFO: Saving data for ZE59650: {'created_time': 1774867977.200693, 'last_price_update_time': 1774867977.200706, 'auction_closing_time': 1774970464.0}
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE59650') HTTP/1.1" 204 0
2026-03-30 10:52:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a15e061-917c-5434-86d3-85a3bf614c8f with identifier: YS37212
2026-03-30 10:52:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a15e061-917c-5434-86d3-85a3bf614c8f with identifier: YS37212
2026-03-30 10:52:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a15e061-917c-5434-86d3-85a3bf614c8f with identifier: YS37212 to the API
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YS37212>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:07:05Z',
 'fuel_type': 'petrol',
 'id': '0a15e061-917c-5434-86d3-85a3bf614c8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS37212',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 99199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_08933b4fb26c3f2ad674f2d4e29f5f09.jpg',
                'https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_3a6332be86c3fbd168a7ae44ec3af0f1.jpg',
                'https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_6a8f13cf3edcee3b7ff51efe13c2d96d.jpg',
                'https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_ade01e0dd8e982abe6bf62cc446922a9.jpg',
                'https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_64b2e51ff9d12794ed28b768cab6a558.jpg',
                'https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_7476da24ec86dd656c13e5f663768e5b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a15e061-917c-5434-86d3-85a3bf614c8f/0a15e061-917c-5434-86d3-85a3bf614c8f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_08933b4fb26c3f2ad674f2d4e29f5f09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a15e061-917c-5434-86d3-85a3bf614c8f/0a15e061-917c-5434-86d3-85a3bf614c8f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_3a6332be86c3fbd168a7ae44ec3af0f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a15e061-917c-5434-86d3-85a3bf614c8f/0a15e061-917c-5434-86d3-85a3bf614c8f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_6a8f13cf3edcee3b7ff51efe13c2d96d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a15e061-917c-5434-86d3-85a3bf614c8f/0a15e061-917c-5434-86d3-85a3bf614c8f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_ade01e0dd8e982abe6bf62cc446922a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a15e061-917c-5434-86d3-85a3bf614c8f/0a15e061-917c-5434-86d3-85a3bf614c8f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_64b2e51ff9d12794ed28b768cab6a558.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a15e061-917c-5434-86d3-85a3bf614c8f/0a15e061-917c-5434-86d3-85a3bf614c8f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/ac/d6ac60e495103bc6c826976695bdedf5/pa/YS37212_7476da24ec86dd656c13e5f663768e5b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.1 ClearTec EDITION',
 'transmission': 'manual',
 'trim': 'ClearTec EDITION',
 'year': 2011}
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS37212%27 HTTP/1.1" 200 None
2026-03-30 10:52:57 [auto1.de] INFO: Saving data for YS37212: {'created_time': 1774867977.591998, 'last_price_update_time': 1774867977.592009, 'auction_closing_time': 1774969625.0}
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS37212') HTTP/1.1" 204 0
2026-03-30 10:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_1a6680d880089fb755606ccfd1afd801.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_1593edc79d0d50357484c938d2b0c8b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:52:57 [auto1.de] INFO: Found listing with ID: MS41783
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS41783%27 HTTP/1.1" 200 None
2026-03-30 10:52:57 [auto1.de] INFO: Scrape type for MS41783: 2
2026-03-30 10:52:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17c0ef1c-8dc4-52fd-9e41-f71c725f4558 with identifier: MS41783
2026-03-30 10:52:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17c0ef1c-8dc4-52fd-9e41-f71c725f4558 with scrape type 2
2026-03-30 10:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17c0ef1c-8dc4-52fd-9e41-f71c725f4558 with scrape type 2
2026-03-30 10:52:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17c0ef1c-8dc4-52fd-9e41-f71c725f4558, identifier: MS41783
2026-03-30 10:52:57 [auto1.de] INFO: Found listing with ID: BV83779
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV83779%27 HTTP/1.1" 200 None
2026-03-30 10:52:57 [auto1.de] INFO: Scrape type for BV83779: 2
2026-03-30 10:52:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3233a73-2270-5142-8666-7cea58202e3e with identifier: BV83779
2026-03-30 10:52:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3233a73-2270-5142-8666-7cea58202e3e with scrape type 2
2026-03-30 10:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3233a73-2270-5142-8666-7cea58202e3e with scrape type 2
2026-03-30 10:52:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3233a73-2270-5142-8666-7cea58202e3e, identifier: BV83779
2026-03-30 10:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef596cb90>
2026-03-30 10:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_e9408587343fa98690dee5c75be0a5ed.jpg') HTTP/1.1" 204 0
2026-03-30 10:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_e9408587343fa98690dee5c75be0a5ed.jpg saved to cache
2026-03-30 10:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fda08c46-4c8e-527d-acf5-bec11a7e521c
2026-03-30 10:52:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17c0ef1c-8dc4-52fd-9e41-f71c725f4558 with identifier: MS41783
2026-03-30 10:52:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17c0ef1c-8dc4-52fd-9e41-f71c725f4558 with identifier: MS41783
2026-03-30 10:52:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17c0ef1c-8dc4-52fd-9e41-f71c725f4558 with identifier: MS41783 to the API
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:47:52Z',
 'fuel_type': 'petrol',
 'id': '17c0ef1c-8dc4-52fd-9e41-f71c725f4558',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS41783',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 181140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-05',
 'seller_name': None,
 'title': 'Volvo V50 1.8 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2005}
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS41783%27 HTTP/1.1" 200 None
2026-03-30 10:52:58 [auto1.de] INFO: Saving data for MS41783: {'auction_closing_time': 1774972072.0, 'created_time': 1774550927.954599, 'last_price_update_time': 1774867978.3014}
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS41783') HTTP/1.1" 204 0
2026-03-30 10:52:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3233a73-2270-5142-8666-7cea58202e3e with identifier: BV83779
2026-03-30 10:52:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3233a73-2270-5142-8666-7cea58202e3e with identifier: BV83779
2026-03-30 10:52:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3233a73-2270-5142-8666-7cea58202e3e with identifier: BV83779 to the API
2026-03-30 10:52:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:24:10Z',
 'fuel_type': 'petrol',
 'id': 'a3233a73-2270-5142-8666-7cea58202e3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV83779',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 150457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-06',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S ALL4',
 'transmission': 'manual',
 'trim': 'ALL4',
 'year': 2011}
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV83779%27 HTTP/1.1" 200 None
2026-03-30 10:52:59 [auto1.de] INFO: Saving data for BV83779: {'auction_closing_time': 1774970650.0, 'created_time': 1773689140.472572, 'last_price_update_time': 1774867979.250117}
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV83779') HTTP/1.1" 204 0
2026-03-30 10:52:59 [auto1.de] INFO: Found listing with ID: BV26090
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV26090%27 HTTP/1.1" 200 None
2026-03-30 10:52:59 [auto1.de] INFO: Scrape type for BV26090: 2
2026-03-30 10:52:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 093e10b9-6e16-5ee3-be1f-0ee18cc8a10f with identifier: BV26090
2026-03-30 10:52:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 093e10b9-6e16-5ee3-be1f-0ee18cc8a10f with scrape type 2
2026-03-30 10:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 093e10b9-6e16-5ee3-be1f-0ee18cc8a10f with scrape type 2
2026-03-30 10:52:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 093e10b9-6e16-5ee3-be1f-0ee18cc8a10f, identifier: BV26090
2026-03-30 10:52:59 [auto1.de] INFO: Found listing with ID: YS11001
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS11001%27 HTTP/1.1" 200 None
2026-03-30 10:52:59 [auto1.de] INFO: Scrape type for YS11001: 2
2026-03-30 10:52:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7334eb47-9b85-54cc-83c0-8848a023970f with identifier: YS11001
2026-03-30 10:52:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7334eb47-9b85-54cc-83c0-8848a023970f with scrape type 2
2026-03-30 10:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7334eb47-9b85-54cc-83c0-8848a023970f with scrape type 2
2026-03-30 10:52:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7334eb47-9b85-54cc-83c0-8848a023970f, identifier: YS11001
2026-03-30 10:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM23326> (referer: https://www.auto1.com/v1/car-details-view/BM23326/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC12973> (referer: https://www.auto1.com/v1/car-details-view/HC12973/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:52:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 093e10b9-6e16-5ee3-be1f-0ee18cc8a10f with identifier: BV26090
2026-03-30 10:52:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 093e10b9-6e16-5ee3-be1f-0ee18cc8a10f with identifier: BV26090
2026-03-30 10:52:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 093e10b9-6e16-5ee3-be1f-0ee18cc8a10f with identifier: BV26090 to the API
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:52:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:08:20Z',
 'fuel_type': 'diesel',
 'id': '093e10b9-6e16-5ee3-be1f-0ee18cc8a10f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV26090',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 154374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV26090%27 HTTP/1.1" 200 None
2026-03-30 10:52:59 [auto1.de] INFO: Saving data for BV26090: {'auction_closing_time': 1774969700.0, 'created_time': 1773773682.765168, 'last_price_update_time': 1774867979.911843}
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV26090') HTTP/1.1" 204 0
2026-03-30 10:52:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7334eb47-9b85-54cc-83c0-8848a023970f with identifier: YS11001
2026-03-30 10:52:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7334eb47-9b85-54cc-83c0-8848a023970f with identifier: YS11001
2026-03-30 10:53:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7334eb47-9b85-54cc-83c0-8848a023970f with identifier: YS11001 to the API
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:43:31Z',
 'fuel_type': 'petrol',
 'id': '7334eb47-9b85-54cc-83c0-8848a023970f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS11001',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 153128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-22',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Dream Team 2WD',
 'transmission': 'manual',
 'trim': 'Dream Team 2WD',
 'year': 2015}
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS11001%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [auto1.de] INFO: Saving data for YS11001: {'auction_closing_time': 1774971811.0, 'created_time': 1773659089.562351, 'last_price_update_time': 1774867980.289924}
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS11001') HTTP/1.1" 204 0
2026-03-30 10:53:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6f090>
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_1a6680d880089fb755606ccfd1afd801.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_1a6680d880089fb755606ccfd1afd801.jpg saved to cache
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fda08c46-4c8e-527d-acf5-bec11a7e521c
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5022050>
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_1593edc79d0d50357484c938d2b0c8b3.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_1593edc79d0d50357484c938d2b0c8b3.jpg saved to cache
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fda08c46-4c8e-527d-acf5-bec11a7e521c
2026-03-30 10:53:00 [auto1.de] INFO: Found listing with ID: RU30790
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU30790%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [auto1.de] INFO: Scrape type for RU30790: 2
2026-03-30 10:53:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caed2394-e8e5-56e6-b980-50de70539c18 with identifier: RU30790
2026-03-30 10:53:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caed2394-e8e5-56e6-b980-50de70539c18 with scrape type 2
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caed2394-e8e5-56e6-b980-50de70539c18 with scrape type 2
2026-03-30 10:53:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caed2394-e8e5-56e6-b980-50de70539c18, identifier: RU30790
2026-03-30 10:53:00 [auto1.de] INFO: Found listing with ID: MN62628
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN62628%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [auto1.de] INFO: Scrape type for MN62628: 2
2026-03-30 10:53:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5037a8d0-52cd-5cc4-9e57-b9697a9f0f3c with identifier: MN62628
2026-03-30 10:53:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5037a8d0-52cd-5cc4-9e57-b9697a9f0f3c with scrape type 2
2026-03-30 10:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5037a8d0-52cd-5cc4-9e57-b9697a9f0f3c with scrape type 2
2026-03-30 10:53:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5037a8d0-52cd-5cc4-9e57-b9697a9f0f3c, identifier: MN62628
2026-03-30 10:53:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caed2394-e8e5-56e6-b980-50de70539c18 with identifier: RU30790
2026-03-30 10:53:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caed2394-e8e5-56e6-b980-50de70539c18 with identifier: RU30790
2026-03-30 10:53:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caed2394-e8e5-56e6-b980-50de70539c18 with identifier: RU30790 to the API
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:59:04Z',
 'fuel_type': 'petrol',
 'id': 'caed2394-e8e5-56e6-b980-50de70539c18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU30790',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Starlet',
 'odometer': 87497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1995-05-18',
 'seller_name': None,
 'title': 'Toyota Starlet 1.3 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 1995}
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU30790%27 HTTP/1.1" 200 None
2026-03-30 10:53:00 [auto1.de] INFO: Saving data for RU30790: {'auction_closing_time': 1774972744.0, 'created_time': 1774466640.22752, 'last_price_update_time': 1774867980.989898}
2026-03-30 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU30790') HTTP/1.1" 204 0
2026-03-30 10:53:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5037a8d0-52cd-5cc4-9e57-b9697a9f0f3c with identifier: MN62628
2026-03-30 10:53:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5037a8d0-52cd-5cc4-9e57-b9697a9f0f3c with identifier: MN62628
2026-03-30 10:53:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5037a8d0-52cd-5cc4-9e57-b9697a9f0f3c with identifier: MN62628 to the API
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:41:00Z',
 'fuel_type': 'petrol',
 'id': '5037a8d0-52cd-5cc4-9e57-b9697a9f0f3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN62628',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 122336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-29',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI Sportline',
 'transmission': 'manual',
 'trim': 'Sportline',
 'year': 2009}
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN62628%27 HTTP/1.1" 200 None
2026-03-30 10:53:01 [auto1.de] INFO: Saving data for MN62628: {'auction_closing_time': 1774971660.0, 'created_time': 1773302875.034518, 'last_price_update_time': 1774867981.344127}
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN62628') HTTP/1.1" 204 0
2026-03-30 10:53:01 [auto1.de] INFO: Found listing with ID: LK30881
2026-03-30 10:53:01 [auto1.de] INFO: Found listing with ID: EX42379
2026-03-30 10:53:01 [auto1.de] INFO: Found listing with ID: PV07453
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV07453%27 HTTP/1.1" 200 None
2026-03-30 10:53:01 [auto1.de] INFO: Scrape type for PV07453: 2
2026-03-30 10:53:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32386616-7d61-5771-acbc-993d464e8229 with identifier: PV07453
2026-03-30 10:53:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32386616-7d61-5771-acbc-993d464e8229 with scrape type 2
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32386616-7d61-5771-acbc-993d464e8229 with scrape type 2
2026-03-30 10:53:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32386616-7d61-5771-acbc-993d464e8229, identifier: PV07453
2026-03-30 10:53:01 [auto1.de] INFO: Found listing with ID: CV94580
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV94580%27 HTTP/1.1" 200 None
2026-03-30 10:53:01 [auto1.de] INFO: Scrape type for CV94580: 2
2026-03-30 10:53:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 860e04f2-7305-52b0-8417-9333520e8e18 with identifier: CV94580
2026-03-30 10:53:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 860e04f2-7305-52b0-8417-9333520e8e18 with scrape type 2
2026-03-30 10:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 860e04f2-7305-52b0-8417-9333520e8e18 with scrape type 2
2026-03-30 10:53:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 860e04f2-7305-52b0-8417-9333520e8e18, identifier: CV94580
2026-03-30 10:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32386616-7d61-5771-acbc-993d464e8229 with identifier: PV07453
2026-03-30 10:53:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32386616-7d61-5771-acbc-993d464e8229 with identifier: PV07453
2026-03-30 10:53:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32386616-7d61-5771-acbc-993d464e8229 with identifier: PV07453 to the API
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-31T15:41:18Z',
 'fuel_type': 'petrol',
 'id': '32386616-7d61-5771-acbc-993d464e8229',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV07453',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 76841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-26',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Opel 2020 Start/Stop',
 'transmission': 'manual',
 'trim': '2020 Start/Stop',
 'year': 2020}
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV07453%27 HTTP/1.1" 200 None
2026-03-30 10:53:01 [auto1.de] INFO: Saving data for PV07453: {'auction_closing_time': 1774971678.0, 'created_time': 1774377366.208894, 'last_price_update_time': 1774867981.948291}
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV07453') HTTP/1.1" 204 0
2026-03-30 10:53:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 860e04f2-7305-52b0-8417-9333520e8e18 with identifier: CV94580
2026-03-30 10:53:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 860e04f2-7305-52b0-8417-9333520e8e18 with identifier: CV94580
2026-03-30 10:53:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 860e04f2-7305-52b0-8417-9333520e8e18 with identifier: CV94580 to the API
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:02:02Z',
 'fuel_type': 'diesel',
 'id': '860e04f2-7305-52b0-8417-9333520e8e18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV94580',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 108367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-08',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2018}
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV94580%27 HTTP/1.1" 200 None
2026-03-30 10:53:02 [auto1.de] INFO: Saving data for CV94580: {'auction_closing_time': 1774969322.0, 'created_time': 1773308328.568998, 'last_price_update_time': 1774867982.423684}
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV94580') HTTP/1.1" 204 0
2026-03-30 10:53:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:02 [auto1.de] INFO: Found listing with ID: CJ76479
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ76479%27 HTTP/1.1" 200 None
2026-03-30 10:53:02 [auto1.de] INFO: Scrape type for CJ76479: 2
2026-03-30 10:53:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0f0f3eb-8af8-5c2a-adbc-8f9872a00244 with identifier: CJ76479
2026-03-30 10:53:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0f0f3eb-8af8-5c2a-adbc-8f9872a00244 with scrape type 2
2026-03-30 10:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0f0f3eb-8af8-5c2a-adbc-8f9872a00244 with scrape type 2
2026-03-30 10:53:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0f0f3eb-8af8-5c2a-adbc-8f9872a00244, identifier: CJ76479
2026-03-30 10:53:02 [auto1.de] INFO: Found listing with ID: GV44074
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV44074%27 HTTP/1.1" 200 None
2026-03-30 10:53:02 [auto1.de] INFO: Scrape type for GV44074: 1
2026-03-30 10:53:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW73821/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00040ae4-3360-50e6-accf-06e7459bcaad with identifier: BM23326
2026-03-30 10:53:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00040ae4-3360-50e6-accf-06e7459bcaad with scrape type 1
2026-03-30 10:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00040ae4-3360-50e6-accf-06e7459bcaad
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_8e132d5537e49877da84e7db58f81ba2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_8e132d5537e49877da84e7db58f81ba2.jpg not downloaded yet
2026-03-30 10:53:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c79f7811-0186-5850-ab21-0ac4af12e20a with identifier: HC12973
2026-03-30 10:53:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c79f7811-0186-5850-ab21-0ac4af12e20a with scrape type 1
2026-03-30 10:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c79f7811-0186-5850-ab21-0ac4af12e20a
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_053d3df327a339d4342ccac022dc06ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_053d3df327a339d4342ccac022dc06ae.jpg not downloaded yet
2026-03-30 10:53:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0f0f3eb-8af8-5c2a-adbc-8f9872a00244 with identifier: CJ76479
2026-03-30 10:53:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0f0f3eb-8af8-5c2a-adbc-8f9872a00244 with identifier: CJ76479
2026-03-30 10:53:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0f0f3eb-8af8-5c2a-adbc-8f9872a00244 with identifier: CJ76479 to the API
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-31T15:42:30Z',
 'fuel_type': 'petrol',
 'id': 'e0f0f3eb-8af8-5c2a-adbc-8f9872a00244',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ76479',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 116774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-20',
 'seller_name': None,
 'title': 'MINI Clubman Cooper S ALL4',
 'transmission': 'manual',
 'trim': 'ALL4',
 'year': 2016}
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ76479%27 HTTP/1.1" 200 None
2026-03-30 10:53:02 [auto1.de] INFO: Saving data for CJ76479: {'auction_closing_time': 1774971750.0, 'created_time': 1774637378.007905, 'last_price_update_time': 1774867982.980631}
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ76479') HTTP/1.1" 204 0
2026-03-30 10:53:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA24351/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RS78128/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:03 [auto1.de] INFO: Found listing with ID: XF29574
2026-03-30 10:53:03 [auto1.de] INFO: Found listing with ID: DR25105
2026-03-30 10:53:03 [auto1.de] INFO: Found listing with ID: BM74248
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM74248%27 HTTP/1.1" 200 None
2026-03-30 10:53:03 [auto1.de] INFO: Scrape type for BM74248: 2
2026-03-30 10:53:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30b831e1-5bf3-574d-8edd-6535e88e677a with identifier: BM74248
2026-03-30 10:53:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30b831e1-5bf3-574d-8edd-6535e88e677a with scrape type 2
2026-03-30 10:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30b831e1-5bf3-574d-8edd-6535e88e677a with scrape type 2
2026-03-30 10:53:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30b831e1-5bf3-574d-8edd-6535e88e677a, identifier: BM74248
2026-03-30 10:53:03 [auto1.de] INFO: Found listing with ID: VD76950
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD76950%27 HTTP/1.1" 200 None
2026-03-30 10:53:03 [auto1.de] INFO: Scrape type for VD76950: 2
2026-03-30 10:53:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ababa33a-fcbc-549f-abbe-7220dd0644fd with identifier: VD76950
2026-03-30 10:53:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ababa33a-fcbc-549f-abbe-7220dd0644fd with scrape type 2
2026-03-30 10:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ababa33a-fcbc-549f-abbe-7220dd0644fd with scrape type 2
2026-03-30 10:53:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ababa33a-fcbc-549f-abbe-7220dd0644fd, identifier: VD76950
2026-03-30 10:53:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_5d3618c4a8fb4e3e0b0468549b7e7359.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_5d3618c4a8fb4e3e0b0468549b7e7359.jpg not downloaded yet
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_bf0e6070140c80b4638213f0ab46f214.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_bf0e6070140c80b4638213f0ab46f214.jpg not downloaded yet
2026-03-30 10:53:03 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 9515 | hits on page: 40
2026-03-30 10:53:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30b831e1-5bf3-574d-8edd-6535e88e677a with identifier: BM74248
2026-03-30 10:53:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30b831e1-5bf3-574d-8edd-6535e88e677a with identifier: BM74248
2026-03-30 10:53:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30b831e1-5bf3-574d-8edd-6535e88e677a with identifier: BM74248 to the API
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:15:21Z',
 'fuel_type': 'petrol',
 'id': '30b831e1-5bf3-574d-8edd-6535e88e677a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM74248',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 108604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-07',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM74248%27 HTTP/1.1" 200 None
2026-03-30 10:53:03 [auto1.de] INFO: Saving data for BM74248: {'auction_closing_time': 1774970121.0, 'created_time': 1773131878.581426, 'last_price_update_time': 1774867983.625794}
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM74248') HTTP/1.1" 204 0
2026-03-30 10:53:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ababa33a-fcbc-549f-abbe-7220dd0644fd with identifier: VD76950
2026-03-30 10:53:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ababa33a-fcbc-549f-abbe-7220dd0644fd with identifier: VD76950
2026-03-30 10:53:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ababa33a-fcbc-549f-abbe-7220dd0644fd with identifier: VD76950 to the API
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:08:56Z',
 'fuel_type': 'petrol',
 'id': 'ababa33a-fcbc-549f-abbe-7220dd0644fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD76950',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 117885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2006}
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD76950%27 HTTP/1.1" 200 None
2026-03-30 10:53:03 [auto1.de] INFO: Saving data for VD76950: {'auction_closing_time': 1774969736.0, 'created_time': 1774467431.903285, 'last_price_update_time': 1774867983.975729}
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VD76950') HTTP/1.1" 204 0
2026-03-30 10:53:04 [auto1.de] INFO: Found listing with ID: PR18701
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR18701%27 HTTP/1.1" 200 None
2026-03-30 10:53:04 [auto1.de] INFO: Scrape type for PR18701: 2
2026-03-30 10:53:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b166b420-f24d-581e-b43b-1df5992b7781 with identifier: PR18701
2026-03-30 10:53:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b166b420-f24d-581e-b43b-1df5992b7781 with scrape type 2
2026-03-30 10:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b166b420-f24d-581e-b43b-1df5992b7781 with scrape type 2
2026-03-30 10:53:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b166b420-f24d-581e-b43b-1df5992b7781, identifier: PR18701
2026-03-30 10:53:04 [auto1.de] INFO: Found listing with ID: HU95609
2026-03-30 10:53:04 [auto1.de] INFO: Found listing with ID: PN76408
2026-03-30 10:53:04 [auto1.de] INFO: Found listing with ID: TR77666
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR77666%27 HTTP/1.1" 200 None
2026-03-30 10:53:04 [auto1.de] INFO: Scrape type for TR77666: 2
2026-03-30 10:53:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1af5f7e3-b3a5-5b41-bdc3-e0e720526b1e with identifier: TR77666
2026-03-30 10:53:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1af5f7e3-b3a5-5b41-bdc3-e0e720526b1e with scrape type 2
2026-03-30 10:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1af5f7e3-b3a5-5b41-bdc3-e0e720526b1e with scrape type 2
2026-03-30 10:53:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1af5f7e3-b3a5-5b41-bdc3-e0e720526b1e, identifier: TR77666
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_65f5878c5a813318f91d6eab81edb15f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_65f5878c5a813318f91d6eab81edb15f.jpg not downloaded yet
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_00e6c065d8ba665779fb19fc896eb51a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_00e6c065d8ba665779fb19fc896eb51a.jpg not downloaded yet
2026-03-30 10:53:04 [auto1.de] INFO: Found listing with ID: FU60583
2026-03-30 10:53:04 [auto1.de] INFO: Found listing with ID: SZ82893
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ82893%27 HTTP/1.1" 200 None
2026-03-30 10:53:04 [auto1.de] INFO: Scrape type for SZ82893: 2
2026-03-30 10:53:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99983eb4-3340-532c-92bf-fc2e3b515d0e with identifier: SZ82893
2026-03-30 10:53:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99983eb4-3340-532c-92bf-fc2e3b515d0e with scrape type 2
2026-03-30 10:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99983eb4-3340-532c-92bf-fc2e3b515d0e with scrape type 2
2026-03-30 10:53:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99983eb4-3340-532c-92bf-fc2e3b515d0e, identifier: SZ82893
2026-03-30 10:53:04 [scrapy.extensions.logstats] INFO: Crawled 669 pages (at 52 pages/min), scraped 563 items (at 94 items/min)
2026-03-30 10:53:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-30 10:53:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b166b420-f24d-581e-b43b-1df5992b7781 with identifier: PR18701
2026-03-30 10:53:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b166b420-f24d-581e-b43b-1df5992b7781 with identifier: PR18701
2026-03-30 10:53:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b166b420-f24d-581e-b43b-1df5992b7781 with identifier: PR18701 to the API
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:30:24Z',
 'fuel_type': 'petrol',
 'id': 'b166b420-f24d-581e-b43b-1df5992b7781',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR18701',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 137376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-07',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2017}
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR18701%27 HTTP/1.1" 200 None
2026-03-30 10:53:04 [auto1.de] INFO: Saving data for PR18701: {'auction_closing_time': 1774971024.0, 'created_time': 1774435594.163789, 'last_price_update_time': 1774867984.759515}
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR18701') HTTP/1.1" 204 0
2026-03-30 10:53:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1af5f7e3-b3a5-5b41-bdc3-e0e720526b1e with identifier: TR77666
2026-03-30 10:53:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1af5f7e3-b3a5-5b41-bdc3-e0e720526b1e with identifier: TR77666
2026-03-30 10:53:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1af5f7e3-b3a5-5b41-bdc3-e0e720526b1e with identifier: TR77666 to the API
2026-03-30 10:53:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:48:10Z',
 'fuel_type': 'petrol',
 'id': '1af5f7e3-b3a5-5b41-bdc3-e0e720526b1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR77666',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 134731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR77666%27 HTTP/1.1" 200 None
2026-03-30 10:53:05 [auto1.de] INFO: Saving data for TR77666: {'auction_closing_time': 1774972090.0, 'created_time': 1773301427.19916, 'last_price_update_time': 1774867985.189269}
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR77666') HTTP/1.1" 204 0
2026-03-30 10:53:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99983eb4-3340-532c-92bf-fc2e3b515d0e with identifier: SZ82893
2026-03-30 10:53:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99983eb4-3340-532c-92bf-fc2e3b515d0e with identifier: SZ82893
2026-03-30 10:53:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99983eb4-3340-532c-92bf-fc2e3b515d0e with identifier: SZ82893 to the API
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:02:22Z',
 'fuel_type': 'diesel',
 'id': '99983eb4-3340-532c-92bf-fc2e3b515d0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ82893',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 112925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-01',
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI S line Sportpaket',
 'transmission': 'manual',
 'trim': 'S line Sportpaket',
 'year': 2013}
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ82893%27 HTTP/1.1" 200 None
2026-03-30 10:53:05 [auto1.de] INFO: Saving data for SZ82893: {'auction_closing_time': 1774969342.0, 'created_time': 1773345987.666905, 'last_price_update_time': 1774867985.557712}
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ82893') HTTP/1.1" 204 0
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: PZ85127
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: YX62865
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: CZ38094
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ38094%27 HTTP/1.1" 200 None
2026-03-30 10:53:05 [auto1.de] INFO: Scrape type for CZ38094: 2
2026-03-30 10:53:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fdc6bbd-163d-5984-8a05-81c354f19ef8 with identifier: CZ38094
2026-03-30 10:53:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fdc6bbd-163d-5984-8a05-81c354f19ef8 with scrape type 2
2026-03-30 10:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fdc6bbd-163d-5984-8a05-81c354f19ef8 with scrape type 2
2026-03-30 10:53:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fdc6bbd-163d-5984-8a05-81c354f19ef8, identifier: CZ38094
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: VK05734
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: RZ52182
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ52182%27 HTTP/1.1" 200 None
2026-03-30 10:53:05 [auto1.de] INFO: Scrape type for RZ52182: 2
2026-03-30 10:53:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb827cdc-15fe-504f-83cd-1283c35ce115 with identifier: RZ52182
2026-03-30 10:53:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb827cdc-15fe-504f-83cd-1283c35ce115 with scrape type 2
2026-03-30 10:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb827cdc-15fe-504f-83cd-1283c35ce115 with scrape type 2
2026-03-30 10:53:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb827cdc-15fe-504f-83cd-1283c35ce115, identifier: RZ52182
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_ef057a2a4f6c4b70a5c8389224a5da37.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_ef057a2a4f6c4b70a5c8389224a5da37.jpg not downloaded yet
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_d8cca2a17a6dfe0660e58ca3f5113e75.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_d8cca2a17a6dfe0660e58ca3f5113e75.jpg not downloaded yet
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: UR83555
2026-03-30 10:53:05 [auto1.de] INFO: Found listing with ID: WZ84002
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ84002%27 HTTP/1.1" 200 None
2026-03-30 10:53:05 [auto1.de] INFO: Scrape type for WZ84002: 2
2026-03-30 10:53:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e01299f5-81d7-5eb0-b217-509e218db396 with identifier: WZ84002
2026-03-30 10:53:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e01299f5-81d7-5eb0-b217-509e218db396 with scrape type 2
2026-03-30 10:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e01299f5-81d7-5eb0-b217-509e218db396 with scrape type 2
2026-03-30 10:53:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e01299f5-81d7-5eb0-b217-509e218db396, identifier: WZ84002
2026-03-30 10:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_053d3df327a339d4342ccac022dc06ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fdc6bbd-163d-5984-8a05-81c354f19ef8 with identifier: CZ38094
2026-03-30 10:53:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fdc6bbd-163d-5984-8a05-81c354f19ef8 with identifier: CZ38094
2026-03-30 10:53:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fdc6bbd-163d-5984-8a05-81c354f19ef8 with identifier: CZ38094 to the API
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:05:35Z',
 'fuel_type': 'diesel',
 'id': '4fdc6bbd-163d-5984-8a05-81c354f19ef8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ38094',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 322389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-08',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ38094%27 HTTP/1.1" 200 None
2026-03-30 10:53:06 [auto1.de] INFO: Saving data for CZ38094: {'auction_closing_time': 1774969535.0, 'created_time': 1774294172.046006, 'last_price_update_time': 1774867986.284562}
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ38094') HTTP/1.1" 204 0
2026-03-30 10:53:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb827cdc-15fe-504f-83cd-1283c35ce115 with identifier: RZ52182
2026-03-30 10:53:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb827cdc-15fe-504f-83cd-1283c35ce115 with identifier: RZ52182
2026-03-30 10:53:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb827cdc-15fe-504f-83cd-1283c35ce115 with identifier: RZ52182 to the API
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:39:54Z',
 'fuel_type': 'diesel',
 'id': 'cb827cdc-15fe-504f-83cd-1283c35ce115',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ52182',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 246276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-24',
 'seller_name': None,
 'title': 'Audi A4 Allroad 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ52182%27 HTTP/1.1" 200 None
2026-03-30 10:53:06 [auto1.de] INFO: Saving data for RZ52182: {'auction_closing_time': 1774971594.0, 'created_time': 1773686169.863735, 'last_price_update_time': 1774867986.673287}
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ52182') HTTP/1.1" 204 0
2026-03-30 10:53:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e01299f5-81d7-5eb0-b217-509e218db396 with identifier: WZ84002
2026-03-30 10:53:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e01299f5-81d7-5eb0-b217-509e218db396 with identifier: WZ84002
2026-03-30 10:53:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e01299f5-81d7-5eb0-b217-509e218db396 with identifier: WZ84002 to the API
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-31T15:35:11Z',
 'fuel_type': 'petrol',
 'id': 'e01299f5-81d7-5eb0-b217-509e218db396',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ84002',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 90740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-05',
 'seller_name': None,
 'title': 'BMW 2er M235i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ84002%27 HTTP/1.1" 200 None
2026-03-30 10:53:07 [auto1.de] INFO: Saving data for WZ84002: {'auction_closing_time': 1774971311.0, 'created_time': 1774380924.405688, 'last_price_update_time': 1774867987.049913}
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ84002') HTTP/1.1" 204 0
2026-03-30 10:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_8e132d5537e49877da84e7db58f81ba2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:07 [auto1.de] INFO: Found listing with ID: FJ62780
2026-03-30 10:53:07 [auto1.de] INFO: Found listing with ID: DU13236
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13236%27 HTTP/1.1" 200 None
2026-03-30 10:53:07 [auto1.de] INFO: Scrape type for DU13236: 1
2026-03-30 10:53:07 [auto1.de] INFO: Found listing with ID: ZX86337
2026-03-30 10:53:07 [auto1.de] INFO: Found listing with ID: WX81960
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX81960%27 HTTP/1.1" 200 None
2026-03-30 10:53:07 [auto1.de] INFO: Scrape type for WX81960: 2
2026-03-30 10:53:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68696bb7-e32b-544a-83fa-11c34ac59c9f with identifier: WX81960
2026-03-30 10:53:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68696bb7-e32b-544a-83fa-11c34ac59c9f with scrape type 2
2026-03-30 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68696bb7-e32b-544a-83fa-11c34ac59c9f with scrape type 2
2026-03-30 10:53:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68696bb7-e32b-544a-83fa-11c34ac59c9f, identifier: WX81960
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_4eeb8911f45c3a013e16e77eda237f15.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_4eeb8911f45c3a013e16e77eda237f15.jpg not downloaded yet
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_482b145af058de7e5fb3abc35aa42c15.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_482b145af058de7e5fb3abc35aa42c15.jpg not downloaded yet
2026-03-30 10:53:07 [auto1.de] INFO: Found listing with ID: BU83638
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU83638%27 HTTP/1.1" 200 None
2026-03-30 10:53:07 [auto1.de] INFO: Scrape type for BU83638: 2
2026-03-30 10:53:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24b192b5-e3b4-5e7f-8790-88557a68a309 with identifier: BU83638
2026-03-30 10:53:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24b192b5-e3b4-5e7f-8790-88557a68a309 with scrape type 2
2026-03-30 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24b192b5-e3b4-5e7f-8790-88557a68a309 with scrape type 2
2026-03-30 10:53:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24b192b5-e3b4-5e7f-8790-88557a68a309, identifier: BU83638
2026-03-30 10:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP11097/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD05197/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME64597/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68696bb7-e32b-544a-83fa-11c34ac59c9f with identifier: WX81960
2026-03-30 10:53:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68696bb7-e32b-544a-83fa-11c34ac59c9f with identifier: WX81960
2026-03-30 10:53:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68696bb7-e32b-544a-83fa-11c34ac59c9f with identifier: WX81960 to the API
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:33:53Z',
 'fuel_type': 'petrol',
 'id': '68696bb7-e32b-544a-83fa-11c34ac59c9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX81960',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 129348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-17',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2016}
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX81960%27 HTTP/1.1" 200 None
2026-03-30 10:53:07 [auto1.de] INFO: Saving data for WX81960: {'auction_closing_time': 1774971233.0, 'created_time': 1773917142.139531, 'last_price_update_time': 1774867987.78352}
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX81960') HTTP/1.1" 204 0
2026-03-30 10:53:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24b192b5-e3b4-5e7f-8790-88557a68a309 with identifier: BU83638
2026-03-30 10:53:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24b192b5-e3b4-5e7f-8790-88557a68a309 with identifier: BU83638
2026-03-30 10:53:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24b192b5-e3b4-5e7f-8790-88557a68a309 with identifier: BU83638 to the API
2026-03-30 10:53:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:14:09Z',
 'fuel_type': 'petrol',
 'id': '24b192b5-e3b4-5e7f-8790-88557a68a309',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU83638',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 97168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-11',
 'seller_name': None,
 'title': 'Audi Q2 2.0 TFSI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU83638%27 HTTP/1.1" 200 None
2026-03-30 10:53:08 [auto1.de] INFO: Saving data for BU83638: {'auction_closing_time': 1774970049.0, 'created_time': 1774467683.720186, 'last_price_update_time': 1774867988.214461}
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU83638') HTTP/1.1" 204 0
2026-03-30 10:53:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:08 [auto1.de] INFO: Found listing with ID: TE24428
2026-03-30 10:53:08 [auto1.de] INFO: Found listing with ID: YU65678
2026-03-30 10:53:08 [auto1.de] INFO: Found listing with ID: DL07796
2026-03-30 10:53:08 [auto1.de] INFO: Found listing with ID: ZR68100
2026-03-30 10:53:08 [auto1.de] INFO: Found listing with ID: TN69182
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN69182%27 HTTP/1.1" 200 None
2026-03-30 10:53:08 [auto1.de] INFO: Scrape type for TN69182: 2
2026-03-30 10:53:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93d130bd-3230-51a2-a917-58976cebf9ba with identifier: TN69182
2026-03-30 10:53:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93d130bd-3230-51a2-a917-58976cebf9ba with scrape type 2
2026-03-30 10:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93d130bd-3230-51a2-a917-58976cebf9ba with scrape type 2
2026-03-30 10:53:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93d130bd-3230-51a2-a917-58976cebf9ba, identifier: TN69182
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_8c726ac0011f34774cd1ce45ef1b962d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_8c726ac0011f34774cd1ce45ef1b962d.jpg not downloaded yet
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_c3ded40873f1c3a67c1d533acc10b0c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_c3ded40873f1c3a67c1d533acc10b0c4.jpg not downloaded yet
2026-03-30 10:53:08 [auto1.de] INFO: Found listing with ID: SR37454
2026-03-30 10:53:08 [auto1.de] INFO: Found listing with ID: BX73975
2026-03-30 10:53:08 [auto1.de] INFO: Found listing with ID: DL80467
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL80467%27 HTTP/1.1" 200 None
2026-03-30 10:53:08 [auto1.de] INFO: Scrape type for DL80467: 2
2026-03-30 10:53:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 442c64a1-8cd1-5a8b-898c-b7e192a14715 with identifier: DL80467
2026-03-30 10:53:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 442c64a1-8cd1-5a8b-898c-b7e192a14715 with scrape type 2
2026-03-30 10:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 442c64a1-8cd1-5a8b-898c-b7e192a14715 with scrape type 2
2026-03-30 10:53:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 442c64a1-8cd1-5a8b-898c-b7e192a14715, identifier: DL80467
2026-03-30 10:53:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93d130bd-3230-51a2-a917-58976cebf9ba with identifier: TN69182
2026-03-30 10:53:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93d130bd-3230-51a2-a917-58976cebf9ba with identifier: TN69182
2026-03-30 10:53:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93d130bd-3230-51a2-a917-58976cebf9ba with identifier: TN69182 to the API
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:47:48Z',
 'fuel_type': 'diesel',
 'id': '93d130bd-3230-51a2-a917-58976cebf9ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN69182',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 223052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-07-15',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2004}
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN69182%27 HTTP/1.1" 200 None
2026-03-30 10:53:08 [auto1.de] INFO: Saving data for TN69182: {'auction_closing_time': 1774972068.0, 'created_time': 1773516408.928153, 'last_price_update_time': 1774867988.891713}
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN69182') HTTP/1.1" 204 0
2026-03-30 10:53:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 442c64a1-8cd1-5a8b-898c-b7e192a14715 with identifier: DL80467
2026-03-30 10:53:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 442c64a1-8cd1-5a8b-898c-b7e192a14715 with identifier: DL80467
2026-03-30 10:53:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 442c64a1-8cd1-5a8b-898c-b7e192a14715 with identifier: DL80467 to the API
2026-03-30 10:53:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-31T15:50:59Z',
 'fuel_type': 'petrol',
 'id': '442c64a1-8cd1-5a8b-898c-b7e192a14715',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL80467',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 137442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-31',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 DSi ES',
 'transmission': 'manual',
 'trim': 'ES',
 'year': 2006}
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL80467%27 HTTP/1.1" 200 None
2026-03-30 10:53:09 [auto1.de] INFO: Saving data for DL80467: {'auction_closing_time': 1774972259.0, 'created_time': 1773302640.929147, 'last_price_update_time': 1774867989.292375}
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL80467') HTTP/1.1" 204 0
2026-03-30 10:53:09 [auto1.de] INFO: Found listing with ID: XV50693
2026-03-30 10:53:09 [auto1.de] INFO: Found listing with ID: LL82191
2026-03-30 10:53:09 [auto1.de] INFO: Found listing with ID: LD74655
2026-03-30 10:53:09 [auto1.de] INFO: Found listing with ID: KS17982
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS17982%27 HTTP/1.1" 200 None
2026-03-30 10:53:09 [auto1.de] INFO: Scrape type for KS17982: 2
2026-03-30 10:53:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d592e785-cb2e-5e6f-9b4a-07723120c3e3 with identifier: KS17982
2026-03-30 10:53:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d592e785-cb2e-5e6f-9b4a-07723120c3e3 with scrape type 2
2026-03-30 10:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d592e785-cb2e-5e6f-9b4a-07723120c3e3 with scrape type 2
2026-03-30 10:53:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d592e785-cb2e-5e6f-9b4a-07723120c3e3, identifier: KS17982
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_ccbed91e8bb60397440a8aa1ac9d8c36.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_ccbed91e8bb60397440a8aa1ac9d8c36.jpg not downloaded yet
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_abd8f4764bfe449009040741bae9f598.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_abd8f4764bfe449009040741bae9f598.jpg not downloaded yet
2026-03-30 10:53:09 [auto1.de] INFO: Found listing with ID: FX59217
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX59217%27 HTTP/1.1" 200 None
2026-03-30 10:53:09 [auto1.de] INFO: Scrape type for FX59217: 2
2026-03-30 10:53:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08f11da2-2d1a-5e65-9bf0-408386030a86 with identifier: FX59217
2026-03-30 10:53:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08f11da2-2d1a-5e65-9bf0-408386030a86 with scrape type 2
2026-03-30 10:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08f11da2-2d1a-5e65-9bf0-408386030a86 with scrape type 2
2026-03-30 10:53:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08f11da2-2d1a-5e65-9bf0-408386030a86, identifier: FX59217
2026-03-30 10:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LD73259> (referer: https://www.auto1.com/v1/car-details-view/LD73259/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5124fd0>
2026-03-30 10:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_053d3df327a339d4342ccac022dc06ae.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_053d3df327a339d4342ccac022dc06ae.jpg saved to cache
2026-03-30 10:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c79f7811-0186-5850-ab21-0ac4af12e20a
2026-03-30 10:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0dc10>
2026-03-30 10:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_8e132d5537e49877da84e7db58f81ba2.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_8e132d5537e49877da84e7db58f81ba2.jpg saved to cache
2026-03-30 10:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00040ae4-3360-50e6-accf-06e7459bcaad
2026-03-30 10:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_d8cca2a17a6dfe0660e58ca3f5113e75.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d592e785-cb2e-5e6f-9b4a-07723120c3e3 with identifier: KS17982
2026-03-30 10:53:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d592e785-cb2e-5e6f-9b4a-07723120c3e3 with identifier: KS17982
2026-03-30 10:53:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d592e785-cb2e-5e6f-9b4a-07723120c3e3 with identifier: KS17982 to the API
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:00:17Z',
 'fuel_type': 'hybrid',
 'id': 'd592e785-cb2e-5e6f-9b4a-07723120c3e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS17982',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 58247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-26',
 'seller_name': None,
 'title': 'Kia Sorento 1.6 TGDI Plug-in Hybrid Platinum 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum 4WD',
 'year': 2022}
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS17982%27 HTTP/1.1" 200 None
2026-03-30 10:53:10 [auto1.de] INFO: Saving data for KS17982: {'auction_closing_time': 1774969217.0, 'created_time': 1774380099.107823, 'last_price_update_time': 1774867990.136341}
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS17982') HTTP/1.1" 204 0
2026-03-30 10:53:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08f11da2-2d1a-5e65-9bf0-408386030a86 with identifier: FX59217
2026-03-30 10:53:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08f11da2-2d1a-5e65-9bf0-408386030a86 with identifier: FX59217
2026-03-30 10:53:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08f11da2-2d1a-5e65-9bf0-408386030a86 with identifier: FX59217 to the API
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:54:40Z',
 'fuel_type': 'diesel',
 'id': '08f11da2-2d1a-5e65-9bf0-408386030a86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX59217',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 198240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2016}
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX59217%27 HTTP/1.1" 200 None
2026-03-30 10:53:10 [auto1.de] INFO: Saving data for FX59217: {'auction_closing_time': 1774972480.0, 'created_time': 1773403140.268597, 'last_price_update_time': 1774867990.671076}
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX59217') HTTP/1.1" 204 0
2026-03-30 10:53:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_ef057a2a4f6c4b70a5c8389224a5da37.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:10 [auto1.de] INFO: Found listing with ID: FX77489
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX77489%27 HTTP/1.1" 200 None
2026-03-30 10:53:10 [auto1.de] INFO: Scrape type for FX77489: 2
2026-03-30 10:53:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0688b1b3-9855-55d6-82fa-60909e48d4a4 with identifier: FX77489
2026-03-30 10:53:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0688b1b3-9855-55d6-82fa-60909e48d4a4 with scrape type 2
2026-03-30 10:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0688b1b3-9855-55d6-82fa-60909e48d4a4 with scrape type 2
2026-03-30 10:53:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0688b1b3-9855-55d6-82fa-60909e48d4a4, identifier: FX77489
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_0bdc6867724d3075175fa34a84c06941.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_0bdc6867724d3075175fa34a84c06941.jpg not downloaded yet
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_376bf29357509c6dd213d2e08ef95fae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_376bf29357509c6dd213d2e08ef95fae.jpg not downloaded yet
2026-03-30 10:53:10 [auto1.de] INFO: Found listing with ID: KP93453
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP93453%27 HTTP/1.1" 200 None
2026-03-30 10:53:10 [auto1.de] INFO: Scrape type for KP93453: 2
2026-03-30 10:53:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0da75940-bec5-50e9-9a10-118a2d9af10e with identifier: KP93453
2026-03-30 10:53:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0da75940-bec5-50e9-9a10-118a2d9af10e with scrape type 2
2026-03-30 10:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0da75940-bec5-50e9-9a10-118a2d9af10e with scrape type 2
2026-03-30 10:53:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0da75940-bec5-50e9-9a10-118a2d9af10e, identifier: KP93453
2026-03-30 10:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ46471> (referer: https://www.auto1.com/v1/car-details-view/MJ46471/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0688b1b3-9855-55d6-82fa-60909e48d4a4 with identifier: FX77489
2026-03-30 10:53:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0688b1b3-9855-55d6-82fa-60909e48d4a4 with identifier: FX77489
2026-03-30 10:53:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0688b1b3-9855-55d6-82fa-60909e48d4a4 with identifier: FX77489 to the API
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:11:33Z',
 'fuel_type': 'hybrid',
 'id': '0688b1b3-9855-55d6-82fa-60909e48d4a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX77489',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 57163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-03',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Prime 4WD',
 'transmission': 'automatic',
 'trim': 'Prime 4WD',
 'year': 2021}
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX77489%27 HTTP/1.1" 200 None
2026-03-30 10:53:11 [auto1.de] INFO: Saving data for FX77489: {'auction_closing_time': 1774969893.0, 'created_time': 1774435435.117804, 'last_price_update_time': 1774867991.269749}
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX77489') HTTP/1.1" 204 0
2026-03-30 10:53:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0da75940-bec5-50e9-9a10-118a2d9af10e with identifier: KP93453
2026-03-30 10:53:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0da75940-bec5-50e9-9a10-118a2d9af10e with identifier: KP93453
2026-03-30 10:53:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0da75940-bec5-50e9-9a10-118a2d9af10e with identifier: KP93453 to the API
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:26:26Z',
 'fuel_type': 'diesel',
 'id': '0da75940-bec5-50e9-9a10-118a2d9af10e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP93453',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 155310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP93453%27 HTTP/1.1" 200 None
2026-03-30 10:53:11 [auto1.de] INFO: Saving data for KP93453: {'auction_closing_time': 1774970786.0, 'created_time': 1774380103.036332, 'last_price_update_time': 1774867991.646746}
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP93453') HTTP/1.1" 204 0
2026-03-30 10:53:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU65226> (referer: https://www.auto1.com/v1/car-details-view/HU65226/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP66630> (referer: https://www.auto1.com/v1/car-details-view/BP66630/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:11 [auto1.de] INFO: Found listing with ID: MG35847
2026-03-30 10:53:11 [auto1.de] INFO: Found listing with ID: GP35592
2026-03-30 10:53:11 [auto1.de] INFO: Found listing with ID: FY18796
2026-03-30 10:53:11 [auto1.de] INFO: Found listing with ID: CC51739
2026-03-30 10:53:11 [auto1.de] INFO: Found listing with ID: KN33134
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN33134%27 HTTP/1.1" 200 None
2026-03-30 10:53:11 [auto1.de] INFO: Scrape type for KN33134: 2
2026-03-30 10:53:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7ead16f-2193-503b-9a5c-d766b365a84d with identifier: KN33134
2026-03-30 10:53:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7ead16f-2193-503b-9a5c-d766b365a84d with scrape type 2
2026-03-30 10:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7ead16f-2193-503b-9a5c-d766b365a84d with scrape type 2
2026-03-30 10:53:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7ead16f-2193-503b-9a5c-d766b365a84d, identifier: KN33134
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_4d94cc60cb7f8ccd8ca605f583e2f91f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_4d94cc60cb7f8ccd8ca605f583e2f91f.jpg not downloaded yet
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_3914df870a04c4f22a972de2e392fb31.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_3914df870a04c4f22a972de2e392fb31.jpg not downloaded yet
2026-03-30 10:53:11 [auto1.de] INFO: Found listing with ID: UN87828
2026-03-30 10:53:11 [auto1.de] INFO: Found listing with ID: KF01282
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF01282%27 HTTP/1.1" 200 None
2026-03-30 10:53:11 [auto1.de] INFO: Scrape type for KF01282: 2
2026-03-30 10:53:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdfbcb40-dafc-5aea-9586-92e8313f1fa6 with identifier: KF01282
2026-03-30 10:53:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdfbcb40-dafc-5aea-9586-92e8313f1fa6 with scrape type 2
2026-03-30 10:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdfbcb40-dafc-5aea-9586-92e8313f1fa6 with scrape type 2
2026-03-30 10:53:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fdfbcb40-dafc-5aea-9586-92e8313f1fa6, identifier: KF01282
2026-03-30 10:53:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_c3ded40873f1c3a67c1d533acc10b0c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7ead16f-2193-503b-9a5c-d766b365a84d with identifier: KN33134
2026-03-30 10:53:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7ead16f-2193-503b-9a5c-d766b365a84d with identifier: KN33134
2026-03-30 10:53:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7ead16f-2193-503b-9a5c-d766b365a84d with identifier: KN33134 to the API
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b7ead16f-2193-503b-9a5c-d766b365a84d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN33134',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 113019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-26',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TFSI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2015}
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN33134%27 HTTP/1.1" 200 None
2026-03-30 10:53:12 [auto1.de] INFO: Saving data for KN33134: {'auction_closing_time': 1774969200.0, 'created_time': 1774294379.722524, 'last_price_update_time': 1774867992.318116}
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN33134') HTTP/1.1" 204 0
2026-03-30 10:53:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fdfbcb40-dafc-5aea-9586-92e8313f1fa6 with identifier: KF01282
2026-03-30 10:53:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fdfbcb40-dafc-5aea-9586-92e8313f1fa6 with identifier: KF01282
2026-03-30 10:53:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fdfbcb40-dafc-5aea-9586-92e8313f1fa6 with identifier: KF01282 to the API
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:05:43Z',
 'fuel_type': 'diesel',
 'id': 'fdfbcb40-dafc-5aea-9586-92e8313f1fa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF01282',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 287571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-21',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 250 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF01282%27 HTTP/1.1" 200 None
2026-03-30 10:53:12 [auto1.de] INFO: Saving data for KF01282: {'auction_closing_time': 1774969543.0, 'created_time': 1773380549.036245, 'last_price_update_time': 1774867992.67082}
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF01282') HTTP/1.1" 204 0
2026-03-30 10:53:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da02af60-e6c0-506e-9ad1-509baffabdb3 with identifier: LD73259
2026-03-30 10:53:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da02af60-e6c0-506e-9ad1-509baffabdb3 with scrape type 1
2026-03-30 10:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da02af60-e6c0-506e-9ad1-509baffabdb3
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c642aec03269bb74e38c8d0cbc31e58%252Fpa%252FLD73259_f8ef53f897337ce1137c9e712dea97a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_f8ef53f897337ce1137c9e712dea97a8.jpg already downloaded
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c642aec03269bb74e38c8d0cbc31e58%252Fpa%252FLD73259_c1f26db31dcd4ba1d034268e90ff942b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_c1f26db31dcd4ba1d034268e90ff942b.jpg already downloaded
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c642aec03269bb74e38c8d0cbc31e58%252Fpa%252FLD73259_8b6e82d093801a8df59a573608134a79.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_8b6e82d093801a8df59a573608134a79.jpg already downloaded
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c642aec03269bb74e38c8d0cbc31e58%252Fpa%252FLD73259_3e3f29d7239fcb43b28857c96a03434c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_3e3f29d7239fcb43b28857c96a03434c.jpg already downloaded
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c642aec03269bb74e38c8d0cbc31e58%252Fpa%252FLD73259_1c0359f5f17fe3cdfe0496e15519e4a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_1c0359f5f17fe3cdfe0496e15519e4a6.jpg already downloaded
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c642aec03269bb74e38c8d0cbc31e58%252Fpa%252FLD73259_78c6810b2dfd72ab4c2f254be225708b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_78c6810b2dfd72ab4c2f254be225708b.jpg already downloaded
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c642aec03269bb74e38c8d0cbc31e58%252Fpa%252FLD73259_9d297d8be5620e355cebca4453c35012.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_9d297d8be5620e355cebca4453c35012.jpg already downloaded
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c642aec03269bb74e38c8d0cbc31e58%252Fpa%252FLD73259_92b5b6175d7cc9936ff41c55b094815f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_92b5b6175d7cc9936ff41c55b094815f.jpg already downloaded
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c642aec03269bb74e38c8d0cbc31e58%252Fpa%252FLD73259_178a902d6bbc79bdd758bf2342767091.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_178a902d6bbc79bdd758bf2342767091.jpg already downloaded
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c642aec03269bb74e38c8d0cbc31e58%252Fpa%252FLD73259_b6a6891f855eebc7743e720b06abce66.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_b6a6891f855eebc7743e720b06abce66.jpg already downloaded
2026-03-30 10:53:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da02af60-e6c0-506e-9ad1-509baffabdb3, identifier: LD73259
2026-03-30 10:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b3190>
2026-03-30 10:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_d8cca2a17a6dfe0660e58ca3f5113e75.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_d8cca2a17a6dfe0660e58ca3f5113e75.jpg saved to cache
2026-03-30 10:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c79f7811-0186-5850-ab21-0ac4af12e20a
2026-03-30 10:53:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d7d3d0>
2026-03-30 10:53:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_ef057a2a4f6c4b70a5c8389224a5da37.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_ef057a2a4f6c4b70a5c8389224a5da37.jpg saved to cache
2026-03-30 10:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00040ae4-3360-50e6-accf-06e7459bcaad
2026-03-30 10:53:13 [auto1.de] INFO: Found listing with ID: BM72660
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM72660%27 HTTP/1.1" 200 None
2026-03-30 10:53:13 [auto1.de] INFO: Scrape type for BM72660: 2
2026-03-30 10:53:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77245f81-6d84-5fda-9899-339021558917 with identifier: BM72660
2026-03-30 10:53:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77245f81-6d84-5fda-9899-339021558917 with scrape type 2
2026-03-30 10:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77245f81-6d84-5fda-9899-339021558917 with scrape type 2
2026-03-30 10:53:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77245f81-6d84-5fda-9899-339021558917, identifier: BM72660
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_1efd322ea2be2cad9d997430f9148083.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_1efd322ea2be2cad9d997430f9148083.jpg not downloaded yet
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_5a61ef6157123e3b073c7d6b0b244133.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_5a61ef6157123e3b073c7d6b0b244133.jpg not downloaded yet
2026-03-30 10:53:13 [auto1.de] INFO: Found listing with ID: XJ37654
2026-03-30 10:53:13 [auto1.de] INFO: Found listing with ID: PU06584
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU06584%27 HTTP/1.1" 200 None
2026-03-30 10:53:13 [auto1.de] INFO: Scrape type for PU06584: 2
2026-03-30 10:53:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e46bea90-5175-5622-996d-6a50cc518907 with identifier: PU06584
2026-03-30 10:53:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e46bea90-5175-5622-996d-6a50cc518907 with scrape type 2
2026-03-30 10:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e46bea90-5175-5622-996d-6a50cc518907 with scrape type 2
2026-03-30 10:53:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e46bea90-5175-5622-996d-6a50cc518907, identifier: PU06584
2026-03-30 10:53:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da02af60-e6c0-506e-9ad1-509baffabdb3 with identifier: LD73259
2026-03-30 10:53:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da02af60-e6c0-506e-9ad1-509baffabdb3 with identifier: LD73259
2026-03-30 10:53:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da02af60-e6c0-506e-9ad1-509baffabdb3 with identifier: LD73259 to the API
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LD73259>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2026-03-31T15:12:13Z',
 'fuel_type': 'petrol',
 'id': 'da02af60-e6c0-506e-9ad1-509baffabdb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD73259',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 20854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_f8ef53f897337ce1137c9e712dea97a8.jpg',
                'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_c1f26db31dcd4ba1d034268e90ff942b.jpg',
                'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_8b6e82d093801a8df59a573608134a79.jpg',
                'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_3e3f29d7239fcb43b28857c96a03434c.jpg',
                'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_1c0359f5f17fe3cdfe0496e15519e4a6.jpg',
                'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_78c6810b2dfd72ab4c2f254be225708b.jpg',
                'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_9d297d8be5620e355cebca4453c35012.jpg',
                'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_92b5b6175d7cc9936ff41c55b094815f.jpg',
                'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_178a902d6bbc79bdd758bf2342767091.jpg',
                'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_b6a6891f855eebc7743e720b06abce66.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da02af60-e6c0-506e-9ad1-509baffabdb3/da02af60-e6c0-506e-9ad1-509baffabdb3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_f8ef53f897337ce1137c9e712dea97a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da02af60-e6c0-506e-9ad1-509baffabdb3/da02af60-e6c0-506e-9ad1-509baffabdb3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2224853,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_c1f26db31dcd4ba1d034268e90ff942b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da02af60-e6c0-506e-9ad1-509baffabdb3/da02af60-e6c0-506e-9ad1-509baffabdb3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_8b6e82d093801a8df59a573608134a79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da02af60-e6c0-506e-9ad1-509baffabdb3/da02af60-e6c0-506e-9ad1-509baffabdb3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2057061,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_3e3f29d7239fcb43b28857c96a03434c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da02af60-e6c0-506e-9ad1-509baffabdb3/da02af60-e6c0-506e-9ad1-509baffabdb3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2607256,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_1c0359f5f17fe3cdfe0496e15519e4a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da02af60-e6c0-506e-9ad1-509baffabdb3/da02af60-e6c0-506e-9ad1-509baffabdb3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_78c6810b2dfd72ab4c2f254be225708b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da02af60-e6c0-506e-9ad1-509baffabdb3/da02af60-e6c0-506e-9ad1-509baffabdb3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_9d297d8be5620e355cebca4453c35012.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da02af60-e6c0-506e-9ad1-509baffabdb3/da02af60-e6c0-506e-9ad1-509baffabdb3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2363371,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_92b5b6175d7cc9936ff41c55b094815f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da02af60-e6c0-506e-9ad1-509baffabdb3/da02af60-e6c0-506e-9ad1-509baffabdb3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2480275,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_178a902d6bbc79bdd758bf2342767091.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da02af60-e6c0-506e-9ad1-509baffabdb3/da02af60-e6c0-506e-9ad1-509baffabdb3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c642aec03269bb74e38c8d0cbc31e58/pa/LD73259_b6a6891f855eebc7743e720b06abce66.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2022}
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD73259%27 HTTP/1.1" 200 None
2026-03-30 10:53:13 [auto1.de] INFO: Saving data for LD73259: {'created_time': 1774867993.637037, 'last_price_update_time': 1774867993.637047, 'auction_closing_time': 1774969933.0}
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD73259') HTTP/1.1" 204 0
2026-03-30 10:53:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_8c726ac0011f34774cd1ce45ef1b962d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77245f81-6d84-5fda-9899-339021558917 with identifier: BM72660
2026-03-30 10:53:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77245f81-6d84-5fda-9899-339021558917 with identifier: BM72660
2026-03-30 10:53:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77245f81-6d84-5fda-9899-339021558917 with identifier: BM72660 to the API
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:17:05Z',
 'fuel_type': 'diesel',
 'id': '77245f81-6d84-5fda-9899-339021558917',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM72660',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 142485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-17',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2017}
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM72660%27 HTTP/1.1" 200 None
2026-03-30 10:53:14 [auto1.de] INFO: Saving data for BM72660: {'auction_closing_time': 1774970225.0, 'created_time': 1774349033.464232, 'last_price_update_time': 1774867994.074911}
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM72660') HTTP/1.1" 204 0
2026-03-30 10:53:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e46bea90-5175-5622-996d-6a50cc518907 with identifier: PU06584
2026-03-30 10:53:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e46bea90-5175-5622-996d-6a50cc518907 with identifier: PU06584
2026-03-30 10:53:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e46bea90-5175-5622-996d-6a50cc518907 with identifier: PU06584 to the API
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:52:36Z',
 'fuel_type': 'petrol',
 'id': 'e46bea90-5175-5622-996d-6a50cc518907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU06584',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 181219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-26',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2011}
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU06584%27 HTTP/1.1" 200 None
2026-03-30 10:53:14 [auto1.de] INFO: Saving data for PU06584: {'auction_closing_time': 1774972356.0, 'created_time': 1774436899.488932, 'last_price_update_time': 1774867994.409919}
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU06584') HTTP/1.1" 204 0
2026-03-30 10:53:14 [auto1.de] INFO: Found listing with ID: HM06155
2026-03-30 10:53:14 [auto1.de] INFO: Found listing with ID: GL23186
2026-03-30 10:53:14 [auto1.de] INFO: Found listing with ID: FU60583
2026-03-30 10:53:14 [auto1.de] INFO: Found listing with ID: SZ82893
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ82893%27 HTTP/1.1" 200 None
2026-03-30 10:53:14 [auto1.de] INFO: Scrape type for SZ82893: 0
2026-03-30 10:53:14 [auto1.de] INFO: Found listing with ID: UR83555
2026-03-30 10:53:14 [auto1.de] INFO: Found listing with ID: JA95391
2026-03-30 10:53:14 [auto1.de] INFO: Found listing with ID: MR13527
2026-03-30 10:53:14 [auto1.de] INFO: Found listing with ID: XG57506
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG57506%27 HTTP/1.1" 200 None
2026-03-30 10:53:14 [auto1.de] INFO: Scrape type for XG57506: 1
2026-03-30 10:53:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c3a0791-e53f-527f-b77e-1bb21c80beda with identifier: MJ46471
2026-03-30 10:53:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c3a0791-e53f-527f-b77e-1bb21c80beda with scrape type 1
2026-03-30 10:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c3a0791-e53f-527f-b77e-1bb21c80beda
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_b3ed8d443e1fcfc967595fb129ed84ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_b3ed8d443e1fcfc967595fb129ed84ba.jpg not downloaded yet
2026-03-30 10:53:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2436a515-55c7-5747-8c1d-68d47eafdcf0 with identifier: HU65226
2026-03-30 10:53:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2436a515-55c7-5747-8c1d-68d47eafdcf0 with scrape type 1
2026-03-30 10:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2436a515-55c7-5747-8c1d-68d47eafdcf0
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_3b677ded85dee20fc0ae50f70d2bdfd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_3b677ded85dee20fc0ae50f70d2bdfd7.jpg not downloaded yet
2026-03-30 10:53:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fee702fc-eb0c-554c-b155-c2dc6d2467bd with identifier: BP66630
2026-03-30 10:53:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fee702fc-eb0c-554c-b155-c2dc6d2467bd with scrape type 1
2026-03-30 10:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fee702fc-eb0c-554c-b155-c2dc6d2467bd
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_325e528a417eaeb8799af5994b507edd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_325e528a417eaeb8799af5994b507edd.jpg not downloaded yet
2026-03-30 10:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef501c190>
2026-03-30 10:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_c3ded40873f1c3a67c1d533acc10b0c4.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_c3ded40873f1c3a67c1d533acc10b0c4.jpg saved to cache
2026-03-30 10:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c79f7811-0186-5850-ab21-0ac4af12e20a
2026-03-30 10:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_376bf29357509c6dd213d2e08ef95fae.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV44074/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG04043> (referer: https://www.auto1.com/v1/car-details-view/SG04043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RS78128> (referer: https://www.auto1.com/v1/car-details-view/RS78128/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:14 [auto1.de] INFO: Found listing with ID: TW00393
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW00393%27 HTTP/1.1" 200 None
2026-03-30 10:53:14 [auto1.de] INFO: Scrape type for TW00393: 2
2026-03-30 10:53:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 994279e4-8000-5618-a909-2e159ff829f8 with identifier: TW00393
2026-03-30 10:53:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 994279e4-8000-5618-a909-2e159ff829f8 with scrape type 2
2026-03-30 10:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 994279e4-8000-5618-a909-2e159ff829f8 with scrape type 2
2026-03-30 10:53:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 994279e4-8000-5618-a909-2e159ff829f8, identifier: TW00393
2026-03-30 10:53:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_a73f6f408141f40f589fcee5ed696912.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_a73f6f408141f40f589fcee5ed696912.jpg not downloaded yet
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_2159bfe5a7fdbeaea91d5b5e4ba72bf5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_2159bfe5a7fdbeaea91d5b5e4ba72bf5.jpg not downloaded yet
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_ac759c2388bac11c1ec964cda981c4d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_ac759c2388bac11c1ec964cda981c4d5.jpg not downloaded yet
2026-03-30 10:53:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c9a210>
2026-03-30 10:53:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_8c726ac0011f34774cd1ce45ef1b962d.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_8c726ac0011f34774cd1ce45ef1b962d.jpg saved to cache
2026-03-30 10:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00040ae4-3360-50e6-accf-06e7459bcaad
2026-03-30 10:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_0bdc6867724d3075175fa34a84c06941.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 994279e4-8000-5618-a909-2e159ff829f8 with identifier: TW00393
2026-03-30 10:53:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 994279e4-8000-5618-a909-2e159ff829f8 with identifier: TW00393
2026-03-30 10:53:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 994279e4-8000-5618-a909-2e159ff829f8 with identifier: TW00393 to the API
2026-03-30 10:53:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:49:31Z',
 'fuel_type': 'diesel',
 'id': '994279e4-8000-5618-a909-2e159ff829f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW00393',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 114678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-12',
 'seller_name': None,
 'title': 'BMW 2er 218d Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2017}
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW00393%27 HTTP/1.1" 200 None
2026-03-30 10:53:15 [auto1.de] INFO: Saving data for TW00393: {'auction_closing_time': 1774972171.0, 'created_time': 1773688627.146537, 'last_price_update_time': 1774867995.448416}
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW00393') HTTP/1.1" 204 0
2026-03-30 10:53:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:15 [auto1.de] INFO: Found listing with ID: RL24974
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL24974%27 HTTP/1.1" 200 None
2026-03-30 10:53:15 [auto1.de] INFO: Scrape type for RL24974: 2
2026-03-30 10:53:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f40655c-a978-58b0-8a6f-a316c75ddc1b with identifier: RL24974
2026-03-30 10:53:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f40655c-a978-58b0-8a6f-a316c75ddc1b with scrape type 2
2026-03-30 10:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f40655c-a978-58b0-8a6f-a316c75ddc1b with scrape type 2
2026-03-30 10:53:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f40655c-a978-58b0-8a6f-a316c75ddc1b, identifier: RL24974
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_05ad9f3fb295c3c15213f2569e30002c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_05ad9f3fb295c3c15213f2569e30002c.jpg not downloaded yet
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_c65095ae15b393007a31ba2c77f2f051.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_c65095ae15b393007a31ba2c77f2f051.jpg not downloaded yet
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_e7d37144f9dae820209916b5d02cdf3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_e7d37144f9dae820209916b5d02cdf3f.jpg not downloaded yet
2026-03-30 10:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_5a61ef6157123e3b073c7d6b0b244133.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f40655c-a978-58b0-8a6f-a316c75ddc1b with identifier: RL24974
2026-03-30 10:53:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f40655c-a978-58b0-8a6f-a316c75ddc1b with identifier: RL24974
2026-03-30 10:53:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f40655c-a978-58b0-8a6f-a316c75ddc1b with identifier: RL24974 to the API
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:43:20Z',
 'fuel_type': 'diesel',
 'id': '8f40655c-a978-58b0-8a6f-a316c75ddc1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL24974',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 405053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-27',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Scout 4x4',
 'transmission': 'manual',
 'trim': 'Scout 4x4',
 'year': 2013}
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL24974%27 HTTP/1.1" 200 None
2026-03-30 10:53:15 [auto1.de] INFO: Saving data for RL24974: {'auction_closing_time': 1774971800.0, 'created_time': 1774463786.14922, 'last_price_update_time': 1774867995.988829}
2026-03-30 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL24974') HTTP/1.1" 204 0
2026-03-30 10:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5980750>
2026-03-30 10:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_376bf29357509c6dd213d2e08ef95fae.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_376bf29357509c6dd213d2e08ef95fae.jpg saved to cache
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c79f7811-0186-5850-ab21-0ac4af12e20a
2026-03-30 10:53:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe62c9fd-6667-5a7a-b5da-f7de9e7986c3 with identifier: SG04043
2026-03-30 10:53:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe62c9fd-6667-5a7a-b5da-f7de9e7986c3 with scrape type 1
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe62c9fd-6667-5a7a-b5da-f7de9e7986c3
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F3d%252F9e3dcb98655caf40b818f51a7d9d8904%252Fpa%252FSG04043_9aed49fee2377114d41c1fa5924cf1e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_9aed49fee2377114d41c1fa5924cf1e1.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F3d%252F9e3dcb98655caf40b818f51a7d9d8904%252Fpa%252FSG04043_9fac2fdf32b9136e461158910ae616cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_9fac2fdf32b9136e461158910ae616cd.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F3d%252F9e3dcb98655caf40b818f51a7d9d8904%252Fpa%252FSG04043_4bf9daea4a3b2e203cc03ca3f01a818a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_4bf9daea4a3b2e203cc03ca3f01a818a.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F3d%252F9e3dcb98655caf40b818f51a7d9d8904%252Fpa%252FSG04043_d4d392d16953b5db35d532aacdb88a4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_d4d392d16953b5db35d532aacdb88a4f.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F3d%252F9e3dcb98655caf40b818f51a7d9d8904%252Fpa%252FSG04043_6a2a06fb6c3de919869746881065cbc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_6a2a06fb6c3de919869746881065cbc4.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F3d%252F9e3dcb98655caf40b818f51a7d9d8904%252Fpa%252FSG04043_a5bca41175124f489317124610a6820e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_a5bca41175124f489317124610a6820e.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F3d%252F9e3dcb98655caf40b818f51a7d9d8904%252Fpa%252FSG04043_dd8c9cbfa5b95252ef5a253230b9df11.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_dd8c9cbfa5b95252ef5a253230b9df11.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F3d%252F9e3dcb98655caf40b818f51a7d9d8904%252Fpa%252FSG04043_3887e4a1aa8eb175cd626fafe07e3f72.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_3887e4a1aa8eb175cd626fafe07e3f72.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F3d%252F9e3dcb98655caf40b818f51a7d9d8904%252Fpa%252FSG04043_1baaf29a605d0cda8796ff2f7c7b89b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_1baaf29a605d0cda8796ff2f7c7b89b9.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F3d%252F9e3dcb98655caf40b818f51a7d9d8904%252Fpa%252FSG04043_41e00dd219cc3e7ebb11387b83528c30.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_41e00dd219cc3e7ebb11387b83528c30.jpg already downloaded
2026-03-30 10:53:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe62c9fd-6667-5a7a-b5da-f7de9e7986c3, identifier: SG04043
2026-03-30 10:53:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f02a21ab-6194-564a-a079-70b7f5ae3ed6 with identifier: RS78128
2026-03-30 10:53:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f02a21ab-6194-564a-a079-70b7f5ae3ed6 with scrape type 1
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f02a21ab-6194-564a-a079-70b7f5ae3ed6
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F34%252F1134e469b2e6f75a4ea8c0858ff8a392%252Fpa%252FRS78128_fe8c1f0de6a0a861fbad613b5388da34.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_fe8c1f0de6a0a861fbad613b5388da34.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F34%252F1134e469b2e6f75a4ea8c0858ff8a392%252Fpa%252FRS78128_5ef8e1a189cc48a4e629c1ccbf9e6404.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_5ef8e1a189cc48a4e629c1ccbf9e6404.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F34%252F1134e469b2e6f75a4ea8c0858ff8a392%252Fpa%252FRS78128_7e1edb876e4df1834889643861dbf17f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_7e1edb876e4df1834889643861dbf17f.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F34%252F1134e469b2e6f75a4ea8c0858ff8a392%252Fpa%252FRS78128_d6e6f5f2f2c9b144ef1e99187ff098b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_d6e6f5f2f2c9b144ef1e99187ff098b8.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F34%252F1134e469b2e6f75a4ea8c0858ff8a392%252Fpa%252FRS78128_50b804a178b03731f14f2fc2f181a3a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_50b804a178b03731f14f2fc2f181a3a7.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F34%252F1134e469b2e6f75a4ea8c0858ff8a392%252Fpa%252FRS78128_968007ad69d632a00ecf8a6db57f2abb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_968007ad69d632a00ecf8a6db57f2abb.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F34%252F1134e469b2e6f75a4ea8c0858ff8a392%252Fpa%252FRS78128_c0e4932fe7e7c7b7ecf3fc4134a7c3c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_c0e4932fe7e7c7b7ecf3fc4134a7c3c1.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F34%252F1134e469b2e6f75a4ea8c0858ff8a392%252Fpa%252FRS78128_9fbf4744b45432706d891d2b34c29cb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_9fbf4744b45432706d891d2b34c29cb3.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F34%252F1134e469b2e6f75a4ea8c0858ff8a392%252Fpa%252FRS78128_cc09812a6d8d5c4c543087ec32182084.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_cc09812a6d8d5c4c543087ec32182084.jpg already downloaded
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F34%252F1134e469b2e6f75a4ea8c0858ff8a392%252Fpa%252FRS78128_e401faf547a49601213b9cef474b6e82.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_e401faf547a49601213b9cef474b6e82.jpg already downloaded
2026-03-30 10:53:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f02a21ab-6194-564a-a079-70b7f5ae3ed6, identifier: RS78128
2026-03-30 10:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_1efd322ea2be2cad9d997430f9148083.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:16 [auto1.de] INFO: Found listing with ID: HU31000
2026-03-30 10:53:16 [auto1.de] INFO: Found listing with ID: GX87864
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX87864%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [auto1.de] INFO: Scrape type for GX87864: 2
2026-03-30 10:53:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1207be13-4a66-5a71-a04c-79eb8a0beb84 with identifier: GX87864
2026-03-30 10:53:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1207be13-4a66-5a71-a04c-79eb8a0beb84 with scrape type 2
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1207be13-4a66-5a71-a04c-79eb8a0beb84 with scrape type 2
2026-03-30 10:53:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1207be13-4a66-5a71-a04c-79eb8a0beb84, identifier: GX87864
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_04bcb4642a857846395bf41258bc7b0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_04bcb4642a857846395bf41258bc7b0a.jpg not downloaded yet
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_1554ff5024f2c03c657094fb5501b9e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_1554ff5024f2c03c657094fb5501b9e7.jpg not downloaded yet
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_ae4476ce827f66122acb4398f3bc13d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_ae4476ce827f66122acb4398f3bc13d1.jpg not downloaded yet
2026-03-30 10:53:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe62c9fd-6667-5a7a-b5da-f7de9e7986c3 with identifier: SG04043
2026-03-30 10:53:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe62c9fd-6667-5a7a-b5da-f7de9e7986c3 with identifier: SG04043
2026-03-30 10:53:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe62c9fd-6667-5a7a-b5da-f7de9e7986c3 with identifier: SG04043 to the API
2026-03-30 10:53:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SG04043>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:40:14Z',
 'fuel_type': 'diesel',
 'id': 'fe62c9fd-6667-5a7a-b5da-f7de9e7986c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG04043',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 95888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_9aed49fee2377114d41c1fa5924cf1e1.jpg',
                'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_9fac2fdf32b9136e461158910ae616cd.jpg',
                'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_4bf9daea4a3b2e203cc03ca3f01a818a.jpg',
                'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_d4d392d16953b5db35d532aacdb88a4f.jpg',
                'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_6a2a06fb6c3de919869746881065cbc4.jpg',
                'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_a5bca41175124f489317124610a6820e.jpg',
                'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_dd8c9cbfa5b95252ef5a253230b9df11.jpg',
                'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_3887e4a1aa8eb175cd626fafe07e3f72.jpg',
                'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_1baaf29a605d0cda8796ff2f7c7b89b9.jpg',
                'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_41e00dd219cc3e7ebb11387b83528c30.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe62c9fd-6667-5a7a-b5da-f7de9e7986c3/fe62c9fd-6667-5a7a-b5da-f7de9e7986c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_9aed49fee2377114d41c1fa5924cf1e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe62c9fd-6667-5a7a-b5da-f7de9e7986c3/fe62c9fd-6667-5a7a-b5da-f7de9e7986c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2648371,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_9fac2fdf32b9136e461158910ae616cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe62c9fd-6667-5a7a-b5da-f7de9e7986c3/fe62c9fd-6667-5a7a-b5da-f7de9e7986c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2435931,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_4bf9daea4a3b2e203cc03ca3f01a818a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe62c9fd-6667-5a7a-b5da-f7de9e7986c3/fe62c9fd-6667-5a7a-b5da-f7de9e7986c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2399377,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_d4d392d16953b5db35d532aacdb88a4f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe62c9fd-6667-5a7a-b5da-f7de9e7986c3/fe62c9fd-6667-5a7a-b5da-f7de9e7986c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2599279,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_6a2a06fb6c3de919869746881065cbc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe62c9fd-6667-5a7a-b5da-f7de9e7986c3/fe62c9fd-6667-5a7a-b5da-f7de9e7986c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2473087,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_a5bca41175124f489317124610a6820e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe62c9fd-6667-5a7a-b5da-f7de9e7986c3/fe62c9fd-6667-5a7a-b5da-f7de9e7986c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_dd8c9cbfa5b95252ef5a253230b9df11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe62c9fd-6667-5a7a-b5da-f7de9e7986c3/fe62c9fd-6667-5a7a-b5da-f7de9e7986c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2434898,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_3887e4a1aa8eb175cd626fafe07e3f72.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe62c9fd-6667-5a7a-b5da-f7de9e7986c3/fe62c9fd-6667-5a7a-b5da-f7de9e7986c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2535577,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_1baaf29a605d0cda8796ff2f7c7b89b9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe62c9fd-6667-5a7a-b5da-f7de9e7986c3/fe62c9fd-6667-5a7a-b5da-f7de9e7986c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2957490,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/3d/9e3dcb98655caf40b818f51a7d9d8904/pa/SG04043_41e00dd219cc3e7ebb11387b83528c30.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Combo Life 1.5 CDTI INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2019}
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG04043%27 HTTP/1.1" 200 None
2026-03-30 10:53:17 [auto1.de] INFO: Saving data for SG04043: {'created_time': 1774867997.182226, 'last_price_update_time': 1774867997.182236, 'auction_closing_time': 1774971614.0}
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG04043') HTTP/1.1" 204 0
2026-03-30 10:53:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f02a21ab-6194-564a-a079-70b7f5ae3ed6 with identifier: RS78128
2026-03-30 10:53:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f02a21ab-6194-564a-a079-70b7f5ae3ed6 with identifier: RS78128
2026-03-30 10:53:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f02a21ab-6194-564a-a079-70b7f5ae3ed6 with identifier: RS78128 to the API
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RS78128>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:42:15Z',
 'fuel_type': 'petrol',
 'id': 'f02a21ab-6194-564a-a079-70b7f5ae3ed6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS78128',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 29336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_fe8c1f0de6a0a861fbad613b5388da34.jpg',
                'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_5ef8e1a189cc48a4e629c1ccbf9e6404.jpg',
                'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_7e1edb876e4df1834889643861dbf17f.jpg',
                'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_d6e6f5f2f2c9b144ef1e99187ff098b8.jpg',
                'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_50b804a178b03731f14f2fc2f181a3a7.jpg',
                'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_968007ad69d632a00ecf8a6db57f2abb.jpg',
                'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_c0e4932fe7e7c7b7ecf3fc4134a7c3c1.jpg',
                'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_9fbf4744b45432706d891d2b34c29cb3.jpg',
                'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_cc09812a6d8d5c4c543087ec32182084.jpg',
                'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_e401faf547a49601213b9cef474b6e82.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02a21ab-6194-564a-a079-70b7f5ae3ed6/f02a21ab-6194-564a-a079-70b7f5ae3ed6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_fe8c1f0de6a0a861fbad613b5388da34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02a21ab-6194-564a-a079-70b7f5ae3ed6/f02a21ab-6194-564a-a079-70b7f5ae3ed6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_5ef8e1a189cc48a4e629c1ccbf9e6404.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02a21ab-6194-564a-a079-70b7f5ae3ed6/f02a21ab-6194-564a-a079-70b7f5ae3ed6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_7e1edb876e4df1834889643861dbf17f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02a21ab-6194-564a-a079-70b7f5ae3ed6/f02a21ab-6194-564a-a079-70b7f5ae3ed6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_d6e6f5f2f2c9b144ef1e99187ff098b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02a21ab-6194-564a-a079-70b7f5ae3ed6/f02a21ab-6194-564a-a079-70b7f5ae3ed6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_50b804a178b03731f14f2fc2f181a3a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02a21ab-6194-564a-a079-70b7f5ae3ed6/f02a21ab-6194-564a-a079-70b7f5ae3ed6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_968007ad69d632a00ecf8a6db57f2abb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02a21ab-6194-564a-a079-70b7f5ae3ed6/f02a21ab-6194-564a-a079-70b7f5ae3ed6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_c0e4932fe7e7c7b7ecf3fc4134a7c3c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02a21ab-6194-564a-a079-70b7f5ae3ed6/f02a21ab-6194-564a-a079-70b7f5ae3ed6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_9fbf4744b45432706d891d2b34c29cb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02a21ab-6194-564a-a079-70b7f5ae3ed6/f02a21ab-6194-564a-a079-70b7f5ae3ed6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_cc09812a6d8d5c4c543087ec32182084.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02a21ab-6194-564a-a079-70b7f5ae3ed6/f02a21ab-6194-564a-a079-70b7f5ae3ed6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/34/1134e469b2e6f75a4ea8c0858ff8a392/pa/RS78128_e401faf547a49601213b9cef474b6e82.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 TGDI GT",
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2024}
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS78128%27 HTTP/1.1" 200 None
2026-03-30 10:53:17 [auto1.de] INFO: Saving data for RS78128: {'created_time': 1774867997.652254, 'last_price_update_time': 1774867997.652264, 'auction_closing_time': 1774971735.0}
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS78128') HTTP/1.1" 204 0
2026-03-30 10:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_325e528a417eaeb8799af5994b507edd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_3b677ded85dee20fc0ae50f70d2bdfd7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1207be13-4a66-5a71-a04c-79eb8a0beb84 with identifier: GX87864
2026-03-30 10:53:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1207be13-4a66-5a71-a04c-79eb8a0beb84 with identifier: GX87864
2026-03-30 10:53:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1207be13-4a66-5a71-a04c-79eb8a0beb84 with identifier: GX87864 to the API
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:50:31Z',
 'fuel_type': 'diesel',
 'id': '1207be13-4a66-5a71-a04c-79eb8a0beb84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX87864',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 251028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-31',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI S line Sportpaket',
 'transmission': 'manual',
 'trim': 'S line Sportpaket',
 'year': 2015}
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX87864%27 HTTP/1.1" 200 None
2026-03-30 10:53:17 [auto1.de] INFO: Saving data for GX87864: {'auction_closing_time': 1774972231.0, 'created_time': 1774377343.416236, 'last_price_update_time': 1774867997.980656}
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX87864') HTTP/1.1" 204 0
2026-03-30 10:53:18 [auto1.de] INFO: Found listing with ID: SC34211
2026-03-30 10:53:18 [auto1.de] INFO: Found listing with ID: AL34825
2026-03-30 10:53:18 [auto1.de] INFO: Found listing with ID: TB55378
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB55378%27 HTTP/1.1" 200 None
2026-03-30 10:53:18 [auto1.de] INFO: Scrape type for TB55378: 2
2026-03-30 10:53:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 243af1e6-8798-5104-9c98-7f9d38027d03 with identifier: TB55378
2026-03-30 10:53:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 243af1e6-8798-5104-9c98-7f9d38027d03 with scrape type 2
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 243af1e6-8798-5104-9c98-7f9d38027d03 with scrape type 2
2026-03-30 10:53:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 243af1e6-8798-5104-9c98-7f9d38027d03, identifier: TB55378
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_a01e82234525f34a12ee46eb75293f55.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_a01e82234525f34a12ee46eb75293f55.jpg not downloaded yet
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_e3ecef73b3966e14d73c9c4a8d9691f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_e3ecef73b3966e14d73c9c4a8d9691f7.jpg not downloaded yet
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_5fc7c588d1d46581c31f567cb1432856.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_5fc7c588d1d46581c31f567cb1432856.jpg not downloaded yet
2026-03-30 10:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA24351> (referer: https://www.auto1.com/v1/car-details-view/DA24351/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f03990>
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_0bdc6867724d3075175fa34a84c06941.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_0bdc6867724d3075175fa34a84c06941.jpg saved to cache
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00040ae4-3360-50e6-accf-06e7459bcaad
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d9a210>
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_5a61ef6157123e3b073c7d6b0b244133.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_5a61ef6157123e3b073c7d6b0b244133.jpg saved to cache
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c79f7811-0186-5850-ab21-0ac4af12e20a
2026-03-30 10:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_ac759c2388bac11c1ec964cda981c4d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_b3ed8d443e1fcfc967595fb129ed84ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 243af1e6-8798-5104-9c98-7f9d38027d03 with identifier: TB55378
2026-03-30 10:53:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 243af1e6-8798-5104-9c98-7f9d38027d03 with identifier: TB55378
2026-03-30 10:53:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 243af1e6-8798-5104-9c98-7f9d38027d03 with identifier: TB55378 to the API
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:44:43Z',
 'fuel_type': 'diesel',
 'id': '243af1e6-8798-5104-9c98-7f9d38027d03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB55378',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 193088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-01',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB55378%27 HTTP/1.1" 200 None
2026-03-30 10:53:18 [auto1.de] INFO: Saving data for TB55378: {'auction_closing_time': 1774971883.0, 'created_time': 1773381112.328799, 'last_price_update_time': 1774867998.612098}
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB55378') HTTP/1.1" 204 0
2026-03-30 10:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LC32113/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:18 [auto1.de] INFO: Found listing with ID: EA46191
2026-03-30 10:53:18 [auto1.de] INFO: Found listing with ID: YV13376
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV13376%27 HTTP/1.1" 200 None
2026-03-30 10:53:18 [auto1.de] INFO: Scrape type for YV13376: 2
2026-03-30 10:53:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7036f6b9-706f-5185-b65f-e60c1790cf2d with identifier: YV13376
2026-03-30 10:53:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7036f6b9-706f-5185-b65f-e60c1790cf2d with scrape type 2
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7036f6b9-706f-5185-b65f-e60c1790cf2d with scrape type 2
2026-03-30 10:53:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7036f6b9-706f-5185-b65f-e60c1790cf2d, identifier: YV13376
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_e9c87b99abf27dcab4b3739de534f0d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_e9c87b99abf27dcab4b3739de534f0d0.jpg not downloaded yet
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_d37e004b1b4f7015051aa6859196f524.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_d37e004b1b4f7015051aa6859196f524.jpg not downloaded yet
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_3c5e839cba9c06448d414e11f8d79719.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_3c5e839cba9c06448d414e11f8d79719.jpg not downloaded yet
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7d1a5d0>
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_1efd322ea2be2cad9d997430f9148083.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_1efd322ea2be2cad9d997430f9148083.jpg saved to cache
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00040ae4-3360-50e6-accf-06e7459bcaad
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef78494d0>
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_325e528a417eaeb8799af5994b507edd.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_325e528a417eaeb8799af5994b507edd.jpg saved to cache
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fee702fc-eb0c-554c-b155-c2dc6d2467bd
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a96a10>
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_3b677ded85dee20fc0ae50f70d2bdfd7.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_3b677ded85dee20fc0ae50f70d2bdfd7.jpg saved to cache
2026-03-30 10:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2436a515-55c7-5747-8c1d-68d47eafdcf0
2026-03-30 10:53:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_e7d37144f9dae820209916b5d02cdf3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7036f6b9-706f-5185-b65f-e60c1790cf2d with identifier: YV13376
2026-03-30 10:53:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7036f6b9-706f-5185-b65f-e60c1790cf2d with identifier: YV13376
2026-03-30 10:53:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7036f6b9-706f-5185-b65f-e60c1790cf2d with identifier: YV13376 to the API
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:21:00Z',
 'fuel_type': 'diesel',
 'id': '7036f6b9-706f-5185-b65f-e60c1790cf2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV13376',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 132551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-23',
 'seller_name': None,
 'title': 'BMW 3er 316d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2016}
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV13376%27 HTTP/1.1" 200 None
2026-03-30 10:53:19 [auto1.de] INFO: Saving data for YV13376: {'auction_closing_time': 1774970460.0, 'created_time': 1773341787.208863, 'last_price_update_time': 1774867999.292568}
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV13376') HTTP/1.1" 204 0
2026-03-30 10:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_1554ff5024f2c03c657094fb5501b9e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_ae4476ce827f66122acb4398f3bc13d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:19 [auto1.de] INFO: Found listing with ID: PE88762
2026-03-30 10:53:19 [auto1.de] INFO: Found listing with ID: CP40147
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP40147%27 HTTP/1.1" 200 None
2026-03-30 10:53:19 [auto1.de] INFO: Scrape type for CP40147: 2
2026-03-30 10:53:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d16a1009-e7aa-50bb-9518-d5452b03e7c3 with identifier: CP40147
2026-03-30 10:53:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d16a1009-e7aa-50bb-9518-d5452b03e7c3 with scrape type 2
2026-03-30 10:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d16a1009-e7aa-50bb-9518-d5452b03e7c3 with scrape type 2
2026-03-30 10:53:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d16a1009-e7aa-50bb-9518-d5452b03e7c3, identifier: CP40147
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_da6b1481736fe7f69e38176929b66e06.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_da6b1481736fe7f69e38176929b66e06.jpg not downloaded yet
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_963153256e8caa3232243827c3c596d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_963153256e8caa3232243827c3c596d3.jpg not downloaded yet
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_a705d2037b0031223c150c22c042c640.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_a705d2037b0031223c150c22c042c640.jpg not downloaded yet
2026-03-30 10:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW73821> (referer: https://www.auto1.com/v1/car-details-view/SW73821/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_975bfa43ad7cb8f195b9d107afb1f66d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_04bcb4642a857846395bf41258bc7b0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d16a1009-e7aa-50bb-9518-d5452b03e7c3 with identifier: CP40147
2026-03-30 10:53:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d16a1009-e7aa-50bb-9518-d5452b03e7c3 with identifier: CP40147
2026-03-30 10:53:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d16a1009-e7aa-50bb-9518-d5452b03e7c3 with identifier: CP40147 to the API
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:08:02Z',
 'fuel_type': 'diesel',
 'id': 'd16a1009-e7aa-50bb-9518-d5452b03e7c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP40147',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 205404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-17',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP40147%27 HTTP/1.1" 200 None
2026-03-30 10:53:19 [auto1.de] INFO: Saving data for CP40147: {'auction_closing_time': 1774969682.0, 'created_time': 1773428217.086048, 'last_price_update_time': 1774867999.952908}
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP40147') HTTP/1.1" 204 0
2026-03-30 10:53:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69bde426-cb42-5090-87e1-7a86efa78db7 with identifier: DA24351
2026-03-30 10:53:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69bde426-cb42-5090-87e1-7a86efa78db7 with scrape type 1
2026-03-30 10:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 69bde426-cb42-5090-87e1-7a86efa78db7
2026-03-30 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F0d%252F770d517f97f85c6a99a35b7f0c8a4230%252Fpa%252FDA24351_0656094fa0fa7f237b2da4a71f984bde.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_0656094fa0fa7f237b2da4a71f984bde.jpg not downloaded yet
2026-03-30 10:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5020590>
2026-03-30 10:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_ac759c2388bac11c1ec964cda981c4d5.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_ac759c2388bac11c1ec964cda981c4d5.jpg saved to cache
2026-03-30 10:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fee702fc-eb0c-554c-b155-c2dc6d2467bd
2026-03-30 10:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e7a990>
2026-03-30 10:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_b3ed8d443e1fcfc967595fb129ed84ba.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_b3ed8d443e1fcfc967595fb129ed84ba.jpg saved to cache
2026-03-30 10:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c3a0791-e53f-527f-b77e-1bb21c80beda
2026-03-30 10:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_bb9e0dec5cf29350b04c0dd0fd18cda6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:20 [auto1.de] INFO: Found listing with ID: YR22562
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR22562%27 HTTP/1.1" 200 None
2026-03-30 10:53:20 [auto1.de] INFO: Scrape type for YR22562: 2
2026-03-30 10:53:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3158c12c-91ed-5e31-8dc9-0d45acf63887 with identifier: YR22562
2026-03-30 10:53:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3158c12c-91ed-5e31-8dc9-0d45acf63887 with scrape type 2
2026-03-30 10:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3158c12c-91ed-5e31-8dc9-0d45acf63887 with scrape type 2
2026-03-30 10:53:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3158c12c-91ed-5e31-8dc9-0d45acf63887, identifier: YR22562
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_bf9fe9529b6a61941b0965c147a007af.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_bf9fe9529b6a61941b0965c147a007af.jpg not downloaded yet
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_ae85861d7563e1c73af7c6111f2376f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_ae85861d7563e1c73af7c6111f2376f3.jpg not downloaded yet
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_1edf94b3ef9e0a02bdb797c46c401e8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_1edf94b3ef9e0a02bdb797c46c401e8d.jpg not downloaded yet
2026-03-30 10:53:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3158c12c-91ed-5e31-8dc9-0d45acf63887 with identifier: YR22562
2026-03-30 10:53:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3158c12c-91ed-5e31-8dc9-0d45acf63887 with identifier: YR22562
2026-03-30 10:53:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3158c12c-91ed-5e31-8dc9-0d45acf63887 with identifier: YR22562 to the API
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:16:43Z',
 'fuel_type': 'diesel',
 'id': '3158c12c-91ed-5e31-8dc9-0d45acf63887',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR22562',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 173026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-05',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion',
 'year': 2015}
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR22562%27 HTTP/1.1" 200 None
2026-03-30 10:53:20 [auto1.de] INFO: Saving data for YR22562: {'auction_closing_time': 1774970203.0, 'created_time': 1773132280.336357, 'last_price_update_time': 1774868000.721039}
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR22562') HTTP/1.1" 204 0
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F0d%252F770d517f97f85c6a99a35b7f0c8a4230%252Fpa%252FDA24351_52b5b61af9be5f41a2ac0d30ea948a78.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_52b5b61af9be5f41a2ac0d30ea948a78.jpg not downloaded yet
2026-03-30 10:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_c65095ae15b393007a31ba2c77f2f051.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:20 [auto1.de] INFO: Found listing with ID: YT76473
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT76473%27 HTTP/1.1" 200 None
2026-03-30 10:53:20 [auto1.de] INFO: Scrape type for YT76473: 2
2026-03-30 10:53:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34c32623-0828-5aec-b015-2677c6ac0197 with identifier: YT76473
2026-03-30 10:53:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34c32623-0828-5aec-b015-2677c6ac0197 with scrape type 2
2026-03-30 10:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34c32623-0828-5aec-b015-2677c6ac0197 with scrape type 2
2026-03-30 10:53:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34c32623-0828-5aec-b015-2677c6ac0197, identifier: YT76473
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_944afbbc349fb5ca6516d3575c6ef87f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_944afbbc349fb5ca6516d3575c6ef87f.jpg not downloaded yet
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_6b35aaee1c4400087a227f290adc51a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_6b35aaee1c4400087a227f290adc51a9.jpg not downloaded yet
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_c5fa761a1c01384bdf8fcf23126831f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_c5fa761a1c01384bdf8fcf23126831f8.jpg not downloaded yet
2026-03-30 10:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD05197> (referer: https://www.auto1.com/v1/car-details-view/UD05197/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP11097> (referer: https://www.auto1.com/v1/car-details-view/BP11097/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e74350>
2026-03-30 10:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_e7d37144f9dae820209916b5d02cdf3f.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_e7d37144f9dae820209916b5d02cdf3f.jpg saved to cache
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fee702fc-eb0c-554c-b155-c2dc6d2467bd
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee3c10>
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_1554ff5024f2c03c657094fb5501b9e7.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_1554ff5024f2c03c657094fb5501b9e7.jpg saved to cache
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2436a515-55c7-5747-8c1d-68d47eafdcf0
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5010ed0>
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_ae4476ce827f66122acb4398f3bc13d1.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_ae4476ce827f66122acb4398f3bc13d1.jpg saved to cache
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fee702fc-eb0c-554c-b155-c2dc6d2467bd
2026-03-30 10:53:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce with identifier: SW73821
2026-03-30 10:53:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce with scrape type 1
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_1bb89509edd657804b71794262dfc667.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_1bb89509edd657804b71794262dfc667.jpg not downloaded yet
2026-03-30 10:53:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c9d190>
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_975bfa43ad7cb8f195b9d107afb1f66d.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_975bfa43ad7cb8f195b9d107afb1f66d.jpg saved to cache
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2e6e57b-81cd-50ba-88c6-2592c4bb6495
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e0b850>
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_04bcb4642a857846395bf41258bc7b0a.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_04bcb4642a857846395bf41258bc7b0a.jpg saved to cache
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c3a0791-e53f-527f-b77e-1bb21c80beda
2026-03-30 10:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_e3ecef73b3966e14d73c9c4a8d9691f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_5fc7c588d1d46581c31f567cb1432856.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34c32623-0828-5aec-b015-2677c6ac0197 with identifier: YT76473
2026-03-30 10:53:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34c32623-0828-5aec-b015-2677c6ac0197 with identifier: YT76473
2026-03-30 10:53:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34c32623-0828-5aec-b015-2677c6ac0197 with identifier: YT76473 to the API
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:59:30Z',
 'fuel_type': 'diesel',
 'id': '34c32623-0828-5aec-b015-2677c6ac0197',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT76473',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 205356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2018}
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT76473%27 HTTP/1.1" 200 None
2026-03-30 10:53:21 [auto1.de] INFO: Saving data for YT76473: {'auction_closing_time': 1774972770.0, 'created_time': 1774351285.375232, 'last_price_update_time': 1774868001.743643}
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT76473') HTTP/1.1" 204 0
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F0d%252F770d517f97f85c6a99a35b7f0c8a4230%252Fpa%252FDA24351_cacfdbd7eb96d2cbabf8330e74e09f24.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_cacfdbd7eb96d2cbabf8330e74e09f24.jpg not downloaded yet
2026-03-30 10:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XG57506/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_d37e004b1b4f7015051aa6859196f524.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:21 [auto1.de] INFO: Found listing with ID: NZ33655
2026-03-30 10:53:21 [auto1.de] INFO: Found listing with ID: UV04779
2026-03-30 10:53:21 [auto1.de] INFO: Found listing with ID: FD94929
2026-03-30 10:53:21 [auto1.de] INFO: Found listing with ID: KK41609
2026-03-30 10:53:21 [auto1.de] INFO: Found listing with ID: HU48157
2026-03-30 10:53:21 [auto1.de] INFO: Found listing with ID: ZE90872
2026-03-30 10:53:21 [auto1.de] INFO: Found listing with ID: BK48500
2026-03-30 10:53:21 [auto1.de] INFO: Found listing with ID: AT18561
2026-03-30 10:53:21 [auto1.de] INFO: Found listing with ID: UV49850
2026-03-30 10:53:21 [auto1.de] INFO: Found listing with ID: AX09860
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_0ada83e91fa21a061018dc102b1aaf6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_0ada83e91fa21a061018dc102b1aaf6a.jpg not downloaded yet
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_6e2d334242ba939797875c88fb5bb74c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_6e2d334242ba939797875c88fb5bb74c.jpg not downloaded yet
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_0350a64a7d9b628faa0338a9d14bc667.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_0350a64a7d9b628faa0338a9d14bc667.jpg not downloaded yet
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_4000a7721faae9ddacc0c4c3358fa21d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_4000a7721faae9ddacc0c4c3358fa21d.jpg not downloaded yet
2026-03-30 10:53:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ca96d0>
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F29%252F7a29ec271cf2dcaaf403b224b9a08d86%252Fpa%252FMD89807_bb9e0dec5cf29350b04c0dd0fd18cda6.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_bb9e0dec5cf29350b04c0dd0fd18cda6.jpg saved to cache
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2e6e57b-81cd-50ba-88c6-2592c4bb6495
2026-03-30 10:53:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2e6e57b-81cd-50ba-88c6-2592c4bb6495, skipping ID generation
2026-03-30 10:53:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2e6e57b-81cd-50ba-88c6-2592c4bb6495 with scrape type 1
2026-03-30 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2e6e57b-81cd-50ba-88c6-2592c4bb6495 sending to next pipeline
2026-03-30 10:53:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2e6e57b-81cd-50ba-88c6-2592c4bb6495, identifier: MD89807
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F0d%252F770d517f97f85c6a99a35b7f0c8a4230%252Fpa%252FDA24351_584e400c593960e4ef9a889f2d8eff64.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_584e400c593960e4ef9a889f2d8eff64.jpg not downloaded yet
2026-03-30 10:53:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2e6e57b-81cd-50ba-88c6-2592c4bb6495 with identifier: MD89807
2026-03-30 10:53:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2e6e57b-81cd-50ba-88c6-2592c4bb6495 with identifier: MD89807
2026-03-30 10:53:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2e6e57b-81cd-50ba-88c6-2592c4bb6495 with identifier: MD89807 to the API
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_bb9e0dec5cf29350b04c0dd0fd18cda6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:44:45Z',
 'fuel_type': 'petrol',
 'id': 'd2e6e57b-81cd-50ba-88c6-2592c4bb6495',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD89807',
 'listing': 'auction',
 'location': 'DE, Greifswald',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 112491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_40463c3ef266890055b3b8ce28b41a54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_41f01fb3b2324cccbe24c0ec0bdade1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3178194,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_bb9e0dec5cf29350b04c0dd0fd18cda6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3190139,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_975bfa43ad7cb8f195b9d107afb1f66d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_bb7556e783eb27b95a56d1420c40ce91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3356805,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_f141c02db8fb7e860ede092f6b7317f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_c7cf2d4ce9879bd36a384915dc3cae76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3282265,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_8702b657ca10d1f221eb10780719166b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55474,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_ac8fdc480d40ad892838698c1a728d4b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e6e57b-81cd-50ba-88c6-2592c4bb6495/d2e6e57b-81cd-50ba-88c6-2592c4bb6495_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3201747,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/29/7a29ec271cf2dcaaf403b224b9a08d86/pa/MD89807_ed78ea7edde0f8dbd26cb2b656984b71.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2014}
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD89807%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [auto1.de] INFO: Saving data for MD89807: {'created_time': 1774868002.477477, 'last_price_update_time': 1774868002.477488, 'auction_closing_time': 1774971885.0}
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD89807') HTTP/1.1" 204 0
2026-03-30 10:53:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4caa710>
2026-03-30 10:53:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_c65095ae15b393007a31ba2c77f2f051.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_c65095ae15b393007a31ba2c77f2f051.jpg saved to cache
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2436a515-55c7-5747-8c1d-68d47eafdcf0
2026-03-30 10:53:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64d397af-c207-5873-b78a-15599920361f with identifier: UD05197
2026-03-30 10:53:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64d397af-c207-5873-b78a-15599920361f with scrape type 1
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64d397af-c207-5873-b78a-15599920361f
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_a30a602a80dd955a9e2eb0b9ff18895d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_a30a602a80dd955a9e2eb0b9ff18895d.jpg not downloaded yet
2026-03-30 10:53:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37a4b06e-861b-5465-8667-5117e32733e4 with identifier: BP11097
2026-03-30 10:53:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37a4b06e-861b-5465-8667-5117e32733e4 with scrape type 1
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37a4b06e-861b-5465-8667-5117e32733e4
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F01%252F7201e22dcb8f380ed2f29a9700016b05%252Fpa%252FBP11097_c7b97f48c7a90d051762dd8717ef949c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_c7b97f48c7a90d051762dd8717ef949c.jpg already downloaded
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F01%252F7201e22dcb8f380ed2f29a9700016b05%252Fpa%252FBP11097_eaa5263dc6315ceed2ab3fd467f0a313.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_eaa5263dc6315ceed2ab3fd467f0a313.jpg already downloaded
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F01%252F7201e22dcb8f380ed2f29a9700016b05%252Fpa%252FBP11097_8e0d4dddb3e61057daed18064bd5739b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_8e0d4dddb3e61057daed18064bd5739b.jpg already downloaded
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F01%252F7201e22dcb8f380ed2f29a9700016b05%252Fpa%252FBP11097_b011bfb7f15800abeb23a98fae54693b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_b011bfb7f15800abeb23a98fae54693b.jpg already downloaded
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F01%252F7201e22dcb8f380ed2f29a9700016b05%252Fpa%252FBP11097_d3526b433839b910c19eb38bc389af27.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_d3526b433839b910c19eb38bc389af27.jpg already downloaded
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F01%252F7201e22dcb8f380ed2f29a9700016b05%252Fpa%252FBP11097_65899a1206445fd007f2790780330b1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_65899a1206445fd007f2790780330b1e.jpg already downloaded
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F01%252F7201e22dcb8f380ed2f29a9700016b05%252Fpa%252FBP11097_2fa63952286f9b254d056b202d7a22c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_2fa63952286f9b254d056b202d7a22c2.jpg already downloaded
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F01%252F7201e22dcb8f380ed2f29a9700016b05%252Fpa%252FBP11097_3551ddbe84b4a51432081a3a9490fc2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_3551ddbe84b4a51432081a3a9490fc2d.jpg already downloaded
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F01%252F7201e22dcb8f380ed2f29a9700016b05%252Fpa%252FBP11097_22cc3a14803c296e2b048e252057d863.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_22cc3a14803c296e2b048e252057d863.jpg already downloaded
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F01%252F7201e22dcb8f380ed2f29a9700016b05%252Fpa%252FBP11097_71d0c9d8250337eafc5a8c346b9f9b01.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_71d0c9d8250337eafc5a8c346b9f9b01.jpg already downloaded
2026-03-30 10:53:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37a4b06e-861b-5465-8667-5117e32733e4, identifier: BP11097
2026-03-30 10:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_a01e82234525f34a12ee46eb75293f55.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_7c43d9f6deb3da48f374022c93a6f41c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_7c43d9f6deb3da48f374022c93a6f41c.jpg not downloaded yet
2026-03-30 10:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV44074> (referer: https://www.auto1.com/v1/car-details-view/GV44074/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37a4b06e-861b-5465-8667-5117e32733e4 with identifier: BP11097
2026-03-30 10:53:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37a4b06e-861b-5465-8667-5117e32733e4 with identifier: BP11097
2026-03-30 10:53:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37a4b06e-861b-5465-8667-5117e32733e4 with identifier: BP11097 to the API
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BP11097>
{'auction_title': '',
 'c_o_2_emission_value': 56,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 367,
 'expiration_date': '2026-03-31T15:00:30Z',
 'fuel_type': 'hybrid',
 'id': '37a4b06e-861b-5465-8667-5117e32733e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP11097',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 142562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_c7b97f48c7a90d051762dd8717ef949c.jpg',
                'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_eaa5263dc6315ceed2ab3fd467f0a313.jpg',
                'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_8e0d4dddb3e61057daed18064bd5739b.jpg',
                'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_b011bfb7f15800abeb23a98fae54693b.jpg',
                'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_d3526b433839b910c19eb38bc389af27.jpg',
                'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_65899a1206445fd007f2790780330b1e.jpg',
                'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_2fa63952286f9b254d056b202d7a22c2.jpg',
                'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_3551ddbe84b4a51432081a3a9490fc2d.jpg',
                'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_22cc3a14803c296e2b048e252057d863.jpg',
                'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_71d0c9d8250337eafc5a8c346b9f9b01.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a4b06e-861b-5465-8667-5117e32733e4/37a4b06e-861b-5465-8667-5117e32733e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_c7b97f48c7a90d051762dd8717ef949c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a4b06e-861b-5465-8667-5117e32733e4/37a4b06e-861b-5465-8667-5117e32733e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_eaa5263dc6315ceed2ab3fd467f0a313.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a4b06e-861b-5465-8667-5117e32733e4/37a4b06e-861b-5465-8667-5117e32733e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_8e0d4dddb3e61057daed18064bd5739b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a4b06e-861b-5465-8667-5117e32733e4/37a4b06e-861b-5465-8667-5117e32733e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2913530,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_b011bfb7f15800abeb23a98fae54693b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a4b06e-861b-5465-8667-5117e32733e4/37a4b06e-861b-5465-8667-5117e32733e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_d3526b433839b910c19eb38bc389af27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a4b06e-861b-5465-8667-5117e32733e4/37a4b06e-861b-5465-8667-5117e32733e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_65899a1206445fd007f2790780330b1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a4b06e-861b-5465-8667-5117e32733e4/37a4b06e-861b-5465-8667-5117e32733e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_2fa63952286f9b254d056b202d7a22c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a4b06e-861b-5465-8667-5117e32733e4/37a4b06e-861b-5465-8667-5117e32733e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3268848,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_3551ddbe84b4a51432081a3a9490fc2d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a4b06e-861b-5465-8667-5117e32733e4/37a4b06e-861b-5465-8667-5117e32733e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3145557,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_22cc3a14803c296e2b048e252057d863.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a4b06e-861b-5465-8667-5117e32733e4/37a4b06e-861b-5465-8667-5117e32733e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/01/7201e22dcb8f380ed2f29a9700016b05/pa/BP11097_71d0c9d8250337eafc5a8c346b9f9b01.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 55 TFSIe quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2020}
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP11097%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [auto1.de] INFO: Saving data for BP11097: {'created_time': 1774868003.46017, 'last_price_update_time': 1774868003.460184, 'auction_closing_time': 1774969230.0}
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP11097') HTTP/1.1" 204 0
2026-03-30 10:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e512d0>
2026-03-30 10:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_e3ecef73b3966e14d73c9c4a8d9691f7.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_e3ecef73b3966e14d73c9c4a8d9691f7.jpg saved to cache
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2436a515-55c7-5747-8c1d-68d47eafdcf0
2026-03-30 10:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef501c090>
2026-03-30 10:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_5fc7c588d1d46581c31f567cb1432856.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_5fc7c588d1d46581c31f567cb1432856.jpg saved to cache
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fee702fc-eb0c-554c-b155-c2dc6d2467bd
2026-03-30 10:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_05ad9f3fb295c3c15213f2569e30002c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F0d%252F770d517f97f85c6a99a35b7f0c8a4230%252Fpa%252FDA24351_cc5fae848cc45e26afd2da4720d3044f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_cc5fae848cc45e26afd2da4720d3044f.jpg not downloaded yet
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_7417658e266b08ca724c4fc266c7b3ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_7417658e266b08ca724c4fc266c7b3ac.jpg not downloaded yet
2026-03-30 10:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_dd7fa116415c3e3432e974b88adc4e9b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_daac01e0ebb02c993de38581daa1a2f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_daac01e0ebb02c993de38581daa1a2f3.jpg not downloaded yet
2026-03-30 10:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5053a50>
2026-03-30 10:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_d37e004b1b4f7015051aa6859196f524.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_d37e004b1b4f7015051aa6859196f524.jpg saved to cache
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2436a515-55c7-5747-8c1d-68d47eafdcf0
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F0d%252F770d517f97f85c6a99a35b7f0c8a4230%252Fpa%252FDA24351_7217a7432bdc1686a0c732323db9af8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_7217a7432bdc1686a0c732323db9af8e.jpg not downloaded yet
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_7fb57cca9ac7dc0449b7ba23b89dbad3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_7fb57cca9ac7dc0449b7ba23b89dbad3.jpg not downloaded yet
2026-03-30 10:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_c5fa761a1c01384bdf8fcf23126831f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_1bb89509edd657804b71794262dfc667.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_f8b562ba88c8182983200c6002431c92.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_f8b562ba88c8182983200c6002431c92.jpg not downloaded yet
2026-03-30 10:53:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fc8690>
2026-03-30 10:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_a01e82234525f34a12ee46eb75293f55.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_a01e82234525f34a12ee46eb75293f55.jpg saved to cache
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c3a0791-e53f-527f-b77e-1bb21c80beda
2026-03-30 10:53:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1582cf5b-85fd-5f63-bc68-8bd61abd8b30 with identifier: GV44074
2026-03-30 10:53:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1582cf5b-85fd-5f63-bc68-8bd61abd8b30 with scrape type 1
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1582cf5b-85fd-5f63-bc68-8bd61abd8b30
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fac%252Fadacf6a9f79f723229cc1db8c4057f73%252Fpa%252FGV44074_1121e7e151795a3479e4abc7b8ed9168.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_1121e7e151795a3479e4abc7b8ed9168.jpg already downloaded
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fac%252Fadacf6a9f79f723229cc1db8c4057f73%252Fpa%252FGV44074_85e843d5ce1c31cd1b691594ee0674d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_85e843d5ce1c31cd1b691594ee0674d4.jpg already downloaded
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fac%252Fadacf6a9f79f723229cc1db8c4057f73%252Fpa%252FGV44074_bd9ec21efcc3baf1034ac018101a2517.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_bd9ec21efcc3baf1034ac018101a2517.jpg already downloaded
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fac%252Fadacf6a9f79f723229cc1db8c4057f73%252Fpa%252FGV44074_a0f5b5e51120042359ebeeda8a006404.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_a0f5b5e51120042359ebeeda8a006404.jpg already downloaded
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fac%252Fadacf6a9f79f723229cc1db8c4057f73%252Fpa%252FGV44074_486b68acb2ae26132dcf1be06f289c46.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_486b68acb2ae26132dcf1be06f289c46.jpg already downloaded
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fac%252Fadacf6a9f79f723229cc1db8c4057f73%252Fpa%252FGV44074_14304e5574e5ba834b659e647e2b6d1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_14304e5574e5ba834b659e647e2b6d1f.jpg already downloaded
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fac%252Fadacf6a9f79f723229cc1db8c4057f73%252Fpa%252FGV44074_12776e92bf35e213ab1c22adac7cc802.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_12776e92bf35e213ab1c22adac7cc802.jpg already downloaded
2026-03-30 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fac%252Fadacf6a9f79f723229cc1db8c4057f73%252Fpa%252FGV44074_acddb01926ed7db6f293bacf48671cd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_acddb01926ed7db6f293bacf48671cd5.jpg already downloaded
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fac%252Fadacf6a9f79f723229cc1db8c4057f73%252Fpa%252FGV44074_b2e4134895f5c07063ddcab16080996c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_b2e4134895f5c07063ddcab16080996c.jpg already downloaded
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fac%252Fadacf6a9f79f723229cc1db8c4057f73%252Fpa%252FGV44074_72e2299166fc2eaef62153aed63e2925.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_72e2299166fc2eaef62153aed63e2925.jpg already downloaded
2026-03-30 10:53:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1582cf5b-85fd-5f63-bc68-8bd61abd8b30, identifier: GV44074
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_4fd90d68d2a667cb444951e38cff5551.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_4fd90d68d2a667cb444951e38cff5551.jpg not downloaded yet
2026-03-30 10:53:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1582cf5b-85fd-5f63-bc68-8bd61abd8b30 with identifier: GV44074
2026-03-30 10:53:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1582cf5b-85fd-5f63-bc68-8bd61abd8b30 with identifier: GV44074
2026-03-30 10:53:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1582cf5b-85fd-5f63-bc68-8bd61abd8b30 with identifier: GV44074 to the API
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GV44074>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:04:55Z',
 'fuel_type': 'diesel',
 'id': '1582cf5b-85fd-5f63-bc68-8bd61abd8b30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV44074',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 61302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_1121e7e151795a3479e4abc7b8ed9168.jpg',
                'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_85e843d5ce1c31cd1b691594ee0674d4.jpg',
                'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_bd9ec21efcc3baf1034ac018101a2517.jpg',
                'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_a0f5b5e51120042359ebeeda8a006404.jpg',
                'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_486b68acb2ae26132dcf1be06f289c46.jpg',
                'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_14304e5574e5ba834b659e647e2b6d1f.jpg',
                'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_12776e92bf35e213ab1c22adac7cc802.jpg',
                'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_acddb01926ed7db6f293bacf48671cd5.jpg',
                'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_b2e4134895f5c07063ddcab16080996c.jpg',
                'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_72e2299166fc2eaef62153aed63e2925.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1582cf5b-85fd-5f63-bc68-8bd61abd8b30/1582cf5b-85fd-5f63-bc68-8bd61abd8b30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_1121e7e151795a3479e4abc7b8ed9168.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1582cf5b-85fd-5f63-bc68-8bd61abd8b30/1582cf5b-85fd-5f63-bc68-8bd61abd8b30_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2789994,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_85e843d5ce1c31cd1b691594ee0674d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1582cf5b-85fd-5f63-bc68-8bd61abd8b30/1582cf5b-85fd-5f63-bc68-8bd61abd8b30_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_bd9ec21efcc3baf1034ac018101a2517.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1582cf5b-85fd-5f63-bc68-8bd61abd8b30/1582cf5b-85fd-5f63-bc68-8bd61abd8b30_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_a0f5b5e51120042359ebeeda8a006404.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1582cf5b-85fd-5f63-bc68-8bd61abd8b30/1582cf5b-85fd-5f63-bc68-8bd61abd8b30_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3063726,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_486b68acb2ae26132dcf1be06f289c46.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1582cf5b-85fd-5f63-bc68-8bd61abd8b30/1582cf5b-85fd-5f63-bc68-8bd61abd8b30_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_14304e5574e5ba834b659e647e2b6d1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1582cf5b-85fd-5f63-bc68-8bd61abd8b30/1582cf5b-85fd-5f63-bc68-8bd61abd8b30_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_12776e92bf35e213ab1c22adac7cc802.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1582cf5b-85fd-5f63-bc68-8bd61abd8b30/1582cf5b-85fd-5f63-bc68-8bd61abd8b30_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2888123,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_acddb01926ed7db6f293bacf48671cd5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1582cf5b-85fd-5f63-bc68-8bd61abd8b30/1582cf5b-85fd-5f63-bc68-8bd61abd8b30_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2975966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_b2e4134895f5c07063ddcab16080996c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1582cf5b-85fd-5f63-bc68-8bd61abd8b30/1582cf5b-85fd-5f63-bc68-8bd61abd8b30_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3031391,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/ac/adacf6a9f79f723229cc1db8c4057f73/pa/GV44074_72e2299166fc2eaef62153aed63e2925.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV44074%27 HTTP/1.1" 200 None
2026-03-30 10:53:24 [auto1.de] INFO: Saving data for GV44074: {'created_time': 1774868004.524876, 'last_price_update_time': 1774868004.524887, 'auction_closing_time': 1774969495.0}
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV44074') HTTP/1.1" 204 0
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e44a90>
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_05ad9f3fb295c3c15213f2569e30002c.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_05ad9f3fb295c3c15213f2569e30002c.jpg saved to cache
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c3a0791-e53f-527f-b77e-1bb21c80beda
2026-03-30 10:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_7c1a6e5e0bb938fd2f86d1e51aaadd79.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_cacfdbd7eb96d2cbabf8330e74e09f24.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_d6ddb2e871358560d265b28545445e6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_d6ddb2e871358560d265b28545445e6f.jpg not downloaded yet
2026-03-30 10:53:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c79750>
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_dd7fa116415c3e3432e974b88adc4e9b.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_dd7fa116415c3e3432e974b88adc4e9b.jpg saved to cache
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fda08c46-4c8e-527d-acf5-bec11a7e521c
2026-03-30 10:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_1edf94b3ef9e0a02bdb797c46c401e8d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_6b35aaee1c4400087a227f290adc51a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_2e0fb8e062117e369b4c5edbc2cf7c08.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_2e0fb8e062117e369b4c5edbc2cf7c08.jpg not downloaded yet
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c9f9d0>
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_c5fa761a1c01384bdf8fcf23126831f8.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_c5fa761a1c01384bdf8fcf23126831f8.jpg saved to cache
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fee702fc-eb0c-554c-b155-c2dc6d2467bd
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50cc510>
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_1bb89509edd657804b71794262dfc667.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_1bb89509edd657804b71794262dfc667.jpg saved to cache
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce
2026-03-30 10:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_52b5b61af9be5f41a2ac0d30ea948a78.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_5f863fca8ba9d6ea49d2b46fbc54d114.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_5f863fca8ba9d6ea49d2b46fbc54d114.jpg not downloaded yet
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_668ce18d0bc44f8b862e42527c6bd014.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_668ce18d0bc44f8b862e42527c6bd014.jpg not downloaded yet
2026-03-30 10:53:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e88f10>
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fef%252Fa7ef657fef8186962488ca83806154bd%252Fpa%252FEZ95690_7c1a6e5e0bb938fd2f86d1e51aaadd79.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_7c1a6e5e0bb938fd2f86d1e51aaadd79.jpg saved to cache
2026-03-30 10:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fda08c46-4c8e-527d-acf5-bec11a7e521c
2026-03-30 10:53:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fda08c46-4c8e-527d-acf5-bec11a7e521c, skipping ID generation
2026-03-30 10:53:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fda08c46-4c8e-527d-acf5-bec11a7e521c with scrape type 1
2026-03-30 10:53:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fda08c46-4c8e-527d-acf5-bec11a7e521c sending to next pipeline
2026-03-30 10:53:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fda08c46-4c8e-527d-acf5-bec11a7e521c, identifier: EZ95690
2026-03-30 10:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef593dfd0>
2026-03-30 10:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69bde426-cb42-5090-87e1-7a86efa78db7/69bde426-cb42-5090-87e1-7a86efa78db7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F0d%252F770d517f97f85c6a99a35b7f0c8a4230%252Fpa%252FDA24351_cacfdbd7eb96d2cbabf8330e74e09f24.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_cacfdbd7eb96d2cbabf8330e74e09f24.jpg saved to cache
2026-03-30 10:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 69bde426-cb42-5090-87e1-7a86efa78db7
2026-03-30 10:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_ae85861d7563e1c73af7c6111f2376f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_7685785ceb898fd6e5722cd3c4c29e7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_7685785ceb898fd6e5722cd3c4c29e7b.jpg not downloaded yet
2026-03-30 10:53:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fda08c46-4c8e-527d-acf5-bec11a7e521c with identifier: EZ95690
2026-03-30 10:53:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fda08c46-4c8e-527d-acf5-bec11a7e521c with identifier: EZ95690
2026-03-30 10:53:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fda08c46-4c8e-527d-acf5-bec11a7e521c with identifier: EZ95690 to the API
2026-03-30 10:53:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_7c1a6e5e0bb938fd2f86d1e51aaadd79.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:17:35Z',
 'fuel_type': 'petrol',
 'id': 'fda08c46-4c8e-527d-acf5-bec11a7e521c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ95690',
 'listing': 'auction',
 'location': 'DE, Köln',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 65425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_1a6680d880089fb755606ccfd1afd801.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3597512,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_7c1a6e5e0bb938fd2f86d1e51aaadd79.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_1593edc79d0d50357484c938d2b0c8b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3536366,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_dd7fa116415c3e3432e974b88adc4e9b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_e2073086de274c564917eba95b329f0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_e9408587343fa98690dee5c75be0a5ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3455362,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_4d04830e917f68b72d2d460879d01ab3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3669183,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_dcad9d354f72f2e20083222722e40220.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3593835,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_4fb795a42d614d203ffebb06d5768b6c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda08c46-4c8e-527d-acf5-bec11a7e521c/fda08c46-4c8e-527d-acf5-bec11a7e521c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ef/a7ef657fef8186962488ca83806154bd/pa/EZ95690_01e9d686ed6d423cda6c0e897814517d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2019}
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ95690%27 HTTP/1.1" 200 None
2026-03-30 10:53:26 [auto1.de] INFO: Saving data for EZ95690: {'created_time': 1774868006.354857, 'last_price_update_time': 1774868006.354869, 'auction_closing_time': 1774970255.0}
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ95690') HTTP/1.1" 204 0
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ab8fd0>
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_1edf94b3ef9e0a02bdb797c46c401e8d.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_1edf94b3ef9e0a02bdb797c46c401e8d.jpg saved to cache
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fee702fc-eb0c-554c-b155-c2dc6d2467bd
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5976e50>
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_6b35aaee1c4400087a227f290adc51a9.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_6b35aaee1c4400087a227f290adc51a9.jpg saved to cache
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2436a515-55c7-5747-8c1d-68d47eafdcf0
2026-03-30 10:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_cc5fae848cc45e26afd2da4720d3044f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_4000a7721faae9ddacc0c4c3358fa21d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_491b4aa339439ee1cb9fafa19a4f0861.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_491b4aa339439ee1cb9fafa19a4f0861.jpg not downloaded yet
2026-03-30 10:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_7417658e266b08ca724c4fc266c7b3ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_7c43d9f6deb3da48f374022c93a6f41c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_88123364094984e9a6b58358df5faacc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_88123364094984e9a6b58358df5faacc.jpg not downloaded yet
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef593d150>
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69bde426-cb42-5090-87e1-7a86efa78db7/69bde426-cb42-5090-87e1-7a86efa78db7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F0d%252F770d517f97f85c6a99a35b7f0c8a4230%252Fpa%252FDA24351_52b5b61af9be5f41a2ac0d30ea948a78.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_52b5b61af9be5f41a2ac0d30ea948a78.jpg saved to cache
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69bde426-cb42-5090-87e1-7a86efa78db7
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_52507ceee818ff0afb13d885e6ea4414.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_52507ceee818ff0afb13d885e6ea4414.jpg not downloaded yet
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_cad8f58e905e2f024b64719662fe6a96.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_cad8f58e905e2f024b64719662fe6a96.jpg not downloaded yet
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef593c350>
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_ae85861d7563e1c73af7c6111f2376f3.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_ae85861d7563e1c73af7c6111f2376f3.jpg saved to cache
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2436a515-55c7-5747-8c1d-68d47eafdcf0
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_ad805863e78b5af2be79ed1d30d318d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_ad805863e78b5af2be79ed1d30d318d1.jpg not downloaded yet
2026-03-30 10:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_daac01e0ebb02c993de38581daa1a2f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_d9f58dea9e5d12f3bc40fd591b8a1e2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_d9f58dea9e5d12f3bc40fd591b8a1e2d.jpg not downloaded yet
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50102d0>
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69bde426-cb42-5090-87e1-7a86efa78db7/69bde426-cb42-5090-87e1-7a86efa78db7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F0d%252F770d517f97f85c6a99a35b7f0c8a4230%252Fpa%252FDA24351_cc5fae848cc45e26afd2da4720d3044f.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_cc5fae848cc45e26afd2da4720d3044f.jpg saved to cache
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69bde426-cb42-5090-87e1-7a86efa78db7
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb8bd0>
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_4000a7721faae9ddacc0c4c3358fa21d.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_4000a7721faae9ddacc0c4c3358fa21d.jpg saved to cache
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe3a90>
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_7417658e266b08ca724c4fc266c7b3ac.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_7417658e266b08ca724c4fc266c7b3ac.jpg saved to cache
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64d397af-c207-5873-b78a-15599920361f
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e28e50>
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_7c43d9f6deb3da48f374022c93a6f41c.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_7c43d9f6deb3da48f374022c93a6f41c.jpg saved to cache
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce
2026-03-30 10:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_4fd90d68d2a667cb444951e38cff5551.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_2e0fb8e062117e369b4c5edbc2cf7c08.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_f8b562ba88c8182983200c6002431c92.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_d6ddb2e871358560d265b28545445e6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7933410>
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_daac01e0ebb02c993de38581daa1a2f3.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_daac01e0ebb02c993de38581daa1a2f3.jpg saved to cache
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce
2026-03-30 10:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_3c5e839cba9c06448d414e11f8d79719.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_7fb57cca9ac7dc0449b7ba23b89dbad3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_e9c87b99abf27dcab4b3739de534f0d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_944afbbc349fb5ca6516d3575c6ef87f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ecc210>
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_4fd90d68d2a667cb444951e38cff5551.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_4fd90d68d2a667cb444951e38cff5551.jpg saved to cache
2026-03-30 10:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64d397af-c207-5873-b78a-15599920361f
2026-03-30 10:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_a30a602a80dd955a9e2eb0b9ff18895d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_ad805863e78b5af2be79ed1d30d318d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da1310>
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_2e0fb8e062117e369b4c5edbc2cf7c08.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_2e0fb8e062117e369b4c5edbc2cf7c08.jpg saved to cache
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64d397af-c207-5873-b78a-15599920361f
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d48950>
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_f8b562ba88c8182983200c6002431c92.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_f8b562ba88c8182983200c6002431c92.jpg saved to cache
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f54650>
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_d6ddb2e871358560d265b28545445e6f.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_d6ddb2e871358560d265b28545445e6f.jpg saved to cache
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce
2026-03-30 10:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_d9f58dea9e5d12f3bc40fd591b8a1e2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_7217a7432bdc1686a0c732323db9af8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_5f863fca8ba9d6ea49d2b46fbc54d114.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d4a010>
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_3c5e839cba9c06448d414e11f8d79719.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_3c5e839cba9c06448d414e11f8d79719.jpg saved to cache
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fee702fc-eb0c-554c-b155-c2dc6d2467bd
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d4a610>
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_7fb57cca9ac7dc0449b7ba23b89dbad3.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_7fb57cca9ac7dc0449b7ba23b89dbad3.jpg saved to cache
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64d397af-c207-5873-b78a-15599920361f
2026-03-30 10:53:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e208d0>
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_e9c87b99abf27dcab4b3739de534f0d0.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_e9c87b99abf27dcab4b3739de534f0d0.jpg saved to cache
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c3a0791-e53f-527f-b77e-1bb21c80beda
2026-03-30 10:53:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f89a90>
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_944afbbc349fb5ca6516d3575c6ef87f.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_944afbbc349fb5ca6516d3575c6ef87f.jpg saved to cache
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c3a0791-e53f-527f-b77e-1bb21c80beda
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e233d0>
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_a30a602a80dd955a9e2eb0b9ff18895d.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_a30a602a80dd955a9e2eb0b9ff18895d.jpg saved to cache
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64d397af-c207-5873-b78a-15599920361f
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50d5ed0>
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_ad805863e78b5af2be79ed1d30d318d1.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_ad805863e78b5af2be79ed1d30d318d1.jpg saved to cache
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 64d397af-c207-5873-b78a-15599920361f
2026-03-30 10:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_7685785ceb898fd6e5722cd3c4c29e7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_668ce18d0bc44f8b862e42527c6bd014.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_491b4aa339439ee1cb9fafa19a4f0861.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_584e400c593960e4ef9a889f2d8eff64.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_cad8f58e905e2f024b64719662fe6a96.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_52507ceee818ff0afb13d885e6ea4414.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_88123364094984e9a6b58358df5faacc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XG57506> (referer: https://www.auto1.com/v1/car-details-view/XG57506/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d7f690>
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_d9f58dea9e5d12f3bc40fd591b8a1e2d.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_d9f58dea9e5d12f3bc40fd591b8a1e2d.jpg saved to cache
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 64d397af-c207-5873-b78a-15599920361f
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6c190>
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69bde426-cb42-5090-87e1-7a86efa78db7/69bde426-cb42-5090-87e1-7a86efa78db7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F0d%252F770d517f97f85c6a99a35b7f0c8a4230%252Fpa%252FDA24351_7217a7432bdc1686a0c732323db9af8e.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_7217a7432bdc1686a0c732323db9af8e.jpg saved to cache
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69bde426-cb42-5090-87e1-7a86efa78db7
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d7cfd0>
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_5f863fca8ba9d6ea49d2b46fbc54d114.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_5f863fca8ba9d6ea49d2b46fbc54d114.jpg saved to cache
2026-03-30 10:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e88ed0>
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_7685785ceb898fd6e5722cd3c4c29e7b.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_7685785ceb898fd6e5722cd3c4c29e7b.jpg saved to cache
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d7f990>
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_668ce18d0bc44f8b862e42527c6bd014.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_668ce18d0bc44f8b862e42527c6bd014.jpg saved to cache
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64d397af-c207-5873-b78a-15599920361f
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d3d790>
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_491b4aa339439ee1cb9fafa19a4f0861.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_491b4aa339439ee1cb9fafa19a4f0861.jpg saved to cache
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64d397af-c207-5873-b78a-15599920361f
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d7dd10>
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69bde426-cb42-5090-87e1-7a86efa78db7/69bde426-cb42-5090-87e1-7a86efa78db7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F0d%252F770d517f97f85c6a99a35b7f0c8a4230%252Fpa%252FDA24351_584e400c593960e4ef9a889f2d8eff64.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_584e400c593960e4ef9a889f2d8eff64.jpg saved to cache
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69bde426-cb42-5090-87e1-7a86efa78db7
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e22150>
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_cad8f58e905e2f024b64719662fe6a96.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_cad8f58e905e2f024b64719662fe6a96.jpg saved to cache
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d7ded0>
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5c%252Fa05cd6db4d2f9cce2513b07213de6e72%252Fpa%252FUD05197_52507ceee818ff0afb13d885e6ea4414.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_52507ceee818ff0afb13d885e6ea4414.jpg saved to cache
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64d397af-c207-5873-b78a-15599920361f
2026-03-30 10:53:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64d397af-c207-5873-b78a-15599920361f, skipping ID generation
2026-03-30 10:53:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64d397af-c207-5873-b78a-15599920361f with scrape type 1
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64d397af-c207-5873-b78a-15599920361f sending to next pipeline
2026-03-30 10:53:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64d397af-c207-5873-b78a-15599920361f, identifier: UD05197
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5044ed0>
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fa9%252F2ca979114c1ab95d462d73d7add2e9c0%252Fpa%252FSW73821_88123364094984e9a6b58358df5faacc.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_88123364094984e9a6b58358df5faacc.jpg saved to cache
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce
2026-03-30 10:53:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce, skipping ID generation
2026-03-30 10:53:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce with scrape type 1
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce sending to next pipeline
2026-03-30 10:53:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce, identifier: SW73821
2026-03-30 10:53:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d with identifier: XG57506
2026-03-30 10:53:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d with scrape type 1
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_e744b09e109041946413cc1177cebaef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_e744b09e109041946413cc1177cebaef.jpg not downloaded yet
2026-03-30 10:53:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64d397af-c207-5873-b78a-15599920361f with identifier: UD05197
2026-03-30 10:53:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64d397af-c207-5873-b78a-15599920361f with identifier: UD05197
2026-03-30 10:53:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64d397af-c207-5873-b78a-15599920361f with identifier: UD05197 to the API
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_52507ceee818ff0afb13d885e6ea4414.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:54:36Z',
 'fuel_type': 'petrol',
 'id': '64d397af-c207-5873-b78a-15599920361f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD05197',
 'listing': 'auction',
 'location': 'DE, Nürnberg',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 59821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_a30a602a80dd955a9e2eb0b9ff18895d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_7417658e266b08ca724c4fc266c7b3ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_7fb57cca9ac7dc0449b7ba23b89dbad3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_4fd90d68d2a667cb444951e38cff5551.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_2e0fb8e062117e369b4c5edbc2cf7c08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_668ce18d0bc44f8b862e42527c6bd014.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_491b4aa339439ee1cb9fafa19a4f0861.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_52507ceee818ff0afb13d885e6ea4414.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_ad805863e78b5af2be79ed1d30d318d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d397af-c207-5873-b78a-15599920361f/64d397af-c207-5873-b78a-15599920361f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/5c/a05cd6db4d2f9cce2513b07213de6e72/pa/UD05197_d9f58dea9e5d12f3bc40fd591b8a1e2d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-23',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD05197%27 HTTP/1.1" 200 None
2026-03-30 10:53:29 [auto1.de] INFO: Saving data for UD05197: {'created_time': 1774868009.050562, 'last_price_update_time': 1774868009.050575, 'auction_closing_time': 1774972476.0}
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD05197') HTTP/1.1" 204 0
2026-03-30 10:53:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce with identifier: SW73821
2026-03-30 10:53:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce with identifier: SW73821
2026-03-30 10:53:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce with identifier: SW73821 to the API
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_88123364094984e9a6b58358df5faacc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:10:45Z',
 'fuel_type': 'petrol',
 'id': 'ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW73821',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 37380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_1bb89509edd657804b71794262dfc667.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_4000a7721faae9ddacc0c4c3358fa21d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_7c43d9f6deb3da48f374022c93a6f41c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_daac01e0ebb02c993de38581daa1a2f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_f8b562ba88c8182983200c6002431c92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_d6ddb2e871358560d265b28545445e6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_5f863fca8ba9d6ea49d2b46fbc54d114.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_7685785ceb898fd6e5722cd3c4c29e7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_88123364094984e9a6b58358df5faacc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce/ca52a39f-6c93-5a05-8c58-08a8aa9bf7ce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/a9/2ca979114c1ab95d462d73d7add2e9c0/pa/SW73821_cad8f58e905e2f024b64719662fe6a96.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2021}
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW73821%27 HTTP/1.1" 200 None
2026-03-30 10:53:29 [auto1.de] INFO: Saving data for SW73821: {'created_time': 1774868009.477196, 'last_price_update_time': 1774868009.477209, 'auction_closing_time': 1774969845.0}
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW73821') HTTP/1.1" 204 0
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_684b86019681d3e5c82be853f3a03a09.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_684b86019681d3e5c82be853f3a03a09.jpg not downloaded yet
2026-03-30 10:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_0656094fa0fa7f237b2da4a71f984bde.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_963153256e8caa3232243827c3c596d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_0350a64a7d9b628faa0338a9d14bc667.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_6e2d334242ba939797875c88fb5bb74c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_a705d2037b0031223c150c22c042c640.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_0ada83e91fa21a061018dc102b1aaf6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_a8c95752846995f8a4f8b98789ee9805.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_a8c95752846995f8a4f8b98789ee9805.jpg not downloaded yet
2026-03-30 10:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME64597> (referer: https://www.auto1.com/v1/car-details-view/ME64597/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_0d0557294ede79620945ab1ae8fdc4ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_0d0557294ede79620945ab1ae8fdc4ed.jpg not downloaded yet
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_e2c70b8d34802f3961110e1737f726a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_e2c70b8d34802f3961110e1737f726a8.jpg not downloaded yet
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_c27b110187cf29b0d2e70730dd948e2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_c27b110187cf29b0d2e70730dd948e2b.jpg not downloaded yet
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_796b4acd01653e932869ebdaf9a64d54.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_796b4acd01653e932869ebdaf9a64d54.jpg not downloaded yet
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_d55bda434fd958922085a1cfdb1257da.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_d55bda434fd958922085a1cfdb1257da.jpg not downloaded yet
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59646d0>
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69bde426-cb42-5090-87e1-7a86efa78db7/69bde426-cb42-5090-87e1-7a86efa78db7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F0d%252F770d517f97f85c6a99a35b7f0c8a4230%252Fpa%252FDA24351_0656094fa0fa7f237b2da4a71f984bde.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_0656094fa0fa7f237b2da4a71f984bde.jpg saved to cache
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69bde426-cb42-5090-87e1-7a86efa78db7
2026-03-30 10:53:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69bde426-cb42-5090-87e1-7a86efa78db7, skipping ID generation
2026-03-30 10:53:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69bde426-cb42-5090-87e1-7a86efa78db7 with scrape type 1
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69bde426-cb42-5090-87e1-7a86efa78db7 sending to next pipeline
2026-03-30 10:53:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69bde426-cb42-5090-87e1-7a86efa78db7, identifier: DA24351
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50b3ad0>
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_963153256e8caa3232243827c3c596d3.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_963153256e8caa3232243827c3c596d3.jpg saved to cache
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2436a515-55c7-5747-8c1d-68d47eafdcf0
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c74ed0>
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_0350a64a7d9b628faa0338a9d14bc667.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_0350a64a7d9b628faa0338a9d14bc667.jpg saved to cache
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fee702fc-eb0c-554c-b155-c2dc6d2467bd
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a43950>
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_6e2d334242ba939797875c88fb5bb74c.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_6e2d334242ba939797875c88fb5bb74c.jpg saved to cache
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2436a515-55c7-5747-8c1d-68d47eafdcf0
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7932a90>
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F0d%252Ff80d06d7f55aba49d2560330a55afa52%252Fpa%252FBP66630_a705d2037b0031223c150c22c042c640.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_a705d2037b0031223c150c22c042c640.jpg saved to cache
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fee702fc-eb0c-554c-b155-c2dc6d2467bd
2026-03-30 10:53:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fee702fc-eb0c-554c-b155-c2dc6d2467bd, skipping ID generation
2026-03-30 10:53:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fee702fc-eb0c-554c-b155-c2dc6d2467bd with scrape type 1
2026-03-30 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fee702fc-eb0c-554c-b155-c2dc6d2467bd sending to next pipeline
2026-03-30 10:53:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fee702fc-eb0c-554c-b155-c2dc6d2467bd, identifier: BP66630
2026-03-30 10:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f06750>
2026-03-30 10:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_0ada83e91fa21a061018dc102b1aaf6a.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_0ada83e91fa21a061018dc102b1aaf6a.jpg saved to cache
2026-03-30 10:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c3a0791-e53f-527f-b77e-1bb21c80beda
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_98a760f9aeef429b05e3d57c1ca6eade.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_98a760f9aeef429b05e3d57c1ca6eade.jpg not downloaded yet
2026-03-30 10:53:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69bde426-cb42-5090-87e1-7a86efa78db7 with identifier: DA24351
2026-03-30 10:53:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69bde426-cb42-5090-87e1-7a86efa78db7 with identifier: DA24351
2026-03-30 10:53:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69bde426-cb42-5090-87e1-7a86efa78db7 with identifier: DA24351 to the API
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_0656094fa0fa7f237b2da4a71f984bde.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-31T15:24:47Z',
 'fuel_type': 'petrol',
 'id': '69bde426-cb42-5090-87e1-7a86efa78db7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA24351',
 'listing': 'auction',
 'location': 'DE, Waiblingen',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 183041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69bde426-cb42-5090-87e1-7a86efa78db7/69bde426-cb42-5090-87e1-7a86efa78db7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_0656094fa0fa7f237b2da4a71f984bde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69bde426-cb42-5090-87e1-7a86efa78db7/69bde426-cb42-5090-87e1-7a86efa78db7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_52b5b61af9be5f41a2ac0d30ea948a78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69bde426-cb42-5090-87e1-7a86efa78db7/69bde426-cb42-5090-87e1-7a86efa78db7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_cacfdbd7eb96d2cbabf8330e74e09f24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69bde426-cb42-5090-87e1-7a86efa78db7/69bde426-cb42-5090-87e1-7a86efa78db7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_584e400c593960e4ef9a889f2d8eff64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69bde426-cb42-5090-87e1-7a86efa78db7/69bde426-cb42-5090-87e1-7a86efa78db7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_cc5fae848cc45e26afd2da4720d3044f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69bde426-cb42-5090-87e1-7a86efa78db7/69bde426-cb42-5090-87e1-7a86efa78db7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/0d/770d517f97f85c6a99a35b7f0c8a4230/pa/DA24351_7217a7432bdc1686a0c732323db9af8e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2007}
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA24351%27 HTTP/1.1" 200 None
2026-03-30 10:53:30 [auto1.de] INFO: Saving data for DA24351: {'created_time': 1774868010.525036, 'last_price_update_time': 1774868010.525045, 'auction_closing_time': 1774970687.0}
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA24351') HTTP/1.1" 204 0
2026-03-30 10:53:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fee702fc-eb0c-554c-b155-c2dc6d2467bd with identifier: BP66630
2026-03-30 10:53:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fee702fc-eb0c-554c-b155-c2dc6d2467bd with identifier: BP66630
2026-03-30 10:53:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fee702fc-eb0c-554c-b155-c2dc6d2467bd with identifier: BP66630 to the API
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_a705d2037b0031223c150c22c042c640.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 213,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:50:06Z',
 'fuel_type': 'diesel',
 'id': 'fee702fc-eb0c-554c-b155-c2dc6d2467bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP66630',
 'listing': 'auction',
 'location': 'DE, Neufahrn',
 'make': 'Volkswagen',
 'model': 'T5 Kombi',
 'odometer': 259780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_325e528a417eaeb8799af5994b507edd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_ac759c2388bac11c1ec964cda981c4d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_e7d37144f9dae820209916b5d02cdf3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_ae4476ce827f66122acb4398f3bc13d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_5fc7c588d1d46581c31f567cb1432856.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2146091,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_3c5e839cba9c06448d414e11f8d79719.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_a705d2037b0031223c150c22c042c640.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_1edf94b3ef9e0a02bdb797c46c401e8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_c5fa761a1c01384bdf8fcf23126831f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fee702fc-eb0c-554c-b155-c2dc6d2467bd/fee702fc-eb0c-554c-b155-c2dc6d2467bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/0d/f80d06d7f55aba49d2560330a55afa52/pa/BP66630_0350a64a7d9b628faa0338a9d14bc667.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-11-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen T5 Kombi 1.9 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP66630%27 HTTP/1.1" 200 None
2026-03-30 10:53:30 [auto1.de] INFO: Saving data for BP66630: {'created_time': 1774868010.910152, 'last_price_update_time': 1774868010.910161, 'auction_closing_time': 1774972206.0}
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP66630') HTTP/1.1" 204 0
2026-03-30 10:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_2159bfe5a7fdbeaea91d5b5e4ba72bf5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1f30bc9-1328-5b40-947b-813ed7fd00ea with identifier: ME64597
2026-03-30 10:53:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1f30bc9-1328-5b40-947b-813ed7fd00ea with scrape type 1
2026-03-30 10:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c1f30bc9-1328-5b40-947b-813ed7fd00ea
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_683a01af9509f770a22bc85354ffe1a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_683a01af9509f770a22bc85354ffe1a4.jpg not downloaded yet
2026-03-30 10:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_3914df870a04c4f22a972de2e392fb31.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_4d94cc60cb7f8ccd8ca605f583e2f91f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_ccbed91e8bb60397440a8aa1ac9d8c36.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_8d51c131281e8356a96230ced707b5d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_8d51c131281e8356a96230ced707b5d7.jpg not downloaded yet
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_b5c85066629fdbddf30500a69f34e4cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_b5c85066629fdbddf30500a69f34e4cc.jpg not downloaded yet
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_fa17ad1d5ee03ae0e51b6563248e4ac0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_fa17ad1d5ee03ae0e51b6563248e4ac0.jpg not downloaded yet
2026-03-30 10:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_e744b09e109041946413cc1177cebaef.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_673f4ed0c52303f72b5e12355a24f9e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_673f4ed0c52303f72b5e12355a24f9e1.jpg not downloaded yet
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_340f34da58749b4f5d25a4d88d40541f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_340f34da58749b4f5d25a4d88d40541f.jpg not downloaded yet
2026-03-30 10:53:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a43390>
2026-03-30 10:53:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F91%252F1b91c15058c7610aef88d2b8fd8fdfab%252Fpa%252FHU65226_2159bfe5a7fdbeaea91d5b5e4ba72bf5.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_2159bfe5a7fdbeaea91d5b5e4ba72bf5.jpg saved to cache
2026-03-30 10:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2436a515-55c7-5747-8c1d-68d47eafdcf0
2026-03-30 10:53:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2436a515-55c7-5747-8c1d-68d47eafdcf0, skipping ID generation
2026-03-30 10:53:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2436a515-55c7-5747-8c1d-68d47eafdcf0 with scrape type 1
2026-03-30 10:53:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2436a515-55c7-5747-8c1d-68d47eafdcf0 sending to next pipeline
2026-03-30 10:53:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2436a515-55c7-5747-8c1d-68d47eafdcf0, identifier: HU65226
2026-03-30 10:53:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2436a515-55c7-5747-8c1d-68d47eafdcf0 with identifier: HU65226
2026-03-30 10:53:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2436a515-55c7-5747-8c1d-68d47eafdcf0 with identifier: HU65226
2026-03-30 10:53:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2436a515-55c7-5747-8c1d-68d47eafdcf0 with identifier: HU65226 to the API
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_2159bfe5a7fdbeaea91d5b5e4ba72bf5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:23:54Z',
 'fuel_type': 'petrol',
 'id': '2436a515-55c7-5747-8c1d-68d47eafdcf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU65226',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Mazda',
 'model': '2',
 'odometer': 139838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_3b677ded85dee20fc0ae50f70d2bdfd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_2159bfe5a7fdbeaea91d5b5e4ba72bf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_c65095ae15b393007a31ba2c77f2f051.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_1554ff5024f2c03c657094fb5501b9e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_e3ecef73b3966e14d73c9c4a8d9691f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_d37e004b1b4f7015051aa6859196f524.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_963153256e8caa3232243827c3c596d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_ae85861d7563e1c73af7c6111f2376f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_6b35aaee1c4400087a227f290adc51a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2436a515-55c7-5747-8c1d-68d47eafdcf0/2436a515-55c7-5747-8c1d-68d47eafdcf0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/91/1b91c15058c7610aef88d2b8fd8fdfab/pa/HU65226_6e2d334242ba939797875c88fb5bb74c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 2 1.5 Kizoku',
 'transmission': 'manual',
 'trim': 'Kizoku',
 'year': 2018}
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU65226%27 HTTP/1.1" 200 None
2026-03-30 10:53:31 [auto1.de] INFO: Saving data for HU65226: {'created_time': 1774868011.936744, 'last_price_update_time': 1774868011.936753, 'auction_closing_time': 1774970634.0}
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU65226') HTTP/1.1" 204 0
2026-03-30 10:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_00e6c065d8ba665779fb19fc896eb51a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_482b145af058de7e5fb3abc35aa42c15.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_06f4eb695e613e82936961ea80925c1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_06f4eb695e613e82936961ea80925c1f.jpg not downloaded yet
2026-03-30 10:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_4eeb8911f45c3a013e16e77eda237f15.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_65f5878c5a813318f91d6eab81edb15f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU13236/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_f55e440deed69c115dfa6f094697a593.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_f55e440deed69c115dfa6f094697a593.jpg not downloaded yet
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f07550>
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_3914df870a04c4f22a972de2e392fb31.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_3914df870a04c4f22a972de2e392fb31.jpg saved to cache
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c79f7811-0186-5850-ab21-0ac4af12e20a
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7d1b9d0>
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_4d94cc60cb7f8ccd8ca605f583e2f91f.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_4d94cc60cb7f8ccd8ca605f583e2f91f.jpg saved to cache
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00040ae4-3360-50e6-accf-06e7459bcaad
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e72010>
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_ccbed91e8bb60397440a8aa1ac9d8c36.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_ccbed91e8bb60397440a8aa1ac9d8c36.jpg saved to cache
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00040ae4-3360-50e6-accf-06e7459bcaad
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b00990>
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_e744b09e109041946413cc1177cebaef.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_e744b09e109041946413cc1177cebaef.jpg saved to cache
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d
2026-03-30 10:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_d55bda434fd958922085a1cfdb1257da.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_d925c511f580c0287ec4c4b976c956e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_d925c511f580c0287ec4c4b976c956e3.jpg not downloaded yet
2026-03-30 10:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_684b86019681d3e5c82be853f3a03a09.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c68b10>
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_00e6c065d8ba665779fb19fc896eb51a.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_00e6c065d8ba665779fb19fc896eb51a.jpg saved to cache
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c79f7811-0186-5850-ab21-0ac4af12e20a
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50fe2d0>
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_482b145af058de7e5fb3abc35aa42c15.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_482b145af058de7e5fb3abc35aa42c15.jpg saved to cache
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c79f7811-0186-5850-ab21-0ac4af12e20a
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d4a310>
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_4eeb8911f45c3a013e16e77eda237f15.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_4eeb8911f45c3a013e16e77eda237f15.jpg saved to cache
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00040ae4-3360-50e6-accf-06e7459bcaad
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e29a50>
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_65f5878c5a813318f91d6eab81edb15f.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_65f5878c5a813318f91d6eab81edb15f.jpg saved to cache
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00040ae4-3360-50e6-accf-06e7459bcaad
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_4af0ca58534e1de19470aee5c99f1857.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_4af0ca58534e1de19470aee5c99f1857.jpg not downloaded yet
2026-03-30 10:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_98a760f9aeef429b05e3d57c1ca6eade.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_796b4acd01653e932869ebdaf9a64d54.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_ae29639b73e87a0fbdcf90a145faa4a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_ae29639b73e87a0fbdcf90a145faa4a5.jpg not downloaded yet
2026-03-30 10:53:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef78507d0>
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_d55bda434fd958922085a1cfdb1257da.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_d55bda434fd958922085a1cfdb1257da.jpg saved to cache
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef501e890>
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_684b86019681d3e5c82be853f3a03a09.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_684b86019681d3e5c82be853f3a03a09.jpg saved to cache
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d
2026-03-30 10:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_c27b110187cf29b0d2e70730dd948e2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_da6b1481736fe7f69e38176929b66e06.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c1750>
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_98a760f9aeef429b05e3d57c1ca6eade.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_98a760f9aeef429b05e3d57c1ca6eade.jpg saved to cache
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e6ac90>
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_796b4acd01653e932869ebdaf9a64d54.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_796b4acd01653e932869ebdaf9a64d54.jpg saved to cache
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d
2026-03-30 10:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_fa17ad1d5ee03ae0e51b6563248e4ac0.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_abd8f4764bfe449009040741bae9f598.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_bf9fe9529b6a61941b0965c147a007af.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50924d0>
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_c27b110187cf29b0d2e70730dd948e2b.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_c27b110187cf29b0d2e70730dd948e2b.jpg saved to cache
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d
2026-03-30 10:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_a73f6f408141f40f589fcee5ed696912.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f722d0>
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_da6b1481736fe7f69e38176929b66e06.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_da6b1481736fe7f69e38176929b66e06.jpg saved to cache
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c3a0791-e53f-527f-b77e-1bb21c80beda
2026-03-30 10:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_673f4ed0c52303f72b5e12355a24f9e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_06f4eb695e613e82936961ea80925c1f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_340f34da58749b4f5d25a4d88d40541f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ca6450>
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_fa17ad1d5ee03ae0e51b6563248e4ac0.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_fa17ad1d5ee03ae0e51b6563248e4ac0.jpg saved to cache
2026-03-30 10:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1f30bc9-1328-5b40-947b-813ed7fd00ea
2026-03-30 10:53:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef593e310>
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_abd8f4764bfe449009040741bae9f598.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_abd8f4764bfe449009040741bae9f598.jpg saved to cache
2026-03-30 10:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c79f7811-0186-5850-ab21-0ac4af12e20a
2026-03-30 10:53:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:53:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef511e810>
2026-03-30 10:53:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_bf9fe9529b6a61941b0965c147a007af.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_bf9fe9529b6a61941b0965c147a007af.jpg saved to cache
2026-03-30 10:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c3a0791-e53f-527f-b77e-1bb21c80beda
2026-03-30 10:53:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:53:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7b37550>
2026-03-30 10:53:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F66%252F6266ccb13f033f535a89221f9abc20e4%252Fpa%252FMJ46471_a73f6f408141f40f589fcee5ed696912.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_a73f6f408141f40f589fcee5ed696912.jpg saved to cache
2026-03-30 10:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c3a0791-e53f-527f-b77e-1bb21c80beda
2026-03-30 10:53:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c3a0791-e53f-527f-b77e-1bb21c80beda, skipping ID generation
2026-03-30 10:53:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c3a0791-e53f-527f-b77e-1bb21c80beda with scrape type 1
2026-03-30 10:53:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c3a0791-e53f-527f-b77e-1bb21c80beda sending to next pipeline
2026-03-30 10:53:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c3a0791-e53f-527f-b77e-1bb21c80beda, identifier: MJ46471
2026-03-30 10:53:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c3a0791-e53f-527f-b77e-1bb21c80beda with identifier: MJ46471
2026-03-30 10:53:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c3a0791-e53f-527f-b77e-1bb21c80beda with identifier: MJ46471
2026-03-30 10:53:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c3a0791-e53f-527f-b77e-1bb21c80beda with identifier: MJ46471 to the API
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_a73f6f408141f40f589fcee5ed696912.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:42:07Z',
 'fuel_type': 'petrol',
 'id': '3c3a0791-e53f-527f-b77e-1bb21c80beda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ46471',
 'listing': 'auction',
 'location': 'DE, Bremerhaven',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 125063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_b3ed8d443e1fcfc967595fb129ed84ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3102744,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_a73f6f408141f40f589fcee5ed696912.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_05ad9f3fb295c3c15213f2569e30002c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_04bcb4642a857846395bf41258bc7b0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_a01e82234525f34a12ee46eb75293f55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3476291,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_e9c87b99abf27dcab4b3739de534f0d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2522400,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_da6b1481736fe7f69e38176929b66e06.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3428768,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_bf9fe9529b6a61941b0965c147a007af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3143270,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_944afbbc349fb5ca6516d3575c6ef87f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3a0791-e53f-527f-b77e-1bb21c80beda/3c3a0791-e53f-527f-b77e-1bb21c80beda_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/66/6266ccb13f033f535a89221f9abc20e4/pa/MJ46471_0ada83e91fa21a061018dc102b1aaf6a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.6 Ti-VCT Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ46471%27 HTTP/1.1" 200 None
2026-03-30 10:53:33 [auto1.de] INFO: Saving data for MJ46471: {'created_time': 1774868013.960942, 'last_price_update_time': 1774868013.960952, 'auction_closing_time': 1774971727.0}
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ46471') HTTP/1.1" 204 0
2026-03-30 10:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_8d51c131281e8356a96230ced707b5d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_e2c70b8d34802f3961110e1737f726a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_ae29639b73e87a0fbdcf90a145faa4a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LC32113> (referer: https://www.auto1.com/v1/car-details-view/LC32113/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_d925c511f580c0287ec4c4b976c956e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe3bd0>
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_673f4ed0c52303f72b5e12355a24f9e1.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_673f4ed0c52303f72b5e12355a24f9e1.jpg saved to cache
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1f30bc9-1328-5b40-947b-813ed7fd00ea
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe8fd0>
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_06f4eb695e613e82936961ea80925c1f.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_06f4eb695e613e82936961ea80925c1f.jpg saved to cache
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1f30bc9-1328-5b40-947b-813ed7fd00ea
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ae17d0>
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_340f34da58749b4f5d25a4d88d40541f.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_340f34da58749b4f5d25a4d88d40541f.jpg saved to cache
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1f30bc9-1328-5b40-947b-813ed7fd00ea
2026-03-30 10:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_a8c95752846995f8a4f8b98789ee9805.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_bf0e6070140c80b4638213f0ab46f214.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4febcd0>
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_8d51c131281e8356a96230ced707b5d7.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_8d51c131281e8356a96230ced707b5d7.jpg saved to cache
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5110490>
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_e2c70b8d34802f3961110e1737f726a8.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_e2c70b8d34802f3961110e1737f726a8.jpg saved to cache
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d78650>
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_ae29639b73e87a0fbdcf90a145faa4a5.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_ae29639b73e87a0fbdcf90a145faa4a5.jpg saved to cache
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c1f30bc9-1328-5b40-947b-813ed7fd00ea
2026-03-30 10:53:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07da1ee5-5a8d-5218-af95-394bf20777b8 with identifier: LC32113
2026-03-30 10:53:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07da1ee5-5a8d-5218-af95-394bf20777b8 with scrape type 1
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 07da1ee5-5a8d-5218-af95-394bf20777b8
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_9e052abb56cb11353c4813d0baf2d2b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_9e052abb56cb11353c4813d0baf2d2b1.jpg not downloaded yet
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9f04056fd0>
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_d925c511f580c0287ec4c4b976c956e3.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_d925c511f580c0287ec4c4b976c956e3.jpg saved to cache
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1f30bc9-1328-5b40-947b-813ed7fd00ea
2026-03-30 10:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_0d0557294ede79620945ab1ae8fdc4ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_2c7b88dd2b47c8c871dd733b526d63c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_2c7b88dd2b47c8c871dd733b526d63c9.jpg not downloaded yet
2026-03-30 10:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_5d3618c4a8fb4e3e0b0468549b7e7359.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_73f7818d526c5c79d548d81e5596e7e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_73f7818d526c5c79d548d81e5596e7e9.jpg not downloaded yet
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d7d250>
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_a8c95752846995f8a4f8b98789ee9805.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_a8c95752846995f8a4f8b98789ee9805.jpg saved to cache
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dfa750>
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F3f%252Ff73f269152ed366a605eaef999a14d9d%252Fpa%252FHC12973_bf0e6070140c80b4638213f0ab46f214.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_bf0e6070140c80b4638213f0ab46f214.jpg saved to cache
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c79f7811-0186-5850-ab21-0ac4af12e20a
2026-03-30 10:53:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c79f7811-0186-5850-ab21-0ac4af12e20a, skipping ID generation
2026-03-30 10:53:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c79f7811-0186-5850-ab21-0ac4af12e20a with scrape type 1
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c79f7811-0186-5850-ab21-0ac4af12e20a sending to next pipeline
2026-03-30 10:53:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c79f7811-0186-5850-ab21-0ac4af12e20a, identifier: HC12973
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_169e0278831e728fd47bf751ed896b43.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_169e0278831e728fd47bf751ed896b43.jpg not downloaded yet
2026-03-30 10:53:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c79f7811-0186-5850-ab21-0ac4af12e20a with identifier: HC12973
2026-03-30 10:53:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c79f7811-0186-5850-ab21-0ac4af12e20a with identifier: HC12973
2026-03-30 10:53:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c79f7811-0186-5850-ab21-0ac4af12e20a with identifier: HC12973 to the API
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_bf0e6070140c80b4638213f0ab46f214.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:34:10Z',
 'fuel_type': 'petrol',
 'id': 'c79f7811-0186-5850-ab21-0ac4af12e20a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC12973',
 'listing': 'auction',
 'location': 'DE, Waiblingen',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 89261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_053d3df327a339d4342ccac022dc06ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_bf0e6070140c80b4638213f0ab46f214.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_00e6c065d8ba665779fb19fc896eb51a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_d8cca2a17a6dfe0660e58ca3f5113e75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_482b145af058de7e5fb3abc35aa42c15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_c3ded40873f1c3a67c1d533acc10b0c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2537752,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_abd8f4764bfe449009040741bae9f598.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_376bf29357509c6dd213d2e08ef95fae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_3914df870a04c4f22a972de2e392fb31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79f7811-0186-5850-ab21-0ac4af12e20a/c79f7811-0186-5850-ab21-0ac4af12e20a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/3f/f73f269152ed366a605eaef999a14d9d/pa/HC12973_5a61ef6157123e3b073c7d6b0b244133.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2016}
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC12973%27 HTTP/1.1" 200 None
2026-03-30 10:53:34 [auto1.de] INFO: Saving data for HC12973: {'created_time': 1774868014.997028, 'last_price_update_time': 1774868014.99704, 'auction_closing_time': 1774971250.0}
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC12973') HTTP/1.1" 204 0
2026-03-30 10:53:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_9e052abb56cb11353c4813d0baf2d2b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_61964f77dbda782bb5f9f937aa7b1749.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_61964f77dbda782bb5f9f937aa7b1749.jpg not downloaded yet
2026-03-30 10:53:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT55201/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ea2e10>
2026-03-30 10:53:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fea%252F67ea53381d1d095065b20567f0937e2c%252Fpa%252FXG57506_0d0557294ede79620945ab1ae8fdc4ed.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_0d0557294ede79620945ab1ae8fdc4ed.jpg saved to cache
2026-03-30 10:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d
2026-03-30 10:53:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d, skipping ID generation
2026-03-30 10:53:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d with scrape type 1
2026-03-30 10:53:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d sending to next pipeline
2026-03-30 10:53:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d, identifier: XG57506
2026-03-30 10:53:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6eed0>
2026-03-30 10:53:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbd%252F5abd231ff3285cda795ae07b78d48a7c%252Fpa%252FBM23326_5d3618c4a8fb4e3e0b0468549b7e7359.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_5d3618c4a8fb4e3e0b0468549b7e7359.jpg saved to cache
2026-03-30 10:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00040ae4-3360-50e6-accf-06e7459bcaad
2026-03-30 10:53:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00040ae4-3360-50e6-accf-06e7459bcaad, skipping ID generation
2026-03-30 10:53:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00040ae4-3360-50e6-accf-06e7459bcaad with scrape type 1
2026-03-30 10:53:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00040ae4-3360-50e6-accf-06e7459bcaad sending to next pipeline
2026-03-30 10:53:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00040ae4-3360-50e6-accf-06e7459bcaad, identifier: BM23326
2026-03-30 10:53:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU13236> (referer: https://www.auto1.com/v1/car-details-view/DU13236/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d with identifier: XG57506
2026-03-30 10:53:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d with identifier: XG57506
2026-03-30 10:53:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bb4a7be-4e94-5f10-8b0c-49aff31aac1d with identifier: XG57506 to the API
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_0d0557294ede79620945ab1ae8fdc4ed.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:54:28Z',
 'fuel_type': 'diesel',
 'id': '7bb4a7be-4e94-5f10-8b0c-49aff31aac1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG57506',
 'listing': 'auction',
 'location': 'DE, Pforzheim',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 178935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_e744b09e109041946413cc1177cebaef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_684b86019681d3e5c82be853f3a03a09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_a8c95752846995f8a4f8b98789ee9805.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_0d0557294ede79620945ab1ae8fdc4ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_e2c70b8d34802f3961110e1737f726a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_c27b110187cf29b0d2e70730dd948e2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_796b4acd01653e932869ebdaf9a64d54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_d55bda434fd958922085a1cfdb1257da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_98a760f9aeef429b05e3d57c1ca6eade.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bb4a7be-4e94-5f10-8b0c-49aff31aac1d/7bb4a7be-4e94-5f10-8b0c-49aff31aac1d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/ea/67ea53381d1d095065b20567f0937e2c/pa/XG57506_8d51c131281e8356a96230ced707b5d7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-05',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI FR-Line',
 'transmission': 'automatic',
 'trim': 'FR-Line',
 'year': 2017}
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG57506%27 HTTP/1.1" 200 None
2026-03-30 10:53:35 [auto1.de] INFO: Saving data for XG57506: {'created_time': 1774868015.709985, 'last_price_update_time': 1774868015.709994, 'auction_closing_time': 1774972468.0}
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG57506') HTTP/1.1" 204 0
2026-03-30 10:53:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00040ae4-3360-50e6-accf-06e7459bcaad with identifier: BM23326
2026-03-30 10:53:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00040ae4-3360-50e6-accf-06e7459bcaad with identifier: BM23326
2026-03-30 10:53:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00040ae4-3360-50e6-accf-06e7459bcaad with identifier: BM23326 to the API
2026-03-30 10:53:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_5d3618c4a8fb4e3e0b0468549b7e7359.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:05:06Z',
 'fuel_type': 'electro',
 'id': '00040ae4-3360-50e6-accf-06e7459bcaad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM23326',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 16,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_8e132d5537e49877da84e7db58f81ba2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_5d3618c4a8fb4e3e0b0468549b7e7359.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_65f5878c5a813318f91d6eab81edb15f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_ef057a2a4f6c4b70a5c8389224a5da37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_4eeb8911f45c3a013e16e77eda237f15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_8c726ac0011f34774cd1ce45ef1b962d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_ccbed91e8bb60397440a8aa1ac9d8c36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_0bdc6867724d3075175fa34a84c06941.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_4d94cc60cb7f8ccd8ca605f583e2f91f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00040ae4-3360-50e6-accf-06e7459bcaad/00040ae4-3360-50e6-accf-06e7459bcaad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bd/5abd231ff3285cda795ae07b78d48a7c/pa/BM23326_1efd322ea2be2cad9d997430f9148083.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM23326%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [auto1.de] INFO: Saving data for BM23326: {'created_time': 1774868016.130039, 'last_price_update_time': 1774868016.130048, 'auction_closing_time': 1774969506.0}
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM23326') HTTP/1.1" 204 0
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_db89c7c66a0d7b8702b496c10572c06d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_db89c7c66a0d7b8702b496c10572c06d.jpg not downloaded yet
2026-03-30 10:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_2c7b88dd2b47c8c871dd733b526d63c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_73f7818d526c5c79d548d81e5596e7e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP33761/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AM79685/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dfabd0>
2026-03-30 10:53:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_9e052abb56cb11353c4813d0baf2d2b1.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_9e052abb56cb11353c4813d0baf2d2b1.jpg saved to cache
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07da1ee5-5a8d-5218-af95-394bf20777b8
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_e8d50d1602ccda96747110b7620e9666.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_e8d50d1602ccda96747110b7620e9666.jpg not downloaded yet
2026-03-30 10:53:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a36c2c1-709f-50be-9c4a-b5f1e0222a46 with identifier: DU13236
2026-03-30 10:53:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a36c2c1-709f-50be-9c4a-b5f1e0222a46 with scrape type 1
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a36c2c1-709f-50be-9c4a-b5f1e0222a46
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fc3%252F0ec34474569aa15e4db8760ac430f7fa%252Fpa%252FDU13236_c8d8c2bbbe41d9c0a1bf27274fc4ebf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_c8d8c2bbbe41d9c0a1bf27274fc4ebf7.jpg already downloaded
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fc3%252F0ec34474569aa15e4db8760ac430f7fa%252Fpa%252FDU13236_670c1e75dd8535f4f1c6c6c9fb6eefb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_670c1e75dd8535f4f1c6c6c9fb6eefb9.jpg already downloaded
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fc3%252F0ec34474569aa15e4db8760ac430f7fa%252Fpa%252FDU13236_fdbae233d9ce32b271b07c6394a10055.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_fdbae233d9ce32b271b07c6394a10055.jpg already downloaded
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fc3%252F0ec34474569aa15e4db8760ac430f7fa%252Fpa%252FDU13236_6db9fbfb2d38e661523f55e5a174d241.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_6db9fbfb2d38e661523f55e5a174d241.jpg already downloaded
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fc3%252F0ec34474569aa15e4db8760ac430f7fa%252Fpa%252FDU13236_dccb4ad8e3c7a6b2bff49556b764fc88.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_dccb4ad8e3c7a6b2bff49556b764fc88.jpg already downloaded
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fc3%252F0ec34474569aa15e4db8760ac430f7fa%252Fpa%252FDU13236_e710de18885f68c0a4c43be4ad7a6ec2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_e710de18885f68c0a4c43be4ad7a6ec2.jpg already downloaded
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fc3%252F0ec34474569aa15e4db8760ac430f7fa%252Fpa%252FDU13236_af378c59524bc8ad413a9c464f46ea0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_af378c59524bc8ad413a9c464f46ea0f.jpg already downloaded
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fc3%252F0ec34474569aa15e4db8760ac430f7fa%252Fpa%252FDU13236_adcb9450d64dd0ae6b922fa9c56c7dff.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_adcb9450d64dd0ae6b922fa9c56c7dff.jpg already downloaded
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fc3%252F0ec34474569aa15e4db8760ac430f7fa%252Fpa%252FDU13236_5012cafa090e0a593bc3fcc2d8fe0371.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_5012cafa090e0a593bc3fcc2d8fe0371.jpg already downloaded
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fc3%252F0ec34474569aa15e4db8760ac430f7fa%252Fpa%252FDU13236_0a12eba37baed8b4548a7fe8705d828f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_0a12eba37baed8b4548a7fe8705d828f.jpg already downloaded
2026-03-30 10:53:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a36c2c1-709f-50be-9c4a-b5f1e0222a46, identifier: DU13236
2026-03-30 10:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_4af0ca58534e1de19470aee5c99f1857.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_fe45b914a6d785678eef5a883de09566.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_fe45b914a6d785678eef5a883de09566.jpg not downloaded yet
2026-03-30 10:53:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a36c2c1-709f-50be-9c4a-b5f1e0222a46 with identifier: DU13236
2026-03-30 10:53:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a36c2c1-709f-50be-9c4a-b5f1e0222a46 with identifier: DU13236
2026-03-30 10:53:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a36c2c1-709f-50be-9c4a-b5f1e0222a46 with identifier: DU13236 to the API
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DU13236>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:07:54Z',
 'fuel_type': 'petrol',
 'id': '8a36c2c1-709f-50be-9c4a-b5f1e0222a46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU13236',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 137417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_c8d8c2bbbe41d9c0a1bf27274fc4ebf7.jpg',
                'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_670c1e75dd8535f4f1c6c6c9fb6eefb9.jpg',
                'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_fdbae233d9ce32b271b07c6394a10055.jpg',
                'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_6db9fbfb2d38e661523f55e5a174d241.jpg',
                'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_dccb4ad8e3c7a6b2bff49556b764fc88.jpg',
                'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_e710de18885f68c0a4c43be4ad7a6ec2.jpg',
                'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_af378c59524bc8ad413a9c464f46ea0f.jpg',
                'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_adcb9450d64dd0ae6b922fa9c56c7dff.jpg',
                'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_5012cafa090e0a593bc3fcc2d8fe0371.jpg',
                'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_0a12eba37baed8b4548a7fe8705d828f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a36c2c1-709f-50be-9c4a-b5f1e0222a46/8a36c2c1-709f-50be-9c4a-b5f1e0222a46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2785578,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_c8d8c2bbbe41d9c0a1bf27274fc4ebf7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a36c2c1-709f-50be-9c4a-b5f1e0222a46/8a36c2c1-709f-50be-9c4a-b5f1e0222a46_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2673164,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_670c1e75dd8535f4f1c6c6c9fb6eefb9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a36c2c1-709f-50be-9c4a-b5f1e0222a46/8a36c2c1-709f-50be-9c4a-b5f1e0222a46_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2621493,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_fdbae233d9ce32b271b07c6394a10055.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a36c2c1-709f-50be-9c4a-b5f1e0222a46/8a36c2c1-709f-50be-9c4a-b5f1e0222a46_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2557747,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_6db9fbfb2d38e661523f55e5a174d241.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a36c2c1-709f-50be-9c4a-b5f1e0222a46/8a36c2c1-709f-50be-9c4a-b5f1e0222a46_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2799587,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_dccb4ad8e3c7a6b2bff49556b764fc88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a36c2c1-709f-50be-9c4a-b5f1e0222a46/8a36c2c1-709f-50be-9c4a-b5f1e0222a46_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2869132,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_e710de18885f68c0a4c43be4ad7a6ec2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a36c2c1-709f-50be-9c4a-b5f1e0222a46/8a36c2c1-709f-50be-9c4a-b5f1e0222a46_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2477915,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_af378c59524bc8ad413a9c464f46ea0f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a36c2c1-709f-50be-9c4a-b5f1e0222a46/8a36c2c1-709f-50be-9c4a-b5f1e0222a46_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2876413,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_adcb9450d64dd0ae6b922fa9c56c7dff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a36c2c1-709f-50be-9c4a-b5f1e0222a46/8a36c2c1-709f-50be-9c4a-b5f1e0222a46_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2724945,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_5012cafa090e0a593bc3fcc2d8fe0371.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a36c2c1-709f-50be-9c4a-b5f1e0222a46/8a36c2c1-709f-50be-9c4a-b5f1e0222a46_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2659524,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/c3/0ec34474569aa15e4db8760ac430f7fa/pa/DU13236_0a12eba37baed8b4548a7fe8705d828f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 1.8 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2009}
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13236%27 HTTP/1.1" 200 None
2026-03-30 10:53:36 [auto1.de] INFO: Saving data for DU13236: {'created_time': 1774868016.997135, 'last_price_update_time': 1774868016.997146, 'auction_closing_time': 1774969674.0}
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU13236') HTTP/1.1" 204 0
2026-03-30 10:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_169e0278831e728fd47bf751ed896b43.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_61964f77dbda782bb5f9f937aa7b1749.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_d839566e0b30e1c027edac5018deba2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_d839566e0b30e1c027edac5018deba2f.jpg not downloaded yet
2026-03-30 10:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_db89c7c66a0d7b8702b496c10572c06d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f19d0>
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_2c7b88dd2b47c8c871dd733b526d63c9.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_2c7b88dd2b47c8c871dd733b526d63c9.jpg saved to cache
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07da1ee5-5a8d-5218-af95-394bf20777b8
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f154d0>
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_73f7818d526c5c79d548d81e5596e7e9.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_73f7818d526c5c79d548d81e5596e7e9.jpg saved to cache
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07da1ee5-5a8d-5218-af95-394bf20777b8
2026-03-30 10:53:37 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 9519 | hits on page: 40
2026-03-30 10:53:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c3710>
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_4af0ca58534e1de19470aee5c99f1857.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_4af0ca58534e1de19470aee5c99f1857.jpg saved to cache
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c1f30bc9-1328-5b40-947b-813ed7fd00ea
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_de741a110f06f44d208422b574ea3727.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_de741a110f06f44d208422b574ea3727.jpg not downloaded yet
2026-03-30 10:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_e8d50d1602ccda96747110b7620e9666.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:37 [auto1.de] INFO: Found listing with ID: BK48500
2026-03-30 10:53:37 [auto1.de] INFO: Found listing with ID: AT18561
2026-03-30 10:53:37 [auto1.de] INFO: Found listing with ID: UV49850
2026-03-30 10:53:37 [auto1.de] INFO: Found listing with ID: AX09860
2026-03-30 10:53:37 [auto1.de] INFO: Found listing with ID: BT59614
2026-03-30 10:53:37 [auto1.de] INFO: Found listing with ID: KY40781
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY40781%27 HTTP/1.1" 200 None
2026-03-30 10:53:37 [auto1.de] INFO: Scrape type for KY40781: 2
2026-03-30 10:53:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edc6df01-7f6c-5b50-9614-5ee8dc8259cd with identifier: KY40781
2026-03-30 10:53:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edc6df01-7f6c-5b50-9614-5ee8dc8259cd with scrape type 2
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edc6df01-7f6c-5b50-9614-5ee8dc8259cd with scrape type 2
2026-03-30 10:53:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edc6df01-7f6c-5b50-9614-5ee8dc8259cd, identifier: KY40781
2026-03-30 10:53:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_f55e440deed69c115dfa6f094697a593.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edc6df01-7f6c-5b50-9614-5ee8dc8259cd with identifier: KY40781
2026-03-30 10:53:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edc6df01-7f6c-5b50-9614-5ee8dc8259cd with identifier: KY40781
2026-03-30 10:53:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edc6df01-7f6c-5b50-9614-5ee8dc8259cd with identifier: KY40781 to the API
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:37:37Z',
 'fuel_type': 'petrol',
 'id': 'edc6df01-7f6c-5b50-9614-5ee8dc8259cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY40781',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 84409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-28',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2017}
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY40781%27 HTTP/1.1" 200 None
2026-03-30 10:53:37 [auto1.de] INFO: Saving data for KY40781: {'auction_closing_time': 1774971457.0, 'created_time': 1773383310.179438, 'last_price_update_time': 1774868017.713835}
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY40781') HTTP/1.1" 204 0
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb5410>
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_169e0278831e728fd47bf751ed896b43.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_169e0278831e728fd47bf751ed896b43.jpg saved to cache
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07da1ee5-5a8d-5218-af95-394bf20777b8
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d78d50>
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_61964f77dbda782bb5f9f937aa7b1749.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_61964f77dbda782bb5f9f937aa7b1749.jpg saved to cache
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07da1ee5-5a8d-5218-af95-394bf20777b8
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5112ed0>
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_db89c7c66a0d7b8702b496c10572c06d.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_db89c7c66a0d7b8702b496c10572c06d.jpg saved to cache
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07da1ee5-5a8d-5218-af95-394bf20777b8
2026-03-30 10:53:37 [auto1.de] INFO: Found listing with ID: JP65265
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP65265%27 HTTP/1.1" 200 None
2026-03-30 10:53:37 [auto1.de] INFO: Scrape type for JP65265: 2
2026-03-30 10:53:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49610941-d8d7-56ab-8f56-afccadb68576 with identifier: JP65265
2026-03-30 10:53:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49610941-d8d7-56ab-8f56-afccadb68576 with scrape type 2
2026-03-30 10:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49610941-d8d7-56ab-8f56-afccadb68576 with scrape type 2
2026-03-30 10:53:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49610941-d8d7-56ab-8f56-afccadb68576, identifier: JP65265
2026-03-30 10:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_fe45b914a6d785678eef5a883de09566.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49610941-d8d7-56ab-8f56-afccadb68576 with identifier: JP65265
2026-03-30 10:53:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49610941-d8d7-56ab-8f56-afccadb68576 with identifier: JP65265
2026-03-30 10:53:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49610941-d8d7-56ab-8f56-afccadb68576 with identifier: JP65265 to the API
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:08:07Z',
 'fuel_type': 'hybrid',
 'id': '49610941-d8d7-56ab-8f56-afccadb68576',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP65265',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 34832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2022}
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP65265%27 HTTP/1.1" 200 None
2026-03-30 10:53:38 [auto1.de] INFO: Saving data for JP65265: {'auction_closing_time': 1774969687.0, 'created_time': 1774463915.549183, 'last_price_update_time': 1774868018.313474}
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP65265') HTTP/1.1" 204 0
2026-03-30 10:53:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508c550>
2026-03-30 10:53:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_e8d50d1602ccda96747110b7620e9666.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_e8d50d1602ccda96747110b7620e9666.jpg saved to cache
2026-03-30 10:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07da1ee5-5a8d-5218-af95-394bf20777b8
2026-03-30 10:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_d839566e0b30e1c027edac5018deba2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:38 [auto1.de] INFO: Found listing with ID: WV72742
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV72742%27 HTTP/1.1" 200 None
2026-03-30 10:53:38 [auto1.de] INFO: Scrape type for WV72742: 2
2026-03-30 10:53:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f40614b8-23f3-5b86-82f2-b591d643e2dd with identifier: WV72742
2026-03-30 10:53:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f40614b8-23f3-5b86-82f2-b591d643e2dd with scrape type 2
2026-03-30 10:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f40614b8-23f3-5b86-82f2-b591d643e2dd with scrape type 2
2026-03-30 10:53:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f40614b8-23f3-5b86-82f2-b591d643e2dd, identifier: WV72742
2026-03-30 10:53:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:53:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508f450>
2026-03-30 10:53:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_f55e440deed69c115dfa6f094697a593.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_f55e440deed69c115dfa6f094697a593.jpg saved to cache
2026-03-30 10:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1f30bc9-1328-5b40-947b-813ed7fd00ea
2026-03-30 10:53:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f40614b8-23f3-5b86-82f2-b591d643e2dd with identifier: WV72742
2026-03-30 10:53:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f40614b8-23f3-5b86-82f2-b591d643e2dd with identifier: WV72742
2026-03-30 10:53:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f40614b8-23f3-5b86-82f2-b591d643e2dd with identifier: WV72742 to the API
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:33:47Z',
 'fuel_type': 'petrol',
 'id': 'f40614b8-23f3-5b86-82f2-b591d643e2dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV72742',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 17434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-29',
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo GS Line',
 'transmission': 'automatic',
 'trim': 'GS Line',
 'year': 2021}
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV72742%27 HTTP/1.1" 200 None
2026-03-30 10:53:39 [auto1.de] INFO: Saving data for WV72742: {'auction_closing_time': 1774971227.0, 'created_time': 1773662061.370682, 'last_price_update_time': 1774868019.016949}
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV72742') HTTP/1.1" 204 0
2026-03-30 10:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_de741a110f06f44d208422b574ea3727.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:39 [auto1.de] INFO: Found listing with ID: MW79572
2026-03-30 10:53:39 [auto1.de] INFO: Found listing with ID: EU16436
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU16436%27 HTTP/1.1" 200 None
2026-03-30 10:53:39 [auto1.de] INFO: Scrape type for EU16436: 2
2026-03-30 10:53:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3964b989-fe7d-510a-89ab-cfc620e7899d with identifier: EU16436
2026-03-30 10:53:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3964b989-fe7d-510a-89ab-cfc620e7899d with scrape type 2
2026-03-30 10:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3964b989-fe7d-510a-89ab-cfc620e7899d with scrape type 2
2026-03-30 10:53:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3964b989-fe7d-510a-89ab-cfc620e7899d, identifier: EU16436
2026-03-30 10:53:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef508f310>
2026-03-30 10:53:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_fe45b914a6d785678eef5a883de09566.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_fe45b914a6d785678eef5a883de09566.jpg saved to cache
2026-03-30 10:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07da1ee5-5a8d-5218-af95-394bf20777b8
2026-03-30 10:53:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3964b989-fe7d-510a-89ab-cfc620e7899d with identifier: EU16436
2026-03-30 10:53:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3964b989-fe7d-510a-89ab-cfc620e7899d with identifier: EU16436
2026-03-30 10:53:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3964b989-fe7d-510a-89ab-cfc620e7899d with identifier: EU16436 to the API
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:13:03Z',
 'fuel_type': 'diesel',
 'id': '3964b989-fe7d-510a-89ab-cfc620e7899d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU16436',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 200476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-10',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2011}
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU16436%27 HTTP/1.1" 200 None
2026-03-30 10:53:39 [auto1.de] INFO: Saving data for EU16436: {'auction_closing_time': 1774969983.0, 'created_time': 1774377365.01656, 'last_price_update_time': 1774868019.585721}
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU16436') HTTP/1.1" 204 0
2026-03-30 10:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT55201> (referer: https://www.auto1.com/v1/car-details-view/LT55201/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_b5c85066629fdbddf30500a69f34e4cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:39 [auto1.de] INFO: Found listing with ID: PV40119
2026-03-30 10:53:39 [auto1.de] INFO: Found listing with ID: WJ34554
2026-03-30 10:53:39 [auto1.de] INFO: Found listing with ID: WB03660
2026-03-30 10:53:39 [auto1.de] INFO: Found listing with ID: SA60451
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA60451%27 HTTP/1.1" 200 None
2026-03-30 10:53:39 [auto1.de] INFO: Scrape type for SA60451: 2
2026-03-30 10:53:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b77ec5af-aff9-5334-8b5c-4ff2eb96ccf2 with identifier: SA60451
2026-03-30 10:53:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b77ec5af-aff9-5334-8b5c-4ff2eb96ccf2 with scrape type 2
2026-03-30 10:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b77ec5af-aff9-5334-8b5c-4ff2eb96ccf2 with scrape type 2
2026-03-30 10:53:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b77ec5af-aff9-5334-8b5c-4ff2eb96ccf2, identifier: SA60451
2026-03-30 10:53:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9f0550d550>
2026-03-30 10:53:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_d839566e0b30e1c027edac5018deba2f.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_d839566e0b30e1c027edac5018deba2f.jpg saved to cache
2026-03-30 10:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 07da1ee5-5a8d-5218-af95-394bf20777b8
2026-03-30 10:53:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b77ec5af-aff9-5334-8b5c-4ff2eb96ccf2 with identifier: SA60451
2026-03-30 10:53:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b77ec5af-aff9-5334-8b5c-4ff2eb96ccf2 with identifier: SA60451
2026-03-30 10:53:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b77ec5af-aff9-5334-8b5c-4ff2eb96ccf2 with identifier: SA60451 to the API
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:21:28Z',
 'fuel_type': 'petrol',
 'id': 'b77ec5af-aff9-5334-8b5c-4ff2eb96ccf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA60451',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 249929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2011}
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA60451%27 HTTP/1.1" 200 None
2026-03-30 10:53:40 [auto1.de] INFO: Saving data for SA60451: {'auction_closing_time': 1774970488.0, 'created_time': 1773686177.412512, 'last_price_update_time': 1774868020.101742}
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA60451') HTTP/1.1" 204 0
2026-03-30 10:53:40 [auto1.de] INFO: Found listing with ID: XA52420
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA52420%27 HTTP/1.1" 200 None
2026-03-30 10:53:40 [auto1.de] INFO: Scrape type for XA52420: 1
2026-03-30 10:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_683a01af9509f770a22bc85354ffe1a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6dd50>
2026-03-30 10:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F18%252F37181c2390e1ad25d43adf78594fcd9d%252Fpa%252FLC32113_de741a110f06f44d208422b574ea3727.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_de741a110f06f44d208422b574ea3727.jpg saved to cache
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 07da1ee5-5a8d-5218-af95-394bf20777b8
2026-03-30 10:53:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07da1ee5-5a8d-5218-af95-394bf20777b8, skipping ID generation
2026-03-30 10:53:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07da1ee5-5a8d-5218-af95-394bf20777b8 with scrape type 1
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07da1ee5-5a8d-5218-af95-394bf20777b8 sending to next pipeline
2026-03-30 10:53:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07da1ee5-5a8d-5218-af95-394bf20777b8, identifier: LC32113
2026-03-30 10:53:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c631de3-03bc-5c14-8730-11e201d9aeb4 with identifier: LT55201
2026-03-30 10:53:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c631de3-03bc-5c14-8730-11e201d9aeb4 with scrape type 1
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c631de3-03bc-5c14-8730-11e201d9aeb4
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_88e8c81fbd63d2d2a226873d73d39c40.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_88e8c81fbd63d2d2a226873d73d39c40.jpg not downloaded yet
2026-03-30 10:53:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fcb610>
2026-03-30 10:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_b5c85066629fdbddf30500a69f34e4cc.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_b5c85066629fdbddf30500a69f34e4cc.jpg saved to cache
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1f30bc9-1328-5b40-947b-813ed7fd00ea
2026-03-30 10:53:40 [auto1.de] INFO: Found listing with ID: GC35405
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC35405%27 HTTP/1.1" 200 None
2026-03-30 10:53:40 [auto1.de] INFO: Scrape type for GC35405: 2
2026-03-30 10:53:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31ed959b-a493-53b4-994e-39cf831540ab with identifier: GC35405
2026-03-30 10:53:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31ed959b-a493-53b4-994e-39cf831540ab with scrape type 2
2026-03-30 10:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31ed959b-a493-53b4-994e-39cf831540ab with scrape type 2
2026-03-30 10:53:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31ed959b-a493-53b4-994e-39cf831540ab, identifier: GC35405
2026-03-30 10:53:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07da1ee5-5a8d-5218-af95-394bf20777b8 with identifier: LC32113
2026-03-30 10:53:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07da1ee5-5a8d-5218-af95-394bf20777b8 with identifier: LC32113
2026-03-30 10:53:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07da1ee5-5a8d-5218-af95-394bf20777b8 with identifier: LC32113 to the API
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_de741a110f06f44d208422b574ea3727.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:54:36Z',
 'fuel_type': 'diesel',
 'id': '07da1ee5-5a8d-5218-af95-394bf20777b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC32113',
 'listing': 'auction',
 'location': 'DE, Passau',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 201409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_9e052abb56cb11353c4813d0baf2d2b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_2c7b88dd2b47c8c871dd733b526d63c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_73f7818d526c5c79d548d81e5596e7e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_169e0278831e728fd47bf751ed896b43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_61964f77dbda782bb5f9f937aa7b1749.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_db89c7c66a0d7b8702b496c10572c06d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_e8d50d1602ccda96747110b7620e9666.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_fe45b914a6d785678eef5a883de09566.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_d839566e0b30e1c027edac5018deba2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07da1ee5-5a8d-5218-af95-394bf20777b8/07da1ee5-5a8d-5218-af95-394bf20777b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/18/37181c2390e1ad25d43adf78594fcd9d/pa/LC32113_de741a110f06f44d208422b574ea3727.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2015}
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC32113%27 HTTP/1.1" 200 None
2026-03-30 10:53:41 [auto1.de] INFO: Saving data for LC32113: {'created_time': 1774868021.104959, 'last_price_update_time': 1774868021.104972, 'auction_closing_time': 1774972476.0}
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC32113') HTTP/1.1" 204 0
2026-03-30 10:53:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31ed959b-a493-53b4-994e-39cf831540ab with identifier: GC35405
2026-03-30 10:53:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31ed959b-a493-53b4-994e-39cf831540ab with identifier: GC35405
2026-03-30 10:53:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31ed959b-a493-53b4-994e-39cf831540ab with identifier: GC35405 to the API
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-31T15:24:57Z',
 'fuel_type': 'petrol',
 'id': '31ed959b-a493-53b4-994e-39cf831540ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC35405',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 40362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-02',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 FIFA WM Edition',
 'transmission': 'manual',
 'trim': 'FIFA WM Edition',
 'year': 2011}
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC35405%27 HTTP/1.1" 200 None
2026-03-30 10:53:41 [auto1.de] INFO: Saving data for GC35405: {'auction_closing_time': 1774970697.0, 'created_time': 1773301709.083755, 'last_price_update_time': 1774868021.449079}
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC35405') HTTP/1.1" 204 0
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_dae07b71c361b562437d2f94f3736870.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_dae07b71c361b562437d2f94f3736870.jpg not downloaded yet
2026-03-30 10:53:41 [auto1.de] INFO: Found listing with ID: HH88396
2026-03-30 10:53:41 [auto1.de] INFO: Found listing with ID: MW52698
2026-03-30 10:53:41 [auto1.de] INFO: Found listing with ID: JL06100
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL06100%27 HTTP/1.1" 200 None
2026-03-30 10:53:41 [auto1.de] INFO: Scrape type for JL06100: 2
2026-03-30 10:53:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 005d395e-d675-56fd-aaf4-35faf98365d7 with identifier: JL06100
2026-03-30 10:53:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 005d395e-d675-56fd-aaf4-35faf98365d7 with scrape type 2
2026-03-30 10:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 005d395e-d675-56fd-aaf4-35faf98365d7 with scrape type 2
2026-03-30 10:53:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 005d395e-d675-56fd-aaf4-35faf98365d7, identifier: JL06100
2026-03-30 10:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP33761> (referer: https://www.auto1.com/v1/car-details-view/GP33761/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AM79685> (referer: https://www.auto1.com/v1/car-details-view/AM79685/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 005d395e-d675-56fd-aaf4-35faf98365d7 with identifier: JL06100
2026-03-30 10:53:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 005d395e-d675-56fd-aaf4-35faf98365d7 with identifier: JL06100
2026-03-30 10:53:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 005d395e-d675-56fd-aaf4-35faf98365d7 with identifier: JL06100 to the API
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:56:05Z',
 'fuel_type': 'petrol',
 'id': '005d395e-d675-56fd-aaf4-35faf98365d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL06100',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 179425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-12',
 'seller_name': None,
 'title': "Kia cee'd 1.0 TGDI Vision",
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2016}
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL06100%27 HTTP/1.1" 200 None
2026-03-30 10:53:42 [auto1.de] INFO: Saving data for JL06100: {'auction_closing_time': 1774972565.0, 'created_time': 1773518763.270051, 'last_price_update_time': 1774868022.024864}
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL06100') HTTP/1.1" 204 0
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_80bf8d47133171ba6193cb87515478f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_80bf8d47133171ba6193cb87515478f6.jpg not downloaded yet
2026-03-30 10:53:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f97590>
2026-03-30 10:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff5%252F24f554160039817271ca0a16faf000fb%252Fpa%252FME64597_683a01af9509f770a22bc85354ffe1a4.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_683a01af9509f770a22bc85354ffe1a4.jpg saved to cache
2026-03-30 10:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1f30bc9-1328-5b40-947b-813ed7fd00ea
2026-03-30 10:53:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1f30bc9-1328-5b40-947b-813ed7fd00ea, skipping ID generation
2026-03-30 10:53:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1f30bc9-1328-5b40-947b-813ed7fd00ea with scrape type 1
2026-03-30 10:53:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1f30bc9-1328-5b40-947b-813ed7fd00ea sending to next pipeline
2026-03-30 10:53:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1f30bc9-1328-5b40-947b-813ed7fd00ea, identifier: ME64597
2026-03-30 10:53:42 [auto1.de] INFO: Found listing with ID: UP87347
2026-03-30 10:53:42 [auto1.de] INFO: Found listing with ID: GB40015
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB40015%27 HTTP/1.1" 200 None
2026-03-30 10:53:42 [auto1.de] INFO: Scrape type for GB40015: 2
2026-03-30 10:53:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cce12eb-3fce-5c1d-8921-d934385304ca with identifier: GB40015
2026-03-30 10:53:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cce12eb-3fce-5c1d-8921-d934385304ca with scrape type 2
2026-03-30 10:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cce12eb-3fce-5c1d-8921-d934385304ca with scrape type 2
2026-03-30 10:53:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cce12eb-3fce-5c1d-8921-d934385304ca, identifier: GB40015
2026-03-30 10:53:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1f30bc9-1328-5b40-947b-813ed7fd00ea with identifier: ME64597
2026-03-30 10:53:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1f30bc9-1328-5b40-947b-813ed7fd00ea with identifier: ME64597
2026-03-30 10:53:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1f30bc9-1328-5b40-947b-813ed7fd00ea with identifier: ME64597 to the API
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_683a01af9509f770a22bc85354ffe1a4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:55:18Z',
 'fuel_type': 'petrol',
 'id': 'c1f30bc9-1328-5b40-947b-813ed7fd00ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME64597',
 'listing': 'auction',
 'location': 'DE, Regensburg',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 50494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2708741,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_683a01af9509f770a22bc85354ffe1a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2672417,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_b5c85066629fdbddf30500a69f34e4cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_fa17ad1d5ee03ae0e51b6563248e4ac0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_673f4ed0c52303f72b5e12355a24f9e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_340f34da58749b4f5d25a4d88d40541f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_06f4eb695e613e82936961ea80925c1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2130522,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_f55e440deed69c115dfa6f094697a593.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_d925c511f580c0287ec4c4b976c956e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1439601,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_4af0ca58534e1de19470aee5c99f1857.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f30bc9-1328-5b40-947b-813ed7fd00ea/c1f30bc9-1328-5b40-947b-813ed7fd00ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f5/24f554160039817271ca0a16faf000fb/pa/ME64597_ae29639b73e87a0fbdcf90a145faa4a5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-08-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME64597%27 HTTP/1.1" 200 None
2026-03-30 10:53:42 [auto1.de] INFO: Saving data for ME64597: {'created_time': 1774868022.828785, 'last_price_update_time': 1774868022.828796, 'auction_closing_time': 1774972518.0}
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME64597') HTTP/1.1" 204 0
2026-03-30 10:53:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cce12eb-3fce-5c1d-8921-d934385304ca with identifier: GB40015
2026-03-30 10:53:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cce12eb-3fce-5c1d-8921-d934385304ca with identifier: GB40015
2026-03-30 10:53:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cce12eb-3fce-5c1d-8921-d934385304ca with identifier: GB40015 to the API
2026-03-30 10:53:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:54:09Z',
 'fuel_type': 'hybrid',
 'id': '8cce12eb-3fce-5c1d-8921-d934385304ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB40015',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 100418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-19',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium X',
 'transmission': 'automatic',
 'trim': 'Titanium X',
 'year': 2020}
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB40015%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [auto1.de] INFO: Saving data for GB40015: {'auction_closing_time': 1774972449.0, 'created_time': 1774465729.938048, 'last_price_update_time': 1774868023.176096}
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB40015') HTTP/1.1" 204 0
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_cf20daa99a2e750adc64e3f15f8cfb02.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_cf20daa99a2e750adc64e3f15f8cfb02.jpg not downloaded yet
2026-03-30 10:53:43 [auto1.de] INFO: Found listing with ID: WA53567
2026-03-30 10:53:43 [auto1.de] INFO: Found listing with ID: LN31726
2026-03-30 10:53:43 [auto1.de] INFO: Found listing with ID: ZH98765
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH98765%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [auto1.de] INFO: Scrape type for ZH98765: 2
2026-03-30 10:53:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f623983f-6cbc-52f6-8ca6-52c17d343751 with identifier: ZH98765
2026-03-30 10:53:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f623983f-6cbc-52f6-8ca6-52c17d343751 with scrape type 2
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f623983f-6cbc-52f6-8ca6-52c17d343751 with scrape type 2
2026-03-30 10:53:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f623983f-6cbc-52f6-8ca6-52c17d343751, identifier: ZH98765
2026-03-30 10:53:43 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 9520 | hits on page: 40
2026-03-30 10:53:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b05960b1-4edd-5d46-85e2-c70ed0230279 with identifier: GP33761
2026-03-30 10:53:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b05960b1-4edd-5d46-85e2-c70ed0230279 with scrape type 1
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b05960b1-4edd-5d46-85e2-c70ed0230279
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e90ac0941ada5392b8ce0ccbde4e4%252Fpa%252FGP33761_d77df3ee84cb8d7e19b4f62957d24918.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e90ac0941ada5392b8ce0ccbde4e4/pa/GP33761_d77df3ee84cb8d7e19b4f62957d24918.jpg already downloaded
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e90ac0941ada5392b8ce0ccbde4e4%252Fpa%252FGP33761_38c5c46a00b310c976f5a717a8664517.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e90ac0941ada5392b8ce0ccbde4e4/pa/GP33761_38c5c46a00b310c976f5a717a8664517.jpg already downloaded
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e90ac0941ada5392b8ce0ccbde4e4%252Fpa%252FGP33761_f5123ce80f08a2b1a2fa0b0765e0efb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e90ac0941ada5392b8ce0ccbde4e4/pa/GP33761_f5123ce80f08a2b1a2fa0b0765e0efb6.jpg already downloaded
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e90ac0941ada5392b8ce0ccbde4e4%252Fpa%252FGP33761_c83030f0fb1b640fc7e824a7804d70a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e90ac0941ada5392b8ce0ccbde4e4/pa/GP33761_c83030f0fb1b640fc7e824a7804d70a9.jpg already downloaded
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e90ac0941ada5392b8ce0ccbde4e4%252Fpa%252FGP33761_ad368d100a98e65268fab91460fe3acd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e90ac0941ada5392b8ce0ccbde4e4/pa/GP33761_ad368d100a98e65268fab91460fe3acd.jpg already downloaded
2026-03-30 10:53:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b05960b1-4edd-5d46-85e2-c70ed0230279, identifier: GP33761
2026-03-30 10:53:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b76a2812-dd06-539c-a3ab-2b8d14260b6c with identifier: AM79685
2026-03-30 10:53:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b76a2812-dd06-539c-a3ab-2b8d14260b6c with scrape type 1
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b76a2812-dd06-539c-a3ab-2b8d14260b6c
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F14%252F58145da3a502fd039f6e9fa33565ee60%252Fpa%252FAM79685_764d9f22d4372e8decff4ab07de00c45.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_764d9f22d4372e8decff4ab07de00c45.jpg already downloaded
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F14%252F58145da3a502fd039f6e9fa33565ee60%252Fpa%252FAM79685_059a1c5179fbe45546fe5c63b0189a39.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_059a1c5179fbe45546fe5c63b0189a39.jpg already downloaded
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F14%252F58145da3a502fd039f6e9fa33565ee60%252Fpa%252FAM79685_fe6220fe3a2700436bb4724acebe3de7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_fe6220fe3a2700436bb4724acebe3de7.jpg already downloaded
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F14%252F58145da3a502fd039f6e9fa33565ee60%252Fpa%252FAM79685_de211739fea358082feb75f017ee9cc6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_de211739fea358082feb75f017ee9cc6.jpg already downloaded
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F14%252F58145da3a502fd039f6e9fa33565ee60%252Fpa%252FAM79685_93a04688d01422b6b81b78993cec62fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_93a04688d01422b6b81b78993cec62fa.jpg already downloaded
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F14%252F58145da3a502fd039f6e9fa33565ee60%252Fpa%252FAM79685_c57c3c4a13445495a4c435ecb3142eae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_c57c3c4a13445495a4c435ecb3142eae.jpg already downloaded
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F14%252F58145da3a502fd039f6e9fa33565ee60%252Fpa%252FAM79685_0979e654972f2886a9d87ef39b6ca1b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_0979e654972f2886a9d87ef39b6ca1b9.jpg already downloaded
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F14%252F58145da3a502fd039f6e9fa33565ee60%252Fpa%252FAM79685_5272eed9c85e42205d7cbfb12df5cc04.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_5272eed9c85e42205d7cbfb12df5cc04.jpg already downloaded
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F14%252F58145da3a502fd039f6e9fa33565ee60%252Fpa%252FAM79685_0d15328767aab82b0f2e8abcb318b426.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_0d15328767aab82b0f2e8abcb318b426.jpg already downloaded
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F14%252F58145da3a502fd039f6e9fa33565ee60%252Fpa%252FAM79685_35cc70dfef94c6cee380fc51ccc194ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_35cc70dfef94c6cee380fc51ccc194ab.jpg already downloaded
2026-03-30 10:53:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b76a2812-dd06-539c-a3ab-2b8d14260b6c, identifier: AM79685
2026-03-30 10:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_88e8c81fbd63d2d2a226873d73d39c40.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f623983f-6cbc-52f6-8ca6-52c17d343751 with identifier: ZH98765
2026-03-30 10:53:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f623983f-6cbc-52f6-8ca6-52c17d343751 with identifier: ZH98765
2026-03-30 10:53:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f623983f-6cbc-52f6-8ca6-52c17d343751 with identifier: ZH98765 to the API
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:52:02Z',
 'fuel_type': 'diesel',
 'id': 'f623983f-6cbc-52f6-8ca6-52c17d343751',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH98765',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 189173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-05',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 119 CDI kompakt',
 'transmission': 'automatic',
 'trim': 'kompakt',
 'year': 2017}
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH98765%27 HTTP/1.1" 200 None
2026-03-30 10:53:44 [auto1.de] INFO: Saving data for ZH98765: {'auction_closing_time': 1774972322.0, 'created_time': 1772547078.011267, 'last_price_update_time': 1774868024.357475}
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH98765') HTTP/1.1" 204 0
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_7b6ad83874f243379e346ddd5b08b703.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_7b6ad83874f243379e346ddd5b08b703.jpg not downloaded yet
2026-03-30 10:53:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b05960b1-4edd-5d46-85e2-c70ed0230279 with identifier: GP33761
2026-03-30 10:53:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b05960b1-4edd-5d46-85e2-c70ed0230279 with identifier: GP33761
2026-03-30 10:53:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b05960b1-4edd-5d46-85e2-c70ed0230279 with identifier: GP33761 to the API
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GP33761>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:51:45Z',
 'fuel_type': 'petrol',
 'id': 'b05960b1-4edd-5d46-85e2-c70ed0230279',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP33761',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 144377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img30/1e/301e90ac0941ada5392b8ce0ccbde4e4/pa/GP33761_d77df3ee84cb8d7e19b4f62957d24918.jpg',
                'https://img-pa.auto1.com/img30/1e/301e90ac0941ada5392b8ce0ccbde4e4/pa/GP33761_38c5c46a00b310c976f5a717a8664517.jpg',
                'https://img-pa.auto1.com/img30/1e/301e90ac0941ada5392b8ce0ccbde4e4/pa/GP33761_f5123ce80f08a2b1a2fa0b0765e0efb6.jpg',
                'https://img-pa.auto1.com/img30/1e/301e90ac0941ada5392b8ce0ccbde4e4/pa/GP33761_c83030f0fb1b640fc7e824a7804d70a9.jpg',
                'https://img-pa.auto1.com/img30/1e/301e90ac0941ada5392b8ce0ccbde4e4/pa/GP33761_ad368d100a98e65268fab91460fe3acd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b05960b1-4edd-5d46-85e2-c70ed0230279/b05960b1-4edd-5d46-85e2-c70ed0230279_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/1e/301e90ac0941ada5392b8ce0ccbde4e4/pa/GP33761_d77df3ee84cb8d7e19b4f62957d24918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b05960b1-4edd-5d46-85e2-c70ed0230279/b05960b1-4edd-5d46-85e2-c70ed0230279_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/1e/301e90ac0941ada5392b8ce0ccbde4e4/pa/GP33761_38c5c46a00b310c976f5a717a8664517.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b05960b1-4edd-5d46-85e2-c70ed0230279/b05960b1-4edd-5d46-85e2-c70ed0230279_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/1e/301e90ac0941ada5392b8ce0ccbde4e4/pa/GP33761_f5123ce80f08a2b1a2fa0b0765e0efb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b05960b1-4edd-5d46-85e2-c70ed0230279/b05960b1-4edd-5d46-85e2-c70ed0230279_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/1e/301e90ac0941ada5392b8ce0ccbde4e4/pa/GP33761_c83030f0fb1b640fc7e824a7804d70a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b05960b1-4edd-5d46-85e2-c70ed0230279/b05960b1-4edd-5d46-85e2-c70ed0230279_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/1e/301e90ac0941ada5392b8ce0ccbde4e4/pa/GP33761_ad368d100a98e65268fab91460fe3acd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP33761%27 HTTP/1.1" 200 None
2026-03-30 10:53:44 [auto1.de] INFO: Saving data for GP33761: {'created_time': 1774868024.722474, 'last_price_update_time': 1774868024.722484, 'auction_closing_time': 1774972305.0}
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP33761') HTTP/1.1" 204 0
2026-03-30 10:53:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b76a2812-dd06-539c-a3ab-2b8d14260b6c with identifier: AM79685
2026-03-30 10:53:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b76a2812-dd06-539c-a3ab-2b8d14260b6c with identifier: AM79685
2026-03-30 10:53:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b76a2812-dd06-539c-a3ab-2b8d14260b6c with identifier: AM79685 to the API
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AM79685>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:34:19Z',
 'fuel_type': 'diesel',
 'id': 'b76a2812-dd06-539c-a3ab-2b8d14260b6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM79685',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 194098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_764d9f22d4372e8decff4ab07de00c45.jpg',
                'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_059a1c5179fbe45546fe5c63b0189a39.jpg',
                'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_fe6220fe3a2700436bb4724acebe3de7.jpg',
                'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_de211739fea358082feb75f017ee9cc6.jpg',
                'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_93a04688d01422b6b81b78993cec62fa.jpg',
                'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_c57c3c4a13445495a4c435ecb3142eae.jpg',
                'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_0979e654972f2886a9d87ef39b6ca1b9.jpg',
                'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_5272eed9c85e42205d7cbfb12df5cc04.jpg',
                'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_0d15328767aab82b0f2e8abcb318b426.jpg',
                'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_35cc70dfef94c6cee380fc51ccc194ab.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b76a2812-dd06-539c-a3ab-2b8d14260b6c/b76a2812-dd06-539c-a3ab-2b8d14260b6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2576173,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_764d9f22d4372e8decff4ab07de00c45.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b76a2812-dd06-539c-a3ab-2b8d14260b6c/b76a2812-dd06-539c-a3ab-2b8d14260b6c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_059a1c5179fbe45546fe5c63b0189a39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b76a2812-dd06-539c-a3ab-2b8d14260b6c/b76a2812-dd06-539c-a3ab-2b8d14260b6c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_fe6220fe3a2700436bb4724acebe3de7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b76a2812-dd06-539c-a3ab-2b8d14260b6c/b76a2812-dd06-539c-a3ab-2b8d14260b6c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_de211739fea358082feb75f017ee9cc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b76a2812-dd06-539c-a3ab-2b8d14260b6c/b76a2812-dd06-539c-a3ab-2b8d14260b6c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_93a04688d01422b6b81b78993cec62fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b76a2812-dd06-539c-a3ab-2b8d14260b6c/b76a2812-dd06-539c-a3ab-2b8d14260b6c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2321482,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_c57c3c4a13445495a4c435ecb3142eae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b76a2812-dd06-539c-a3ab-2b8d14260b6c/b76a2812-dd06-539c-a3ab-2b8d14260b6c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_0979e654972f2886a9d87ef39b6ca1b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b76a2812-dd06-539c-a3ab-2b8d14260b6c/b76a2812-dd06-539c-a3ab-2b8d14260b6c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_5272eed9c85e42205d7cbfb12df5cc04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b76a2812-dd06-539c-a3ab-2b8d14260b6c/b76a2812-dd06-539c-a3ab-2b8d14260b6c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2439692,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_0d15328767aab82b0f2e8abcb318b426.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b76a2812-dd06-539c-a3ab-2b8d14260b6c/b76a2812-dd06-539c-a3ab-2b8d14260b6c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/14/58145da3a502fd039f6e9fa33565ee60/pa/AM79685_35cc70dfef94c6cee380fc51ccc194ab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM79685%27 HTTP/1.1" 200 None
2026-03-30 10:53:45 [auto1.de] INFO: Saving data for AM79685: {'created_time': 1774868025.092768, 'last_price_update_time': 1774868025.092779, 'auction_closing_time': 1774971259.0}
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM79685') HTTP/1.1" 204 0
2026-03-30 10:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_dae07b71c361b562437d2f94f3736870.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:45 [auto1.de] INFO: Found listing with ID: TM51786
2026-03-30 10:53:45 [auto1.de] INFO: Found listing with ID: SX57791
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX57791%27 HTTP/1.1" 200 None
2026-03-30 10:53:45 [auto1.de] INFO: Scrape type for SX57791: 2
2026-03-30 10:53:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1b9c1f5-8d0f-5630-8821-2131de848990 with identifier: SX57791
2026-03-30 10:53:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1b9c1f5-8d0f-5630-8821-2131de848990 with scrape type 2
2026-03-30 10:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1b9c1f5-8d0f-5630-8821-2131de848990 with scrape type 2
2026-03-30 10:53:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1b9c1f5-8d0f-5630-8821-2131de848990, identifier: SX57791
2026-03-30 10:53:45 [auto1.de] INFO: Found listing with ID: HJ19382
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ19382%27 HTTP/1.1" 200 None
2026-03-30 10:53:45 [auto1.de] INFO: Scrape type for HJ19382: 2
2026-03-30 10:53:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3685a9a2-0816-59cc-91cf-be3985c89f0d with identifier: HJ19382
2026-03-30 10:53:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3685a9a2-0816-59cc-91cf-be3985c89f0d with scrape type 2
2026-03-30 10:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3685a9a2-0816-59cc-91cf-be3985c89f0d with scrape type 2
2026-03-30 10:53:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3685a9a2-0816-59cc-91cf-be3985c89f0d, identifier: HJ19382
2026-03-30 10:53:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1b9c1f5-8d0f-5630-8821-2131de848990 with identifier: SX57791
2026-03-30 10:53:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1b9c1f5-8d0f-5630-8821-2131de848990 with identifier: SX57791
2026-03-30 10:53:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1b9c1f5-8d0f-5630-8821-2131de848990 with identifier: SX57791 to the API
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-31T15:16:37Z',
 'fuel_type': 'diesel',
 'id': 'd1b9c1f5-8d0f-5630-8821-2131de848990',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX57791',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 54236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-07',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 d Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2023}
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX57791%27 HTTP/1.1" 200 None
2026-03-30 10:53:45 [auto1.de] INFO: Saving data for SX57791: {'auction_closing_time': 1774970197.0, 'created_time': 1773304488.249244, 'last_price_update_time': 1774868025.643416}
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX57791') HTTP/1.1" 204 0
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_5a04a47d2bb67fb95a8a3be23c38a276.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_5a04a47d2bb67fb95a8a3be23c38a276.jpg not downloaded yet
2026-03-30 10:53:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3685a9a2-0816-59cc-91cf-be3985c89f0d with identifier: HJ19382
2026-03-30 10:53:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3685a9a2-0816-59cc-91cf-be3985c89f0d with identifier: HJ19382
2026-03-30 10:53:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3685a9a2-0816-59cc-91cf-be3985c89f0d with identifier: HJ19382 to the API
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:56:07Z',
 'fuel_type': 'diesel',
 'id': '3685a9a2-0816-59cc-91cf-be3985c89f0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ19382',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 223337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-25',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2013}
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ19382%27 HTTP/1.1" 200 None
2026-03-30 10:53:46 [auto1.de] INFO: Saving data for HJ19382: {'auction_closing_time': 1774972567.0, 'created_time': 1773303936.224813, 'last_price_update_time': 1774868026.105607}
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ19382') HTTP/1.1" 204 0
2026-03-30 10:53:46 [auto1.de] INFO: Found listing with ID: GH40750
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH40750%27 HTTP/1.1" 200 None
2026-03-30 10:53:46 [auto1.de] INFO: Scrape type for GH40750: 2
2026-03-30 10:53:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13214dbd-cfbb-529d-b458-ca9a3024d650 with identifier: GH40750
2026-03-30 10:53:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13214dbd-cfbb-529d-b458-ca9a3024d650 with scrape type 2
2026-03-30 10:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13214dbd-cfbb-529d-b458-ca9a3024d650 with scrape type 2
2026-03-30 10:53:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13214dbd-cfbb-529d-b458-ca9a3024d650, identifier: GH40750
2026-03-30 10:53:46 [auto1.de] INFO: Found listing with ID: NF12258
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF12258%27 HTTP/1.1" 200 None
2026-03-30 10:53:46 [auto1.de] INFO: Scrape type for NF12258: 2
2026-03-30 10:53:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93831491-4f11-5027-99d1-2d1e31b6e40a with identifier: NF12258
2026-03-30 10:53:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93831491-4f11-5027-99d1-2d1e31b6e40a with scrape type 2
2026-03-30 10:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93831491-4f11-5027-99d1-2d1e31b6e40a with scrape type 2
2026-03-30 10:53:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93831491-4f11-5027-99d1-2d1e31b6e40a, identifier: NF12258
2026-03-30 10:53:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9f0550fad0>
2026-03-30 10:53:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_88e8c81fbd63d2d2a226873d73d39c40.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_88e8c81fbd63d2d2a226873d73d39c40.jpg saved to cache
2026-03-30 10:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c631de3-03bc-5c14-8730-11e201d9aeb4
2026-03-30 10:53:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_80bf8d47133171ba6193cb87515478f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13214dbd-cfbb-529d-b458-ca9a3024d650 with identifier: GH40750
2026-03-30 10:53:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13214dbd-cfbb-529d-b458-ca9a3024d650 with identifier: GH40750
2026-03-30 10:53:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13214dbd-cfbb-529d-b458-ca9a3024d650 with identifier: GH40750 to the API
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:08:05Z',
 'fuel_type': 'petrol',
 'id': '13214dbd-cfbb-529d-b458-ca9a3024d650',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH40750',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 170262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-14',
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2014}
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH40750%27 HTTP/1.1" 200 None
2026-03-30 10:53:46 [auto1.de] INFO: Saving data for GH40750: {'auction_closing_time': 1774969685.0, 'created_time': 1773946853.119104, 'last_price_update_time': 1774868026.837372}
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH40750') HTTP/1.1" 204 0
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_753df8a22af13783e117eeb2cac64647.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_753df8a22af13783e117eeb2cac64647.jpg not downloaded yet
2026-03-30 10:53:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93831491-4f11-5027-99d1-2d1e31b6e40a with identifier: NF12258
2026-03-30 10:53:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93831491-4f11-5027-99d1-2d1e31b6e40a with identifier: NF12258
2026-03-30 10:53:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93831491-4f11-5027-99d1-2d1e31b6e40a with identifier: NF12258 to the API
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:57:39Z',
 'fuel_type': 'petrol',
 'id': '93831491-4f11-5027-99d1-2d1e31b6e40a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF12258',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Ateca',
 'odometer': 108503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-12',
 'seller_name': None,
 'title': 'Cupra Ateca 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2019}
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF12258%27 HTTP/1.1" 200 None
2026-03-30 10:53:47 [auto1.de] INFO: Saving data for NF12258: {'auction_closing_time': 1774972659.0, 'created_time': 1773426959.712695, 'last_price_update_time': 1774868027.265367}
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF12258') HTTP/1.1" 204 0
2026-03-30 10:53:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e68650>
2026-03-30 10:53:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_dae07b71c361b562437d2f94f3736870.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_dae07b71c361b562437d2f94f3736870.jpg saved to cache
2026-03-30 10:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c631de3-03bc-5c14-8730-11e201d9aeb4
2026-03-30 10:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_cf20daa99a2e750adc64e3f15f8cfb02.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:47 [auto1.de] INFO: Found listing with ID: RM29810
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM29810%27 HTTP/1.1" 200 None
2026-03-30 10:53:47 [auto1.de] INFO: Scrape type for RM29810: 2
2026-03-30 10:53:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be7f14c1-2fb7-5817-8ae2-7e2905dad1a3 with identifier: RM29810
2026-03-30 10:53:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be7f14c1-2fb7-5817-8ae2-7e2905dad1a3 with scrape type 2
2026-03-30 10:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be7f14c1-2fb7-5817-8ae2-7e2905dad1a3 with scrape type 2
2026-03-30 10:53:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be7f14c1-2fb7-5817-8ae2-7e2905dad1a3, identifier: RM29810
2026-03-30 10:53:47 [auto1.de] INFO: Found listing with ID: TE51742
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE51742%27 HTTP/1.1" 200 None
2026-03-30 10:53:47 [auto1.de] INFO: Scrape type for TE51742: 2
2026-03-30 10:53:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56d2829b-6552-50ba-bbac-d1be22fe668a with identifier: TE51742
2026-03-30 10:53:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56d2829b-6552-50ba-bbac-d1be22fe668a with scrape type 2
2026-03-30 10:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56d2829b-6552-50ba-bbac-d1be22fe668a with scrape type 2
2026-03-30 10:53:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56d2829b-6552-50ba-bbac-d1be22fe668a, identifier: TE51742
2026-03-30 10:53:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be7f14c1-2fb7-5817-8ae2-7e2905dad1a3 with identifier: RM29810
2026-03-30 10:53:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be7f14c1-2fb7-5817-8ae2-7e2905dad1a3 with identifier: RM29810
2026-03-30 10:53:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be7f14c1-2fb7-5817-8ae2-7e2905dad1a3 with identifier: RM29810 to the API
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:16:31Z',
 'fuel_type': 'hybrid',
 'id': 'be7f14c1-2fb7-5817-8ae2-7e2905dad1a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM29810',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 93368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-29',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM29810%27 HTTP/1.1" 200 None
2026-03-30 10:53:47 [auto1.de] INFO: Saving data for RM29810: {'auction_closing_time': 1774970191.0, 'created_time': 1774465815.647551, 'last_price_update_time': 1774868027.919652}
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM29810') HTTP/1.1" 204 0
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_7b070efa2dc35c0e476bfbd3ff042a4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_7b070efa2dc35c0e476bfbd3ff042a4f.jpg not downloaded yet
2026-03-30 10:53:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56d2829b-6552-50ba-bbac-d1be22fe668a with identifier: TE51742
2026-03-30 10:53:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56d2829b-6552-50ba-bbac-d1be22fe668a with identifier: TE51742
2026-03-30 10:53:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56d2829b-6552-50ba-bbac-d1be22fe668a with identifier: TE51742 to the API
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 411,
 'expiration_date': '2026-03-31T15:09:41Z',
 'fuel_type': 'petrol',
 'id': '56d2829b-6552-50ba-bbac-d1be22fe668a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE51742',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 39575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-10',
 'seller_name': None,
 'title': 'BMW 2er M2 Competition',
 'transmission': 'automatic',
 'trim': 'Competition',
 'year': 2019}
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE51742%27 HTTP/1.1" 200 None
2026-03-30 10:53:48 [auto1.de] INFO: Saving data for TE51742: {'auction_closing_time': 1774969781.0, 'created_time': 1773659828.990909, 'last_price_update_time': 1774868028.323087}
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE51742') HTTP/1.1" 204 0
2026-03-30 10:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_7b6ad83874f243379e346ddd5b08b703.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:48 [auto1.de] INFO: Found listing with ID: HN93513
2026-03-30 10:53:48 [auto1.de] INFO: Found listing with ID: UK33318
2026-03-30 10:53:48 [auto1.de] INFO: Found listing with ID: LM70179
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM70179%27 HTTP/1.1" 200 None
2026-03-30 10:53:48 [auto1.de] INFO: Scrape type for LM70179: 2
2026-03-30 10:53:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9712e412-9f27-50f4-8497-de4d2982778a with identifier: LM70179
2026-03-30 10:53:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9712e412-9f27-50f4-8497-de4d2982778a with scrape type 2
2026-03-30 10:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9712e412-9f27-50f4-8497-de4d2982778a with scrape type 2
2026-03-30 10:53:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9712e412-9f27-50f4-8497-de4d2982778a, identifier: LM70179
2026-03-30 10:53:48 [auto1.de] INFO: Found listing with ID: YH42279
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH42279%27 HTTP/1.1" 200 None
2026-03-30 10:53:48 [auto1.de] INFO: Scrape type for YH42279: 2
2026-03-30 10:53:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 540aac36-cd96-5e3b-b800-f97a5e5a8d73 with identifier: YH42279
2026-03-30 10:53:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 540aac36-cd96-5e3b-b800-f97a5e5a8d73 with scrape type 2
2026-03-30 10:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 540aac36-cd96-5e3b-b800-f97a5e5a8d73 with scrape type 2
2026-03-30 10:53:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 540aac36-cd96-5e3b-b800-f97a5e5a8d73, identifier: YH42279
2026-03-30 10:53:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c87d90>
2026-03-30 10:53:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_80bf8d47133171ba6193cb87515478f6.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_80bf8d47133171ba6193cb87515478f6.jpg saved to cache
2026-03-30 10:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c631de3-03bc-5c14-8730-11e201d9aeb4
2026-03-30 10:53:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9712e412-9f27-50f4-8497-de4d2982778a with identifier: LM70179
2026-03-30 10:53:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9712e412-9f27-50f4-8497-de4d2982778a with identifier: LM70179
2026-03-30 10:53:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9712e412-9f27-50f4-8497-de4d2982778a with identifier: LM70179 to the API
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-31T15:27:16Z',
 'fuel_type': 'diesel',
 'id': '9712e412-9f27-50f4-8497-de4d2982778a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM70179',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 190547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B4 Diesel Mild-Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2020}
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM70179%27 HTTP/1.1" 200 None
2026-03-30 10:53:48 [auto1.de] INFO: Saving data for LM70179: {'auction_closing_time': 1774970836.0, 'created_time': 1774380418.642664, 'last_price_update_time': 1774868028.95011}
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM70179') HTTP/1.1" 204 0
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_70325dd117e798c1d0f24e95d1408e83.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_70325dd117e798c1d0f24e95d1408e83.jpg not downloaded yet
2026-03-30 10:53:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 540aac36-cd96-5e3b-b800-f97a5e5a8d73 with identifier: YH42279
2026-03-30 10:53:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 540aac36-cd96-5e3b-b800-f97a5e5a8d73 with identifier: YH42279
2026-03-30 10:53:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 540aac36-cd96-5e3b-b800-f97a5e5a8d73 with identifier: YH42279 to the API
2026-03-30 10:53:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:51:01Z',
 'fuel_type': 'diesel',
 'id': '540aac36-cd96-5e3b-b800-f97a5e5a8d73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH42279',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 150046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Life 4Motion BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Life 4Motion BlueMotion Tech',
 'year': 2013}
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH42279%27 HTTP/1.1" 200 None
2026-03-30 10:53:50 [auto1.de] INFO: Saving data for YH42279: {'auction_closing_time': 1774972261.0, 'created_time': 1773380988.618028, 'last_price_update_time': 1774868030.179358}
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH42279') HTTP/1.1" 204 0
2026-03-30 10:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_5a04a47d2bb67fb95a8a3be23c38a276.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:50 [auto1.de] INFO: Found listing with ID: HH81200
2026-03-30 10:53:50 [auto1.de] INFO: Found listing with ID: MX24097
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX24097%27 HTTP/1.1" 200 None
2026-03-30 10:53:50 [auto1.de] INFO: Scrape type for MX24097: 2
2026-03-30 10:53:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16b70a19-c8fd-5656-a98b-6b3ddfd157c1 with identifier: MX24097
2026-03-30 10:53:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16b70a19-c8fd-5656-a98b-6b3ddfd157c1 with scrape type 2
2026-03-30 10:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16b70a19-c8fd-5656-a98b-6b3ddfd157c1 with scrape type 2
2026-03-30 10:53:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16b70a19-c8fd-5656-a98b-6b3ddfd157c1, identifier: MX24097
2026-03-30 10:53:50 [auto1.de] INFO: Found listing with ID: SG32034
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG32034%27 HTTP/1.1" 200 None
2026-03-30 10:53:50 [auto1.de] INFO: Scrape type for SG32034: 2
2026-03-30 10:53:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2bb864f-ccac-573f-884c-42d1311e9800 with identifier: SG32034
2026-03-30 10:53:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2bb864f-ccac-573f-884c-42d1311e9800 with scrape type 2
2026-03-30 10:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2bb864f-ccac-573f-884c-42d1311e9800 with scrape type 2
2026-03-30 10:53:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2bb864f-ccac-573f-884c-42d1311e9800, identifier: SG32034
2026-03-30 10:53:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e95890>
2026-03-30 10:53:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_cf20daa99a2e750adc64e3f15f8cfb02.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_cf20daa99a2e750adc64e3f15f8cfb02.jpg saved to cache
2026-03-30 10:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c631de3-03bc-5c14-8730-11e201d9aeb4
2026-03-30 10:53:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16b70a19-c8fd-5656-a98b-6b3ddfd157c1 with identifier: MX24097
2026-03-30 10:53:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16b70a19-c8fd-5656-a98b-6b3ddfd157c1 with identifier: MX24097
2026-03-30 10:53:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16b70a19-c8fd-5656-a98b-6b3ddfd157c1 with identifier: MX24097 to the API
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:44:42Z',
 'fuel_type': 'diesel',
 'id': '16b70a19-c8fd-5656-a98b-6b3ddfd157c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX24097',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 131801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-12',
 'seller_name': None,
 'title': 'Porsche Cayenne Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX24097%27 HTTP/1.1" 200 None
2026-03-30 10:53:50 [auto1.de] INFO: Saving data for MX24097: {'auction_closing_time': 1774971882.0, 'created_time': 1773686849.016219, 'last_price_update_time': 1774868030.806436}
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX24097') HTTP/1.1" 204 0
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_e0492337e7f9a3182d70e3ef37c92c61.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_e0492337e7f9a3182d70e3ef37c92c61.jpg not downloaded yet
2026-03-30 10:53:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2bb864f-ccac-573f-884c-42d1311e9800 with identifier: SG32034
2026-03-30 10:53:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2bb864f-ccac-573f-884c-42d1311e9800 with identifier: SG32034
2026-03-30 10:53:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2bb864f-ccac-573f-884c-42d1311e9800 with identifier: SG32034 to the API
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-31T15:35:06Z',
 'fuel_type': 'diesel',
 'id': 'c2bb864f-ccac-573f-884c-42d1311e9800',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG32034',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 112433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-03',
 'seller_name': None,
 'title': 'BMW X5 M50d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG32034%27 HTTP/1.1" 200 None
2026-03-30 10:53:51 [auto1.de] INFO: Saving data for SG32034: {'auction_closing_time': 1774971306.0, 'created_time': 1773301701.963045, 'last_price_update_time': 1774868031.385638}
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG32034') HTTP/1.1" 204 0
2026-03-30 10:53:51 [auto1.de] INFO: Found listing with ID: FG94597
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94597%27 HTTP/1.1" 200 None
2026-03-30 10:53:51 [auto1.de] INFO: Scrape type for FG94597: 2
2026-03-30 10:53:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fed01f5-5ca9-5854-9caf-5ca70530c4d1 with identifier: FG94597
2026-03-30 10:53:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fed01f5-5ca9-5854-9caf-5ca70530c4d1 with scrape type 2
2026-03-30 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fed01f5-5ca9-5854-9caf-5ca70530c4d1 with scrape type 2
2026-03-30 10:53:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fed01f5-5ca9-5854-9caf-5ca70530c4d1, identifier: FG94597
2026-03-30 10:53:51 [auto1.de] INFO: Found listing with ID: TD37503
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD37503%27 HTTP/1.1" 200 None
2026-03-30 10:53:51 [auto1.de] INFO: Scrape type for TD37503: 2
2026-03-30 10:53:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 584b8562-c9d9-5dd7-bbe0-8dc2ebb29ee8 with identifier: TD37503
2026-03-30 10:53:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 584b8562-c9d9-5dd7-bbe0-8dc2ebb29ee8 with scrape type 2
2026-03-30 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 584b8562-c9d9-5dd7-bbe0-8dc2ebb29ee8 with scrape type 2
2026-03-30 10:53:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 584b8562-c9d9-5dd7-bbe0-8dc2ebb29ee8, identifier: TD37503
2026-03-30 10:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA52420/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f57b50>
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_7b6ad83874f243379e346ddd5b08b703.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_7b6ad83874f243379e346ddd5b08b703.jpg saved to cache
2026-03-30 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c631de3-03bc-5c14-8730-11e201d9aeb4
2026-03-30 10:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_753df8a22af13783e117eeb2cac64647.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fed01f5-5ca9-5854-9caf-5ca70530c4d1 with identifier: FG94597
2026-03-30 10:53:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fed01f5-5ca9-5854-9caf-5ca70530c4d1 with identifier: FG94597
2026-03-30 10:53:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fed01f5-5ca9-5854-9caf-5ca70530c4d1 with identifier: FG94597 to the API
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:43:04Z',
 'fuel_type': 'diesel',
 'id': '1fed01f5-5ca9-5854-9caf-5ca70530c4d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG94597',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 256610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-24',
 'seller_name': None,
 'title': 'BMW 5er 530d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94597%27 HTTP/1.1" 200 None
2026-03-30 10:53:52 [auto1.de] INFO: Saving data for FG94597: {'auction_closing_time': 1774971784.0, 'created_time': 1773135175.92704, 'last_price_update_time': 1774868032.06936}
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG94597') HTTP/1.1" 204 0
2026-03-30 10:53:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 584b8562-c9d9-5dd7-bbe0-8dc2ebb29ee8 with identifier: TD37503
2026-03-30 10:53:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 584b8562-c9d9-5dd7-bbe0-8dc2ebb29ee8 with identifier: TD37503
2026-03-30 10:53:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 584b8562-c9d9-5dd7-bbe0-8dc2ebb29ee8 with identifier: TD37503 to the API
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-31T15:20:39Z',
 'fuel_type': 'petrol',
 'id': '584b8562-c9d9-5dd7-bbe0-8dc2ebb29ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD37503',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 77880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-11',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 43 AMG T 4Matic',
 'transmission': 'automatic',
 'trim': 'T 4Matic',
 'year': 2017}
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD37503%27 HTTP/1.1" 200 None
2026-03-30 10:53:52 [auto1.de] INFO: Saving data for TD37503: {'auction_closing_time': 1774970439.0, 'created_time': 1773659717.275371, 'last_price_update_time': 1774868032.38537}
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD37503') HTTP/1.1" 204 0
2026-03-30 10:53:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_7b070efa2dc35c0e476bfbd3ff042a4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:52 [auto1.de] INFO: Found listing with ID: PY30467
2026-03-30 10:53:52 [auto1.de] INFO: Found listing with ID: DR91116
2026-03-30 10:53:52 [auto1.de] INFO: Found listing with ID: FK92289
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK92289%27 HTTP/1.1" 200 None
2026-03-30 10:53:52 [auto1.de] INFO: Scrape type for FK92289: 2
2026-03-30 10:53:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8accbdf7-3211-5424-864b-3ab4c769c051 with identifier: FK92289
2026-03-30 10:53:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8accbdf7-3211-5424-864b-3ab4c769c051 with scrape type 2
2026-03-30 10:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8accbdf7-3211-5424-864b-3ab4c769c051 with scrape type 2
2026-03-30 10:53:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8accbdf7-3211-5424-864b-3ab4c769c051, identifier: FK92289
2026-03-30 10:53:52 [auto1.de] INFO: Found listing with ID: WL44936
2026-03-30 10:53:52 [auto1.de] INFO: Found listing with ID: RT58189
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT58189%27 HTTP/1.1" 200 None
2026-03-30 10:53:52 [auto1.de] INFO: Scrape type for RT58189: 2
2026-03-30 10:53:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 084584d6-1b02-5c99-ac95-ac8c61694a72 with identifier: RT58189
2026-03-30 10:53:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 084584d6-1b02-5c99-ac95-ac8c61694a72 with scrape type 2
2026-03-30 10:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 084584d6-1b02-5c99-ac95-ac8c61694a72 with scrape type 2
2026-03-30 10:53:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 084584d6-1b02-5c99-ac95-ac8c61694a72, identifier: RT58189
2026-03-30 10:53:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:53:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f15a50>
2026-03-30 10:53:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_5a04a47d2bb67fb95a8a3be23c38a276.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_5a04a47d2bb67fb95a8a3be23c38a276.jpg saved to cache
2026-03-30 10:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c631de3-03bc-5c14-8730-11e201d9aeb4
2026-03-30 10:53:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8accbdf7-3211-5424-864b-3ab4c769c051 with identifier: FK92289
2026-03-30 10:53:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8accbdf7-3211-5424-864b-3ab4c769c051 with identifier: FK92289
2026-03-30 10:53:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8accbdf7-3211-5424-864b-3ab4c769c051 with identifier: FK92289 to the API
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:53:02Z',
 'fuel_type': 'petrol',
 'id': '8accbdf7-3211-5424-864b-3ab4c769c051',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK92289',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 62346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Cup',
 'transmission': 'automatic',
 'trim': 'Cup',
 'year': 2014}
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK92289%27 HTTP/1.1" 200 None
2026-03-30 10:53:52 [auto1.de] INFO: Saving data for FK92289: {'auction_closing_time': 1774972382.0, 'created_time': 1773945792.053678, 'last_price_update_time': 1774868032.999069}
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK92289') HTTP/1.1" 204 0
2026-03-30 10:53:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 084584d6-1b02-5c99-ac95-ac8c61694a72 with identifier: RT58189
2026-03-30 10:53:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 084584d6-1b02-5c99-ac95-ac8c61694a72 with identifier: RT58189
2026-03-30 10:53:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 084584d6-1b02-5c99-ac95-ac8c61694a72 with identifier: RT58189 to the API
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:24:18Z',
 'fuel_type': 'diesel',
 'id': '084584d6-1b02-5c99-ac95-ac8c61694a72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT58189',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 228220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-27',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT58189%27 HTTP/1.1" 200 None
2026-03-30 10:53:53 [auto1.de] INFO: Saving data for RT58189: {'auction_closing_time': 1774970658.0, 'created_time': 1774437054.837699, 'last_price_update_time': 1774868033.391491}
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT58189') HTTP/1.1" 204 0
2026-03-30 10:53:53 [auto1.de] INFO: Found listing with ID: FD73392
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD73392%27 HTTP/1.1" 200 None
2026-03-30 10:53:53 [auto1.de] INFO: Scrape type for FD73392: 2
2026-03-30 10:53:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c613c7e-5d4e-5756-9af8-d8992ec72686 with identifier: FD73392
2026-03-30 10:53:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c613c7e-5d4e-5756-9af8-d8992ec72686 with scrape type 2
2026-03-30 10:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c613c7e-5d4e-5756-9af8-d8992ec72686 with scrape type 2
2026-03-30 10:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c613c7e-5d4e-5756-9af8-d8992ec72686, identifier: FD73392
2026-03-30 10:53:53 [auto1.de] INFO: Found listing with ID: KB71899
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB71899%27 HTTP/1.1" 200 None
2026-03-30 10:53:53 [auto1.de] INFO: Scrape type for KB71899: 2
2026-03-30 10:53:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6c3c54b-41a6-57be-aa1b-e5916ca0fe48 with identifier: KB71899
2026-03-30 10:53:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6c3c54b-41a6-57be-aa1b-e5916ca0fe48 with scrape type 2
2026-03-30 10:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6c3c54b-41a6-57be-aa1b-e5916ca0fe48 with scrape type 2
2026-03-30 10:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6c3c54b-41a6-57be-aa1b-e5916ca0fe48, identifier: KB71899
2026-03-30 10:53:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e65ed0>
2026-03-30 10:53:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_753df8a22af13783e117eeb2cac64647.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_753df8a22af13783e117eeb2cac64647.jpg saved to cache
2026-03-30 10:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c631de3-03bc-5c14-8730-11e201d9aeb4
2026-03-30 10:53:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_70325dd117e798c1d0f24e95d1408e83.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c613c7e-5d4e-5756-9af8-d8992ec72686 with identifier: FD73392
2026-03-30 10:53:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c613c7e-5d4e-5756-9af8-d8992ec72686 with identifier: FD73392
2026-03-30 10:53:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c613c7e-5d4e-5756-9af8-d8992ec72686 with identifier: FD73392 to the API
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:14:09Z',
 'fuel_type': 'diesel',
 'id': '5c613c7e-5d4e-5756-9af8-d8992ec72686',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD73392',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Kombi',
 'odometer': 409297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-16',
 'seller_name': None,
 'title': 'Volkswagen T5 Kombi 2.0 TDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2015}
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD73392%27 HTTP/1.1" 200 None
2026-03-30 10:53:54 [auto1.de] INFO: Saving data for FD73392: {'auction_closing_time': 1774970049.0, 'created_time': 1773776106.969945, 'last_price_update_time': 1774868034.010218}
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD73392') HTTP/1.1" 204 0
2026-03-30 10:53:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6c3c54b-41a6-57be-aa1b-e5916ca0fe48 with identifier: KB71899
2026-03-30 10:53:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6c3c54b-41a6-57be-aa1b-e5916ca0fe48 with identifier: KB71899
2026-03-30 10:53:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6c3c54b-41a6-57be-aa1b-e5916ca0fe48 with identifier: KB71899 to the API
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:42:31Z',
 'fuel_type': 'petrol',
 'id': 'e6c3c54b-41a6-57be-aa1b-e5916ca0fe48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB71899',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 106678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-25',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2017}
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB71899%27 HTTP/1.1" 200 None
2026-03-30 10:53:54 [auto1.de] INFO: Saving data for KB71899: {'auction_closing_time': 1774971751.0, 'created_time': 1774378033.848824, 'last_price_update_time': 1774868034.355925}
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB71899') HTTP/1.1" 204 0
2026-03-30 10:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_e0492337e7f9a3182d70e3ef37c92c61.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: EN35064
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: HJ19382
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ19382%27 HTTP/1.1" 200 None
2026-03-30 10:53:54 [auto1.de] INFO: Scrape type for HJ19382: 0
2026-03-30 10:53:54 [auto1.de] INFO: Found listing with ID: NC35073
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35073%27 HTTP/1.1" 200 None
2026-03-30 10:53:54 [auto1.de] INFO: Scrape type for NC35073: 2
2026-03-30 10:53:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7d4170b-e4de-5cdf-93e8-0f4cb4e420bb with identifier: NC35073
2026-03-30 10:53:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7d4170b-e4de-5cdf-93e8-0f4cb4e420bb with scrape type 2
2026-03-30 10:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7d4170b-e4de-5cdf-93e8-0f4cb4e420bb with scrape type 2
2026-03-30 10:53:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7d4170b-e4de-5cdf-93e8-0f4cb4e420bb, identifier: NC35073
2026-03-30 10:53:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7d4170b-e4de-5cdf-93e8-0f4cb4e420bb with identifier: NC35073
2026-03-30 10:53:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7d4170b-e4de-5cdf-93e8-0f4cb4e420bb with identifier: NC35073
2026-03-30 10:53:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7d4170b-e4de-5cdf-93e8-0f4cb4e420bb with identifier: NC35073 to the API
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:37:37Z',
 'fuel_type': 'petrol',
 'id': 'c7d4170b-e4de-5cdf-93e8-0f4cb4e420bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC35073',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 123375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-19',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2008}
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35073%27 HTTP/1.1" 200 None
2026-03-30 10:53:54 [auto1.de] INFO: Saving data for NC35073: {'auction_closing_time': 1774971457.0, 'created_time': 1774464119.506284, 'last_price_update_time': 1774868034.894211}
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC35073') HTTP/1.1" 204 0
2026-03-30 10:53:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f955d0>
2026-03-30 10:53:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_7b070efa2dc35c0e476bfbd3ff042a4f.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_7b070efa2dc35c0e476bfbd3ff042a4f.jpg saved to cache
2026-03-30 10:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c631de3-03bc-5c14-8730-11e201d9aeb4
2026-03-30 10:53:55 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 9521 | hits on page: 40
2026-03-30 10:53:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:55 [auto1.de] INFO: Found listing with ID: NP13175
2026-03-30 10:53:55 [auto1.de] INFO: Found listing with ID: XM28055
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM28055%27 HTTP/1.1" 200 None
2026-03-30 10:53:55 [auto1.de] INFO: Scrape type for XM28055: 2
2026-03-30 10:53:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1da3478f-3c88-549b-901f-f6e31535135e with identifier: XM28055
2026-03-30 10:53:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1da3478f-3c88-549b-901f-f6e31535135e with scrape type 2
2026-03-30 10:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1da3478f-3c88-549b-901f-f6e31535135e with scrape type 2
2026-03-30 10:53:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1da3478f-3c88-549b-901f-f6e31535135e, identifier: XM28055
2026-03-30 10:53:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1da3478f-3c88-549b-901f-f6e31535135e with identifier: XM28055
2026-03-30 10:53:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1da3478f-3c88-549b-901f-f6e31535135e with identifier: XM28055
2026-03-30 10:53:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1da3478f-3c88-549b-901f-f6e31535135e with identifier: XM28055 to the API
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:20:49Z',
 'fuel_type': 'diesel',
 'id': '1da3478f-3c88-549b-901f-f6e31535135e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM28055',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Movano',
 'odometer': 45305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-15',
 'seller_name': None,
 'title': 'Opel Movano 2.2 CDTI HKa L3H2 3,5t Edition',
 'transmission': 'manual',
 'trim': 'HKa L3H2 3,5t Edition',
 'year': 2022}
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM28055%27 HTTP/1.1" 200 None
2026-03-30 10:53:55 [auto1.de] INFO: Saving data for XM28055: {'auction_closing_time': 1774970449.0, 'created_time': 1773307660.60771, 'last_price_update_time': 1774868035.761386}
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM28055') HTTP/1.1" 204 0
2026-03-30 10:53:55 [auto1.de] INFO: Found listing with ID: RM06492
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM06492%27 HTTP/1.1" 200 None
2026-03-30 10:53:55 [auto1.de] INFO: Scrape type for RM06492: 2
2026-03-30 10:53:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 928ec7f1-fcf9-5404-b163-a7e504aace8a with identifier: RM06492
2026-03-30 10:53:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 928ec7f1-fcf9-5404-b163-a7e504aace8a with scrape type 2
2026-03-30 10:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 928ec7f1-fcf9-5404-b163-a7e504aace8a with scrape type 2
2026-03-30 10:53:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 928ec7f1-fcf9-5404-b163-a7e504aace8a, identifier: RM06492
2026-03-30 10:53:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:53:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4feb0d0>
2026-03-30 10:53:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_70325dd117e798c1d0f24e95d1408e83.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_70325dd117e798c1d0f24e95d1408e83.jpg saved to cache
2026-03-30 10:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c631de3-03bc-5c14-8730-11e201d9aeb4
2026-03-30 10:53:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:53:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db9b10>
2026-03-30 10:53:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:53:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F08%252Fdd08481fc26b38dff6e5a10998ce0bee%252Fpa%252FLT55201_e0492337e7f9a3182d70e3ef37c92c61.jpg') HTTP/1.1" 204 0
2026-03-30 10:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_e0492337e7f9a3182d70e3ef37c92c61.jpg saved to cache
2026-03-30 10:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c631de3-03bc-5c14-8730-11e201d9aeb4
2026-03-30 10:53:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c631de3-03bc-5c14-8730-11e201d9aeb4, skipping ID generation
2026-03-30 10:53:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c631de3-03bc-5c14-8730-11e201d9aeb4 with scrape type 1
2026-03-30 10:53:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c631de3-03bc-5c14-8730-11e201d9aeb4 sending to next pipeline
2026-03-30 10:53:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c631de3-03bc-5c14-8730-11e201d9aeb4, identifier: LT55201
2026-03-30 10:53:56 [auto1.de] INFO: Found listing with ID: UF29141
2026-03-30 10:53:56 [auto1.de] INFO: Found listing with ID: TB76582
2026-03-30 10:53:56 [auto1.de] INFO: Found listing with ID: DL96803
2026-03-30 10:53:56 [auto1.de] INFO: Found listing with ID: WP89589
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP89589%27 HTTP/1.1" 200 None
2026-03-30 10:53:56 [auto1.de] INFO: Scrape type for WP89589: 2
2026-03-30 10:53:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 871332e8-1d9d-5cab-a75d-1751574e9067 with identifier: WP89589
2026-03-30 10:53:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 871332e8-1d9d-5cab-a75d-1751574e9067 with scrape type 2
2026-03-30 10:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 871332e8-1d9d-5cab-a75d-1751574e9067 with scrape type 2
2026-03-30 10:53:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 871332e8-1d9d-5cab-a75d-1751574e9067, identifier: WP89589
2026-03-30 10:53:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 928ec7f1-fcf9-5404-b163-a7e504aace8a with identifier: RM06492
2026-03-30 10:53:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 928ec7f1-fcf9-5404-b163-a7e504aace8a with identifier: RM06492
2026-03-30 10:53:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 928ec7f1-fcf9-5404-b163-a7e504aace8a with identifier: RM06492 to the API
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:30:34Z',
 'fuel_type': 'petrol',
 'id': '928ec7f1-fcf9-5404-b163-a7e504aace8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM06492',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 172226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-21',
 'seller_name': None,
 'title': 'BMW 7er 735i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM06492%27 HTTP/1.1" 200 None
2026-03-30 10:53:56 [auto1.de] INFO: Saving data for RM06492: {'auction_closing_time': 1774971034.0, 'created_time': 1773662071.467785, 'last_price_update_time': 1774868036.552992}
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM06492') HTTP/1.1" 204 0
2026-03-30 10:53:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c631de3-03bc-5c14-8730-11e201d9aeb4 with identifier: LT55201
2026-03-30 10:53:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c631de3-03bc-5c14-8730-11e201d9aeb4 with identifier: LT55201
2026-03-30 10:53:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c631de3-03bc-5c14-8730-11e201d9aeb4 with identifier: LT55201 to the API
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_e0492337e7f9a3182d70e3ef37c92c61.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:54:16Z',
 'fuel_type': 'petrol',
 'id': '4c631de3-03bc-5c14-8730-11e201d9aeb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT55201',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 57539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_88e8c81fbd63d2d2a226873d73d39c40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_dae07b71c361b562437d2f94f3736870.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_80bf8d47133171ba6193cb87515478f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_cf20daa99a2e750adc64e3f15f8cfb02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_7b6ad83874f243379e346ddd5b08b703.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_5a04a47d2bb67fb95a8a3be23c38a276.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_753df8a22af13783e117eeb2cac64647.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_7b070efa2dc35c0e476bfbd3ff042a4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_70325dd117e798c1d0f24e95d1408e83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c631de3-03bc-5c14-8730-11e201d9aeb4/4c631de3-03bc-5c14-8730-11e201d9aeb4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/08/dd08481fc26b38dff6e5a10998ce0bee/pa/LT55201_e0492337e7f9a3182d70e3ef37c92c61.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Extreme 4WD',
 'transmission': 'manual',
 'trim': 'Extreme 4WD',
 'year': 2023}
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT55201%27 HTTP/1.1" 200 None
2026-03-30 10:53:56 [auto1.de] INFO: Saving data for LT55201: {'created_time': 1774868036.978832, 'last_price_update_time': 1774868036.978845, 'auction_closing_time': 1774972456.0}
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT55201') HTTP/1.1" 204 0
2026-03-30 10:53:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 871332e8-1d9d-5cab-a75d-1751574e9067 with identifier: WP89589
2026-03-30 10:53:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 871332e8-1d9d-5cab-a75d-1751574e9067 with identifier: WP89589
2026-03-30 10:53:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 871332e8-1d9d-5cab-a75d-1751574e9067 with identifier: WP89589 to the API
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-31T15:24:58Z',
 'fuel_type': 'petrol',
 'id': '871332e8-1d9d-5cab-a75d-1751574e9067',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP89589',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 104022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-02',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 PureTech Feel',
 'transmission': 'automatic',
 'trim': 'Feel',
 'year': 2019}
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP89589%27 HTTP/1.1" 200 None
2026-03-30 10:53:57 [auto1.de] INFO: Saving data for WP89589: {'auction_closing_time': 1774970698.0, 'created_time': 1774465709.545108, 'last_price_update_time': 1774868037.311883}
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP89589') HTTP/1.1" 204 0
2026-03-30 10:53:57 [auto1.de] INFO: Found listing with ID: UV24482
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV24482%27 HTTP/1.1" 200 None
2026-03-30 10:53:57 [auto1.de] INFO: Scrape type for UV24482: 2
2026-03-30 10:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82b95f37-ddb2-5489-94d0-67d722037655 with identifier: UV24482
2026-03-30 10:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82b95f37-ddb2-5489-94d0-67d722037655 with scrape type 2
2026-03-30 10:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82b95f37-ddb2-5489-94d0-67d722037655 with scrape type 2
2026-03-30 10:53:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82b95f37-ddb2-5489-94d0-67d722037655, identifier: UV24482
2026-03-30 10:53:57 [auto1.de] INFO: Found listing with ID: YM15308
2026-03-30 10:53:57 [auto1.de] INFO: Found listing with ID: WX33301
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX33301%27 HTTP/1.1" 200 None
2026-03-30 10:53:57 [auto1.de] INFO: Scrape type for WX33301: 2
2026-03-30 10:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fbfeae0-0be5-563f-bd16-ef0e95d041b4 with identifier: WX33301
2026-03-30 10:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fbfeae0-0be5-563f-bd16-ef0e95d041b4 with scrape type 2
2026-03-30 10:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fbfeae0-0be5-563f-bd16-ef0e95d041b4 with scrape type 2
2026-03-30 10:53:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fbfeae0-0be5-563f-bd16-ef0e95d041b4, identifier: WX33301
2026-03-30 10:53:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82b95f37-ddb2-5489-94d0-67d722037655 with identifier: UV24482
2026-03-30 10:53:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82b95f37-ddb2-5489-94d0-67d722037655 with identifier: UV24482
2026-03-30 10:53:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82b95f37-ddb2-5489-94d0-67d722037655 with identifier: UV24482 to the API
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:50:41Z',
 'fuel_type': 'petrol',
 'id': '82b95f37-ddb2-5489-94d0-67d722037655',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV24482',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Pluriel',
 'odometer': 92686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-15',
 'seller_name': None,
 'title': 'Citroen C3 Pluriel 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV24482%27 HTTP/1.1" 200 None
2026-03-30 10:53:57 [auto1.de] INFO: Saving data for UV24482: {'auction_closing_time': 1774972241.0, 'created_time': 1774293981.663961, 'last_price_update_time': 1774868037.885996}
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV24482') HTTP/1.1" 204 0
2026-03-30 10:53:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fbfeae0-0be5-563f-bd16-ef0e95d041b4 with identifier: WX33301
2026-03-30 10:53:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fbfeae0-0be5-563f-bd16-ef0e95d041b4 with identifier: WX33301
2026-03-30 10:53:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fbfeae0-0be5-563f-bd16-ef0e95d041b4 with identifier: WX33301 to the API
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:40:05Z',
 'fuel_type': 'diesel',
 'id': '5fbfeae0-0be5-563f-bd16-ef0e95d041b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX33301',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 53868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-02',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2020}
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX33301%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [auto1.de] INFO: Saving data for WX33301: {'auction_closing_time': 1774971605.0, 'created_time': 1774466564.24714, 'last_price_update_time': 1774868038.313934}
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX33301') HTTP/1.1" 204 0
2026-03-30 10:53:58 [auto1.de] INFO: Found listing with ID: DL13353
2026-03-30 10:53:58 [auto1.de] INFO: Found listing with ID: VJ42576
2026-03-30 10:53:58 [auto1.de] INFO: Found listing with ID: PH19669
2026-03-30 10:53:58 [auto1.de] INFO: Found listing with ID: FV21228
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV21228%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [auto1.de] INFO: Scrape type for FV21228: 2
2026-03-30 10:53:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 772a94d0-004c-5285-b820-1fd8fc7cad6b with identifier: FV21228
2026-03-30 10:53:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 772a94d0-004c-5285-b820-1fd8fc7cad6b with scrape type 2
2026-03-30 10:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 772a94d0-004c-5285-b820-1fd8fc7cad6b with scrape type 2
2026-03-30 10:53:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 772a94d0-004c-5285-b820-1fd8fc7cad6b, identifier: FV21228
2026-03-30 10:53:58 [auto1.de] INFO: Found listing with ID: GF55006
2026-03-30 10:53:58 [auto1.de] INFO: Found listing with ID: ET75266
2026-03-30 10:53:58 [auto1.de] INFO: Found listing with ID: SV38598
2026-03-30 10:53:58 [auto1.de] INFO: Found listing with ID: PJ28903
2026-03-30 10:53:58 [auto1.de] INFO: Found listing with ID: ZY59187
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY59187%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [auto1.de] INFO: Scrape type for ZY59187: 2
2026-03-30 10:53:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f464f2a-8553-57e6-8f3c-4158e95f3607 with identifier: ZY59187
2026-03-30 10:53:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f464f2a-8553-57e6-8f3c-4158e95f3607 with scrape type 2
2026-03-30 10:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f464f2a-8553-57e6-8f3c-4158e95f3607 with scrape type 2
2026-03-30 10:53:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f464f2a-8553-57e6-8f3c-4158e95f3607, identifier: ZY59187
2026-03-30 10:53:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 772a94d0-004c-5285-b820-1fd8fc7cad6b with identifier: FV21228
2026-03-30 10:53:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 772a94d0-004c-5285-b820-1fd8fc7cad6b with identifier: FV21228
2026-03-30 10:53:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 772a94d0-004c-5285-b820-1fd8fc7cad6b with identifier: FV21228 to the API
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:07:43Z',
 'fuel_type': 'petrol',
 'id': '772a94d0-004c-5285-b820-1fd8fc7cad6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV21228',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 36056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2020}
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV21228%27 HTTP/1.1" 200 None
2026-03-30 10:53:58 [auto1.de] INFO: Saving data for FV21228: {'auction_closing_time': 1774969663.0, 'created_time': 1774463870.130418, 'last_price_update_time': 1774868038.987317}
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV21228') HTTP/1.1" 204 0
2026-03-30 10:53:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f464f2a-8553-57e6-8f3c-4158e95f3607 with identifier: ZY59187
2026-03-30 10:53:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f464f2a-8553-57e6-8f3c-4158e95f3607 with identifier: ZY59187
2026-03-30 10:53:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f464f2a-8553-57e6-8f3c-4158e95f3607 with identifier: ZY59187 to the API
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:53:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:29:23Z',
 'fuel_type': 'diesel',
 'id': '8f464f2a-8553-57e6-8f3c-4158e95f3607',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY59187',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 450488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-04',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Exclusive 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Exclusive 4Motion BlueMotion',
 'year': 2013}
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY59187%27 HTTP/1.1" 200 None
2026-03-30 10:53:59 [auto1.de] INFO: Saving data for ZY59187: {'auction_closing_time': 1774970963.0, 'created_time': 1773302937.508028, 'last_price_update_time': 1774868039.499571}
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY59187') HTTP/1.1" 204 0
2026-03-30 10:53:59 [auto1.de] INFO: Found listing with ID: FT70246
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT70246%27 HTTP/1.1" 200 None
2026-03-30 10:53:59 [auto1.de] INFO: Scrape type for FT70246: 2
2026-03-30 10:53:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 716d558e-c6e0-52e8-8cb9-d16726fd931a with identifier: FT70246
2026-03-30 10:53:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 716d558e-c6e0-52e8-8cb9-d16726fd931a with scrape type 2
2026-03-30 10:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 716d558e-c6e0-52e8-8cb9-d16726fd931a with scrape type 2
2026-03-30 10:53:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 716d558e-c6e0-52e8-8cb9-d16726fd931a, identifier: FT70246
2026-03-30 10:53:59 [auto1.de] INFO: Found listing with ID: JT25631
2026-03-30 10:53:59 [auto1.de] INFO: Found listing with ID: HH04688
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04688%27 HTTP/1.1" 200 None
2026-03-30 10:53:59 [auto1.de] INFO: Scrape type for HH04688: 2
2026-03-30 10:53:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6a0c6d6-8df6-596b-aec5-4398242e8a82 with identifier: HH04688
2026-03-30 10:53:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6a0c6d6-8df6-596b-aec5-4398242e8a82 with scrape type 2
2026-03-30 10:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6a0c6d6-8df6-596b-aec5-4398242e8a82 with scrape type 2
2026-03-30 10:53:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6a0c6d6-8df6-596b-aec5-4398242e8a82, identifier: HH04688
2026-03-30 10:53:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 716d558e-c6e0-52e8-8cb9-d16726fd931a with identifier: FT70246
2026-03-30 10:53:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 716d558e-c6e0-52e8-8cb9-d16726fd931a with identifier: FT70246
2026-03-30 10:53:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 716d558e-c6e0-52e8-8cb9-d16726fd931a with identifier: FT70246 to the API
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:53:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:15:49Z',
 'fuel_type': 'petrol',
 'id': '716d558e-c6e0-52e8-8cb9-d16726fd931a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT70246',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 185635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-30',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT70246%27 HTTP/1.1" 200 None
2026-03-30 10:54:00 [auto1.de] INFO: Saving data for FT70246: {'auction_closing_time': 1774970149.0, 'created_time': 1774291406.340637, 'last_price_update_time': 1774868040.08634}
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT70246') HTTP/1.1" 204 0
2026-03-30 10:54:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6a0c6d6-8df6-596b-aec5-4398242e8a82 with identifier: HH04688
2026-03-30 10:54:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6a0c6d6-8df6-596b-aec5-4398242e8a82 with identifier: HH04688
2026-03-30 10:54:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6a0c6d6-8df6-596b-aec5-4398242e8a82 with identifier: HH04688 to the API
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-31T15:51:31Z',
 'fuel_type': 'petrol',
 'id': 'e6a0c6d6-8df6-596b-aec5-4398242e8a82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH04688',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 45267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-23',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2022}
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04688%27 HTTP/1.1" 200 None
2026-03-30 10:54:00 [auto1.de] INFO: Saving data for HH04688: {'auction_closing_time': 1774972291.0, 'created_time': 1773383725.131311, 'last_price_update_time': 1774868040.639229}
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH04688') HTTP/1.1" 204 0
2026-03-30 10:54:00 [auto1.de] INFO: Found listing with ID: YZ14429
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ14429%27 HTTP/1.1" 200 None
2026-03-30 10:54:00 [auto1.de] INFO: Scrape type for YZ14429: 2
2026-03-30 10:54:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ca049c7-2d03-5fc5-a40a-433981573256 with identifier: YZ14429
2026-03-30 10:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ca049c7-2d03-5fc5-a40a-433981573256 with scrape type 2
2026-03-30 10:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ca049c7-2d03-5fc5-a40a-433981573256 with scrape type 2
2026-03-30 10:54:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ca049c7-2d03-5fc5-a40a-433981573256, identifier: YZ14429
2026-03-30 10:54:00 [auto1.de] INFO: Found listing with ID: DE69503
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69503%27 HTTP/1.1" 200 None
2026-03-30 10:54:00 [auto1.de] INFO: Scrape type for DE69503: 2
2026-03-30 10:54:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b06f2cf-2ed5-5329-a5dd-28e8f07c5c8c with identifier: DE69503
2026-03-30 10:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b06f2cf-2ed5-5329-a5dd-28e8f07c5c8c with scrape type 2
2026-03-30 10:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b06f2cf-2ed5-5329-a5dd-28e8f07c5c8c with scrape type 2
2026-03-30 10:54:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b06f2cf-2ed5-5329-a5dd-28e8f07c5c8c, identifier: DE69503
2026-03-30 10:54:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ca049c7-2d03-5fc5-a40a-433981573256 with identifier: YZ14429
2026-03-30 10:54:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ca049c7-2d03-5fc5-a40a-433981573256 with identifier: YZ14429
2026-03-30 10:54:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ca049c7-2d03-5fc5-a40a-433981573256 with identifier: YZ14429 to the API
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:19:35Z',
 'fuel_type': 'petrol',
 'id': '6ca049c7-2d03-5fc5-a40a-433981573256',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ14429',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Ateca',
 'odometer': 83565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seller_name': None,
 'title': 'Cupra Ateca 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2019}
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ14429%27 HTTP/1.1" 200 None
2026-03-30 10:54:01 [auto1.de] INFO: Saving data for YZ14429: {'auction_closing_time': 1774970375.0, 'created_time': 1773382019.785884, 'last_price_update_time': 1774868041.244424}
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ14429') HTTP/1.1" 204 0
2026-03-30 10:54:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b06f2cf-2ed5-5329-a5dd-28e8f07c5c8c with identifier: DE69503
2026-03-30 10:54:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b06f2cf-2ed5-5329-a5dd-28e8f07c5c8c with identifier: DE69503
2026-03-30 10:54:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b06f2cf-2ed5-5329-a5dd-28e8f07c5c8c with identifier: DE69503 to the API
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:33:20Z',
 'fuel_type': 'petrol',
 'id': '3b06f2cf-2ed5-5329-a5dd-28e8f07c5c8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE69503',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 24568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-04',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake Mild-Hybrid '
          'Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2024}
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69503%27 HTTP/1.1" 200 None
2026-03-30 10:54:01 [auto1.de] INFO: Saving data for DE69503: {'auction_closing_time': 1774971200.0, 'created_time': 1773305375.958864, 'last_price_update_time': 1774868041.594137}
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE69503') HTTP/1.1" 204 0
2026-03-30 10:54:01 [auto1.de] INFO: Found listing with ID: BZ51273
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ51273%27 HTTP/1.1" 200 None
2026-03-30 10:54:01 [auto1.de] INFO: Scrape type for BZ51273: 2
2026-03-30 10:54:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 525b7d66-c5f9-5b1a-87be-53b15f44a426 with identifier: BZ51273
2026-03-30 10:54:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 525b7d66-c5f9-5b1a-87be-53b15f44a426 with scrape type 2
2026-03-30 10:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 525b7d66-c5f9-5b1a-87be-53b15f44a426 with scrape type 2
2026-03-30 10:54:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 525b7d66-c5f9-5b1a-87be-53b15f44a426, identifier: BZ51273
2026-03-30 10:54:01 [auto1.de] INFO: Found listing with ID: SP29379
2026-03-30 10:54:01 [auto1.de] INFO: Found listing with ID: RA40311
2026-03-30 10:54:01 [auto1.de] INFO: Found listing with ID: YA21535
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA21535%27 HTTP/1.1" 200 None
2026-03-30 10:54:01 [auto1.de] INFO: Scrape type for YA21535: 2
2026-03-30 10:54:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e1a0cb5-ff9e-5876-b58f-1195155d057d with identifier: YA21535
2026-03-30 10:54:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e1a0cb5-ff9e-5876-b58f-1195155d057d with scrape type 2
2026-03-30 10:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e1a0cb5-ff9e-5876-b58f-1195155d057d with scrape type 2
2026-03-30 10:54:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e1a0cb5-ff9e-5876-b58f-1195155d057d, identifier: YA21535
2026-03-30 10:54:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 525b7d66-c5f9-5b1a-87be-53b15f44a426 with identifier: BZ51273
2026-03-30 10:54:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 525b7d66-c5f9-5b1a-87be-53b15f44a426 with identifier: BZ51273
2026-03-30 10:54:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 525b7d66-c5f9-5b1a-87be-53b15f44a426 with identifier: BZ51273 to the API
2026-03-30 10:54:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:36:31Z',
 'fuel_type': 'petrol',
 'id': '525b7d66-c5f9-5b1a-87be-53b15f44a426',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ51273',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 174293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2011}
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ51273%27 HTTP/1.1" 200 None
2026-03-30 10:54:02 [auto1.de] INFO: Saving data for BZ51273: {'auction_closing_time': 1774971391.0, 'created_time': 1774463872.703445, 'last_price_update_time': 1774868042.262568}
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ51273') HTTP/1.1" 204 0
2026-03-30 10:54:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e1a0cb5-ff9e-5876-b58f-1195155d057d with identifier: YA21535
2026-03-30 10:54:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e1a0cb5-ff9e-5876-b58f-1195155d057d with identifier: YA21535
2026-03-30 10:54:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e1a0cb5-ff9e-5876-b58f-1195155d057d with identifier: YA21535 to the API
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:36:31Z',
 'fuel_type': 'diesel',
 'id': '3e1a0cb5-ff9e-5876-b58f-1195155d057d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA21535',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 209045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-23',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI CrossPolo',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2011}
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA21535%27 HTTP/1.1" 200 None
2026-03-30 10:54:02 [auto1.de] INFO: Saving data for YA21535: {'auction_closing_time': 1774971391.0, 'created_time': 1773946144.234294, 'last_price_update_time': 1774868042.851989}
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA21535') HTTP/1.1" 204 0
2026-03-30 10:54:02 [auto1.de] INFO: Found listing with ID: SR93888
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR93888%27 HTTP/1.1" 200 None
2026-03-30 10:54:02 [auto1.de] INFO: Scrape type for SR93888: 2
2026-03-30 10:54:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad5057fd-61f2-56ee-813f-cd0dbe3f6c77 with identifier: SR93888
2026-03-30 10:54:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad5057fd-61f2-56ee-813f-cd0dbe3f6c77 with scrape type 2
2026-03-30 10:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad5057fd-61f2-56ee-813f-cd0dbe3f6c77 with scrape type 2
2026-03-30 10:54:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad5057fd-61f2-56ee-813f-cd0dbe3f6c77, identifier: SR93888
2026-03-30 10:54:03 [auto1.de] INFO: Found listing with ID: RT09280
2026-03-30 10:54:03 [auto1.de] INFO: Found listing with ID: EV41055
2026-03-30 10:54:03 [auto1.de] INFO: Found listing with ID: CE24177
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE24177%27 HTTP/1.1" 200 None
2026-03-30 10:54:03 [auto1.de] INFO: Scrape type for CE24177: 2
2026-03-30 10:54:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b62f2a92-6fb3-5918-bc12-cde3ddf5cebb with identifier: CE24177
2026-03-30 10:54:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b62f2a92-6fb3-5918-bc12-cde3ddf5cebb with scrape type 2
2026-03-30 10:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b62f2a92-6fb3-5918-bc12-cde3ddf5cebb with scrape type 2
2026-03-30 10:54:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b62f2a92-6fb3-5918-bc12-cde3ddf5cebb, identifier: CE24177
2026-03-30 10:54:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad5057fd-61f2-56ee-813f-cd0dbe3f6c77 with identifier: SR93888
2026-03-30 10:54:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad5057fd-61f2-56ee-813f-cd0dbe3f6c77 with identifier: SR93888
2026-03-30 10:54:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad5057fd-61f2-56ee-813f-cd0dbe3f6c77 with identifier: SR93888 to the API
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:53:48Z',
 'fuel_type': 'petrol',
 'id': 'ad5057fd-61f2-56ee-813f-cd0dbe3f6c77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR93888',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 260877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-04-16',
 'seller_name': None,
 'title': 'Audi A4 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2001}
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR93888%27 HTTP/1.1" 200 None
2026-03-30 10:54:03 [auto1.de] INFO: Saving data for SR93888: {'auction_closing_time': 1774972428.0, 'created_time': 1774293604.114832, 'last_price_update_time': 1774868043.465793}
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR93888') HTTP/1.1" 204 0
2026-03-30 10:54:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b62f2a92-6fb3-5918-bc12-cde3ddf5cebb with identifier: CE24177
2026-03-30 10:54:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b62f2a92-6fb3-5918-bc12-cde3ddf5cebb with identifier: CE24177
2026-03-30 10:54:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b62f2a92-6fb3-5918-bc12-cde3ddf5cebb with identifier: CE24177 to the API
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:11:32Z',
 'fuel_type': 'petrol',
 'id': 'b62f2a92-6fb3-5918-bc12-cde3ddf5cebb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE24177',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 98318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-30',
 'seller_name': None,
 'title': 'Opel Corsa 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE24177%27 HTTP/1.1" 200 None
2026-03-30 10:54:03 [auto1.de] INFO: Saving data for CE24177: {'auction_closing_time': 1774969892.0, 'created_time': 1774380773.530855, 'last_price_update_time': 1774868043.9898}
2026-03-30 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE24177') HTTP/1.1" 204 0
2026-03-30 10:54:04 [auto1.de] INFO: Found listing with ID: WW56601
2026-03-30 10:54:04 [auto1.de] INFO: Found listing with ID: XT31458
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT31458%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [auto1.de] INFO: Scrape type for XT31458: 2
2026-03-30 10:54:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ea0dff4-2e2d-591a-a698-273329302371 with identifier: XT31458
2026-03-30 10:54:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ea0dff4-2e2d-591a-a698-273329302371 with scrape type 2
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ea0dff4-2e2d-591a-a698-273329302371 with scrape type 2
2026-03-30 10:54:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ea0dff4-2e2d-591a-a698-273329302371, identifier: XT31458
2026-03-30 10:54:04 [auto1.de] INFO: Found listing with ID: NX49590
2026-03-30 10:54:04 [auto1.de] INFO: Found listing with ID: UC16251
2026-03-30 10:54:04 [auto1.de] INFO: Found listing with ID: GT12052
2026-03-30 10:54:04 [auto1.de] INFO: Found listing with ID: GF83151
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF83151%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [auto1.de] INFO: Scrape type for GF83151: 2
2026-03-30 10:54:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fc9210e-db74-547f-ab3a-16ecb1d38703 with identifier: GF83151
2026-03-30 10:54:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fc9210e-db74-547f-ab3a-16ecb1d38703 with scrape type 2
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fc9210e-db74-547f-ab3a-16ecb1d38703 with scrape type 2
2026-03-30 10:54:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fc9210e-db74-547f-ab3a-16ecb1d38703, identifier: GF83151
2026-03-30 10:54:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ea0dff4-2e2d-591a-a698-273329302371 with identifier: XT31458
2026-03-30 10:54:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ea0dff4-2e2d-591a-a698-273329302371 with identifier: XT31458
2026-03-30 10:54:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ea0dff4-2e2d-591a-a698-273329302371 with identifier: XT31458 to the API
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:33:30Z',
 'fuel_type': 'diesel',
 'id': '0ea0dff4-2e2d-591a-a698-273329302371',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT31458',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Alaskan',
 'odometer': 110523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-05',
 'seller_name': None,
 'title': 'Renault Alaskan 2.3 dCi Diesel Intens Double Cab 4x4',
 'transmission': 'automatic',
 'trim': 'Intens Double Cab 4x4',
 'year': 2018}
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT31458%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [auto1.de] INFO: Saving data for XT31458: {'auction_closing_time': 1774971210.0, 'created_time': 1773227511.710345, 'last_price_update_time': 1774868044.592571}
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT31458') HTTP/1.1" 204 0
2026-03-30 10:54:04 [scrapy.extensions.logstats] INFO: Crawled 701 pages (at 32 pages/min), scraped 653 items (at 90 items/min)
2026-03-30 10:54:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 10:54:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fc9210e-db74-547f-ab3a-16ecb1d38703 with identifier: GF83151
2026-03-30 10:54:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fc9210e-db74-547f-ab3a-16ecb1d38703 with identifier: GF83151
2026-03-30 10:54:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fc9210e-db74-547f-ab3a-16ecb1d38703 with identifier: GF83151 to the API
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 159,
 'expiration_date': '2026-03-31T15:36:32Z',
 'fuel_type': 'petrol',
 'id': '6fc9210e-db74-547f-ab3a-16ecb1d38703',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF83151',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 99237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-22',
 'seller_name': None,
 'title': 'Renault Kadjar 1.3 TCe Bose Edition',
 'transmission': 'automatic',
 'trim': 'Bose Edition',
 'year': 2019}
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF83151%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [auto1.de] INFO: Saving data for GF83151: {'auction_closing_time': 1774971392.0, 'created_time': 1774380568.819889, 'last_price_update_time': 1774868044.950248}
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF83151') HTTP/1.1" 204 0
2026-03-30 10:54:04 [auto1.de] INFO: Found listing with ID: FU70567
2026-03-30 10:54:04 [auto1.de] INFO: Found listing with ID: JA92497
2026-03-30 10:54:04 [auto1.de] INFO: Found listing with ID: UU37605
2026-03-30 10:54:04 [auto1.de] INFO: Found listing with ID: HE75386
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE75386%27 HTTP/1.1" 200 None
2026-03-30 10:54:04 [auto1.de] INFO: Scrape type for HE75386: 2
2026-03-30 10:54:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aff8628-63e8-5804-87f6-1b072e4d3c2e with identifier: HE75386
2026-03-30 10:54:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aff8628-63e8-5804-87f6-1b072e4d3c2e with scrape type 2
2026-03-30 10:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4aff8628-63e8-5804-87f6-1b072e4d3c2e with scrape type 2
2026-03-30 10:54:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4aff8628-63e8-5804-87f6-1b072e4d3c2e, identifier: HE75386
2026-03-30 10:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA52420> (referer: https://www.auto1.com/v1/car-details-view/XA52420/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:05 [auto1.de] INFO: Found listing with ID: RL62864
2026-03-30 10:54:05 [auto1.de] INFO: Found listing with ID: DF24349
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF24349%27 HTTP/1.1" 200 None
2026-03-30 10:54:05 [auto1.de] INFO: Scrape type for DF24349: 2
2026-03-30 10:54:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72c9e52d-5849-5efe-a4a6-429836bffed6 with identifier: DF24349
2026-03-30 10:54:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72c9e52d-5849-5efe-a4a6-429836bffed6 with scrape type 2
2026-03-30 10:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72c9e52d-5849-5efe-a4a6-429836bffed6 with scrape type 2
2026-03-30 10:54:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72c9e52d-5849-5efe-a4a6-429836bffed6, identifier: DF24349
2026-03-30 10:54:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4aff8628-63e8-5804-87f6-1b072e4d3c2e with identifier: HE75386
2026-03-30 10:54:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4aff8628-63e8-5804-87f6-1b072e4d3c2e with identifier: HE75386
2026-03-30 10:54:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4aff8628-63e8-5804-87f6-1b072e4d3c2e with identifier: HE75386 to the API
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:41:59Z',
 'fuel_type': 'petrol',
 'id': '4aff8628-63e8-5804-87f6-1b072e4d3c2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE75386',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 40031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-20',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 TGDI GT",
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE75386%27 HTTP/1.1" 200 None
2026-03-30 10:54:05 [auto1.de] INFO: Saving data for HE75386: {'auction_closing_time': 1774971719.0, 'created_time': 1774464554.615906, 'last_price_update_time': 1774868045.522981}
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE75386') HTTP/1.1" 204 0
2026-03-30 10:54:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72c9e52d-5849-5efe-a4a6-429836bffed6 with identifier: DF24349
2026-03-30 10:54:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72c9e52d-5849-5efe-a4a6-429836bffed6 with identifier: DF24349
2026-03-30 10:54:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72c9e52d-5849-5efe-a4a6-429836bffed6 with identifier: DF24349 to the API
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-31T15:21:56Z',
 'fuel_type': 'petrol',
 'id': '72c9e52d-5849-5efe-a4a6-429836bffed6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF24349',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 163155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-17',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 500 CGI BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2012}
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF24349%27 HTTP/1.1" 200 None
2026-03-30 10:54:05 [auto1.de] INFO: Saving data for DF24349: {'auction_closing_time': 1774970516.0, 'created_time': 1774463915.208196, 'last_price_update_time': 1774868045.950839}
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF24349') HTTP/1.1" 204 0
2026-03-30 10:54:05 [auto1.de] INFO: Found listing with ID: WE43939
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE43939%27 HTTP/1.1" 200 None
2026-03-30 10:54:05 [auto1.de] INFO: Scrape type for WE43939: 2
2026-03-30 10:54:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9627b20b-224a-5d85-bb31-ec0c6e2dd32a with identifier: WE43939
2026-03-30 10:54:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9627b20b-224a-5d85-bb31-ec0c6e2dd32a with scrape type 2
2026-03-30 10:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9627b20b-224a-5d85-bb31-ec0c6e2dd32a with scrape type 2
2026-03-30 10:54:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9627b20b-224a-5d85-bb31-ec0c6e2dd32a, identifier: WE43939
2026-03-30 10:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:06 [auto1.de] INFO: Found listing with ID: LZ29816
2026-03-30 10:54:06 [auto1.de] INFO: Found listing with ID: RM06492
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM06492%27 HTTP/1.1" 200 None
2026-03-30 10:54:06 [auto1.de] INFO: Scrape type for RM06492: 0
2026-03-30 10:54:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9627b20b-224a-5d85-bb31-ec0c6e2dd32a with identifier: WE43939
2026-03-30 10:54:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9627b20b-224a-5d85-bb31-ec0c6e2dd32a with identifier: WE43939
2026-03-30 10:54:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9627b20b-224a-5d85-bb31-ec0c6e2dd32a with identifier: WE43939 to the API
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:58:33Z',
 'fuel_type': 'diesel',
 'id': '9627b20b-224a-5d85-bb31-ec0c6e2dd32a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE43939',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 252828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-03',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE43939%27 HTTP/1.1" 200 None
2026-03-30 10:54:06 [auto1.de] INFO: Saving data for WE43939: {'auction_closing_time': 1774972713.0, 'created_time': 1773305131.94491, 'last_price_update_time': 1774868046.40989}
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE43939') HTTP/1.1" 204 0
2026-03-30 10:54:06 [auto1.de] INFO: Found listing with ID: XD99934
2026-03-30 10:54:06 [auto1.de] INFO: Found listing with ID: EF86666
2026-03-30 10:54:06 [auto1.de] INFO: Found listing with ID: FC08101
2026-03-30 10:54:06 [auto1.de] INFO: Found listing with ID: BL44244
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL44244%27 HTTP/1.1" 200 None
2026-03-30 10:54:06 [auto1.de] INFO: Scrape type for BL44244: 2
2026-03-30 10:54:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 269b7b73-47e1-524f-a20d-1861dedf1119 with identifier: BL44244
2026-03-30 10:54:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 269b7b73-47e1-524f-a20d-1861dedf1119 with scrape type 2
2026-03-30 10:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 269b7b73-47e1-524f-a20d-1861dedf1119 with scrape type 2
2026-03-30 10:54:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 269b7b73-47e1-524f-a20d-1861dedf1119, identifier: BL44244
2026-03-30 10:54:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 269b7b73-47e1-524f-a20d-1861dedf1119 with identifier: BL44244
2026-03-30 10:54:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 269b7b73-47e1-524f-a20d-1861dedf1119 with identifier: BL44244
2026-03-30 10:54:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 269b7b73-47e1-524f-a20d-1861dedf1119 with identifier: BL44244 to the API
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:10:07Z',
 'fuel_type': 'petrol',
 'id': '269b7b73-47e1-524f-a20d-1861dedf1119',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL44244',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 51960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-13',
 'seller_name': None,
 'title': 'Renault Captur 1.2 TCe Energy XMOD',
 'transmission': 'automatic',
 'trim': 'XMOD',
 'year': 2015}
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL44244%27 HTTP/1.1" 200 None
2026-03-30 10:54:06 [auto1.de] INFO: Saving data for BL44244: {'auction_closing_time': 1774969807.0, 'created_time': 1774292235.041993, 'last_price_update_time': 1774868046.887915}
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL44244') HTTP/1.1" 204 0
2026-03-30 10:54:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f79d649f-e3a2-5c50-ab64-c271b173848f with identifier: XA52420
2026-03-30 10:54:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f79d649f-e3a2-5c50-ab64-c271b173848f with scrape type 1
2026-03-30 10:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f79d649f-e3a2-5c50-ab64-c271b173848f
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377ca452c1b6589a4756ff5637916b00%252Fpa%252FXA52420_bde25db4a1ffd8a6f511ba04df7adcda.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_bde25db4a1ffd8a6f511ba04df7adcda.jpg not downloaded yet
2026-03-30 10:54:06 [auto1.de] INFO: Found listing with ID: UU71497
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU71497%27 HTTP/1.1" 200 None
2026-03-30 10:54:06 [auto1.de] INFO: Scrape type for UU71497: 2
2026-03-30 10:54:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49565536-52ae-5ff5-8ba5-d30054e8ab89 with identifier: UU71497
2026-03-30 10:54:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49565536-52ae-5ff5-8ba5-d30054e8ab89 with scrape type 2
2026-03-30 10:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49565536-52ae-5ff5-8ba5-d30054e8ab89 with scrape type 2
2026-03-30 10:54:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49565536-52ae-5ff5-8ba5-d30054e8ab89, identifier: UU71497
2026-03-30 10:54:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49565536-52ae-5ff5-8ba5-d30054e8ab89 with identifier: UU71497
2026-03-30 10:54:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49565536-52ae-5ff5-8ba5-d30054e8ab89 with identifier: UU71497
2026-03-30 10:54:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49565536-52ae-5ff5-8ba5-d30054e8ab89 with identifier: UU71497 to the API
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:11:58Z',
 'fuel_type': 'petrol',
 'id': '49565536-52ae-5ff5-8ba5-d30054e8ab89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU71497',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 200256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-29',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU71497%27 HTTP/1.1" 200 None
2026-03-30 10:54:07 [auto1.de] INFO: Saving data for UU71497: {'auction_closing_time': 1774969918.0, 'created_time': 1773686283.031395, 'last_price_update_time': 1774868047.404488}
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU71497') HTTP/1.1" 204 0
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377ca452c1b6589a4756ff5637916b00%252Fpa%252FXA52420_af821c854aea1c96e104e333c02458e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_af821c854aea1c96e104e333c02458e9.jpg not downloaded yet
2026-03-30 10:54:07 [auto1.de] INFO: Found listing with ID: SH34728
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH34728%27 HTTP/1.1" 200 None
2026-03-30 10:54:07 [auto1.de] INFO: Scrape type for SH34728: 2
2026-03-30 10:54:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58777a51-7803-5a0c-9fc6-4e4ae89aac5b with identifier: SH34728
2026-03-30 10:54:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58777a51-7803-5a0c-9fc6-4e4ae89aac5b with scrape type 2
2026-03-30 10:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58777a51-7803-5a0c-9fc6-4e4ae89aac5b with scrape type 2
2026-03-30 10:54:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58777a51-7803-5a0c-9fc6-4e4ae89aac5b, identifier: SH34728
2026-03-30 10:54:07 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 9521 | hits on page: 40
2026-03-30 10:54:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58777a51-7803-5a0c-9fc6-4e4ae89aac5b with identifier: SH34728
2026-03-30 10:54:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58777a51-7803-5a0c-9fc6-4e4ae89aac5b with identifier: SH34728
2026-03-30 10:54:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58777a51-7803-5a0c-9fc6-4e4ae89aac5b with identifier: SH34728 to the API
2026-03-30 10:54:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:53:08Z',
 'fuel_type': 'diesel',
 'id': '58777a51-7803-5a0c-9fc6-4e4ae89aac5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH34728',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 44392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-02',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH34728%27 HTTP/1.1" 200 None
2026-03-30 10:54:08 [auto1.de] INFO: Saving data for SH34728: {'auction_closing_time': 1774972388.0, 'created_time': 1774464605.45071, 'last_price_update_time': 1774868048.158151}
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH34728') HTTP/1.1" 204 0
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377ca452c1b6589a4756ff5637916b00%252Fpa%252FXA52420_323bf55939f93a5ff8c32c6c5f287686.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_323bf55939f93a5ff8c32c6c5f287686.jpg not downloaded yet
2026-03-30 10:54:08 [auto1.de] INFO: Found listing with ID: JU51054
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU51054%27 HTTP/1.1" 200 None
2026-03-30 10:54:08 [auto1.de] INFO: Scrape type for JU51054: 2
2026-03-30 10:54:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e838aeaf-0bfa-5c21-acfd-deebb482c033 with identifier: JU51054
2026-03-30 10:54:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e838aeaf-0bfa-5c21-acfd-deebb482c033 with scrape type 2
2026-03-30 10:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e838aeaf-0bfa-5c21-acfd-deebb482c033 with scrape type 2
2026-03-30 10:54:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e838aeaf-0bfa-5c21-acfd-deebb482c033, identifier: JU51054
2026-03-30 10:54:08 [auto1.de] INFO: Found listing with ID: LJ65322
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65322%27 HTTP/1.1" 200 None
2026-03-30 10:54:08 [auto1.de] INFO: Scrape type for LJ65322: 2
2026-03-30 10:54:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 553acb8d-0ebf-565c-9bf5-88803fcb1869 with identifier: LJ65322
2026-03-30 10:54:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 553acb8d-0ebf-565c-9bf5-88803fcb1869 with scrape type 2
2026-03-30 10:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 553acb8d-0ebf-565c-9bf5-88803fcb1869 with scrape type 2
2026-03-30 10:54:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 553acb8d-0ebf-565c-9bf5-88803fcb1869, identifier: LJ65322
2026-03-30 10:54:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e838aeaf-0bfa-5c21-acfd-deebb482c033 with identifier: JU51054
2026-03-30 10:54:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e838aeaf-0bfa-5c21-acfd-deebb482c033 with identifier: JU51054
2026-03-30 10:54:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e838aeaf-0bfa-5c21-acfd-deebb482c033 with identifier: JU51054 to the API
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-31T15:51:10Z',
 'fuel_type': 'diesel',
 'id': 'e838aeaf-0bfa-5c21-acfd-deebb482c033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU51054',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T4 Kombi',
 'odometer': 504949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-01-30',
 'seller_name': None,
 'title': 'Volkswagen T4 Kombi 2.5 TDI Economy',
 'transmission': 'manual',
 'trim': 'Economy',
 'year': 2002}
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU51054%27 HTTP/1.1" 200 None
2026-03-30 10:54:08 [auto1.de] INFO: Saving data for JU51054: {'auction_closing_time': 1774972270.0, 'created_time': 1774349634.167531, 'last_price_update_time': 1774868048.783397}
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU51054') HTTP/1.1" 204 0
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377ca452c1b6589a4756ff5637916b00%252Fpa%252FXA52420_3af22a0a085766c91a2bbb1459e8ebcf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_3af22a0a085766c91a2bbb1459e8ebcf.jpg not downloaded yet
2026-03-30 10:54:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 553acb8d-0ebf-565c-9bf5-88803fcb1869 with identifier: LJ65322
2026-03-30 10:54:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 553acb8d-0ebf-565c-9bf5-88803fcb1869 with identifier: LJ65322
2026-03-30 10:54:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 553acb8d-0ebf-565c-9bf5-88803fcb1869 with identifier: LJ65322 to the API
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:34:08Z',
 'fuel_type': 'petrol',
 'id': '553acb8d-0ebf-565c-9bf5-88803fcb1869',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ65322',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 93117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-03',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Passion',
 'transmission': 'manual',
 'trim': 'Passion',
 'year': 2018}
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65322%27 HTTP/1.1" 200 None
2026-03-30 10:54:09 [auto1.de] INFO: Saving data for LJ65322: {'auction_closing_time': 1774971248.0, 'created_time': 1773686241.608629, 'last_price_update_time': 1774868049.270779}
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ65322') HTTP/1.1" 204 0
2026-03-30 10:54:09 [auto1.de] INFO: Found listing with ID: GR60102
2026-03-30 10:54:09 [auto1.de] INFO: Found listing with ID: CA99872
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA99872%27 HTTP/1.1" 200 None
2026-03-30 10:54:09 [auto1.de] INFO: Scrape type for CA99872: 2
2026-03-30 10:54:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d3acda9-4a04-5463-a747-724e0f786ec9 with identifier: CA99872
2026-03-30 10:54:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d3acda9-4a04-5463-a747-724e0f786ec9 with scrape type 2
2026-03-30 10:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d3acda9-4a04-5463-a747-724e0f786ec9 with scrape type 2
2026-03-30 10:54:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d3acda9-4a04-5463-a747-724e0f786ec9, identifier: CA99872
2026-03-30 10:54:09 [auto1.de] INFO: Found listing with ID: ZM65799
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM65799%27 HTTP/1.1" 200 None
2026-03-30 10:54:09 [auto1.de] INFO: Scrape type for ZM65799: 2
2026-03-30 10:54:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6bc57a5-1298-5e88-a9e2-10a19fe410e5 with identifier: ZM65799
2026-03-30 10:54:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6bc57a5-1298-5e88-a9e2-10a19fe410e5 with scrape type 2
2026-03-30 10:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6bc57a5-1298-5e88-a9e2-10a19fe410e5 with scrape type 2
2026-03-30 10:54:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6bc57a5-1298-5e88-a9e2-10a19fe410e5, identifier: ZM65799
2026-03-30 10:54:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_bde25db4a1ffd8a6f511ba04df7adcda.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d3acda9-4a04-5463-a747-724e0f786ec9 with identifier: CA99872
2026-03-30 10:54:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d3acda9-4a04-5463-a747-724e0f786ec9 with identifier: CA99872
2026-03-30 10:54:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d3acda9-4a04-5463-a747-724e0f786ec9 with identifier: CA99872 to the API
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:19:32Z',
 'fuel_type': 'petrol',
 'id': '3d3acda9-4a04-5463-a747-724e0f786ec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA99872',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Crossfire',
 'odometer': 122717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-07',
 'seller_name': None,
 'title': 'Chrysler Crossfire 3.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2007}
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA99872%27 HTTP/1.1" 200 None
2026-03-30 10:54:09 [auto1.de] INFO: Saving data for CA99872: {'auction_closing_time': 1774970372.0, 'created_time': 1774294014.093807, 'last_price_update_time': 1774868049.836563}
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA99872') HTTP/1.1" 204 0
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377ca452c1b6589a4756ff5637916b00%252Fpa%252FXA52420_c264b18cae3eca43dfff7ec7233d0da7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_c264b18cae3eca43dfff7ec7233d0da7.jpg not downloaded yet
2026-03-30 10:54:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6bc57a5-1298-5e88-a9e2-10a19fe410e5 with identifier: ZM65799
2026-03-30 10:54:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6bc57a5-1298-5e88-a9e2-10a19fe410e5 with identifier: ZM65799
2026-03-30 10:54:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6bc57a5-1298-5e88-a9e2-10a19fe410e5 with identifier: ZM65799 to the API
2026-03-30 10:54:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:25:04Z',
 'fuel_type': 'petrol',
 'id': 'd6bc57a5-1298-5e88-a9e2-10a19fe410e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM65799',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 278796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-12',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM65799%27 HTTP/1.1" 200 None
2026-03-30 10:54:10 [auto1.de] INFO: Saving data for ZM65799: {'auction_closing_time': 1774970704.0, 'created_time': 1773380835.220162, 'last_price_update_time': 1774868050.187407}
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM65799') HTTP/1.1" 204 0
2026-03-30 10:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_af821c854aea1c96e104e333c02458e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: BY01569
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: XA03133
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: VH89882
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: BH49655
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: NB15408
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: YY19012
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: SY34780
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: CS95663
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: JW06785
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: JU02608
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: AV28159
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: VN58412
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN58412%27 HTTP/1.1" 200 None
2026-03-30 10:54:10 [auto1.de] INFO: Scrape type for VN58412: 2
2026-03-30 10:54:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68476c2a-6ecb-553c-a75c-37b176ad4b57 with identifier: VN58412
2026-03-30 10:54:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68476c2a-6ecb-553c-a75c-37b176ad4b57 with scrape type 2
2026-03-30 10:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68476c2a-6ecb-553c-a75c-37b176ad4b57 with scrape type 2
2026-03-30 10:54:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68476c2a-6ecb-553c-a75c-37b176ad4b57, identifier: VN58412
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: HG99428
2026-03-30 10:54:10 [auto1.de] INFO: Found listing with ID: EH94118
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH94118%27 HTTP/1.1" 200 None
2026-03-30 10:54:10 [auto1.de] INFO: Scrape type for EH94118: 2
2026-03-30 10:54:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bbe5062-c449-5bfd-997c-3959698a4050 with identifier: EH94118
2026-03-30 10:54:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bbe5062-c449-5bfd-997c-3959698a4050 with scrape type 2
2026-03-30 10:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bbe5062-c449-5bfd-997c-3959698a4050 with scrape type 2
2026-03-30 10:54:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bbe5062-c449-5bfd-997c-3959698a4050, identifier: EH94118
2026-03-30 10:54:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68476c2a-6ecb-553c-a75c-37b176ad4b57 with identifier: VN58412
2026-03-30 10:54:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68476c2a-6ecb-553c-a75c-37b176ad4b57 with identifier: VN58412
2026-03-30 10:54:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68476c2a-6ecb-553c-a75c-37b176ad4b57 with identifier: VN58412 to the API
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:02:40Z',
 'fuel_type': 'petrol',
 'id': '68476c2a-6ecb-553c-a75c-37b176ad4b57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN58412',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 42587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-13',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN58412%27 HTTP/1.1" 200 None
2026-03-30 10:54:10 [auto1.de] INFO: Saving data for VN58412: {'auction_closing_time': 1774969360.0, 'created_time': 1774337756.998615, 'last_price_update_time': 1774868050.761556}
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN58412') HTTP/1.1" 204 0
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377ca452c1b6589a4756ff5637916b00%252Fpa%252FXA52420_e70d392bcdb99543b8c934f7b6edf2b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_e70d392bcdb99543b8c934f7b6edf2b4.jpg not downloaded yet
2026-03-30 10:54:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bbe5062-c449-5bfd-997c-3959698a4050 with identifier: EH94118
2026-03-30 10:54:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bbe5062-c449-5bfd-997c-3959698a4050 with identifier: EH94118
2026-03-30 10:54:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bbe5062-c449-5bfd-997c-3959698a4050 with identifier: EH94118 to the API
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:28:30Z',
 'fuel_type': 'diesel',
 'id': '2bbe5062-c449-5bfd-997c-3959698a4050',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH94118',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 242787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-24',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2013}
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH94118%27 HTTP/1.1" 200 None
2026-03-30 10:54:11 [auto1.de] INFO: Saving data for EH94118: {'auction_closing_time': 1774970910.0, 'created_time': 1773687257.021682, 'last_price_update_time': 1774868051.273669}
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH94118') HTTP/1.1" 204 0
2026-03-30 10:54:11 [auto1.de] INFO: Found listing with ID: YC45625
2026-03-30 10:54:11 [auto1.de] INFO: Found listing with ID: NP12620
2026-03-30 10:54:11 [auto1.de] INFO: Found listing with ID: EN59108
2026-03-30 10:54:11 [auto1.de] INFO: Found listing with ID: AM83584
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM83584%27 HTTP/1.1" 200 None
2026-03-30 10:54:11 [auto1.de] INFO: Scrape type for AM83584: 2
2026-03-30 10:54:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a5d4a3-4eed-5200-8383-4b62e95bb0ee with identifier: AM83584
2026-03-30 10:54:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a5d4a3-4eed-5200-8383-4b62e95bb0ee with scrape type 2
2026-03-30 10:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40a5d4a3-4eed-5200-8383-4b62e95bb0ee with scrape type 2
2026-03-30 10:54:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40a5d4a3-4eed-5200-8383-4b62e95bb0ee, identifier: AM83584
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c0710>
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79d649f-e3a2-5c50-ab64-c271b173848f/f79d649f-e3a2-5c50-ab64-c271b173848f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377ca452c1b6589a4756ff5637916b00%252Fpa%252FXA52420_bde25db4a1ffd8a6f511ba04df7adcda.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_bde25db4a1ffd8a6f511ba04df7adcda.jpg saved to cache
2026-03-30 10:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f79d649f-e3a2-5c50-ab64-c271b173848f
2026-03-30 10:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_323bf55939f93a5ff8c32c6c5f287686.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40a5d4a3-4eed-5200-8383-4b62e95bb0ee with identifier: AM83584
2026-03-30 10:54:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40a5d4a3-4eed-5200-8383-4b62e95bb0ee with identifier: AM83584
2026-03-30 10:54:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40a5d4a3-4eed-5200-8383-4b62e95bb0ee with identifier: AM83584 to the API
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:46:27Z',
 'fuel_type': 'diesel',
 'id': '40a5d4a3-4eed-5200-8383-4b62e95bb0ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM83584',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 161244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2018}
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM83584%27 HTTP/1.1" 200 None
2026-03-30 10:54:11 [auto1.de] INFO: Saving data for AM83584: {'auction_closing_time': 1774971987.0, 'created_time': 1773688963.100453, 'last_price_update_time': 1774868051.776716}
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM83584') HTTP/1.1" 204 0
2026-03-30 10:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_3af22a0a085766c91a2bbb1459e8ebcf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:11 [auto1.de] INFO: Found listing with ID: RC15708
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC15708%27 HTTP/1.1" 200 None
2026-03-30 10:54:11 [auto1.de] INFO: Scrape type for RC15708: 1
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4dbb190>
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79d649f-e3a2-5c50-ab64-c271b173848f/f79d649f-e3a2-5c50-ab64-c271b173848f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377ca452c1b6589a4756ff5637916b00%252Fpa%252FXA52420_af821c854aea1c96e104e333c02458e9.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_af821c854aea1c96e104e333c02458e9.jpg saved to cache
2026-03-30 10:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f79d649f-e3a2-5c50-ab64-c271b173848f
2026-03-30 10:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_c264b18cae3eca43dfff7ec7233d0da7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:11 [auto1.de] INFO: Found listing with ID: KA01913
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA01913%27 HTTP/1.1" 200 None
2026-03-30 10:54:11 [auto1.de] INFO: Scrape type for KA01913: 2
2026-03-30 10:54:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 812f8223-4a99-5165-bf96-a07e73d6000c with identifier: KA01913
2026-03-30 10:54:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 812f8223-4a99-5165-bf96-a07e73d6000c with scrape type 2
2026-03-30 10:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 812f8223-4a99-5165-bf96-a07e73d6000c with scrape type 2
2026-03-30 10:54:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 812f8223-4a99-5165-bf96-a07e73d6000c, identifier: KA01913
2026-03-30 10:54:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f05990>
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79d649f-e3a2-5c50-ab64-c271b173848f/f79d649f-e3a2-5c50-ab64-c271b173848f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377ca452c1b6589a4756ff5637916b00%252Fpa%252FXA52420_323bf55939f93a5ff8c32c6c5f287686.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_323bf55939f93a5ff8c32c6c5f287686.jpg saved to cache
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f79d649f-e3a2-5c50-ab64-c271b173848f
2026-03-30 10:54:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 812f8223-4a99-5165-bf96-a07e73d6000c with identifier: KA01913
2026-03-30 10:54:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 812f8223-4a99-5165-bf96-a07e73d6000c with identifier: KA01913
2026-03-30 10:54:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 812f8223-4a99-5165-bf96-a07e73d6000c with identifier: KA01913 to the API
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:26:10Z',
 'fuel_type': 'petrol',
 'id': '812f8223-4a99-5165-bf96-a07e73d6000c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA01913',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 43308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-13',
 'seller_name': None,
 'title': 'Renault Megane 1.3 TCe Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2019}
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA01913%27 HTTP/1.1" 200 None
2026-03-30 10:54:12 [auto1.de] INFO: Saving data for KA01913: {'auction_closing_time': 1774970770.0, 'created_time': 1774380498.723645, 'last_price_update_time': 1774868052.353568}
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA01913') HTTP/1.1" 204 0
2026-03-30 10:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_e70d392bcdb99543b8c934f7b6edf2b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:12 [auto1.de] INFO: Found listing with ID: DL00356
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL00356%27 HTTP/1.1" 200 None
2026-03-30 10:54:12 [auto1.de] INFO: Scrape type for DL00356: 2
2026-03-30 10:54:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51e19422-7d16-5902-8bd1-852539d40937 with identifier: DL00356
2026-03-30 10:54:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51e19422-7d16-5902-8bd1-852539d40937 with scrape type 2
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51e19422-7d16-5902-8bd1-852539d40937 with scrape type 2
2026-03-30 10:54:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51e19422-7d16-5902-8bd1-852539d40937, identifier: DL00356
2026-03-30 10:54:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51e19422-7d16-5902-8bd1-852539d40937 with identifier: DL00356
2026-03-30 10:54:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51e19422-7d16-5902-8bd1-852539d40937 with identifier: DL00356
2026-03-30 10:54:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51e19422-7d16-5902-8bd1-852539d40937 with identifier: DL00356 to the API
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:11:26Z',
 'fuel_type': 'petrol',
 'id': '51e19422-7d16-5902-8bd1-852539d40937',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL00356',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Opirus',
 'odometer': 280721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-02',
 'seller_name': None,
 'title': 'Kia Opirus 3.8 V6 EX',
 'transmission': 'automatic',
 'trim': 'EX',
 'year': 2009}
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL00356%27 HTTP/1.1" 200 None
2026-03-30 10:54:12 [auto1.de] INFO: Saving data for DL00356: {'auction_closing_time': 1774969886.0, 'created_time': 1774381206.447792, 'last_price_update_time': 1774868052.793034}
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL00356') HTTP/1.1" 204 0
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e205d0>
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79d649f-e3a2-5c50-ab64-c271b173848f/f79d649f-e3a2-5c50-ab64-c271b173848f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377ca452c1b6589a4756ff5637916b00%252Fpa%252FXA52420_3af22a0a085766c91a2bbb1459e8ebcf.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_3af22a0a085766c91a2bbb1459e8ebcf.jpg saved to cache
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f79d649f-e3a2-5c50-ab64-c271b173848f
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d7edd0>
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79d649f-e3a2-5c50-ab64-c271b173848f/f79d649f-e3a2-5c50-ab64-c271b173848f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377ca452c1b6589a4756ff5637916b00%252Fpa%252FXA52420_c264b18cae3eca43dfff7ec7233d0da7.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_c264b18cae3eca43dfff7ec7233d0da7.jpg saved to cache
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f79d649f-e3a2-5c50-ab64-c271b173848f
2026-03-30 10:54:12 [auto1.de] INFO: Found listing with ID: HR08840
2026-03-30 10:54:12 [auto1.de] INFO: Found listing with ID: VP81164
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP81164%27 HTTP/1.1" 200 None
2026-03-30 10:54:12 [auto1.de] INFO: Scrape type for VP81164: 2
2026-03-30 10:54:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c13bbc34-81af-5985-b71d-e00e782a29a2 with identifier: VP81164
2026-03-30 10:54:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c13bbc34-81af-5985-b71d-e00e782a29a2 with scrape type 2
2026-03-30 10:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c13bbc34-81af-5985-b71d-e00e782a29a2 with scrape type 2
2026-03-30 10:54:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c13bbc34-81af-5985-b71d-e00e782a29a2, identifier: VP81164
2026-03-30 10:54:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c13bbc34-81af-5985-b71d-e00e782a29a2 with identifier: VP81164
2026-03-30 10:54:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c13bbc34-81af-5985-b71d-e00e782a29a2 with identifier: VP81164
2026-03-30 10:54:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c13bbc34-81af-5985-b71d-e00e782a29a2 with identifier: VP81164 to the API
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:03:23Z',
 'fuel_type': 'petrol',
 'id': 'c13bbc34-81af-5985-b71d-e00e782a29a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP81164',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 163929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-11-26',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Clio Blue Sensation',
 'transmission': 'manual',
 'trim': 'Blue Sensation',
 'year': 2002}
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP81164%27 HTTP/1.1" 200 None
2026-03-30 10:54:13 [auto1.de] INFO: Saving data for VP81164: {'auction_closing_time': 1774969403.0, 'created_time': 1774378819.571382, 'last_price_update_time': 1774868053.363252}
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP81164') HTTP/1.1" 204 0
2026-03-30 10:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e29dd0>
2026-03-30 10:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f79d649f-e3a2-5c50-ab64-c271b173848f/f79d649f-e3a2-5c50-ab64-c271b173848f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7c%252F377ca452c1b6589a4756ff5637916b00%252Fpa%252FXA52420_e70d392bcdb99543b8c934f7b6edf2b4.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_e70d392bcdb99543b8c934f7b6edf2b4.jpg saved to cache
2026-03-30 10:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f79d649f-e3a2-5c50-ab64-c271b173848f
2026-03-30 10:54:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f79d649f-e3a2-5c50-ab64-c271b173848f, skipping ID generation
2026-03-30 10:54:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f79d649f-e3a2-5c50-ab64-c271b173848f with scrape type 1
2026-03-30 10:54:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f79d649f-e3a2-5c50-ab64-c271b173848f sending to next pipeline
2026-03-30 10:54:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f79d649f-e3a2-5c50-ab64-c271b173848f, identifier: XA52420
2026-03-30 10:54:13 [auto1.de] INFO: Found listing with ID: NK36025
2026-03-30 10:54:13 [auto1.de] INFO: Found listing with ID: HS33411
2026-03-30 10:54:13 [auto1.de] INFO: Found listing with ID: CF23775
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF23775%27 HTTP/1.1" 200 None
2026-03-30 10:54:13 [auto1.de] INFO: Scrape type for CF23775: 2
2026-03-30 10:54:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffe2c49f-0c35-511c-8040-ed4012e5bea8 with identifier: CF23775
2026-03-30 10:54:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffe2c49f-0c35-511c-8040-ed4012e5bea8 with scrape type 2
2026-03-30 10:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffe2c49f-0c35-511c-8040-ed4012e5bea8 with scrape type 2
2026-03-30 10:54:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffe2c49f-0c35-511c-8040-ed4012e5bea8, identifier: CF23775
2026-03-30 10:54:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f79d649f-e3a2-5c50-ab64-c271b173848f with identifier: XA52420
2026-03-30 10:54:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f79d649f-e3a2-5c50-ab64-c271b173848f with identifier: XA52420
2026-03-30 10:54:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f79d649f-e3a2-5c50-ab64-c271b173848f with identifier: XA52420 to the API
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_e70d392bcdb99543b8c934f7b6edf2b4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:55:10Z',
 'fuel_type': 'petrol',
 'id': 'f79d649f-e3a2-5c50-ab64-c271b173848f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA52420',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 90961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79d649f-e3a2-5c50-ab64-c271b173848f/f79d649f-e3a2-5c50-ab64-c271b173848f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_bde25db4a1ffd8a6f511ba04df7adcda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79d649f-e3a2-5c50-ab64-c271b173848f/f79d649f-e3a2-5c50-ab64-c271b173848f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_af821c854aea1c96e104e333c02458e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79d649f-e3a2-5c50-ab64-c271b173848f/f79d649f-e3a2-5c50-ab64-c271b173848f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_323bf55939f93a5ff8c32c6c5f287686.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79d649f-e3a2-5c50-ab64-c271b173848f/f79d649f-e3a2-5c50-ab64-c271b173848f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_3af22a0a085766c91a2bbb1459e8ebcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79d649f-e3a2-5c50-ab64-c271b173848f/f79d649f-e3a2-5c50-ab64-c271b173848f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_c264b18cae3eca43dfff7ec7233d0da7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f79d649f-e3a2-5c50-ab64-c271b173848f/f79d649f-e3a2-5c50-ab64-c271b173848f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7c/377ca452c1b6589a4756ff5637916b00/pa/XA52420_e70d392bcdb99543b8c934f7b6edf2b4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2010}
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA52420%27 HTTP/1.1" 200 None
2026-03-30 10:54:13 [auto1.de] INFO: Saving data for XA52420: {'created_time': 1774868053.965475, 'last_price_update_time': 1774868053.96549, 'auction_closing_time': 1774972510.0}
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA52420') HTTP/1.1" 204 0
2026-03-30 10:54:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffe2c49f-0c35-511c-8040-ed4012e5bea8 with identifier: CF23775
2026-03-30 10:54:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffe2c49f-0c35-511c-8040-ed4012e5bea8 with identifier: CF23775
2026-03-30 10:54:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffe2c49f-0c35-511c-8040-ed4012e5bea8 with identifier: CF23775 to the API
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:16:31Z',
 'fuel_type': 'petrol',
 'id': 'ffe2c49f-0c35-511c-8040-ed4012e5bea8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF23775',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 247535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-02',
 'seller_name': None,
 'title': 'Audi A1 1.4 TFSI S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2011}
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF23775%27 HTTP/1.1" 200 None
2026-03-30 10:54:14 [auto1.de] INFO: Saving data for CF23775: {'auction_closing_time': 1774970191.0, 'created_time': 1774466753.384684, 'last_price_update_time': 1774868054.427606}
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF23775') HTTP/1.1" 204 0
2026-03-30 10:54:14 [auto1.de] INFO: Found listing with ID: NR85731
2026-03-30 10:54:14 [auto1.de] INFO: Found listing with ID: WT43265
2026-03-30 10:54:14 [auto1.de] INFO: Found listing with ID: XC24065
2026-03-30 10:54:14 [auto1.de] INFO: Found listing with ID: FF89334
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF89334%27 HTTP/1.1" 200 None
2026-03-30 10:54:14 [auto1.de] INFO: Scrape type for FF89334: 1
2026-03-30 10:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:14 [auto1.de] INFO: Found listing with ID: WR85565
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR85565%27 HTTP/1.1" 200 None
2026-03-30 10:54:14 [auto1.de] INFO: Scrape type for WR85565: 2
2026-03-30 10:54:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fe59fa8-bfab-5009-a8fd-66ef55c5dce2 with identifier: WR85565
2026-03-30 10:54:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fe59fa8-bfab-5009-a8fd-66ef55c5dce2 with scrape type 2
2026-03-30 10:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fe59fa8-bfab-5009-a8fd-66ef55c5dce2 with scrape type 2
2026-03-30 10:54:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fe59fa8-bfab-5009-a8fd-66ef55c5dce2, identifier: WR85565
2026-03-30 10:54:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fe59fa8-bfab-5009-a8fd-66ef55c5dce2 with identifier: WR85565
2026-03-30 10:54:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fe59fa8-bfab-5009-a8fd-66ef55c5dce2 with identifier: WR85565
2026-03-30 10:54:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fe59fa8-bfab-5009-a8fd-66ef55c5dce2 with identifier: WR85565 to the API
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:16:55Z',
 'fuel_type': 'diesel',
 'id': '9fe59fa8-bfab-5009-a8fd-66ef55c5dce2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR85565',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 250549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-24',
 'seller_name': None,
 'title': 'MINI Clubman Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR85565%27 HTTP/1.1" 200 None
2026-03-30 10:54:14 [auto1.de] INFO: Saving data for WR85565: {'auction_closing_time': 1774970215.0, 'created_time': 1773946314.174653, 'last_price_update_time': 1774868054.901093}
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR85565') HTTP/1.1" 204 0
2026-03-30 10:54:14 [auto1.de] INFO: Found listing with ID: KN16725
2026-03-30 10:54:14 [auto1.de] INFO: Found listing with ID: LZ64363
2026-03-30 10:54:14 [auto1.de] INFO: Found listing with ID: GC53073
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC53073%27 HTTP/1.1" 200 None
2026-03-30 10:54:14 [auto1.de] INFO: Scrape type for GC53073: 2
2026-03-30 10:54:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bc96432-e2e9-583e-8ca6-95a12ccd14ea with identifier: GC53073
2026-03-30 10:54:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bc96432-e2e9-583e-8ca6-95a12ccd14ea with scrape type 2
2026-03-30 10:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bc96432-e2e9-583e-8ca6-95a12ccd14ea with scrape type 2
2026-03-30 10:54:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bc96432-e2e9-583e-8ca6-95a12ccd14ea, identifier: GC53073
2026-03-30 10:54:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bc96432-e2e9-583e-8ca6-95a12ccd14ea with identifier: GC53073
2026-03-30 10:54:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bc96432-e2e9-583e-8ca6-95a12ccd14ea with identifier: GC53073
2026-03-30 10:54:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bc96432-e2e9-583e-8ca6-95a12ccd14ea with identifier: GC53073 to the API
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:50:31Z',
 'fuel_type': 'petrol',
 'id': '7bc96432-e2e9-583e-8ca6-95a12ccd14ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC53073',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 139227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-31',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC53073%27 HTTP/1.1" 200 None
2026-03-30 10:54:15 [auto1.de] INFO: Saving data for GC53073: {'auction_closing_time': 1774972231.0, 'created_time': 1774466505.336727, 'last_price_update_time': 1774868055.358998}
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC53073') HTTP/1.1" 204 0
2026-03-30 10:54:15 [auto1.de] INFO: Found listing with ID: AF34629
2026-03-30 10:54:15 [auto1.de] INFO: Found listing with ID: KZ96576
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ96576%27 HTTP/1.1" 200 None
2026-03-30 10:54:15 [auto1.de] INFO: Scrape type for KZ96576: 2
2026-03-30 10:54:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a51f4cd4-b185-5154-bb5c-a3b62ce5d7c5 with identifier: KZ96576
2026-03-30 10:54:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a51f4cd4-b185-5154-bb5c-a3b62ce5d7c5 with scrape type 2
2026-03-30 10:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a51f4cd4-b185-5154-bb5c-a3b62ce5d7c5 with scrape type 2
2026-03-30 10:54:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a51f4cd4-b185-5154-bb5c-a3b62ce5d7c5, identifier: KZ96576
2026-03-30 10:54:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a51f4cd4-b185-5154-bb5c-a3b62ce5d7c5 with identifier: KZ96576
2026-03-30 10:54:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a51f4cd4-b185-5154-bb5c-a3b62ce5d7c5 with identifier: KZ96576
2026-03-30 10:54:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a51f4cd4-b185-5154-bb5c-a3b62ce5d7c5 with identifier: KZ96576 to the API
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:17:51Z',
 'fuel_type': 'petrol',
 'id': 'a51f4cd4-b185-5154-bb5c-a3b62ce5d7c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ96576',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 42738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-08',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Maxi Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Maxi Comfortline BlueMotion',
 'year': 2020}
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ96576%27 HTTP/1.1" 200 None
2026-03-30 10:54:15 [auto1.de] INFO: Saving data for KZ96576: {'auction_closing_time': 1774970271.0, 'created_time': 1774380611.145002, 'last_price_update_time': 1774868055.837612}
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ96576') HTTP/1.1" 204 0
2026-03-30 10:54:15 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 9521 | hits on page: 40
2026-03-30 10:54:15 [auto1.de] INFO: Found listing with ID: MP85459
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP85459%27 HTTP/1.1" 200 None
2026-03-30 10:54:15 [auto1.de] INFO: Scrape type for MP85459: 2
2026-03-30 10:54:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea4aaa36-ec19-5d55-a1b5-448ef94589b3 with identifier: MP85459
2026-03-30 10:54:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea4aaa36-ec19-5d55-a1b5-448ef94589b3 with scrape type 2
2026-03-30 10:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea4aaa36-ec19-5d55-a1b5-448ef94589b3 with scrape type 2
2026-03-30 10:54:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea4aaa36-ec19-5d55-a1b5-448ef94589b3, identifier: MP85459
2026-03-30 10:54:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea4aaa36-ec19-5d55-a1b5-448ef94589b3 with identifier: MP85459
2026-03-30 10:54:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea4aaa36-ec19-5d55-a1b5-448ef94589b3 with identifier: MP85459
2026-03-30 10:54:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea4aaa36-ec19-5d55-a1b5-448ef94589b3 with identifier: MP85459 to the API
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 475,
 'expiration_date': '2026-03-31T15:30:44Z',
 'fuel_type': 'petrol',
 'id': 'ea4aaa36-ec19-5d55-a1b5-448ef94589b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP85459',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 126696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 63 AMG T',
 'transmission': 'automatic',
 'trim': 'T',
 'year': 2019}
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP85459%27 HTTP/1.1" 200 None
2026-03-30 10:54:16 [auto1.de] INFO: Saving data for MP85459: {'auction_closing_time': 1774971044.0, 'created_time': 1774466613.157452, 'last_price_update_time': 1774868056.298559}
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP85459') HTTP/1.1" 204 0
2026-03-30 10:54:16 [auto1.de] INFO: Found listing with ID: JN27816
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN27816%27 HTTP/1.1" 200 None
2026-03-30 10:54:16 [auto1.de] INFO: Scrape type for JN27816: 2
2026-03-30 10:54:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18fabc62-f67e-5437-b249-9a46d9953ee7 with identifier: JN27816
2026-03-30 10:54:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18fabc62-f67e-5437-b249-9a46d9953ee7 with scrape type 2
2026-03-30 10:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18fabc62-f67e-5437-b249-9a46d9953ee7 with scrape type 2
2026-03-30 10:54:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18fabc62-f67e-5437-b249-9a46d9953ee7, identifier: JN27816
2026-03-30 10:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC15708/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:16 [auto1.de] INFO: Found listing with ID: FT42679
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT42679%27 HTTP/1.1" 200 None
2026-03-30 10:54:16 [auto1.de] INFO: Scrape type for FT42679: 2
2026-03-30 10:54:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 310a9bee-3c16-5587-b4a0-7ffdd9802c5d with identifier: FT42679
2026-03-30 10:54:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 310a9bee-3c16-5587-b4a0-7ffdd9802c5d with scrape type 2
2026-03-30 10:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 310a9bee-3c16-5587-b4a0-7ffdd9802c5d with scrape type 2
2026-03-30 10:54:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 310a9bee-3c16-5587-b4a0-7ffdd9802c5d, identifier: FT42679
2026-03-30 10:54:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18fabc62-f67e-5437-b249-9a46d9953ee7 with identifier: JN27816
2026-03-30 10:54:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18fabc62-f67e-5437-b249-9a46d9953ee7 with identifier: JN27816
2026-03-30 10:54:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18fabc62-f67e-5437-b249-9a46d9953ee7 with identifier: JN27816 to the API
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-31T15:34:50Z',
 'fuel_type': 'petrol',
 'id': '18fabc62-f67e-5437-b249-9a46d9953ee7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN27816',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 125000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-20',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 Ghia X',
 'transmission': 'automatic',
 'trim': 'Ghia X',
 'year': 2006}
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN27816%27 HTTP/1.1" 200 None
2026-03-30 10:54:16 [auto1.de] INFO: Saving data for JN27816: {'auction_closing_time': 1774971290.0, 'created_time': 1774463817.843855, 'last_price_update_time': 1774868056.988309}
2026-03-30 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN27816') HTTP/1.1" 204 0
2026-03-30 10:54:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 310a9bee-3c16-5587-b4a0-7ffdd9802c5d with identifier: FT42679
2026-03-30 10:54:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 310a9bee-3c16-5587-b4a0-7ffdd9802c5d with identifier: FT42679
2026-03-30 10:54:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 310a9bee-3c16-5587-b4a0-7ffdd9802c5d with identifier: FT42679 to the API
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:58:35Z',
 'fuel_type': 'hybrid',
 'id': '310a9bee-3c16-5587-b4a0-7ffdd9802c5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT42679',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 65215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-20',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2023}
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT42679%27 HTTP/1.1" 200 None
2026-03-30 10:54:17 [auto1.de] INFO: Saving data for FT42679: {'auction_closing_time': 1774972715.0, 'created_time': 1774463908.778661, 'last_price_update_time': 1774868057.353299}
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT42679') HTTP/1.1" 204 0
2026-03-30 10:54:17 [auto1.de] INFO: Found listing with ID: BL66823
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL66823%27 HTTP/1.1" 200 None
2026-03-30 10:54:17 [auto1.de] INFO: Scrape type for BL66823: 2
2026-03-30 10:54:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 097b0810-5528-57d9-85b9-26262a9bb179 with identifier: BL66823
2026-03-30 10:54:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 097b0810-5528-57d9-85b9-26262a9bb179 with scrape type 2
2026-03-30 10:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 097b0810-5528-57d9-85b9-26262a9bb179 with scrape type 2
2026-03-30 10:54:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 097b0810-5528-57d9-85b9-26262a9bb179, identifier: BL66823
2026-03-30 10:54:17 [auto1.de] INFO: Found listing with ID: GP04405
2026-03-30 10:54:17 [auto1.de] INFO: Found listing with ID: AJ12624
2026-03-30 10:54:17 [auto1.de] INFO: Found listing with ID: ER70065
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER70065%27 HTTP/1.1" 200 None
2026-03-30 10:54:17 [auto1.de] INFO: Scrape type for ER70065: 2
2026-03-30 10:54:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48419f42-c455-53cd-b194-95d5b471f6e1 with identifier: ER70065
2026-03-30 10:54:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48419f42-c455-53cd-b194-95d5b471f6e1 with scrape type 2
2026-03-30 10:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48419f42-c455-53cd-b194-95d5b471f6e1 with scrape type 2
2026-03-30 10:54:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48419f42-c455-53cd-b194-95d5b471f6e1, identifier: ER70065
2026-03-30 10:54:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 097b0810-5528-57d9-85b9-26262a9bb179 with identifier: BL66823
2026-03-30 10:54:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 097b0810-5528-57d9-85b9-26262a9bb179 with identifier: BL66823
2026-03-30 10:54:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 097b0810-5528-57d9-85b9-26262a9bb179 with identifier: BL66823 to the API
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:06:45Z',
 'fuel_type': 'diesel',
 'id': '097b0810-5528-57d9-85b9-26262a9bb179',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL66823',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 127909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-06',
 'seller_name': None,
 'title': 'BMW 5er 530d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL66823%27 HTTP/1.1" 200 None
2026-03-30 10:54:17 [auto1.de] INFO: Saving data for BL66823: {'auction_closing_time': 1774969605.0, 'created_time': 1774377355.566275, 'last_price_update_time': 1774868057.948094}
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL66823') HTTP/1.1" 204 0
2026-03-30 10:54:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48419f42-c455-53cd-b194-95d5b471f6e1 with identifier: ER70065
2026-03-30 10:54:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48419f42-c455-53cd-b194-95d5b471f6e1 with identifier: ER70065
2026-03-30 10:54:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48419f42-c455-53cd-b194-95d5b471f6e1 with identifier: ER70065 to the API
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:14:46Z',
 'fuel_type': 'petrol',
 'id': '48419f42-c455-53cd-b194-95d5b471f6e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER70065',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 140856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER70065%27 HTTP/1.1" 200 None
2026-03-30 10:54:18 [auto1.de] INFO: Saving data for ER70065: {'auction_closing_time': 1774970086.0, 'created_time': 1774349896.126725, 'last_price_update_time': 1774868058.377188}
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER70065') HTTP/1.1" 204 0
2026-03-30 10:54:18 [auto1.de] INFO: Found listing with ID: UG30169
2026-03-30 10:54:18 [auto1.de] INFO: Found listing with ID: JD22287
2026-03-30 10:54:18 [auto1.de] INFO: Found listing with ID: YZ92189
2026-03-30 10:54:18 [auto1.de] INFO: Found listing with ID: RA53800
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA53800%27 HTTP/1.1" 200 None
2026-03-30 10:54:18 [auto1.de] INFO: Scrape type for RA53800: 2
2026-03-30 10:54:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90eb6e4e-8158-5f12-a40d-2899f54f0db0 with identifier: RA53800
2026-03-30 10:54:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90eb6e4e-8158-5f12-a40d-2899f54f0db0 with scrape type 2
2026-03-30 10:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90eb6e4e-8158-5f12-a40d-2899f54f0db0 with scrape type 2
2026-03-30 10:54:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90eb6e4e-8158-5f12-a40d-2899f54f0db0, identifier: RA53800
2026-03-30 10:54:18 [auto1.de] INFO: Found listing with ID: NF60730
2026-03-30 10:54:18 [auto1.de] INFO: Found listing with ID: DU13995
2026-03-30 10:54:18 [auto1.de] INFO: Found listing with ID: DK56258
2026-03-30 10:54:18 [auto1.de] INFO: Found listing with ID: WL25764
2026-03-30 10:54:18 [auto1.de] INFO: Found listing with ID: KH60913
2026-03-30 10:54:18 [auto1.de] INFO: Found listing with ID: WY46685
2026-03-30 10:54:18 [auto1.de] INFO: Found listing with ID: MX60968
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX60968%27 HTTP/1.1" 200 None
2026-03-30 10:54:18 [auto1.de] INFO: Scrape type for MX60968: 2
2026-03-30 10:54:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69934e2c-c7da-559e-849a-8188972f80a9 with identifier: MX60968
2026-03-30 10:54:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69934e2c-c7da-559e-849a-8188972f80a9 with scrape type 2
2026-03-30 10:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69934e2c-c7da-559e-849a-8188972f80a9 with scrape type 2
2026-03-30 10:54:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69934e2c-c7da-559e-849a-8188972f80a9, identifier: MX60968
2026-03-30 10:54:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90eb6e4e-8158-5f12-a40d-2899f54f0db0 with identifier: RA53800
2026-03-30 10:54:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90eb6e4e-8158-5f12-a40d-2899f54f0db0 with identifier: RA53800
2026-03-30 10:54:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90eb6e4e-8158-5f12-a40d-2899f54f0db0 with identifier: RA53800 to the API
2026-03-30 10:54:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:45:14Z',
 'fuel_type': 'petrol',
 'id': '90eb6e4e-8158-5f12-a40d-2899f54f0db0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA53800',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 169990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-11',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 1.4 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA53800%27 HTTP/1.1" 200 None
2026-03-30 10:54:19 [auto1.de] INFO: Saving data for RA53800: {'auction_closing_time': 1774971914.0, 'created_time': 1773301575.641007, 'last_price_update_time': 1774868059.680815}
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA53800') HTTP/1.1" 204 0
2026-03-30 10:54:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69934e2c-c7da-559e-849a-8188972f80a9 with identifier: MX60968
2026-03-30 10:54:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69934e2c-c7da-559e-849a-8188972f80a9 with identifier: MX60968
2026-03-30 10:54:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69934e2c-c7da-559e-849a-8188972f80a9 with identifier: MX60968 to the API
2026-03-30 10:54:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 207,
 'expiration_date': '2026-03-31T15:19:41Z',
 'fuel_type': 'petrol',
 'id': '69934e2c-c7da-559e-849a-8188972f80a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX60968',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 128616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-11',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2022}
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX60968%27 HTTP/1.1" 200 None
2026-03-30 10:54:20 [auto1.de] INFO: Saving data for MX60968: {'auction_closing_time': 1774970381.0, 'created_time': 1774381305.92109, 'last_price_update_time': 1774868060.11686}
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX60968') HTTP/1.1" 204 0
2026-03-30 10:54:20 [auto1.de] INFO: Found listing with ID: AB21758
2026-03-30 10:54:20 [auto1.de] INFO: Found listing with ID: BS08057
2026-03-30 10:54:20 [auto1.de] INFO: Found listing with ID: HF61436
2026-03-30 10:54:20 [auto1.de] INFO: Found listing with ID: JE92990
2026-03-30 10:54:20 [auto1.de] INFO: Found listing with ID: ZM02354
2026-03-30 10:54:20 [auto1.de] INFO: Found listing with ID: PK29892
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK29892%27 HTTP/1.1" 200 None
2026-03-30 10:54:20 [auto1.de] INFO: Scrape type for PK29892: 2
2026-03-30 10:54:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf4d598e-b8e8-5799-a627-c9d3dfcc7107 with identifier: PK29892
2026-03-30 10:54:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf4d598e-b8e8-5799-a627-c9d3dfcc7107 with scrape type 2
2026-03-30 10:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf4d598e-b8e8-5799-a627-c9d3dfcc7107 with scrape type 2
2026-03-30 10:54:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf4d598e-b8e8-5799-a627-c9d3dfcc7107, identifier: PK29892
2026-03-30 10:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF89334/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:20 [auto1.de] INFO: Found listing with ID: FW32642
2026-03-30 10:54:20 [auto1.de] INFO: Found listing with ID: GG45079
2026-03-30 10:54:20 [auto1.de] INFO: Found listing with ID: AE27507
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE27507%27 HTTP/1.1" 200 None
2026-03-30 10:54:20 [auto1.de] INFO: Scrape type for AE27507: 2
2026-03-30 10:54:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 096a1568-8342-5916-9b88-ff53f83eddf2 with identifier: AE27507
2026-03-30 10:54:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 096a1568-8342-5916-9b88-ff53f83eddf2 with scrape type 2
2026-03-30 10:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 096a1568-8342-5916-9b88-ff53f83eddf2 with scrape type 2
2026-03-30 10:54:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 096a1568-8342-5916-9b88-ff53f83eddf2, identifier: AE27507
2026-03-30 10:54:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf4d598e-b8e8-5799-a627-c9d3dfcc7107 with identifier: PK29892
2026-03-30 10:54:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf4d598e-b8e8-5799-a627-c9d3dfcc7107 with identifier: PK29892
2026-03-30 10:54:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf4d598e-b8e8-5799-a627-c9d3dfcc7107 with identifier: PK29892 to the API
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:07:32Z',
 'fuel_type': 'diesel',
 'id': 'cf4d598e-b8e8-5799-a627-c9d3dfcc7107',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK29892',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 150348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-21',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK29892%27 HTTP/1.1" 200 None
2026-03-30 10:54:20 [auto1.de] INFO: Saving data for PK29892: {'auction_closing_time': 1774969652.0, 'created_time': 1774294365.133121, 'last_price_update_time': 1774868060.705323}
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK29892') HTTP/1.1" 204 0
2026-03-30 10:54:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 096a1568-8342-5916-9b88-ff53f83eddf2 with identifier: AE27507
2026-03-30 10:54:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 096a1568-8342-5916-9b88-ff53f83eddf2 with identifier: AE27507
2026-03-30 10:54:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 096a1568-8342-5916-9b88-ff53f83eddf2 with identifier: AE27507 to the API
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:10:57Z',
 'fuel_type': 'petrol',
 'id': '096a1568-8342-5916-9b88-ff53f83eddf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE27507',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 107402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-18',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2017}
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE27507%27 HTTP/1.1" 200 None
2026-03-30 10:54:21 [auto1.de] INFO: Saving data for AE27507: {'auction_closing_time': 1774969857.0, 'created_time': 1773380427.884638, 'last_price_update_time': 1774868061.068396}
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE27507') HTTP/1.1" 204 0
2026-03-30 10:54:21 [auto1.de] INFO: Found listing with ID: WL81842
2026-03-30 10:54:21 [auto1.de] INFO: Found listing with ID: VH44850
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH44850%27 HTTP/1.1" 200 None
2026-03-30 10:54:21 [auto1.de] INFO: Scrape type for VH44850: 2
2026-03-30 10:54:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdd320a4-7776-5234-bdf8-43c9f9dce6d4 with identifier: VH44850
2026-03-30 10:54:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdd320a4-7776-5234-bdf8-43c9f9dce6d4 with scrape type 2
2026-03-30 10:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdd320a4-7776-5234-bdf8-43c9f9dce6d4 with scrape type 2
2026-03-30 10:54:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fdd320a4-7776-5234-bdf8-43c9f9dce6d4, identifier: VH44850
2026-03-30 10:54:21 [auto1.de] INFO: Found listing with ID: UM36066
2026-03-30 10:54:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fdd320a4-7776-5234-bdf8-43c9f9dce6d4 with identifier: VH44850
2026-03-30 10:54:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fdd320a4-7776-5234-bdf8-43c9f9dce6d4 with identifier: VH44850
2026-03-30 10:54:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fdd320a4-7776-5234-bdf8-43c9f9dce6d4 with identifier: VH44850 to the API
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:10:47Z',
 'fuel_type': 'diesel',
 'id': 'fdd320a4-7776-5234-bdf8-43c9f9dce6d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH44850',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 90613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-26',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L2 Tourneo Titanium X',
 'transmission': 'automatic',
 'trim': '320 L2 Tourneo Titanium X',
 'year': 2020}
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH44850%27 HTTP/1.1" 200 None
2026-03-30 10:54:21 [auto1.de] INFO: Saving data for VH44850: {'auction_closing_time': 1774969847.0, 'created_time': 1773383249.618204, 'last_price_update_time': 1774868061.541124}
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH44850') HTTP/1.1" 204 0
2026-03-30 10:54:21 [auto1.de] INFO: Found listing with ID: PP17491
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP17491%27 HTTP/1.1" 200 None
2026-03-30 10:54:21 [auto1.de] INFO: Scrape type for PP17491: 2
2026-03-30 10:54:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f66ab99-b7d8-5d20-98fe-da101f6e5044 with identifier: PP17491
2026-03-30 10:54:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f66ab99-b7d8-5d20-98fe-da101f6e5044 with scrape type 2
2026-03-30 10:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f66ab99-b7d8-5d20-98fe-da101f6e5044 with scrape type 2
2026-03-30 10:54:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f66ab99-b7d8-5d20-98fe-da101f6e5044, identifier: PP17491
2026-03-30 10:54:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f66ab99-b7d8-5d20-98fe-da101f6e5044 with identifier: PP17491
2026-03-30 10:54:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f66ab99-b7d8-5d20-98fe-da101f6e5044 with identifier: PP17491
2026-03-30 10:54:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f66ab99-b7d8-5d20-98fe-da101f6e5044 with identifier: PP17491 to the API
2026-03-30 10:54:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:23:50Z',
 'fuel_type': 'diesel',
 'id': '9f66ab99-b7d8-5d20-98fe-da101f6e5044',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP17491',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 259644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-01',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Style BlueMotion',
 'transmission': 'manual',
 'trim': 'Style BlueMotion',
 'year': 2012}
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP17491%27 HTTP/1.1" 200 None
2026-03-30 10:54:22 [auto1.de] INFO: Saving data for PP17491: {'auction_closing_time': 1774970630.0, 'created_time': 1774293128.76518, 'last_price_update_time': 1774868062.198393}
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP17491') HTTP/1.1" 204 0
2026-03-30 10:54:22 [auto1.de] INFO: Found listing with ID: BF84298
2026-03-30 10:54:22 [auto1.de] INFO: Found listing with ID: DG38505
2026-03-30 10:54:22 [auto1.de] INFO: Found listing with ID: HD75435
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD75435%27 HTTP/1.1" 200 None
2026-03-30 10:54:22 [auto1.de] INFO: Scrape type for HD75435: 2
2026-03-30 10:54:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fee4f4c3-8831-56ac-bde4-656ff32d63ac with identifier: HD75435
2026-03-30 10:54:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fee4f4c3-8831-56ac-bde4-656ff32d63ac with scrape type 2
2026-03-30 10:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fee4f4c3-8831-56ac-bde4-656ff32d63ac with scrape type 2
2026-03-30 10:54:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fee4f4c3-8831-56ac-bde4-656ff32d63ac, identifier: HD75435
2026-03-30 10:54:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fee4f4c3-8831-56ac-bde4-656ff32d63ac with identifier: HD75435
2026-03-30 10:54:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fee4f4c3-8831-56ac-bde4-656ff32d63ac with identifier: HD75435
2026-03-30 10:54:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fee4f4c3-8831-56ac-bde4-656ff32d63ac with identifier: HD75435 to the API
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:31:21Z',
 'fuel_type': 'petrol',
 'id': 'fee4f4c3-8831-56ac-bde4-656ff32d63ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD75435',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 96832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-27',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 N-Tec',
 'transmission': 'manual',
 'trim': 'N-Tec',
 'year': 2016}
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD75435%27 HTTP/1.1" 200 None
2026-03-30 10:54:22 [auto1.de] INFO: Saving data for HD75435: {'auction_closing_time': 1774971081.0, 'created_time': 1774467961.813225, 'last_price_update_time': 1774868062.726451}
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD75435') HTTP/1.1" 204 0
2026-03-30 10:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:22 [auto1.de] INFO: Found listing with ID: RW72092
2026-03-30 10:54:22 [auto1.de] INFO: Found listing with ID: LC41774
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC41774%27 HTTP/1.1" 200 None
2026-03-30 10:54:22 [auto1.de] INFO: Scrape type for LC41774: 2
2026-03-30 10:54:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bdb9c82-32e2-5d81-a02d-85584c10fbb4 with identifier: LC41774
2026-03-30 10:54:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bdb9c82-32e2-5d81-a02d-85584c10fbb4 with scrape type 2
2026-03-30 10:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bdb9c82-32e2-5d81-a02d-85584c10fbb4 with scrape type 2
2026-03-30 10:54:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bdb9c82-32e2-5d81-a02d-85584c10fbb4, identifier: LC41774
2026-03-30 10:54:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bdb9c82-32e2-5d81-a02d-85584c10fbb4 with identifier: LC41774
2026-03-30 10:54:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bdb9c82-32e2-5d81-a02d-85584c10fbb4 with identifier: LC41774
2026-03-30 10:54:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bdb9c82-32e2-5d81-a02d-85584c10fbb4 with identifier: LC41774 to the API
2026-03-30 10:54:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:51:17Z',
 'fuel_type': 'petrol',
 'id': '5bdb9c82-32e2-5d81-a02d-85584c10fbb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC41774',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 88136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-15',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2015}
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC41774%27 HTTP/1.1" 200 None
2026-03-30 10:54:23 [auto1.de] INFO: Saving data for LC41774: {'auction_closing_time': 1774972277.0, 'created_time': 1774380562.48999, 'last_price_update_time': 1774868063.2076}
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC41774') HTTP/1.1" 204 0
2026-03-30 10:54:23 [auto1.de] INFO: Found listing with ID: VP91780
2026-03-30 10:54:23 [auto1.de] INFO: Found listing with ID: XK59952
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK59952%27 HTTP/1.1" 200 None
2026-03-30 10:54:23 [auto1.de] INFO: Scrape type for XK59952: 1
2026-03-30 10:54:23 [auto1.de] INFO: Found listing with ID: RT32909
2026-03-30 10:54:23 [auto1.de] INFO: Found listing with ID: FX85164
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX85164%27 HTTP/1.1" 200 None
2026-03-30 10:54:23 [auto1.de] INFO: Scrape type for FX85164: 2
2026-03-30 10:54:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d353861-1b6e-5b62-bc4e-5a7358f4b3a9 with identifier: FX85164
2026-03-30 10:54:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d353861-1b6e-5b62-bc4e-5a7358f4b3a9 with scrape type 2
2026-03-30 10:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d353861-1b6e-5b62-bc4e-5a7358f4b3a9 with scrape type 2
2026-03-30 10:54:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d353861-1b6e-5b62-bc4e-5a7358f4b3a9, identifier: FX85164
2026-03-30 10:54:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d353861-1b6e-5b62-bc4e-5a7358f4b3a9 with identifier: FX85164
2026-03-30 10:54:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d353861-1b6e-5b62-bc4e-5a7358f4b3a9 with identifier: FX85164
2026-03-30 10:54:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d353861-1b6e-5b62-bc4e-5a7358f4b3a9 with identifier: FX85164 to the API
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:48:31Z',
 'fuel_type': 'petrol',
 'id': '6d353861-1b6e-5b62-bc4e-5a7358f4b3a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX85164',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 193742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-31',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2007}
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX85164%27 HTTP/1.1" 200 None
2026-03-30 10:54:23 [auto1.de] INFO: Saving data for FX85164: {'auction_closing_time': 1774972111.0, 'created_time': 1773302083.060461, 'last_price_update_time': 1774868063.718226}
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX85164') HTTP/1.1" 204 0
2026-03-30 10:54:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:23 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 9523 | hits on page: 40
2026-03-30 10:54:23 [auto1.de] INFO: Found listing with ID: XU91066
2026-03-30 10:54:23 [auto1.de] INFO: Found listing with ID: HX17640
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX17640%27 HTTP/1.1" 200 None
2026-03-30 10:54:23 [auto1.de] INFO: Scrape type for HX17640: 2
2026-03-30 10:54:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b94db576-3c69-50eb-ab03-b5e308ef8ec0 with identifier: HX17640
2026-03-30 10:54:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b94db576-3c69-50eb-ab03-b5e308ef8ec0 with scrape type 2
2026-03-30 10:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b94db576-3c69-50eb-ab03-b5e308ef8ec0 with scrape type 2
2026-03-30 10:54:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b94db576-3c69-50eb-ab03-b5e308ef8ec0, identifier: HX17640
2026-03-30 10:54:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b94db576-3c69-50eb-ab03-b5e308ef8ec0 with identifier: HX17640
2026-03-30 10:54:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b94db576-3c69-50eb-ab03-b5e308ef8ec0 with identifier: HX17640
2026-03-30 10:54:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b94db576-3c69-50eb-ab03-b5e308ef8ec0 with identifier: HX17640 to the API
2026-03-30 10:54:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:04:31Z',
 'fuel_type': 'diesel',
 'id': 'b94db576-3c69-50eb-ab03-b5e308ef8ec0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX17640',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 143839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-13',
 'seller_name': None,
 'title': 'Opel Mokka X 1.6 CDTI DPF Edition Start/Stop 4x4',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop 4x4',
 'year': 2017}
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX17640%27 HTTP/1.1" 200 None
2026-03-30 10:54:24 [auto1.de] INFO: Saving data for HX17640: {'auction_closing_time': 1774969471.0, 'created_time': 1773307109.785114, 'last_price_update_time': 1774868064.217106}
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX17640') HTTP/1.1" 204 0
2026-03-30 10:54:24 [auto1.de] INFO: Found listing with ID: CS10063
2026-03-30 10:54:24 [auto1.de] INFO: Found listing with ID: JL42140
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL42140%27 HTTP/1.1" 200 None
2026-03-30 10:54:24 [auto1.de] INFO: Scrape type for JL42140: 2
2026-03-30 10:54:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41d9b824-bd4f-5a31-b159-556642958ad8 with identifier: JL42140
2026-03-30 10:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41d9b824-bd4f-5a31-b159-556642958ad8 with scrape type 2
2026-03-30 10:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41d9b824-bd4f-5a31-b159-556642958ad8 with scrape type 2
2026-03-30 10:54:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41d9b824-bd4f-5a31-b159-556642958ad8, identifier: JL42140
2026-03-30 10:54:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:24 [auto1.de] INFO: Found listing with ID: FB64910
2026-03-30 10:54:24 [auto1.de] INFO: Found listing with ID: WR44415
2026-03-30 10:54:24 [auto1.de] INFO: Found listing with ID: MT15247
2026-03-30 10:54:24 [auto1.de] INFO: Found listing with ID: BL94167
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL94167%27 HTTP/1.1" 200 None
2026-03-30 10:54:24 [auto1.de] INFO: Scrape type for BL94167: 1
2026-03-30 10:54:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41d9b824-bd4f-5a31-b159-556642958ad8 with identifier: JL42140
2026-03-30 10:54:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41d9b824-bd4f-5a31-b159-556642958ad8 with identifier: JL42140
2026-03-30 10:54:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41d9b824-bd4f-5a31-b159-556642958ad8 with identifier: JL42140 to the API
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:20:23Z',
 'fuel_type': 'diesel',
 'id': '41d9b824-bd4f-5a31-b159-556642958ad8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL42140',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 195198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-06',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2022}
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL42140%27 HTTP/1.1" 200 None
2026-03-30 10:54:24 [auto1.de] INFO: Saving data for JL42140: {'auction_closing_time': 1774970423.0, 'created_time': 1773658944.573011, 'last_price_update_time': 1774868064.786175}
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL42140') HTTP/1.1" 204 0
2026-03-30 10:54:24 [auto1.de] INFO: Found listing with ID: CU82641
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU82641%27 HTTP/1.1" 200 None
2026-03-30 10:54:24 [auto1.de] INFO: Scrape type for CU82641: 2
2026-03-30 10:54:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ec6ee4a-5e49-564a-b250-1bda09bd7afe with identifier: CU82641
2026-03-30 10:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ec6ee4a-5e49-564a-b250-1bda09bd7afe with scrape type 2
2026-03-30 10:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ec6ee4a-5e49-564a-b250-1bda09bd7afe with scrape type 2
2026-03-30 10:54:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ec6ee4a-5e49-564a-b250-1bda09bd7afe, identifier: CU82641
2026-03-30 10:54:24 [auto1.de] INFO: Found listing with ID: ES83380
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES83380%27 HTTP/1.1" 200 None
2026-03-30 10:54:24 [auto1.de] INFO: Scrape type for ES83380: 2
2026-03-30 10:54:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4a7d99f-60e0-5edf-b9aa-2cbb1114f290 with identifier: ES83380
2026-03-30 10:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4a7d99f-60e0-5edf-b9aa-2cbb1114f290 with scrape type 2
2026-03-30 10:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4a7d99f-60e0-5edf-b9aa-2cbb1114f290 with scrape type 2
2026-03-30 10:54:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4a7d99f-60e0-5edf-b9aa-2cbb1114f290, identifier: ES83380
2026-03-30 10:54:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ec6ee4a-5e49-564a-b250-1bda09bd7afe with identifier: CU82641
2026-03-30 10:54:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ec6ee4a-5e49-564a-b250-1bda09bd7afe with identifier: CU82641
2026-03-30 10:54:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ec6ee4a-5e49-564a-b250-1bda09bd7afe with identifier: CU82641 to the API
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:00:20Z',
 'fuel_type': 'petrol',
 'id': '9ec6ee4a-5e49-564a-b250-1bda09bd7afe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU82641',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 200418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-20',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Copa',
 'transmission': 'manual',
 'trim': 'Copa',
 'year': 2012}
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU82641%27 HTTP/1.1" 200 None
2026-03-30 10:54:25 [auto1.de] INFO: Saving data for CU82641: {'auction_closing_time': 1774969220.0, 'created_time': 1773307897.465134, 'last_price_update_time': 1774868065.390035}
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU82641') HTTP/1.1" 204 0
2026-03-30 10:54:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4a7d99f-60e0-5edf-b9aa-2cbb1114f290 with identifier: ES83380
2026-03-30 10:54:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4a7d99f-60e0-5edf-b9aa-2cbb1114f290 with identifier: ES83380
2026-03-30 10:54:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4a7d99f-60e0-5edf-b9aa-2cbb1114f290 with identifier: ES83380 to the API
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:37:56Z',
 'fuel_type': 'petrol',
 'id': 'c4a7d99f-60e0-5edf-b9aa-2cbb1114f290',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES83380',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 61758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-07',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Dream Team 2WD',
 'transmission': 'manual',
 'trim': 'Dream Team 2WD',
 'year': 2019}
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES83380%27 HTTP/1.1" 200 None
2026-03-30 10:54:25 [auto1.de] INFO: Saving data for ES83380: {'auction_closing_time': 1774971476.0, 'created_time': 1773658278.926417, 'last_price_update_time': 1774868065.713218}
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES83380') HTTP/1.1" 204 0
2026-03-30 10:54:25 [auto1.de] INFO: Found listing with ID: ZW11631
2026-03-30 10:54:25 [auto1.de] INFO: Found listing with ID: VK17893
2026-03-30 10:54:25 [auto1.de] INFO: Found listing with ID: JY81419
2026-03-30 10:54:25 [auto1.de] INFO: Found listing with ID: HD49679
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD49679%27 HTTP/1.1" 200 None
2026-03-30 10:54:25 [auto1.de] INFO: Scrape type for HD49679: 2
2026-03-30 10:54:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a784d7aa-5555-5976-be09-8d899fa83e76 with identifier: HD49679
2026-03-30 10:54:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a784d7aa-5555-5976-be09-8d899fa83e76 with scrape type 2
2026-03-30 10:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a784d7aa-5555-5976-be09-8d899fa83e76 with scrape type 2
2026-03-30 10:54:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a784d7aa-5555-5976-be09-8d899fa83e76, identifier: HD49679
2026-03-30 10:54:25 [auto1.de] INFO: Found listing with ID: NZ33680
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ33680%27 HTTP/1.1" 200 None
2026-03-30 10:54:25 [auto1.de] INFO: Scrape type for NZ33680: 2
2026-03-30 10:54:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 715602ac-c3d0-598c-aa23-113b61546c76 with identifier: NZ33680
2026-03-30 10:54:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 715602ac-c3d0-598c-aa23-113b61546c76 with scrape type 2
2026-03-30 10:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 715602ac-c3d0-598c-aa23-113b61546c76 with scrape type 2
2026-03-30 10:54:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 715602ac-c3d0-598c-aa23-113b61546c76, identifier: NZ33680
2026-03-30 10:54:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a784d7aa-5555-5976-be09-8d899fa83e76 with identifier: HD49679
2026-03-30 10:54:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a784d7aa-5555-5976-be09-8d899fa83e76 with identifier: HD49679
2026-03-30 10:54:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a784d7aa-5555-5976-be09-8d899fa83e76 with identifier: HD49679 to the API
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:46:23Z',
 'fuel_type': 'petrol',
 'id': 'a784d7aa-5555-5976-be09-8d899fa83e76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD49679',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 106551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-05',
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 GLS',
 'transmission': 'manual',
 'trim': 'GLS',
 'year': 2010}
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD49679%27 HTTP/1.1" 200 None
2026-03-30 10:54:26 [auto1.de] INFO: Saving data for HD49679: {'auction_closing_time': 1774971983.0, 'created_time': 1773302643.041093, 'last_price_update_time': 1774868066.305813}
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD49679') HTTP/1.1" 204 0
2026-03-30 10:54:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 715602ac-c3d0-598c-aa23-113b61546c76 with identifier: NZ33680
2026-03-30 10:54:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 715602ac-c3d0-598c-aa23-113b61546c76 with identifier: NZ33680
2026-03-30 10:54:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 715602ac-c3d0-598c-aa23-113b61546c76 with identifier: NZ33680 to the API
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:19:24Z',
 'fuel_type': 'diesel',
 'id': '715602ac-c3d0-598c-aa23-113b61546c76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ33680',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 63591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ33680%27 HTTP/1.1" 200 None
2026-03-30 10:54:26 [auto1.de] INFO: Saving data for NZ33680: {'auction_closing_time': 1774970364.0, 'created_time': 1773383256.094397, 'last_price_update_time': 1774868066.781903}
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ33680') HTTP/1.1" 204 0
2026-03-30 10:54:26 [auto1.de] INFO: Found listing with ID: AP39511
2026-03-30 10:54:26 [auto1.de] INFO: Found listing with ID: HX44251
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX44251%27 HTTP/1.1" 200 None
2026-03-30 10:54:26 [auto1.de] INFO: Scrape type for HX44251: 2
2026-03-30 10:54:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc856b46-90f8-5b34-a3a8-eba67b3f673e with identifier: HX44251
2026-03-30 10:54:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc856b46-90f8-5b34-a3a8-eba67b3f673e with scrape type 2
2026-03-30 10:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc856b46-90f8-5b34-a3a8-eba67b3f673e with scrape type 2
2026-03-30 10:54:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc856b46-90f8-5b34-a3a8-eba67b3f673e, identifier: HX44251
2026-03-30 10:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC15708> (referer: https://www.auto1.com/v1/car-details-view/RC15708/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:26 [auto1.de] INFO: Found listing with ID: AP12446
2026-03-30 10:54:26 [auto1.de] INFO: Found listing with ID: DF48310
2026-03-30 10:54:26 [auto1.de] INFO: Found listing with ID: VP95925
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP95925%27 HTTP/1.1" 200 None
2026-03-30 10:54:26 [auto1.de] INFO: Scrape type for VP95925: 2
2026-03-30 10:54:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dff21bd7-9b96-5579-96d4-eee7d1bf2602 with identifier: VP95925
2026-03-30 10:54:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dff21bd7-9b96-5579-96d4-eee7d1bf2602 with scrape type 2
2026-03-30 10:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dff21bd7-9b96-5579-96d4-eee7d1bf2602 with scrape type 2
2026-03-30 10:54:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dff21bd7-9b96-5579-96d4-eee7d1bf2602, identifier: VP95925
2026-03-30 10:54:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc856b46-90f8-5b34-a3a8-eba67b3f673e with identifier: HX44251
2026-03-30 10:54:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc856b46-90f8-5b34-a3a8-eba67b3f673e with identifier: HX44251
2026-03-30 10:54:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc856b46-90f8-5b34-a3a8-eba67b3f673e with identifier: HX44251 to the API
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:22:01Z',
 'fuel_type': 'diesel',
 'id': 'bc856b46-90f8-5b34-a3a8-eba67b3f673e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX44251',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 149178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-06',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX44251%27 HTTP/1.1" 200 None
2026-03-30 10:54:27 [auto1.de] INFO: Saving data for HX44251: {'auction_closing_time': 1774970521.0, 'created_time': 1773302810.174368, 'last_price_update_time': 1774868067.495727}
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX44251') HTTP/1.1" 204 0
2026-03-30 10:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF89334> (referer: https://www.auto1.com/v1/car-details-view/FF89334/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dff21bd7-9b96-5579-96d4-eee7d1bf2602 with identifier: VP95925
2026-03-30 10:54:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dff21bd7-9b96-5579-96d4-eee7d1bf2602 with identifier: VP95925
2026-03-30 10:54:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dff21bd7-9b96-5579-96d4-eee7d1bf2602 with identifier: VP95925 to the API
2026-03-30 10:54:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:14:03Z',
 'fuel_type': 'petrol',
 'id': 'dff21bd7-9b96-5579-96d4-eee7d1bf2602',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP95925',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 112107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-28',
 'seller_name': None,
 'title': 'BMW 5er 520i Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2018}
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP95925%27 HTTP/1.1" 200 None
2026-03-30 10:54:28 [auto1.de] INFO: Saving data for VP95925: {'auction_closing_time': 1774970043.0, 'created_time': 1774465736.591442, 'last_price_update_time': 1774868068.391845}
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP95925') HTTP/1.1" 204 0
2026-03-30 10:54:28 [auto1.de] INFO: Found listing with ID: LK57603
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK57603%27 HTTP/1.1" 200 None
2026-03-30 10:54:28 [auto1.de] INFO: Scrape type for LK57603: 2
2026-03-30 10:54:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6e1f4fd-aab8-581e-9f30-3f98451219e9 with identifier: LK57603
2026-03-30 10:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6e1f4fd-aab8-581e-9f30-3f98451219e9 with scrape type 2
2026-03-30 10:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6e1f4fd-aab8-581e-9f30-3f98451219e9 with scrape type 2
2026-03-30 10:54:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6e1f4fd-aab8-581e-9f30-3f98451219e9, identifier: LK57603
2026-03-30 10:54:28 [auto1.de] INFO: Found listing with ID: JR94106
2026-03-30 10:54:28 [auto1.de] INFO: Found listing with ID: XN03179
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN03179%27 HTTP/1.1" 200 None
2026-03-30 10:54:28 [auto1.de] INFO: Scrape type for XN03179: 2
2026-03-30 10:54:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99946abb-5b82-50d5-bfdc-251fdf51e3bf with identifier: XN03179
2026-03-30 10:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99946abb-5b82-50d5-bfdc-251fdf51e3bf with scrape type 2
2026-03-30 10:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99946abb-5b82-50d5-bfdc-251fdf51e3bf with scrape type 2
2026-03-30 10:54:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99946abb-5b82-50d5-bfdc-251fdf51e3bf, identifier: XN03179
2026-03-30 10:54:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6e1f4fd-aab8-581e-9f30-3f98451219e9 with identifier: LK57603
2026-03-30 10:54:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6e1f4fd-aab8-581e-9f30-3f98451219e9 with identifier: LK57603
2026-03-30 10:54:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6e1f4fd-aab8-581e-9f30-3f98451219e9 with identifier: LK57603 to the API
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:42:12Z',
 'fuel_type': 'petrol',
 'id': 'c6e1f4fd-aab8-581e-9f30-3f98451219e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK57603',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 73581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-24',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Ultimate',
 'transmission': 'manual',
 'trim': 'Ultimate',
 'year': 2019}
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK57603%27 HTTP/1.1" 200 None
2026-03-30 10:54:29 [auto1.de] INFO: Saving data for LK57603: {'auction_closing_time': 1774971732.0, 'created_time': 1773301659.468263, 'last_price_update_time': 1774868069.011371}
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK57603') HTTP/1.1" 204 0
2026-03-30 10:54:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99946abb-5b82-50d5-bfdc-251fdf51e3bf with identifier: XN03179
2026-03-30 10:54:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99946abb-5b82-50d5-bfdc-251fdf51e3bf with identifier: XN03179
2026-03-30 10:54:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99946abb-5b82-50d5-bfdc-251fdf51e3bf with identifier: XN03179 to the API
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:54:59Z',
 'fuel_type': 'petrol',
 'id': '99946abb-5b82-50d5-bfdc-251fdf51e3bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN03179',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 58166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-06',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.5 TSI ACT Monte Carlo',
 'transmission': 'automatic',
 'trim': 'Monte Carlo',
 'year': 2023}
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN03179%27 HTTP/1.1" 200 None
2026-03-30 10:54:29 [auto1.de] INFO: Saving data for XN03179: {'auction_closing_time': 1774972499.0, 'created_time': 1774381208.203342, 'last_price_update_time': 1774868069.367041}
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN03179') HTTP/1.1" 204 0
2026-03-30 10:54:29 [auto1.de] INFO: Found listing with ID: VA46995
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA46995%27 HTTP/1.1" 200 None
2026-03-30 10:54:29 [auto1.de] INFO: Scrape type for VA46995: 2
2026-03-30 10:54:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41387384-f9c0-5ef9-ad69-5a45d82636d8 with identifier: VA46995
2026-03-30 10:54:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41387384-f9c0-5ef9-ad69-5a45d82636d8 with scrape type 2
2026-03-30 10:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41387384-f9c0-5ef9-ad69-5a45d82636d8 with scrape type 2
2026-03-30 10:54:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41387384-f9c0-5ef9-ad69-5a45d82636d8, identifier: VA46995
2026-03-30 10:54:29 [auto1.de] INFO: Found listing with ID: NA04350
2026-03-30 10:54:29 [auto1.de] INFO: Found listing with ID: CS10063
2026-03-30 10:54:29 [auto1.de] INFO: Found listing with ID: JL42140
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL42140%27 HTTP/1.1" 200 None
2026-03-30 10:54:29 [auto1.de] INFO: Scrape type for JL42140: 0
2026-03-30 10:54:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41387384-f9c0-5ef9-ad69-5a45d82636d8 with identifier: VA46995
2026-03-30 10:54:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41387384-f9c0-5ef9-ad69-5a45d82636d8 with identifier: VA46995
2026-03-30 10:54:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41387384-f9c0-5ef9-ad69-5a45d82636d8 with identifier: VA46995 to the API
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:52:59Z',
 'fuel_type': 'petrol',
 'id': '41387384-f9c0-5ef9-ad69-5a45d82636d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA46995',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 91735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-27',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA46995%27 HTTP/1.1" 200 None
2026-03-30 10:54:29 [auto1.de] INFO: Saving data for VA46995: {'auction_closing_time': 1774972379.0, 'created_time': 1774463924.150544, 'last_price_update_time': 1774868069.886707}
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA46995') HTTP/1.1" 204 0
2026-03-30 10:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK59952/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cb7b013-24aa-5944-b3e7-4624f57e31c9 with identifier: RC15708
2026-03-30 10:54:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cb7b013-24aa-5944-b3e7-4624f57e31c9 with scrape type 1
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4cb7b013-24aa-5944-b3e7-4624f57e31c9
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F79%252F03793ef0a57d17183b85639f476d15a5%252Fpa%252FRC15708_43401329188c9231184f56e2ec35a095.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_43401329188c9231184f56e2ec35a095.jpg not downloaded yet
2026-03-30 10:54:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38ff7a13-f21c-5ded-8176-c9facb1385cc with identifier: FF89334
2026-03-30 10:54:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38ff7a13-f21c-5ded-8176-c9facb1385cc with scrape type 1
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38ff7a13-f21c-5ded-8176-c9facb1385cc
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb827a17a4b7ebd6bdaa301f5a6690%252Fpa%252FFF89334_b148b4219dcf1408d75fc717558124a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_b148b4219dcf1408d75fc717558124a8.jpg already downloaded
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb827a17a4b7ebd6bdaa301f5a6690%252Fpa%252FFF89334_0ae3e8216280a44e83839977a3526212.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_0ae3e8216280a44e83839977a3526212.jpg already downloaded
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb827a17a4b7ebd6bdaa301f5a6690%252Fpa%252FFF89334_7d39a4ab2886a724dfa1ebc01129c876.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_7d39a4ab2886a724dfa1ebc01129c876.jpg already downloaded
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb827a17a4b7ebd6bdaa301f5a6690%252Fpa%252FFF89334_201f0b1ce13bf20a5024cba8ce2602ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_201f0b1ce13bf20a5024cba8ce2602ae.jpg already downloaded
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb827a17a4b7ebd6bdaa301f5a6690%252Fpa%252FFF89334_7f2f27b66e426239b13e80e6119fc4c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_7f2f27b66e426239b13e80e6119fc4c9.jpg already downloaded
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb827a17a4b7ebd6bdaa301f5a6690%252Fpa%252FFF89334_84f774f5b748e1ac4a4ff504bdd56dc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_84f774f5b748e1ac4a4ff504bdd56dc2.jpg already downloaded
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb827a17a4b7ebd6bdaa301f5a6690%252Fpa%252FFF89334_402c18cfa192754ab6be65f7886563c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_402c18cfa192754ab6be65f7886563c0.jpg already downloaded
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb827a17a4b7ebd6bdaa301f5a6690%252Fpa%252FFF89334_be9e7864c274899d485a177ec0032119.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_be9e7864c274899d485a177ec0032119.jpg already downloaded
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb827a17a4b7ebd6bdaa301f5a6690%252Fpa%252FFF89334_1208eecd5a70d946d3f9798d208e7a88.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_1208eecd5a70d946d3f9798d208e7a88.jpg already downloaded
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fbb%252Fcebb827a17a4b7ebd6bdaa301f5a6690%252Fpa%252FFF89334_7a3d90179b3db1baaa61c9cbbb0276dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_7a3d90179b3db1baaa61c9cbbb0276dc.jpg already downloaded
2026-03-30 10:54:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38ff7a13-f21c-5ded-8176-c9facb1385cc, identifier: FF89334
2026-03-30 10:54:30 [auto1.de] INFO: Found listing with ID: TH61541
2026-03-30 10:54:30 [auto1.de] INFO: Found listing with ID: RX33159
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX33159%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [auto1.de] INFO: Scrape type for RX33159: 2
2026-03-30 10:54:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d6cde48-96b0-5fe9-81d8-3b839334cae0 with identifier: RX33159
2026-03-30 10:54:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d6cde48-96b0-5fe9-81d8-3b839334cae0 with scrape type 2
2026-03-30 10:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d6cde48-96b0-5fe9-81d8-3b839334cae0 with scrape type 2
2026-03-30 10:54:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d6cde48-96b0-5fe9-81d8-3b839334cae0, identifier: RX33159
2026-03-30 10:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38ff7a13-f21c-5ded-8176-c9facb1385cc with identifier: FF89334
2026-03-30 10:54:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38ff7a13-f21c-5ded-8176-c9facb1385cc with identifier: FF89334
2026-03-30 10:54:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38ff7a13-f21c-5ded-8176-c9facb1385cc with identifier: FF89334 to the API
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FF89334>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:47:38Z',
 'fuel_type': 'diesel',
 'id': '38ff7a13-f21c-5ded-8176-c9facb1385cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF89334',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 301347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_b148b4219dcf1408d75fc717558124a8.jpg',
                'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_0ae3e8216280a44e83839977a3526212.jpg',
                'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_7d39a4ab2886a724dfa1ebc01129c876.jpg',
                'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_201f0b1ce13bf20a5024cba8ce2602ae.jpg',
                'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_7f2f27b66e426239b13e80e6119fc4c9.jpg',
                'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_84f774f5b748e1ac4a4ff504bdd56dc2.jpg',
                'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_402c18cfa192754ab6be65f7886563c0.jpg',
                'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_be9e7864c274899d485a177ec0032119.jpg',
                'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_1208eecd5a70d946d3f9798d208e7a88.jpg',
                'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_7a3d90179b3db1baaa61c9cbbb0276dc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ff7a13-f21c-5ded-8176-c9facb1385cc/38ff7a13-f21c-5ded-8176-c9facb1385cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3176932,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_b148b4219dcf1408d75fc717558124a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ff7a13-f21c-5ded-8176-c9facb1385cc/38ff7a13-f21c-5ded-8176-c9facb1385cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3369379,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_0ae3e8216280a44e83839977a3526212.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ff7a13-f21c-5ded-8176-c9facb1385cc/38ff7a13-f21c-5ded-8176-c9facb1385cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3002234,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_7d39a4ab2886a724dfa1ebc01129c876.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ff7a13-f21c-5ded-8176-c9facb1385cc/38ff7a13-f21c-5ded-8176-c9facb1385cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_201f0b1ce13bf20a5024cba8ce2602ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ff7a13-f21c-5ded-8176-c9facb1385cc/38ff7a13-f21c-5ded-8176-c9facb1385cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3037351,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_7f2f27b66e426239b13e80e6119fc4c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ff7a13-f21c-5ded-8176-c9facb1385cc/38ff7a13-f21c-5ded-8176-c9facb1385cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_84f774f5b748e1ac4a4ff504bdd56dc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ff7a13-f21c-5ded-8176-c9facb1385cc/38ff7a13-f21c-5ded-8176-c9facb1385cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3018435,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_402c18cfa192754ab6be65f7886563c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ff7a13-f21c-5ded-8176-c9facb1385cc/38ff7a13-f21c-5ded-8176-c9facb1385cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3085797,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_be9e7864c274899d485a177ec0032119.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ff7a13-f21c-5ded-8176-c9facb1385cc/38ff7a13-f21c-5ded-8176-c9facb1385cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3084810,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_1208eecd5a70d946d3f9798d208e7a88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ff7a13-f21c-5ded-8176-c9facb1385cc/38ff7a13-f21c-5ded-8176-c9facb1385cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3201687,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/bb/cebb827a17a4b7ebd6bdaa301f5a6690/pa/FF89334_7a3d90179b3db1baaa61c9cbbb0276dc.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2014}
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF89334%27 HTTP/1.1" 200 None
2026-03-30 10:54:30 [auto1.de] INFO: Saving data for FF89334: {'created_time': 1774868070.751217, 'last_price_update_time': 1774868070.751228, 'auction_closing_time': 1774972058.0}
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF89334') HTTP/1.1" 204 0
2026-03-30 10:54:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d6cde48-96b0-5fe9-81d8-3b839334cae0 with identifier: RX33159
2026-03-30 10:54:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d6cde48-96b0-5fe9-81d8-3b839334cae0 with identifier: RX33159
2026-03-30 10:54:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d6cde48-96b0-5fe9-81d8-3b839334cae0 with identifier: RX33159 to the API
2026-03-30 10:54:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:21:31Z',
 'fuel_type': 'petrol',
 'id': '3d6cde48-96b0-5fe9-81d8-3b839334cae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX33159',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 68104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-30',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2017}
2026-03-30 10:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX33159%27 HTTP/1.1" 200 None
2026-03-30 10:54:31 [auto1.de] INFO: Saving data for RX33159: {'auction_closing_time': 1774970491.0, 'created_time': 1773380706.984221, 'last_price_update_time': 1774868071.933336}
2026-03-30 10:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX33159') HTTP/1.1" 204 0
2026-03-30 10:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F79%252F03793ef0a57d17183b85639f476d15a5%252Fpa%252FRC15708_e25489ff84bae1bd5ac7bd797c21fe74.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_e25489ff84bae1bd5ac7bd797c21fe74.jpg not downloaded yet
2026-03-30 10:54:31 [auto1.de] INFO: Found listing with ID: UA01329
2026-03-30 10:54:31 [auto1.de] INFO: Found listing with ID: SX00955
2026-03-30 10:54:31 [auto1.de] INFO: Found listing with ID: NS76929
2026-03-30 10:54:31 [auto1.de] INFO: Found listing with ID: FZ56361
2026-03-30 10:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ56361%27 HTTP/1.1" 200 None
2026-03-30 10:54:31 [auto1.de] INFO: Scrape type for FZ56361: 2
2026-03-30 10:54:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a6c7712-2ab5-5f4d-ac00-32d3fa175e7e with identifier: FZ56361
2026-03-30 10:54:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a6c7712-2ab5-5f4d-ac00-32d3fa175e7e with scrape type 2
2026-03-30 10:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a6c7712-2ab5-5f4d-ac00-32d3fa175e7e with scrape type 2
2026-03-30 10:54:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a6c7712-2ab5-5f4d-ac00-32d3fa175e7e, identifier: FZ56361
2026-03-30 10:54:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a6c7712-2ab5-5f4d-ac00-32d3fa175e7e with identifier: FZ56361
2026-03-30 10:54:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a6c7712-2ab5-5f4d-ac00-32d3fa175e7e with identifier: FZ56361
2026-03-30 10:54:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a6c7712-2ab5-5f4d-ac00-32d3fa175e7e with identifier: FZ56361 to the API
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 374,
 'expiration_date': '2026-03-31T15:21:00Z',
 'fuel_type': 'petrol',
 'id': '9a6c7712-2ab5-5f4d-ac00-32d3fa175e7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ56361',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 35967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-15',
 'seller_name': None,
 'title': 'BMW 3er M340i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2019}
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ56361%27 HTTP/1.1" 200 None
2026-03-30 10:54:32 [auto1.de] INFO: Saving data for FZ56361: {'auction_closing_time': 1774970460.0, 'created_time': 1774379960.471438, 'last_price_update_time': 1774868072.41676}
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ56361') HTTP/1.1" 204 0
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F79%252F03793ef0a57d17183b85639f476d15a5%252Fpa%252FRC15708_a825b1657d993efae670bf801adbecfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_a825b1657d993efae670bf801adbecfc.jpg not downloaded yet
2026-03-30 10:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL94167/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:32 [auto1.de] INFO: Found listing with ID: ET02524
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET02524%27 HTTP/1.1" 200 None
2026-03-30 10:54:32 [auto1.de] INFO: Scrape type for ET02524: 2
2026-03-30 10:54:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60dfd5f4-911d-52f1-a61a-cce2817693b6 with identifier: ET02524
2026-03-30 10:54:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60dfd5f4-911d-52f1-a61a-cce2817693b6 with scrape type 2
2026-03-30 10:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60dfd5f4-911d-52f1-a61a-cce2817693b6 with scrape type 2
2026-03-30 10:54:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60dfd5f4-911d-52f1-a61a-cce2817693b6, identifier: ET02524
2026-03-30 10:54:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:32 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 9523 | hits on page: 40
2026-03-30 10:54:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60dfd5f4-911d-52f1-a61a-cce2817693b6 with identifier: ET02524
2026-03-30 10:54:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60dfd5f4-911d-52f1-a61a-cce2817693b6 with identifier: ET02524
2026-03-30 10:54:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60dfd5f4-911d-52f1-a61a-cce2817693b6 with identifier: ET02524 to the API
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-31T15:40:00Z',
 'fuel_type': 'petrol',
 'id': '60dfd5f4-911d-52f1-a61a-cce2817693b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET02524',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 215846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-18',
 'seller_name': None,
 'title': 'BMW 2er 220i Gran Tourer Luxury Line',
 'transmission': 'manual',
 'trim': 'Luxury Line',
 'year': 2015}
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET02524%27 HTTP/1.1" 200 None
2026-03-30 10:54:32 [auto1.de] INFO: Saving data for ET02524: {'auction_closing_time': 1774971600.0, 'created_time': 1773945322.613693, 'last_price_update_time': 1774868072.957606}
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET02524') HTTP/1.1" 204 0
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F79%252F03793ef0a57d17183b85639f476d15a5%252Fpa%252FRC15708_faf5cebe22c95349ad7e205b7f562c0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_faf5cebe22c95349ad7e205b7f562c0c.jpg not downloaded yet
2026-03-30 10:54:32 [auto1.de] INFO: Found listing with ID: MU10500
2026-03-30 10:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU10500%27 HTTP/1.1" 200 None
2026-03-30 10:54:33 [auto1.de] INFO: Scrape type for MU10500: 2
2026-03-30 10:54:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5929f484-684c-5984-888c-451492a9bd55 with identifier: MU10500
2026-03-30 10:54:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5929f484-684c-5984-888c-451492a9bd55 with scrape type 2
2026-03-30 10:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5929f484-684c-5984-888c-451492a9bd55 with scrape type 2
2026-03-30 10:54:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5929f484-684c-5984-888c-451492a9bd55, identifier: MU10500
2026-03-30 10:54:33 [auto1.de] INFO: Found listing with ID: RU55030
2026-03-30 10:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU55030%27 HTTP/1.1" 200 None
2026-03-30 10:54:33 [auto1.de] INFO: Scrape type for RU55030: 2
2026-03-30 10:54:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ecaad7d-a740-573a-bfb2-f013b5f1594c with identifier: RU55030
2026-03-30 10:54:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ecaad7d-a740-573a-bfb2-f013b5f1594c with scrape type 2
2026-03-30 10:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ecaad7d-a740-573a-bfb2-f013b5f1594c with scrape type 2
2026-03-30 10:54:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ecaad7d-a740-573a-bfb2-f013b5f1594c, identifier: RU55030
2026-03-30 10:54:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_43401329188c9231184f56e2ec35a095.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5929f484-684c-5984-888c-451492a9bd55 with identifier: MU10500
2026-03-30 10:54:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5929f484-684c-5984-888c-451492a9bd55 with identifier: MU10500
2026-03-30 10:54:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5929f484-684c-5984-888c-451492a9bd55 with identifier: MU10500 to the API
2026-03-30 10:54:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:02:28Z',
 'fuel_type': 'diesel',
 'id': '5929f484-684c-5984-888c-451492a9bd55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU10500',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 231789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-15',
 'seller_name': None,
 'title': 'BMW 2er 218d Gran Tourer Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU10500%27 HTTP/1.1" 200 None
2026-03-30 10:54:34 [auto1.de] INFO: Saving data for MU10500: {'auction_closing_time': 1774969348.0, 'created_time': 1773307698.059691, 'last_price_update_time': 1774868074.09789}
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU10500') HTTP/1.1" 204 0
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F79%252F03793ef0a57d17183b85639f476d15a5%252Fpa%252FRC15708_79d109017a82765ef0e72c9f411eb425.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_79d109017a82765ef0e72c9f411eb425.jpg not downloaded yet
2026-03-30 10:54:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ecaad7d-a740-573a-bfb2-f013b5f1594c with identifier: RU55030
2026-03-30 10:54:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ecaad7d-a740-573a-bfb2-f013b5f1594c with identifier: RU55030
2026-03-30 10:54:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ecaad7d-a740-573a-bfb2-f013b5f1594c with identifier: RU55030 to the API
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-31T15:29:03Z',
 'fuel_type': 'diesel',
 'id': '8ecaad7d-a740-573a-bfb2-f013b5f1594c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU55030',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 158894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-24',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU55030%27 HTTP/1.1" 200 None
2026-03-30 10:54:34 [auto1.de] INFO: Saving data for RU55030: {'auction_closing_time': 1774970943.0, 'created_time': 1774638547.772428, 'last_price_update_time': 1774868074.456311}
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU55030') HTTP/1.1" 204 0
2026-03-30 10:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_e25489ff84bae1bd5ac7bd797c21fe74.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:34 [auto1.de] INFO: Found listing with ID: XZ07034
2026-03-30 10:54:34 [auto1.de] INFO: Found listing with ID: YE23414
2026-03-30 10:54:34 [auto1.de] INFO: Found listing with ID: PD05251
2026-03-30 10:54:34 [auto1.de] INFO: Found listing with ID: KG05257
2026-03-30 10:54:34 [auto1.de] INFO: Found listing with ID: WU35652
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU35652%27 HTTP/1.1" 200 None
2026-03-30 10:54:34 [auto1.de] INFO: Scrape type for WU35652: 2
2026-03-30 10:54:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe600779-383c-5006-92ea-3797eb0187ae with identifier: WU35652
2026-03-30 10:54:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe600779-383c-5006-92ea-3797eb0187ae with scrape type 2
2026-03-30 10:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe600779-383c-5006-92ea-3797eb0187ae with scrape type 2
2026-03-30 10:54:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe600779-383c-5006-92ea-3797eb0187ae, identifier: WU35652
2026-03-30 10:54:34 [auto1.de] INFO: Found listing with ID: NZ32797
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32797%27 HTTP/1.1" 200 None
2026-03-30 10:54:34 [auto1.de] INFO: Scrape type for NZ32797: 2
2026-03-30 10:54:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 437d689c-b968-5493-9f37-e0cf66491d48 with identifier: NZ32797
2026-03-30 10:54:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 437d689c-b968-5493-9f37-e0cf66491d48 with scrape type 2
2026-03-30 10:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 437d689c-b968-5493-9f37-e0cf66491d48 with scrape type 2
2026-03-30 10:54:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 437d689c-b968-5493-9f37-e0cf66491d48, identifier: NZ32797
2026-03-30 10:54:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe600779-383c-5006-92ea-3797eb0187ae with identifier: WU35652
2026-03-30 10:54:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe600779-383c-5006-92ea-3797eb0187ae with identifier: WU35652
2026-03-30 10:54:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe600779-383c-5006-92ea-3797eb0187ae with identifier: WU35652 to the API
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:46:39Z',
 'fuel_type': 'petrol',
 'id': 'fe600779-383c-5006-92ea-3797eb0187ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU35652',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 48179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport',
 'year': 2022}
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU35652%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [auto1.de] INFO: Saving data for WU35652: {'auction_closing_time': 1774971999.0, 'created_time': 1773689105.826394, 'last_price_update_time': 1774868075.03756}
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WU35652') HTTP/1.1" 204 0
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F79%252F03793ef0a57d17183b85639f476d15a5%252Fpa%252FRC15708_e8328064120721602c3b9fa652a0a761.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_e8328064120721602c3b9fa652a0a761.jpg not downloaded yet
2026-03-30 10:54:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 437d689c-b968-5493-9f37-e0cf66491d48 with identifier: NZ32797
2026-03-30 10:54:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 437d689c-b968-5493-9f37-e0cf66491d48 with identifier: NZ32797
2026-03-30 10:54:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 437d689c-b968-5493-9f37-e0cf66491d48 with identifier: NZ32797 to the API
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:36:00Z',
 'fuel_type': 'diesel',
 'id': '437d689c-b968-5493-9f37-e0cf66491d48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ32797',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 7217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-26',
 'seller_name': None,
 'title': 'BMW 4er 420d Gran Coupe Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2025}
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32797%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [auto1.de] INFO: Saving data for NZ32797: {'auction_closing_time': 1774971360.0, 'created_time': 1774377348.925927, 'last_price_update_time': 1774868075.48847}
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ32797') HTTP/1.1" 204 0
2026-03-30 10:54:35 [auto1.de] INFO: Found listing with ID: PT76912
2026-03-30 10:54:35 [auto1.de] INFO: Found listing with ID: XH73530
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH73530%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [auto1.de] INFO: Scrape type for XH73530: 2
2026-03-30 10:54:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30686089-613c-5963-b726-d5ff6f186ecf with identifier: XH73530
2026-03-30 10:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30686089-613c-5963-b726-d5ff6f186ecf with scrape type 2
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30686089-613c-5963-b726-d5ff6f186ecf with scrape type 2
2026-03-30 10:54:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30686089-613c-5963-b726-d5ff6f186ecf, identifier: XH73530
2026-03-30 10:54:35 [auto1.de] INFO: Found listing with ID: HB39069
2026-03-30 10:54:35 [auto1.de] INFO: Found listing with ID: GM14403
2026-03-30 10:54:35 [auto1.de] INFO: Found listing with ID: CJ93593
2026-03-30 10:54:35 [auto1.de] INFO: Found listing with ID: ZL92656
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL92656%27 HTTP/1.1" 200 None
2026-03-30 10:54:35 [auto1.de] INFO: Scrape type for ZL92656: 2
2026-03-30 10:54:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e59a1349-9bb7-5134-830e-5541f5311014 with identifier: ZL92656
2026-03-30 10:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e59a1349-9bb7-5134-830e-5541f5311014 with scrape type 2
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e59a1349-9bb7-5134-830e-5541f5311014 with scrape type 2
2026-03-30 10:54:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e59a1349-9bb7-5134-830e-5541f5311014, identifier: ZL92656
2026-03-30 10:54:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e66610>
2026-03-30 10:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb7b013-24aa-5944-b3e7-4624f57e31c9/4cb7b013-24aa-5944-b3e7-4624f57e31c9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F79%252F03793ef0a57d17183b85639f476d15a5%252Fpa%252FRC15708_43401329188c9231184f56e2ec35a095.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_43401329188c9231184f56e2ec35a095.jpg saved to cache
2026-03-30 10:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cb7b013-24aa-5944-b3e7-4624f57e31c9
2026-03-30 10:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_a825b1657d993efae670bf801adbecfc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30686089-613c-5963-b726-d5ff6f186ecf with identifier: XH73530
2026-03-30 10:54:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30686089-613c-5963-b726-d5ff6f186ecf with identifier: XH73530
2026-03-30 10:54:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30686089-613c-5963-b726-d5ff6f186ecf with identifier: XH73530 to the API
2026-03-30 10:54:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:08:19Z',
 'fuel_type': 'diesel',
 'id': '30686089-613c-5963-b726-d5ff6f186ecf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH73530',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 78676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-13',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Extrakabine 4x4 Limited',
 'transmission': 'automatic',
 'trim': 'Extrakabine 4x4 Limited',
 'year': 2020}
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH73530%27 HTTP/1.1" 200 None
2026-03-30 10:54:36 [auto1.de] INFO: Saving data for XH73530: {'auction_closing_time': 1774969699.0, 'created_time': 1774435666.977724, 'last_price_update_time': 1774868076.349345}
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH73530') HTTP/1.1" 204 0
2026-03-30 10:54:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e59a1349-9bb7-5134-830e-5541f5311014 with identifier: ZL92656
2026-03-30 10:54:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e59a1349-9bb7-5134-830e-5541f5311014 with identifier: ZL92656
2026-03-30 10:54:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e59a1349-9bb7-5134-830e-5541f5311014 with identifier: ZL92656 to the API
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:31:40Z',
 'fuel_type': 'diesel',
 'id': 'e59a1349-9bb7-5134-830e-5541f5311014',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL92656',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 195060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-19',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sound 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Sound 4Motion BlueMotion',
 'year': 2017}
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL92656%27 HTTP/1.1" 200 None
2026-03-30 10:54:36 [auto1.de] INFO: Saving data for ZL92656: {'auction_closing_time': 1774971100.0, 'created_time': 1774467657.825823, 'last_price_update_time': 1774868076.769661}
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL92656') HTTP/1.1" 204 0
2026-03-30 10:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_faf5cebe22c95349ad7e205b7f562c0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:36 [auto1.de] INFO: Found listing with ID: HZ35623
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35623%27 HTTP/1.1" 200 None
2026-03-30 10:54:36 [auto1.de] INFO: Scrape type for HZ35623: 2
2026-03-30 10:54:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15dfdad1-7456-5a47-9a53-230b61c7b438 with identifier: HZ35623
2026-03-30 10:54:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15dfdad1-7456-5a47-9a53-230b61c7b438 with scrape type 2
2026-03-30 10:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15dfdad1-7456-5a47-9a53-230b61c7b438 with scrape type 2
2026-03-30 10:54:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15dfdad1-7456-5a47-9a53-230b61c7b438, identifier: HZ35623
2026-03-30 10:54:36 [auto1.de] INFO: Found listing with ID: EZ66449
2026-03-30 10:54:36 [auto1.de] INFO: Found listing with ID: AK28209
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK28209%27 HTTP/1.1" 200 None
2026-03-30 10:54:36 [auto1.de] INFO: Scrape type for AK28209: 2
2026-03-30 10:54:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abdf3f16-9c67-5f19-a32d-431c7850b204 with identifier: AK28209
2026-03-30 10:54:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abdf3f16-9c67-5f19-a32d-431c7850b204 with scrape type 2
2026-03-30 10:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abdf3f16-9c67-5f19-a32d-431c7850b204 with scrape type 2
2026-03-30 10:54:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abdf3f16-9c67-5f19-a32d-431c7850b204, identifier: AK28209
2026-03-30 10:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c9ead0>
2026-03-30 10:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb7b013-24aa-5944-b3e7-4624f57e31c9/4cb7b013-24aa-5944-b3e7-4624f57e31c9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F79%252F03793ef0a57d17183b85639f476d15a5%252Fpa%252FRC15708_e25489ff84bae1bd5ac7bd797c21fe74.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_e25489ff84bae1bd5ac7bd797c21fe74.jpg saved to cache
2026-03-30 10:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cb7b013-24aa-5944-b3e7-4624f57e31c9
2026-03-30 10:54:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15dfdad1-7456-5a47-9a53-230b61c7b438 with identifier: HZ35623
2026-03-30 10:54:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15dfdad1-7456-5a47-9a53-230b61c7b438 with identifier: HZ35623
2026-03-30 10:54:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15dfdad1-7456-5a47-9a53-230b61c7b438 with identifier: HZ35623 to the API
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:46:06Z',
 'fuel_type': 'diesel',
 'id': '15dfdad1-7456-5a47-9a53-230b61c7b438',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ35623',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 115564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-16',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35623%27 HTTP/1.1" 200 None
2026-03-30 10:54:37 [auto1.de] INFO: Saving data for HZ35623: {'auction_closing_time': 1774971966.0, 'created_time': 1774435465.998918, 'last_price_update_time': 1774868077.494697}
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ35623') HTTP/1.1" 204 0
2026-03-30 10:54:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abdf3f16-9c67-5f19-a32d-431c7850b204 with identifier: AK28209
2026-03-30 10:54:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abdf3f16-9c67-5f19-a32d-431c7850b204 with identifier: AK28209
2026-03-30 10:54:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abdf3f16-9c67-5f19-a32d-431c7850b204 with identifier: AK28209 to the API
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:45:46Z',
 'fuel_type': 'diesel',
 'id': 'abdf3f16-9c67-5f19-a32d-431c7850b204',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK28209',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 323359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-26',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK28209%27 HTTP/1.1" 200 None
2026-03-30 10:54:37 [auto1.de] INFO: Saving data for AK28209: {'auction_closing_time': 1774971946.0, 'created_time': 1773302695.47462, 'last_price_update_time': 1774868077.932883}
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK28209') HTTP/1.1" 204 0
2026-03-30 10:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_79d109017a82765ef0e72c9f411eb425.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:38 [auto1.de] INFO: Found listing with ID: RG19344
2026-03-30 10:54:38 [auto1.de] INFO: Found listing with ID: RU06451
2026-03-30 10:54:38 [auto1.de] INFO: Found listing with ID: AJ11776
2026-03-30 10:54:38 [auto1.de] INFO: Found listing with ID: VX77411
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX77411%27 HTTP/1.1" 200 None
2026-03-30 10:54:38 [auto1.de] INFO: Scrape type for VX77411: 2
2026-03-30 10:54:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf0fcedf-c92d-5f67-8055-8dec1f9abb6f with identifier: VX77411
2026-03-30 10:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf0fcedf-c92d-5f67-8055-8dec1f9abb6f with scrape type 2
2026-03-30 10:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf0fcedf-c92d-5f67-8055-8dec1f9abb6f with scrape type 2
2026-03-30 10:54:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf0fcedf-c92d-5f67-8055-8dec1f9abb6f, identifier: VX77411
2026-03-30 10:54:38 [auto1.de] INFO: Found listing with ID: HX41929
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX41929%27 HTTP/1.1" 200 None
2026-03-30 10:54:38 [auto1.de] INFO: Scrape type for HX41929: 2
2026-03-30 10:54:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f38077b-d725-56f9-97a8-faff5ee53c05 with identifier: HX41929
2026-03-30 10:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f38077b-d725-56f9-97a8-faff5ee53c05 with scrape type 2
2026-03-30 10:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f38077b-d725-56f9-97a8-faff5ee53c05 with scrape type 2
2026-03-30 10:54:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f38077b-d725-56f9-97a8-faff5ee53c05, identifier: HX41929
2026-03-30 10:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e44110>
2026-03-30 10:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb7b013-24aa-5944-b3e7-4624f57e31c9/4cb7b013-24aa-5944-b3e7-4624f57e31c9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F79%252F03793ef0a57d17183b85639f476d15a5%252Fpa%252FRC15708_a825b1657d993efae670bf801adbecfc.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_a825b1657d993efae670bf801adbecfc.jpg saved to cache
2026-03-30 10:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cb7b013-24aa-5944-b3e7-4624f57e31c9
2026-03-30 10:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_e8328064120721602c3b9fa652a0a761.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:54:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf0fcedf-c92d-5f67-8055-8dec1f9abb6f with identifier: VX77411
2026-03-30 10:54:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf0fcedf-c92d-5f67-8055-8dec1f9abb6f with identifier: VX77411
2026-03-30 10:54:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf0fcedf-c92d-5f67-8055-8dec1f9abb6f with identifier: VX77411 to the API
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-31T15:10:45Z',
 'fuel_type': 'hybrid',
 'id': 'cf0fcedf-c92d-5f67-8055-8dec1f9abb6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX77411',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 66700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-15',
 'seller_name': None,
 'title': 'BMW 5er 530e xDrive Luxury Line',
 'transmission': 'automatic',
 'trim': 'xDrive Luxury Line',
 'year': 2020}
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX77411%27 HTTP/1.1" 200 None
2026-03-30 10:54:38 [auto1.de] INFO: Saving data for VX77411: {'auction_closing_time': 1774969845.0, 'created_time': 1773306354.167294, 'last_price_update_time': 1774868078.653655}
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX77411') HTTP/1.1" 204 0
2026-03-30 10:54:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f38077b-d725-56f9-97a8-faff5ee53c05 with identifier: HX41929
2026-03-30 10:54:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f38077b-d725-56f9-97a8-faff5ee53c05 with identifier: HX41929
2026-03-30 10:54:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f38077b-d725-56f9-97a8-faff5ee53c05 with identifier: HX41929 to the API
2026-03-30 10:54:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:17:52Z',
 'fuel_type': 'petrol',
 'id': '7f38077b-d725-56f9-97a8-faff5ee53c05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX41929',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 55373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-15',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 TGDI GT",
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX41929%27 HTTP/1.1" 200 None
2026-03-30 10:54:39 [auto1.de] INFO: Saving data for HX41929: {'auction_closing_time': 1774970272.0, 'created_time': 1773342943.106413, 'last_price_update_time': 1774868079.180832}
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX41929') HTTP/1.1" 204 0
2026-03-30 10:54:39 [auto1.de] INFO: Found listing with ID: KP51039
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP51039%27 HTTP/1.1" 200 None
2026-03-30 10:54:39 [auto1.de] INFO: Scrape type for KP51039: 2
2026-03-30 10:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6fdd48f-d985-506f-87ac-cf747c8c4594 with identifier: KP51039
2026-03-30 10:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6fdd48f-d985-506f-87ac-cf747c8c4594 with scrape type 2
2026-03-30 10:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6fdd48f-d985-506f-87ac-cf747c8c4594 with scrape type 2
2026-03-30 10:54:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6fdd48f-d985-506f-87ac-cf747c8c4594, identifier: KP51039
2026-03-30 10:54:39 [auto1.de] INFO: Found listing with ID: JS41418
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS41418%27 HTTP/1.1" 200 None
2026-03-30 10:54:39 [auto1.de] INFO: Scrape type for JS41418: 2
2026-03-30 10:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 934c316c-750b-55d2-b4c6-d87ab0af610e with identifier: JS41418
2026-03-30 10:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 934c316c-750b-55d2-b4c6-d87ab0af610e with scrape type 2
2026-03-30 10:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 934c316c-750b-55d2-b4c6-d87ab0af610e with scrape type 2
2026-03-30 10:54:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 934c316c-750b-55d2-b4c6-d87ab0af610e, identifier: JS41418
2026-03-30 10:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f97f10>
2026-03-30 10:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb7b013-24aa-5944-b3e7-4624f57e31c9/4cb7b013-24aa-5944-b3e7-4624f57e31c9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F79%252F03793ef0a57d17183b85639f476d15a5%252Fpa%252FRC15708_faf5cebe22c95349ad7e205b7f562c0c.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_faf5cebe22c95349ad7e205b7f562c0c.jpg saved to cache
2026-03-30 10:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cb7b013-24aa-5944-b3e7-4624f57e31c9
2026-03-30 10:54:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6fdd48f-d985-506f-87ac-cf747c8c4594 with identifier: KP51039
2026-03-30 10:54:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6fdd48f-d985-506f-87ac-cf747c8c4594 with identifier: KP51039
2026-03-30 10:54:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6fdd48f-d985-506f-87ac-cf747c8c4594 with identifier: KP51039 to the API
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:53:16Z',
 'fuel_type': 'diesel',
 'id': 'a6fdd48f-d985-506f-87ac-cf747c8c4594',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP51039',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 220824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-26',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D4 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2017}
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP51039%27 HTTP/1.1" 200 None
2026-03-30 10:54:39 [auto1.de] INFO: Saving data for KP51039: {'auction_closing_time': 1774972396.0, 'created_time': 1774381481.161027, 'last_price_update_time': 1774868079.853988}
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP51039') HTTP/1.1" 204 0
2026-03-30 10:54:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 934c316c-750b-55d2-b4c6-d87ab0af610e with identifier: JS41418
2026-03-30 10:54:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 934c316c-750b-55d2-b4c6-d87ab0af610e with identifier: JS41418
2026-03-30 10:54:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 934c316c-750b-55d2-b4c6-d87ab0af610e with identifier: JS41418 to the API
2026-03-30 10:54:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:57:59Z',
 'fuel_type': 'diesel',
 'id': '934c316c-750b-55d2-b4c6-d87ab0af610e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS41418',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 183614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-27',
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.2 CRDi Premium blue 4WD',
 'transmission': 'automatic',
 'trim': 'Premium blue 4WD',
 'year': 2016}
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS41418%27 HTTP/1.1" 200 None
2026-03-30 10:54:40 [auto1.de] INFO: Saving data for JS41418: {'auction_closing_time': 1774972679.0, 'created_time': 1773429659.651613, 'last_price_update_time': 1774868080.237884}
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS41418') HTTP/1.1" 204 0
2026-03-30 10:54:40 [auto1.de] INFO: Found listing with ID: NB84936
2026-03-30 10:54:40 [auto1.de] INFO: Found listing with ID: YD41840
2026-03-30 10:54:40 [auto1.de] INFO: Found listing with ID: HV49065
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV49065%27 HTTP/1.1" 200 None
2026-03-30 10:54:40 [auto1.de] INFO: Scrape type for HV49065: 2
2026-03-30 10:54:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49efbabd-6acf-57c6-b856-c3b62591ee28 with identifier: HV49065
2026-03-30 10:54:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49efbabd-6acf-57c6-b856-c3b62591ee28 with scrape type 2
2026-03-30 10:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49efbabd-6acf-57c6-b856-c3b62591ee28 with scrape type 2
2026-03-30 10:54:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49efbabd-6acf-57c6-b856-c3b62591ee28, identifier: HV49065
2026-03-30 10:54:40 [auto1.de] INFO: Found listing with ID: DZ26668
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ26668%27 HTTP/1.1" 200 None
2026-03-30 10:54:40 [auto1.de] INFO: Scrape type for DZ26668: 2
2026-03-30 10:54:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db72a02f-4368-5a59-8c33-99357deb04a6 with identifier: DZ26668
2026-03-30 10:54:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db72a02f-4368-5a59-8c33-99357deb04a6 with scrape type 2
2026-03-30 10:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db72a02f-4368-5a59-8c33-99357deb04a6 with scrape type 2
2026-03-30 10:54:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db72a02f-4368-5a59-8c33-99357deb04a6, identifier: DZ26668
2026-03-30 10:54:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49efbabd-6acf-57c6-b856-c3b62591ee28 with identifier: HV49065
2026-03-30 10:54:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49efbabd-6acf-57c6-b856-c3b62591ee28 with identifier: HV49065
2026-03-30 10:54:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49efbabd-6acf-57c6-b856-c3b62591ee28 with identifier: HV49065 to the API
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:06:51Z',
 'fuel_type': 'diesel',
 'id': '49efbabd-6acf-57c6-b856-c3b62591ee28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV49065',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 58532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-10',
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Ocean',
 'transmission': 'automatic',
 'trim': 'Ocean',
 'year': 2017}
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV49065%27 HTTP/1.1" 200 None
2026-03-30 10:54:40 [auto1.de] INFO: Saving data for HV49065: {'auction_closing_time': 1774969611.0, 'created_time': 1774381472.399724, 'last_price_update_time': 1774868080.842509}
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV49065') HTTP/1.1" 204 0
2026-03-30 10:54:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db72a02f-4368-5a59-8c33-99357deb04a6 with identifier: DZ26668
2026-03-30 10:54:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db72a02f-4368-5a59-8c33-99357deb04a6 with identifier: DZ26668
2026-03-30 10:54:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db72a02f-4368-5a59-8c33-99357deb04a6 with identifier: DZ26668 to the API
2026-03-30 10:54:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:30:55Z',
 'fuel_type': 'diesel',
 'id': 'db72a02f-4368-5a59-8c33-99357deb04a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ26668',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 123007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-15',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ26668%27 HTTP/1.1" 200 None
2026-03-30 10:54:41 [auto1.de] INFO: Saving data for DZ26668: {'auction_closing_time': 1774971055.0, 'created_time': 1773132362.796298, 'last_price_update_time': 1774868081.222921}
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ26668') HTTP/1.1" 204 0
2026-03-30 10:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f0a7d0>
2026-03-30 10:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb7b013-24aa-5944-b3e7-4624f57e31c9/4cb7b013-24aa-5944-b3e7-4624f57e31c9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F79%252F03793ef0a57d17183b85639f476d15a5%252Fpa%252FRC15708_79d109017a82765ef0e72c9f411eb425.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_79d109017a82765ef0e72c9f411eb425.jpg saved to cache
2026-03-30 10:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cb7b013-24aa-5944-b3e7-4624f57e31c9
2026-03-30 10:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef593c890>
2026-03-30 10:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cb7b013-24aa-5944-b3e7-4624f57e31c9/4cb7b013-24aa-5944-b3e7-4624f57e31c9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F79%252F03793ef0a57d17183b85639f476d15a5%252Fpa%252FRC15708_e8328064120721602c3b9fa652a0a761.jpg') HTTP/1.1" 204 0
2026-03-30 10:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_e8328064120721602c3b9fa652a0a761.jpg saved to cache
2026-03-30 10:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4cb7b013-24aa-5944-b3e7-4624f57e31c9
2026-03-30 10:54:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cb7b013-24aa-5944-b3e7-4624f57e31c9, skipping ID generation
2026-03-30 10:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cb7b013-24aa-5944-b3e7-4624f57e31c9 with scrape type 1
2026-03-30 10:54:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cb7b013-24aa-5944-b3e7-4624f57e31c9 sending to next pipeline
2026-03-30 10:54:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cb7b013-24aa-5944-b3e7-4624f57e31c9, identifier: RC15708
2026-03-30 10:54:41 [auto1.de] INFO: Found listing with ID: LT89325
2026-03-30 10:54:41 [auto1.de] INFO: Found listing with ID: RG79664
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG79664%27 HTTP/1.1" 200 None
2026-03-30 10:54:41 [auto1.de] INFO: Scrape type for RG79664: 2
2026-03-30 10:54:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d7e02c9-a2a1-5599-89c5-fc012af11f63 with identifier: RG79664
2026-03-30 10:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d7e02c9-a2a1-5599-89c5-fc012af11f63 with scrape type 2
2026-03-30 10:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d7e02c9-a2a1-5599-89c5-fc012af11f63 with scrape type 2
2026-03-30 10:54:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d7e02c9-a2a1-5599-89c5-fc012af11f63, identifier: RG79664
2026-03-30 10:54:41 [auto1.de] INFO: Found listing with ID: MH07331
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH07331%27 HTTP/1.1" 200 None
2026-03-30 10:54:41 [auto1.de] INFO: Scrape type for MH07331: 2
2026-03-30 10:54:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2515e243-13e0-5279-ba87-bc18d307461b with identifier: MH07331
2026-03-30 10:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2515e243-13e0-5279-ba87-bc18d307461b with scrape type 2
2026-03-30 10:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2515e243-13e0-5279-ba87-bc18d307461b with scrape type 2
2026-03-30 10:54:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2515e243-13e0-5279-ba87-bc18d307461b, identifier: MH07331
2026-03-30 10:54:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cb7b013-24aa-5944-b3e7-4624f57e31c9 with identifier: RC15708
2026-03-30 10:54:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cb7b013-24aa-5944-b3e7-4624f57e31c9 with identifier: RC15708
2026-03-30 10:54:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cb7b013-24aa-5944-b3e7-4624f57e31c9 with identifier: RC15708 to the API
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_e8328064120721602c3b9fa652a0a761.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:54:27Z',
 'fuel_type': 'petrol',
 'id': '4cb7b013-24aa-5944-b3e7-4624f57e31c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC15708',
 'listing': 'auction',
 'location': 'DE, Bitburg',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 189769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb7b013-24aa-5944-b3e7-4624f57e31c9/4cb7b013-24aa-5944-b3e7-4624f57e31c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_43401329188c9231184f56e2ec35a095.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb7b013-24aa-5944-b3e7-4624f57e31c9/4cb7b013-24aa-5944-b3e7-4624f57e31c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_e25489ff84bae1bd5ac7bd797c21fe74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb7b013-24aa-5944-b3e7-4624f57e31c9/4cb7b013-24aa-5944-b3e7-4624f57e31c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_a825b1657d993efae670bf801adbecfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb7b013-24aa-5944-b3e7-4624f57e31c9/4cb7b013-24aa-5944-b3e7-4624f57e31c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_faf5cebe22c95349ad7e205b7f562c0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb7b013-24aa-5944-b3e7-4624f57e31c9/4cb7b013-24aa-5944-b3e7-4624f57e31c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_79d109017a82765ef0e72c9f411eb425.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cb7b013-24aa-5944-b3e7-4624f57e31c9/4cb7b013-24aa-5944-b3e7-4624f57e31c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/79/03793ef0a57d17183b85639f476d15a5/pa/RC15708_e8328064120721602c3b9fa652a0a761.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC15708%27 HTTP/1.1" 200 None
2026-03-30 10:54:42 [auto1.de] INFO: Saving data for RC15708: {'created_time': 1774868082.051161, 'last_price_update_time': 1774868082.051175, 'auction_closing_time': 1774972467.0}
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC15708') HTTP/1.1" 204 0
2026-03-30 10:54:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d7e02c9-a2a1-5599-89c5-fc012af11f63 with identifier: RG79664
2026-03-30 10:54:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d7e02c9-a2a1-5599-89c5-fc012af11f63 with identifier: RG79664
2026-03-30 10:54:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d7e02c9-a2a1-5599-89c5-fc012af11f63 with identifier: RG79664 to the API
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:47:12Z',
 'fuel_type': 'diesel',
 'id': '1d7e02c9-a2a1-5599-89c5-fc012af11f63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG79664',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 237614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-16',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG79664%27 HTTP/1.1" 200 None
2026-03-30 10:54:42 [auto1.de] INFO: Saving data for RG79664: {'auction_closing_time': 1774972032.0, 'created_time': 1773687415.039334, 'last_price_update_time': 1774868082.396322}
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG79664') HTTP/1.1" 204 0
2026-03-30 10:54:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2515e243-13e0-5279-ba87-bc18d307461b with identifier: MH07331
2026-03-30 10:54:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2515e243-13e0-5279-ba87-bc18d307461b with identifier: MH07331
2026-03-30 10:54:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2515e243-13e0-5279-ba87-bc18d307461b with identifier: MH07331 to the API
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:19:09Z',
 'fuel_type': 'petrol',
 'id': '2515e243-13e0-5279-ba87-bc18d307461b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH07331',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 219233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-04',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2008}
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH07331%27 HTTP/1.1" 200 None
2026-03-30 10:54:42 [auto1.de] INFO: Saving data for MH07331: {'auction_closing_time': 1774970349.0, 'created_time': 1774435766.755288, 'last_price_update_time': 1774868082.753832}
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH07331') HTTP/1.1" 204 0
2026-03-30 10:54:42 [auto1.de] INFO: Found listing with ID: GC11554
2026-03-30 10:54:42 [auto1.de] INFO: Found listing with ID: ES17453
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES17453%27 HTTP/1.1" 200 None
2026-03-30 10:54:42 [auto1.de] INFO: Scrape type for ES17453: 2
2026-03-30 10:54:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0747d81e-871e-5a83-a015-a0da15824f22 with identifier: ES17453
2026-03-30 10:54:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0747d81e-871e-5a83-a015-a0da15824f22 with scrape type 2
2026-03-30 10:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0747d81e-871e-5a83-a015-a0da15824f22 with scrape type 2
2026-03-30 10:54:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0747d81e-871e-5a83-a015-a0da15824f22, identifier: ES17453
2026-03-30 10:54:42 [auto1.de] INFO: Found listing with ID: CY08035
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY08035%27 HTTP/1.1" 200 None
2026-03-30 10:54:42 [auto1.de] INFO: Scrape type for CY08035: 2
2026-03-30 10:54:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43195eeb-820d-55d1-9857-49acacf966da with identifier: CY08035
2026-03-30 10:54:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43195eeb-820d-55d1-9857-49acacf966da with scrape type 2
2026-03-30 10:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43195eeb-820d-55d1-9857-49acacf966da with scrape type 2
2026-03-30 10:54:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43195eeb-820d-55d1-9857-49acacf966da, identifier: CY08035
2026-03-30 10:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK59952> (referer: https://www.auto1.com/v1/car-details-view/XK59952/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL94167> (referer: https://www.auto1.com/v1/car-details-view/BL94167/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0747d81e-871e-5a83-a015-a0da15824f22 with identifier: ES17453
2026-03-30 10:54:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0747d81e-871e-5a83-a015-a0da15824f22 with identifier: ES17453
2026-03-30 10:54:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0747d81e-871e-5a83-a015-a0da15824f22 with identifier: ES17453 to the API
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:31:05Z',
 'fuel_type': 'petrol',
 'id': '0747d81e-871e-5a83-a015-a0da15824f22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES17453',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 167108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-25',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2010}
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES17453%27 HTTP/1.1" 200 None
2026-03-30 10:54:43 [auto1.de] INFO: Saving data for ES17453: {'auction_closing_time': 1774971065.0, 'created_time': 1773428729.402895, 'last_price_update_time': 1774868083.357425}
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES17453') HTTP/1.1" 204 0
2026-03-30 10:54:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43195eeb-820d-55d1-9857-49acacf966da with identifier: CY08035
2026-03-30 10:54:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43195eeb-820d-55d1-9857-49acacf966da with identifier: CY08035
2026-03-30 10:54:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43195eeb-820d-55d1-9857-49acacf966da with identifier: CY08035 to the API
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:39:31Z',
 'fuel_type': 'petrol',
 'id': '43195eeb-820d-55d1-9857-49acacf966da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY08035',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 103938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-30',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY08035%27 HTTP/1.1" 200 None
2026-03-30 10:54:43 [auto1.de] INFO: Saving data for CY08035: {'auction_closing_time': 1774971571.0, 'created_time': 1773686246.768123, 'last_price_update_time': 1774868083.822403}
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY08035') HTTP/1.1" 204 0
2026-03-30 10:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:43 [auto1.de] INFO: Found listing with ID: BG27502
2026-03-30 10:54:43 [auto1.de] INFO: Found listing with ID: TW05114
2026-03-30 10:54:43 [auto1.de] INFO: Found listing with ID: ZE91614
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE91614%27 HTTP/1.1" 200 None
2026-03-30 10:54:43 [auto1.de] INFO: Scrape type for ZE91614: 2
2026-03-30 10:54:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 590fd04b-fc99-597b-98bf-c0ad276e26ee with identifier: ZE91614
2026-03-30 10:54:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 590fd04b-fc99-597b-98bf-c0ad276e26ee with scrape type 2
2026-03-30 10:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 590fd04b-fc99-597b-98bf-c0ad276e26ee with scrape type 2
2026-03-30 10:54:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 590fd04b-fc99-597b-98bf-c0ad276e26ee, identifier: ZE91614
2026-03-30 10:54:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 590fd04b-fc99-597b-98bf-c0ad276e26ee with identifier: ZE91614
2026-03-30 10:54:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 590fd04b-fc99-597b-98bf-c0ad276e26ee with identifier: ZE91614
2026-03-30 10:54:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 590fd04b-fc99-597b-98bf-c0ad276e26ee with identifier: ZE91614 to the API
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:52:45Z',
 'fuel_type': 'diesel',
 'id': '590fd04b-fc99-597b-98bf-c0ad276e26ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE91614',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'C30',
 'odometer': 225939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-29',
 'seller_name': None,
 'title': 'Volvo C30 1.6 D Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2008}
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE91614%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [auto1.de] INFO: Saving data for ZE91614: {'auction_closing_time': 1774972365.0, 'created_time': 1774637240.414163, 'last_price_update_time': 1774868084.497434}
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE91614') HTTP/1.1" 204 0
2026-03-30 10:54:44 [auto1.de] INFO: Found listing with ID: XH30445
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH30445%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [auto1.de] INFO: Scrape type for XH30445: 2
2026-03-30 10:54:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11616c16-7743-50bf-b352-43e9edea5b5f with identifier: XH30445
2026-03-30 10:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11616c16-7743-50bf-b352-43e9edea5b5f with scrape type 2
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11616c16-7743-50bf-b352-43e9edea5b5f with scrape type 2
2026-03-30 10:54:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11616c16-7743-50bf-b352-43e9edea5b5f, identifier: XH30445
2026-03-30 10:54:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97914618-b82d-5b17-a2c8-ab9e0601ce39 with identifier: XK59952
2026-03-30 10:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97914618-b82d-5b17-a2c8-ab9e0601ce39 with scrape type 1
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97914618-b82d-5b17-a2c8-ab9e0601ce39
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F27%252Fee27ad1599c13a2c2d6b567b92367d92%252Fpa%252FXK59952_7ea6565aff0117998ca24494b3660e64.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_7ea6565aff0117998ca24494b3660e64.jpg already downloaded
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F27%252Fee27ad1599c13a2c2d6b567b92367d92%252Fpa%252FXK59952_1b65cc9c2247abd5415d4430acc5dedf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_1b65cc9c2247abd5415d4430acc5dedf.jpg already downloaded
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F27%252Fee27ad1599c13a2c2d6b567b92367d92%252Fpa%252FXK59952_89cb3f6262e7f6440d53b44c36b97547.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_89cb3f6262e7f6440d53b44c36b97547.jpg already downloaded
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F27%252Fee27ad1599c13a2c2d6b567b92367d92%252Fpa%252FXK59952_84f354323ebb8b9cb4c50467fb606a04.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_84f354323ebb8b9cb4c50467fb606a04.jpg already downloaded
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F27%252Fee27ad1599c13a2c2d6b567b92367d92%252Fpa%252FXK59952_04cb8f4f0c0a446272f6f35dd1710126.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_04cb8f4f0c0a446272f6f35dd1710126.jpg already downloaded
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F27%252Fee27ad1599c13a2c2d6b567b92367d92%252Fpa%252FXK59952_4388b4bd763b763fd45db7741b4ef569.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_4388b4bd763b763fd45db7741b4ef569.jpg already downloaded
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F27%252Fee27ad1599c13a2c2d6b567b92367d92%252Fpa%252FXK59952_53aaff14a45c55c7dbd71ab805512589.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_53aaff14a45c55c7dbd71ab805512589.jpg already downloaded
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F27%252Fee27ad1599c13a2c2d6b567b92367d92%252Fpa%252FXK59952_a7254bdf821bc26b1ac33eaac6b8b9d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_a7254bdf821bc26b1ac33eaac6b8b9d0.jpg already downloaded
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F27%252Fee27ad1599c13a2c2d6b567b92367d92%252Fpa%252FXK59952_69b4c1c93d18ebb47edc408fc948ae33.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_69b4c1c93d18ebb47edc408fc948ae33.jpg already downloaded
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F27%252Fee27ad1599c13a2c2d6b567b92367d92%252Fpa%252FXK59952_b2af133016111a5ae12110efee28019c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_b2af133016111a5ae12110efee28019c.jpg already downloaded
2026-03-30 10:54:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97914618-b82d-5b17-a2c8-ab9e0601ce39, identifier: XK59952
2026-03-30 10:54:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a877886-db15-508b-a966-ee560755169c with identifier: BL94167
2026-03-30 10:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a877886-db15-508b-a966-ee560755169c with scrape type 1
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4a877886-db15-508b-a966-ee560755169c
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F3e%252F673ea0caa604959d7821f6317bbf50b4%252Fpa%252FBL94167_85c455eaf9d78adafd85d266772d1431.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/3e/673ea0caa604959d7821f6317bbf50b4/pa/BL94167_85c455eaf9d78adafd85d266772d1431.jpg already downloaded
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F3e%252F673ea0caa604959d7821f6317bbf50b4%252Fpa%252FBL94167_97767f3661d23ed11be29ad63f3f6b0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/3e/673ea0caa604959d7821f6317bbf50b4/pa/BL94167_97767f3661d23ed11be29ad63f3f6b0b.jpg already downloaded
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F3e%252F673ea0caa604959d7821f6317bbf50b4%252Fpa%252FBL94167_8cd09336cacd33e69cafa577da77071b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/3e/673ea0caa604959d7821f6317bbf50b4/pa/BL94167_8cd09336cacd33e69cafa577da77071b.jpg already downloaded
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F3e%252F673ea0caa604959d7821f6317bbf50b4%252Fpa%252FBL94167_e2c6dd739228527b240dbdf6e2d4c446.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/3e/673ea0caa604959d7821f6317bbf50b4/pa/BL94167_e2c6dd739228527b240dbdf6e2d4c446.jpg already downloaded
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F3e%252F673ea0caa604959d7821f6317bbf50b4%252Fpa%252FBL94167_a86d30b5e5efe19909fa565db94943b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/3e/673ea0caa604959d7821f6317bbf50b4/pa/BL94167_a86d30b5e5efe19909fa565db94943b3.jpg already downloaded
2026-03-30 10:54:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a877886-db15-508b-a966-ee560755169c, identifier: BL94167
2026-03-30 10:54:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11616c16-7743-50bf-b352-43e9edea5b5f with identifier: XH30445
2026-03-30 10:54:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11616c16-7743-50bf-b352-43e9edea5b5f with identifier: XH30445
2026-03-30 10:54:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11616c16-7743-50bf-b352-43e9edea5b5f with identifier: XH30445 to the API
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-31T15:14:03Z',
 'fuel_type': 'petrol',
 'id': '11616c16-7743-50bf-b352-43e9edea5b5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH30445',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 140797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350 CGI 4Matic BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency Avantgarde',
 'year': 2014}
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH30445%27 HTTP/1.1" 200 None
2026-03-30 10:54:45 [auto1.de] INFO: Saving data for XH30445: {'auction_closing_time': 1774970043.0, 'created_time': 1773303381.221227, 'last_price_update_time': 1774868085.419056}
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH30445') HTTP/1.1" 204 0
2026-03-30 10:54:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97914618-b82d-5b17-a2c8-ab9e0601ce39 with identifier: XK59952
2026-03-30 10:54:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97914618-b82d-5b17-a2c8-ab9e0601ce39 with identifier: XK59952
2026-03-30 10:54:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97914618-b82d-5b17-a2c8-ab9e0601ce39 with identifier: XK59952 to the API
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XK59952>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:48:03Z',
 'fuel_type': 'diesel',
 'id': '97914618-b82d-5b17-a2c8-ab9e0601ce39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK59952',
 'listing': 'auction',
 'location': 'Bitburg',
 'make': 'Volkswagen',
 'model': 'Passat Alltrack',
 'odometer': 187503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_7ea6565aff0117998ca24494b3660e64.jpg',
                'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_1b65cc9c2247abd5415d4430acc5dedf.jpg',
                'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_89cb3f6262e7f6440d53b44c36b97547.jpg',
                'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_84f354323ebb8b9cb4c50467fb606a04.jpg',
                'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_04cb8f4f0c0a446272f6f35dd1710126.jpg',
                'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_4388b4bd763b763fd45db7741b4ef569.jpg',
                'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_53aaff14a45c55c7dbd71ab805512589.jpg',
                'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_a7254bdf821bc26b1ac33eaac6b8b9d0.jpg',
                'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_69b4c1c93d18ebb47edc408fc948ae33.jpg',
                'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_b2af133016111a5ae12110efee28019c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_7ea6565aff0117998ca24494b3660e64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_1b65cc9c2247abd5415d4430acc5dedf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2266254,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_89cb3f6262e7f6440d53b44c36b97547.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_84f354323ebb8b9cb4c50467fb606a04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2384883,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_04cb8f4f0c0a446272f6f35dd1710126.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_4388b4bd763b763fd45db7741b4ef569.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_53aaff14a45c55c7dbd71ab805512589.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_a7254bdf821bc26b1ac33eaac6b8b9d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_69b4c1c93d18ebb47edc408fc948ae33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97914618-b82d-5b17-a2c8-ab9e0601ce39/97914618-b82d-5b17-a2c8-ab9e0601ce39_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/27/ee27ad1599c13a2c2d6b567b92367d92/pa/XK59952_b2af133016111a5ae12110efee28019c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat Alltrack 2.0 TDI 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': '4Motion BlueMotion Tech',
 'year': 2016}
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK59952%27 HTTP/1.1" 200 None
2026-03-30 10:54:45 [auto1.de] INFO: Saving data for XK59952: {'created_time': 1774868085.741362, 'last_price_update_time': 1774868085.741371, 'auction_closing_time': 1774972083.0}
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK59952') HTTP/1.1" 204 0
2026-03-30 10:54:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a877886-db15-508b-a966-ee560755169c with identifier: BL94167
2026-03-30 10:54:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a877886-db15-508b-a966-ee560755169c with identifier: BL94167
2026-03-30 10:54:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a877886-db15-508b-a966-ee560755169c with identifier: BL94167 to the API
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BL94167>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:22:44Z',
 'fuel_type': 'diesel',
 'id': '4a877886-db15-508b-a966-ee560755169c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL94167',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 276488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img67/3e/673ea0caa604959d7821f6317bbf50b4/pa/BL94167_85c455eaf9d78adafd85d266772d1431.jpg',
                'https://img-pa.auto1.com/img67/3e/673ea0caa604959d7821f6317bbf50b4/pa/BL94167_97767f3661d23ed11be29ad63f3f6b0b.jpg',
                'https://img-pa.auto1.com/img67/3e/673ea0caa604959d7821f6317bbf50b4/pa/BL94167_8cd09336cacd33e69cafa577da77071b.jpg',
                'https://img-pa.auto1.com/img67/3e/673ea0caa604959d7821f6317bbf50b4/pa/BL94167_e2c6dd739228527b240dbdf6e2d4c446.jpg',
                'https://img-pa.auto1.com/img67/3e/673ea0caa604959d7821f6317bbf50b4/pa/BL94167_a86d30b5e5efe19909fa565db94943b3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a877886-db15-508b-a966-ee560755169c/4a877886-db15-508b-a966-ee560755169c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/3e/673ea0caa604959d7821f6317bbf50b4/pa/BL94167_85c455eaf9d78adafd85d266772d1431.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a877886-db15-508b-a966-ee560755169c/4a877886-db15-508b-a966-ee560755169c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/3e/673ea0caa604959d7821f6317bbf50b4/pa/BL94167_97767f3661d23ed11be29ad63f3f6b0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a877886-db15-508b-a966-ee560755169c/4a877886-db15-508b-a966-ee560755169c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/3e/673ea0caa604959d7821f6317bbf50b4/pa/BL94167_8cd09336cacd33e69cafa577da77071b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a877886-db15-508b-a966-ee560755169c/4a877886-db15-508b-a966-ee560755169c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/3e/673ea0caa604959d7821f6317bbf50b4/pa/BL94167_e2c6dd739228527b240dbdf6e2d4c446.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a877886-db15-508b-a966-ee560755169c/4a877886-db15-508b-a966-ee560755169c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/3e/673ea0caa604959d7821f6317bbf50b4/pa/BL94167_a86d30b5e5efe19909fa565db94943b3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-30 10:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL94167%27 HTTP/1.1" 200 None
2026-03-30 10:54:46 [auto1.de] INFO: Saving data for BL94167: {'created_time': 1774868086.072989, 'last_price_update_time': 1774868086.073001, 'auction_closing_time': 1774970564.0}
2026-03-30 10:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL94167') HTTP/1.1" 204 0
2026-03-30 10:54:46 [auto1.de] INFO: Found listing with ID: RB04302
2026-03-30 10:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB04302%27 HTTP/1.1" 200 None
2026-03-30 10:54:46 [auto1.de] INFO: Scrape type for RB04302: 2
2026-03-30 10:54:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3f23027-c506-57e6-a388-db8cf67b4a79 with identifier: RB04302
2026-03-30 10:54:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3f23027-c506-57e6-a388-db8cf67b4a79 with scrape type 2
2026-03-30 10:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3f23027-c506-57e6-a388-db8cf67b4a79 with scrape type 2
2026-03-30 10:54:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3f23027-c506-57e6-a388-db8cf67b4a79, identifier: RB04302
2026-03-30 10:54:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3f23027-c506-57e6-a388-db8cf67b4a79 with identifier: RB04302
2026-03-30 10:54:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3f23027-c506-57e6-a388-db8cf67b4a79 with identifier: RB04302
2026-03-30 10:54:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3f23027-c506-57e6-a388-db8cf67b4a79 with identifier: RB04302 to the API
2026-03-30 10:54:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:52:15Z',
 'fuel_type': 'petrol',
 'id': 'd3f23027-c506-57e6-a388-db8cf67b4a79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB04302',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 142088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-27',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2014}
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB04302%27 HTTP/1.1" 200 None
2026-03-30 10:54:47 [auto1.de] INFO: Saving data for RB04302: {'auction_closing_time': 1774972335.0, 'created_time': 1773382574.283124, 'last_price_update_time': 1774868087.092825}
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB04302') HTTP/1.1" 204 0
2026-03-30 10:54:47 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 9524 | hits on page: 40
2026-03-30 10:54:47 [auto1.de] INFO: Found listing with ID: HZ29181
2026-03-30 10:54:47 [auto1.de] INFO: Found listing with ID: FK23500
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK23500%27 HTTP/1.1" 200 None
2026-03-30 10:54:47 [auto1.de] INFO: Scrape type for FK23500: 2
2026-03-30 10:54:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baaab1c4-9cc7-50dd-a7a4-fb8d77879c3d with identifier: FK23500
2026-03-30 10:54:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baaab1c4-9cc7-50dd-a7a4-fb8d77879c3d with scrape type 2
2026-03-30 10:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item baaab1c4-9cc7-50dd-a7a4-fb8d77879c3d with scrape type 2
2026-03-30 10:54:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: baaab1c4-9cc7-50dd-a7a4-fb8d77879c3d, identifier: FK23500
2026-03-30 10:54:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: baaab1c4-9cc7-50dd-a7a4-fb8d77879c3d with identifier: FK23500
2026-03-30 10:54:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: baaab1c4-9cc7-50dd-a7a4-fb8d77879c3d with identifier: FK23500
2026-03-30 10:54:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: baaab1c4-9cc7-50dd-a7a4-fb8d77879c3d with identifier: FK23500 to the API
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:18:16Z',
 'fuel_type': 'diesel',
 'id': 'baaab1c4-9cc7-50dd-a7a4-fb8d77879c3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK23500',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 56691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-23',
 'seller_name': None,
 'title': 'Opel Vivaro 1.5 CDTI L L3',
 'transmission': 'manual',
 'trim': 'L L3',
 'year': 2020}
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK23500%27 HTTP/1.1" 200 None
2026-03-30 10:54:47 [auto1.de] INFO: Saving data for FK23500: {'auction_closing_time': 1774970296.0, 'created_time': 1774463935.570187, 'last_price_update_time': 1774868087.607685}
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK23500') HTTP/1.1" 204 0
2026-03-30 10:54:47 [auto1.de] INFO: Found listing with ID: RB55254
2026-03-30 10:54:47 [auto1.de] INFO: Found listing with ID: CC98432
2026-03-30 10:54:47 [auto1.de] INFO: Found listing with ID: DG91683
2026-03-30 10:54:47 [auto1.de] INFO: Found listing with ID: MT13851
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT13851%27 HTTP/1.1" 200 None
2026-03-30 10:54:47 [auto1.de] INFO: Scrape type for MT13851: 2
2026-03-30 10:54:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a68251f-e32e-5dd0-946d-c59e6b0a8304 with identifier: MT13851
2026-03-30 10:54:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a68251f-e32e-5dd0-946d-c59e6b0a8304 with scrape type 2
2026-03-30 10:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a68251f-e32e-5dd0-946d-c59e6b0a8304 with scrape type 2
2026-03-30 10:54:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a68251f-e32e-5dd0-946d-c59e6b0a8304, identifier: MT13851
2026-03-30 10:54:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:47 [auto1.de] INFO: Found listing with ID: TH64703
2026-03-30 10:54:47 [auto1.de] INFO: Found listing with ID: DE15792
2026-03-30 10:54:47 [auto1.de] INFO: Found listing with ID: TN06340
2026-03-30 10:54:47 [auto1.de] INFO: Found listing with ID: DK78572
2026-03-30 10:54:47 [auto1.de] INFO: Found listing with ID: EG23428
2026-03-30 10:54:47 [auto1.de] INFO: Found listing with ID: FM04287
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM04287%27 HTTP/1.1" 200 None
2026-03-30 10:54:47 [auto1.de] INFO: Scrape type for FM04287: 1
2026-03-30 10:54:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a68251f-e32e-5dd0-946d-c59e6b0a8304 with identifier: MT13851
2026-03-30 10:54:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a68251f-e32e-5dd0-946d-c59e6b0a8304 with identifier: MT13851
2026-03-30 10:54:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a68251f-e32e-5dd0-946d-c59e6b0a8304 with identifier: MT13851 to the API
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:57:22Z',
 'fuel_type': 'petrol',
 'id': '9a68251f-e32e-5dd0-946d-c59e6b0a8304',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT13851',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 114984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-13',
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2012}
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT13851%27 HTTP/1.1" 200 None
2026-03-30 10:54:48 [auto1.de] INFO: Saving data for MT13851: {'auction_closing_time': 1774972642.0, 'created_time': 1774380425.747119, 'last_price_update_time': 1774868088.10189}
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT13851') HTTP/1.1" 204 0
2026-03-30 10:54:48 [auto1.de] INFO: Found listing with ID: LR92682
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR92682%27 HTTP/1.1" 200 None
2026-03-30 10:54:48 [auto1.de] INFO: Scrape type for LR92682: 2
2026-03-30 10:54:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dcdb45f-20b9-5ecf-b3e0-203cc54e2836 with identifier: LR92682
2026-03-30 10:54:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dcdb45f-20b9-5ecf-b3e0-203cc54e2836 with scrape type 2
2026-03-30 10:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dcdb45f-20b9-5ecf-b3e0-203cc54e2836 with scrape type 2
2026-03-30 10:54:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dcdb45f-20b9-5ecf-b3e0-203cc54e2836, identifier: LR92682
2026-03-30 10:54:48 [auto1.de] INFO: Found listing with ID: KV82053
2026-03-30 10:54:48 [auto1.de] INFO: Found listing with ID: WW97819
2026-03-30 10:54:48 [auto1.de] INFO: Found listing with ID: AW11286
2026-03-30 10:54:48 [auto1.de] INFO: Found listing with ID: GV09238
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV09238%27 HTTP/1.1" 200 None
2026-03-30 10:54:48 [auto1.de] INFO: Scrape type for GV09238: 2
2026-03-30 10:54:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec381cab-523e-50fd-88fb-be399a0ccdf0 with identifier: GV09238
2026-03-30 10:54:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec381cab-523e-50fd-88fb-be399a0ccdf0 with scrape type 2
2026-03-30 10:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec381cab-523e-50fd-88fb-be399a0ccdf0 with scrape type 2
2026-03-30 10:54:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec381cab-523e-50fd-88fb-be399a0ccdf0, identifier: GV09238
2026-03-30 10:54:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dcdb45f-20b9-5ecf-b3e0-203cc54e2836 with identifier: LR92682
2026-03-30 10:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dcdb45f-20b9-5ecf-b3e0-203cc54e2836 with identifier: LR92682
2026-03-30 10:54:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dcdb45f-20b9-5ecf-b3e0-203cc54e2836 with identifier: LR92682 to the API
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:10:08Z',
 'fuel_type': 'diesel',
 'id': '4dcdb45f-20b9-5ecf-b3e0-203cc54e2836',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR92682',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 233692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-18',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2020}
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR92682%27 HTTP/1.1" 200 None
2026-03-30 10:54:48 [auto1.de] INFO: Saving data for LR92682: {'auction_closing_time': 1774969808.0, 'created_time': 1774467646.247562, 'last_price_update_time': 1774868088.767203}
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR92682') HTTP/1.1" 204 0
2026-03-30 10:54:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec381cab-523e-50fd-88fb-be399a0ccdf0 with identifier: GV09238
2026-03-30 10:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec381cab-523e-50fd-88fb-be399a0ccdf0 with identifier: GV09238
2026-03-30 10:54:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec381cab-523e-50fd-88fb-be399a0ccdf0 with identifier: GV09238 to the API
2026-03-30 10:54:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:33:08Z',
 'fuel_type': 'petrol',
 'id': 'ec381cab-523e-50fd-88fb-be399a0ccdf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV09238',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 140057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-29',
 'seller_name': None,
 'title': 'Mazda 3 1.6 Sport Active',
 'transmission': 'manual',
 'trim': 'Sport Active',
 'year': 2006}
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV09238%27 HTTP/1.1" 200 None
2026-03-30 10:54:49 [auto1.de] INFO: Saving data for GV09238: {'auction_closing_time': 1774971188.0, 'created_time': 1774379770.031726, 'last_price_update_time': 1774868089.156436}
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV09238') HTTP/1.1" 204 0
2026-03-30 10:54:49 [auto1.de] INFO: Found listing with ID: HE60226
2026-03-30 10:54:49 [auto1.de] INFO: Found listing with ID: DW40061
2026-03-30 10:54:49 [auto1.de] INFO: Found listing with ID: AZ98687
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ98687%27 HTTP/1.1" 200 None
2026-03-30 10:54:49 [auto1.de] INFO: Scrape type for AZ98687: 2
2026-03-30 10:54:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaa1ed39-1e42-5cb2-9e89-a758a1406798 with identifier: AZ98687
2026-03-30 10:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaa1ed39-1e42-5cb2-9e89-a758a1406798 with scrape type 2
2026-03-30 10:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aaa1ed39-1e42-5cb2-9e89-a758a1406798 with scrape type 2
2026-03-30 10:54:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aaa1ed39-1e42-5cb2-9e89-a758a1406798, identifier: AZ98687
2026-03-30 10:54:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:49 [auto1.de] INFO: Found listing with ID: DC75837
2026-03-30 10:54:49 [auto1.de] INFO: Found listing with ID: CW68462
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW68462%27 HTTP/1.1" 200 None
2026-03-30 10:54:49 [auto1.de] INFO: Scrape type for CW68462: 1
2026-03-30 10:54:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aaa1ed39-1e42-5cb2-9e89-a758a1406798 with identifier: AZ98687
2026-03-30 10:54:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aaa1ed39-1e42-5cb2-9e89-a758a1406798 with identifier: AZ98687
2026-03-30 10:54:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aaa1ed39-1e42-5cb2-9e89-a758a1406798 with identifier: AZ98687 to the API
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:35:27Z',
 'fuel_type': 'petrol',
 'id': 'aaa1ed39-1e42-5cb2-9e89-a758a1406798',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ98687',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 138929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-13',
 'seller_name': None,
 'title': 'Fiat 500X 1.4 Turbo Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2016}
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ98687%27 HTTP/1.1" 200 None
2026-03-30 10:54:49 [auto1.de] INFO: Saving data for AZ98687: {'auction_closing_time': 1774971327.0, 'created_time': 1773689215.672057, 'last_price_update_time': 1774868089.682065}
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ98687') HTTP/1.1" 204 0
2026-03-30 10:54:49 [auto1.de] INFO: Found listing with ID: EC94378
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC94378%27 HTTP/1.1" 200 None
2026-03-30 10:54:49 [auto1.de] INFO: Scrape type for EC94378: 2
2026-03-30 10:54:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 996a0354-4c89-5678-8b24-829cb1fb981c with identifier: EC94378
2026-03-30 10:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 996a0354-4c89-5678-8b24-829cb1fb981c with scrape type 2
2026-03-30 10:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 996a0354-4c89-5678-8b24-829cb1fb981c with scrape type 2
2026-03-30 10:54:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 996a0354-4c89-5678-8b24-829cb1fb981c, identifier: EC94378
2026-03-30 10:54:49 [auto1.de] INFO: Found listing with ID: UY74069
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY74069%27 HTTP/1.1" 200 None
2026-03-30 10:54:49 [auto1.de] INFO: Scrape type for UY74069: 2
2026-03-30 10:54:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb7c113c-9146-5266-a6c3-895ae50639b4 with identifier: UY74069
2026-03-30 10:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb7c113c-9146-5266-a6c3-895ae50639b4 with scrape type 2
2026-03-30 10:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb7c113c-9146-5266-a6c3-895ae50639b4 with scrape type 2
2026-03-30 10:54:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb7c113c-9146-5266-a6c3-895ae50639b4, identifier: UY74069
2026-03-30 10:54:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 996a0354-4c89-5678-8b24-829cb1fb981c with identifier: EC94378
2026-03-30 10:54:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 996a0354-4c89-5678-8b24-829cb1fb981c with identifier: EC94378
2026-03-30 10:54:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 996a0354-4c89-5678-8b24-829cb1fb981c with identifier: EC94378 to the API
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:02:45Z',
 'fuel_type': 'petrol',
 'id': '996a0354-4c89-5678-8b24-829cb1fb981c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC94378',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 138103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-01-17',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Kompressor T Elegance',
 'transmission': 'automatic',
 'trim': 'T Elegance',
 'year': 2005}
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC94378%27 HTTP/1.1" 200 None
2026-03-30 10:54:50 [auto1.de] INFO: Saving data for EC94378: {'auction_closing_time': 1774969365.0, 'created_time': 1773688818.129467, 'last_price_update_time': 1774868090.241172}
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC94378') HTTP/1.1" 204 0
2026-03-30 10:54:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb7c113c-9146-5266-a6c3-895ae50639b4 with identifier: UY74069
2026-03-30 10:54:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb7c113c-9146-5266-a6c3-895ae50639b4 with identifier: UY74069
2026-03-30 10:54:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb7c113c-9146-5266-a6c3-895ae50639b4 with identifier: UY74069 to the API
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:34:05Z',
 'fuel_type': 'diesel',
 'id': 'cb7c113c-9146-5266-a6c3-895ae50639b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY74069',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 206791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Cup 4Motion BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup 4Motion BlueMotion Tech',
 'year': 2014}
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY74069%27 HTTP/1.1" 200 None
2026-03-30 10:54:50 [auto1.de] INFO: Saving data for UY74069: {'auction_closing_time': 1774971245.0, 'created_time': 1774377549.86208, 'last_price_update_time': 1774868090.681529}
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY74069') HTTP/1.1" 204 0
2026-03-30 10:54:50 [auto1.de] INFO: Found listing with ID: AV92070
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV92070%27 HTTP/1.1" 200 None
2026-03-30 10:54:50 [auto1.de] INFO: Scrape type for AV92070: 2
2026-03-30 10:54:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccd9ef33-ebb7-5391-a9fa-3b6c621826eb with identifier: AV92070
2026-03-30 10:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccd9ef33-ebb7-5391-a9fa-3b6c621826eb with scrape type 2
2026-03-30 10:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccd9ef33-ebb7-5391-a9fa-3b6c621826eb with scrape type 2
2026-03-30 10:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccd9ef33-ebb7-5391-a9fa-3b6c621826eb, identifier: AV92070
2026-03-30 10:54:50 [auto1.de] INFO: Found listing with ID: DH94169
2026-03-30 10:54:50 [auto1.de] INFO: Found listing with ID: KX28982
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX28982%27 HTTP/1.1" 200 None
2026-03-30 10:54:50 [auto1.de] INFO: Scrape type for KX28982: 2
2026-03-30 10:54:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f240544-5e09-500c-8df3-89a8be8faf5c with identifier: KX28982
2026-03-30 10:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f240544-5e09-500c-8df3-89a8be8faf5c with scrape type 2
2026-03-30 10:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f240544-5e09-500c-8df3-89a8be8faf5c with scrape type 2
2026-03-30 10:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f240544-5e09-500c-8df3-89a8be8faf5c, identifier: KX28982
2026-03-30 10:54:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccd9ef33-ebb7-5391-a9fa-3b6c621826eb with identifier: AV92070
2026-03-30 10:54:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccd9ef33-ebb7-5391-a9fa-3b6c621826eb with identifier: AV92070
2026-03-30 10:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccd9ef33-ebb7-5391-a9fa-3b6c621826eb with identifier: AV92070 to the API
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:35:54Z',
 'fuel_type': 'diesel',
 'id': 'ccd9ef33-ebb7-5391-a9fa-3b6c621826eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV92070',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Country Tourer',
 'odometer': 234847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-01',
 'seller_name': None,
 'title': 'Opel Insignia Country Tourer 2.0 CDTI Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2016}
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV92070%27 HTTP/1.1" 200 None
2026-03-30 10:54:51 [auto1.de] INFO: Saving data for AV92070: {'auction_closing_time': 1774971354.0, 'created_time': 1773342700.492843, 'last_price_update_time': 1774868091.254262}
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV92070') HTTP/1.1" 204 0
2026-03-30 10:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f240544-5e09-500c-8df3-89a8be8faf5c with identifier: KX28982
2026-03-30 10:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f240544-5e09-500c-8df3-89a8be8faf5c with identifier: KX28982
2026-03-30 10:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f240544-5e09-500c-8df3-89a8be8faf5c with identifier: KX28982 to the API
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-31T15:02:02Z',
 'fuel_type': 'hybrid',
 'id': '4f240544-5e09-500c-8df3-89a8be8faf5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX28982',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 78364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-27',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300de T 4Matic',
 'transmission': 'automatic',
 'trim': 'T 4Matic',
 'year': 2022}
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX28982%27 HTTP/1.1" 200 None
2026-03-30 10:54:51 [auto1.de] INFO: Saving data for KX28982: {'auction_closing_time': 1774969322.0, 'created_time': 1774263553.560086, 'last_price_update_time': 1774868091.604322}
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX28982') HTTP/1.1" 204 0
2026-03-30 10:54:51 [auto1.de] INFO: Found listing with ID: XM74841
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM74841%27 HTTP/1.1" 200 None
2026-03-30 10:54:51 [auto1.de] INFO: Scrape type for XM74841: 2
2026-03-30 10:54:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a44da93f-7cd4-5b07-bbaa-a15a3e2fbc70 with identifier: XM74841
2026-03-30 10:54:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a44da93f-7cd4-5b07-bbaa-a15a3e2fbc70 with scrape type 2
2026-03-30 10:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a44da93f-7cd4-5b07-bbaa-a15a3e2fbc70 with scrape type 2
2026-03-30 10:54:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a44da93f-7cd4-5b07-bbaa-a15a3e2fbc70, identifier: XM74841
2026-03-30 10:54:51 [auto1.de] INFO: Found listing with ID: ZC73277
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC73277%27 HTTP/1.1" 200 None
2026-03-30 10:54:51 [auto1.de] INFO: Scrape type for ZC73277: 2
2026-03-30 10:54:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce8b4eae-3241-55b2-b062-0f44af5f81c1 with identifier: ZC73277
2026-03-30 10:54:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce8b4eae-3241-55b2-b062-0f44af5f81c1 with scrape type 2
2026-03-30 10:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce8b4eae-3241-55b2-b062-0f44af5f81c1 with scrape type 2
2026-03-30 10:54:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce8b4eae-3241-55b2-b062-0f44af5f81c1, identifier: ZC73277
2026-03-30 10:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a44da93f-7cd4-5b07-bbaa-a15a3e2fbc70 with identifier: XM74841
2026-03-30 10:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a44da93f-7cd4-5b07-bbaa-a15a3e2fbc70 with identifier: XM74841
2026-03-30 10:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a44da93f-7cd4-5b07-bbaa-a15a3e2fbc70 with identifier: XM74841 to the API
2026-03-30 10:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-31T15:00:39Z',
 'fuel_type': 'petrol',
 'id': 'a44da93f-7cd4-5b07-bbaa-a15a3e2fbc70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM74841',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 122511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-07',
 'seller_name': None,
 'title': 'BMW 1er 120i Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2021}
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM74841%27 HTTP/1.1" 200 None
2026-03-30 10:54:52 [auto1.de] INFO: Saving data for XM74841: {'auction_closing_time': 1774969239.0, 'created_time': 1773307614.839253, 'last_price_update_time': 1774868092.227883}
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM74841') HTTP/1.1" 204 0
2026-03-30 10:54:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce8b4eae-3241-55b2-b062-0f44af5f81c1 with identifier: ZC73277
2026-03-30 10:54:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce8b4eae-3241-55b2-b062-0f44af5f81c1 with identifier: ZC73277
2026-03-30 10:54:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce8b4eae-3241-55b2-b062-0f44af5f81c1 with identifier: ZC73277 to the API
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:33:37Z',
 'fuel_type': 'petrol',
 'id': 'ce8b4eae-3241-55b2-b062-0f44af5f81c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC73277',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 262400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-29',
 'seller_name': None,
 'title': 'Jaguar E-Pace P200 S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2019}
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC73277%27 HTTP/1.1" 200 None
2026-03-30 10:54:52 [auto1.de] INFO: Saving data for ZC73277: {'auction_closing_time': 1774971217.0, 'created_time': 1774468072.288129, 'last_price_update_time': 1774868092.589765}
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC73277') HTTP/1.1" 204 0
2026-03-30 10:54:52 [auto1.de] INFO: Found listing with ID: ZZ04091
2026-03-30 10:54:52 [auto1.de] INFO: Found listing with ID: NB36369
2026-03-30 10:54:52 [auto1.de] INFO: Found listing with ID: EW88282
2026-03-30 10:54:52 [auto1.de] INFO: Found listing with ID: WR65399
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR65399%27 HTTP/1.1" 200 None
2026-03-30 10:54:52 [auto1.de] INFO: Scrape type for WR65399: 2
2026-03-30 10:54:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0e9c7e-8d8c-5d0d-9eea-8c29e54855dd with identifier: WR65399
2026-03-30 10:54:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0e9c7e-8d8c-5d0d-9eea-8c29e54855dd with scrape type 2
2026-03-30 10:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b0e9c7e-8d8c-5d0d-9eea-8c29e54855dd with scrape type 2
2026-03-30 10:54:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b0e9c7e-8d8c-5d0d-9eea-8c29e54855dd, identifier: WR65399
2026-03-30 10:54:52 [auto1.de] INFO: Found listing with ID: HS45664
2026-03-30 10:54:52 [auto1.de] INFO: Found listing with ID: VH45097
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH45097%27 HTTP/1.1" 200 None
2026-03-30 10:54:52 [auto1.de] INFO: Scrape type for VH45097: 2
2026-03-30 10:54:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a75adba1-fa77-58ee-a54e-4559e51f06e6 with identifier: VH45097
2026-03-30 10:54:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a75adba1-fa77-58ee-a54e-4559e51f06e6 with scrape type 2
2026-03-30 10:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a75adba1-fa77-58ee-a54e-4559e51f06e6 with scrape type 2
2026-03-30 10:54:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a75adba1-fa77-58ee-a54e-4559e51f06e6, identifier: VH45097
2026-03-30 10:54:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b0e9c7e-8d8c-5d0d-9eea-8c29e54855dd with identifier: WR65399
2026-03-30 10:54:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b0e9c7e-8d8c-5d0d-9eea-8c29e54855dd with identifier: WR65399
2026-03-30 10:54:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b0e9c7e-8d8c-5d0d-9eea-8c29e54855dd with identifier: WR65399 to the API
2026-03-30 10:54:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 107,
 'expiration_date': '2026-03-31T15:48:19Z',
 'fuel_type': 'diesel',
 'id': '3b0e9c7e-8d8c-5d0d-9eea-8c29e54855dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR65399',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 250408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-09',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Laureate 4x2',
 'transmission': 'manual',
 'trim': 'Laureate 4x2',
 'year': 2011}
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR65399%27 HTTP/1.1" 200 None
2026-03-30 10:54:53 [auto1.de] INFO: Saving data for WR65399: {'auction_closing_time': 1774972099.0, 'created_time': 1774436166.609114, 'last_price_update_time': 1774868093.289892}
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR65399') HTTP/1.1" 204 0
2026-03-30 10:54:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a75adba1-fa77-58ee-a54e-4559e51f06e6 with identifier: VH45097
2026-03-30 10:54:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a75adba1-fa77-58ee-a54e-4559e51f06e6 with identifier: VH45097
2026-03-30 10:54:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a75adba1-fa77-58ee-a54e-4559e51f06e6 with identifier: VH45097 to the API
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:16:39Z',
 'fuel_type': 'petrol',
 'id': 'a75adba1-fa77-58ee-a54e-4559e51f06e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH45097',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 152852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-10',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH45097%27 HTTP/1.1" 200 None
2026-03-30 10:54:53 [auto1.de] INFO: Saving data for VH45097: {'auction_closing_time': 1774970199.0, 'created_time': 1773859956.358912, 'last_price_update_time': 1774868093.760596}
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH45097') HTTP/1.1" 204 0
2026-03-30 10:54:53 [auto1.de] INFO: Found listing with ID: UP47374
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP47374%27 HTTP/1.1" 200 None
2026-03-30 10:54:53 [auto1.de] INFO: Scrape type for UP47374: 2
2026-03-30 10:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4e841ba-520e-5ad0-9e8f-efd9878e7930 with identifier: UP47374
2026-03-30 10:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4e841ba-520e-5ad0-9e8f-efd9878e7930 with scrape type 2
2026-03-30 10:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4e841ba-520e-5ad0-9e8f-efd9878e7930 with scrape type 2
2026-03-30 10:54:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4e841ba-520e-5ad0-9e8f-efd9878e7930, identifier: UP47374
2026-03-30 10:54:53 [auto1.de] INFO: Found listing with ID: VN94649
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN94649%27 HTTP/1.1" 200 None
2026-03-30 10:54:53 [auto1.de] INFO: Scrape type for VN94649: 2
2026-03-30 10:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5ffb970-a961-5d67-bc55-4a3a2dc88650 with identifier: VN94649
2026-03-30 10:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ffb970-a961-5d67-bc55-4a3a2dc88650 with scrape type 2
2026-03-30 10:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5ffb970-a961-5d67-bc55-4a3a2dc88650 with scrape type 2
2026-03-30 10:54:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5ffb970-a961-5d67-bc55-4a3a2dc88650, identifier: VN94649
2026-03-30 10:54:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4e841ba-520e-5ad0-9e8f-efd9878e7930 with identifier: UP47374
2026-03-30 10:54:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4e841ba-520e-5ad0-9e8f-efd9878e7930 with identifier: UP47374
2026-03-30 10:54:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4e841ba-520e-5ad0-9e8f-efd9878e7930 with identifier: UP47374 to the API
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-31T15:29:34Z',
 'fuel_type': 'petrol',
 'id': 'a4e841ba-520e-5ad0-9e8f-efd9878e7930',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP47374',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 142295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-25',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2010}
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP47374%27 HTTP/1.1" 200 None
2026-03-30 10:54:54 [auto1.de] INFO: Saving data for UP47374: {'auction_closing_time': 1774970974.0, 'created_time': 1773304335.029783, 'last_price_update_time': 1774868094.293937}
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP47374') HTTP/1.1" 204 0
2026-03-30 10:54:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5ffb970-a961-5d67-bc55-4a3a2dc88650 with identifier: VN94649
2026-03-30 10:54:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5ffb970-a961-5d67-bc55-4a3a2dc88650 with identifier: VN94649
2026-03-30 10:54:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5ffb970-a961-5d67-bc55-4a3a2dc88650 with identifier: VN94649 to the API
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 354,
 'expiration_date': '2026-03-31T15:00:35Z',
 'fuel_type': 'petrol',
 'id': 'f5ffb970-a961-5d67-bc55-4a3a2dc88650',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN94649',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 101839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-07',
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN94649%27 HTTP/1.1" 200 None
2026-03-30 10:54:54 [auto1.de] INFO: Saving data for VN94649: {'auction_closing_time': 1774969235.0, 'created_time': 1773917603.517094, 'last_price_update_time': 1774868094.639911}
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN94649') HTTP/1.1" 204 0
2026-03-30 10:54:54 [auto1.de] INFO: Found listing with ID: SF02157
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF02157%27 HTTP/1.1" 200 None
2026-03-30 10:54:54 [auto1.de] INFO: Scrape type for SF02157: 2
2026-03-30 10:54:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58d9eb02-2866-5a79-9a12-7be78947f7a0 with identifier: SF02157
2026-03-30 10:54:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58d9eb02-2866-5a79-9a12-7be78947f7a0 with scrape type 2
2026-03-30 10:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58d9eb02-2866-5a79-9a12-7be78947f7a0 with scrape type 2
2026-03-30 10:54:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58d9eb02-2866-5a79-9a12-7be78947f7a0, identifier: SF02157
2026-03-30 10:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM04287/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:54 [auto1.de] INFO: Found listing with ID: CT92868
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT92868%27 HTTP/1.1" 200 None
2026-03-30 10:54:54 [auto1.de] INFO: Scrape type for CT92868: 2
2026-03-30 10:54:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b58406f-3994-50ca-afdb-0f313d4ead25 with identifier: CT92868
2026-03-30 10:54:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b58406f-3994-50ca-afdb-0f313d4ead25 with scrape type 2
2026-03-30 10:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b58406f-3994-50ca-afdb-0f313d4ead25 with scrape type 2
2026-03-30 10:54:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b58406f-3994-50ca-afdb-0f313d4ead25, identifier: CT92868
2026-03-30 10:54:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58d9eb02-2866-5a79-9a12-7be78947f7a0 with identifier: SF02157
2026-03-30 10:54:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58d9eb02-2866-5a79-9a12-7be78947f7a0 with identifier: SF02157
2026-03-30 10:54:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58d9eb02-2866-5a79-9a12-7be78947f7a0 with identifier: SF02157 to the API
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:42:48Z',
 'fuel_type': 'diesel',
 'id': '58d9eb02-2866-5a79-9a12-7be78947f7a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF02157',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 103568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-21',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2020}
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF02157%27 HTTP/1.1" 200 None
2026-03-30 10:54:55 [auto1.de] INFO: Saving data for SF02157: {'auction_closing_time': 1774971768.0, 'created_time': 1774379158.873302, 'last_price_update_time': 1774868095.258918}
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF02157') HTTP/1.1" 204 0
2026-03-30 10:54:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b58406f-3994-50ca-afdb-0f313d4ead25 with identifier: CT92868
2026-03-30 10:54:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b58406f-3994-50ca-afdb-0f313d4ead25 with identifier: CT92868
2026-03-30 10:54:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b58406f-3994-50ca-afdb-0f313d4ead25 with identifier: CT92868 to the API
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:17:21Z',
 'fuel_type': 'diesel',
 'id': '3b58406f-3994-50ca-afdb-0f313d4ead25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT92868',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 208373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-12-31',
 'seller_name': None,
 'title': 'Audi A3 1.9 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 1999}
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT92868%27 HTTP/1.1" 200 None
2026-03-30 10:54:55 [auto1.de] INFO: Saving data for CT92868: {'auction_closing_time': 1774970241.0, 'created_time': 1774638386.884413, 'last_price_update_time': 1774868095.733311}
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT92868') HTTP/1.1" 204 0
2026-03-30 10:54:55 [auto1.de] INFO: Found listing with ID: CE90734
2026-03-30 10:54:55 [auto1.de] INFO: Found listing with ID: LS17715
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS17715%27 HTTP/1.1" 200 None
2026-03-30 10:54:55 [auto1.de] INFO: Scrape type for LS17715: 2
2026-03-30 10:54:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f7e97f4-38a8-5658-beab-aad802750a90 with identifier: LS17715
2026-03-30 10:54:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f7e97f4-38a8-5658-beab-aad802750a90 with scrape type 2
2026-03-30 10:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f7e97f4-38a8-5658-beab-aad802750a90 with scrape type 2
2026-03-30 10:54:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f7e97f4-38a8-5658-beab-aad802750a90, identifier: LS17715
2026-03-30 10:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:55 [auto1.de] INFO: Found listing with ID: RB55254
2026-03-30 10:54:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f7e97f4-38a8-5658-beab-aad802750a90 with identifier: LS17715
2026-03-30 10:54:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f7e97f4-38a8-5658-beab-aad802750a90 with identifier: LS17715
2026-03-30 10:54:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f7e97f4-38a8-5658-beab-aad802750a90 with identifier: LS17715 to the API
2026-03-30 10:54:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:35:52Z',
 'fuel_type': 'petrol',
 'id': '8f7e97f4-38a8-5658-beab-aad802750a90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS17715',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 127558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-24',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS17715%27 HTTP/1.1" 200 None
2026-03-30 10:54:56 [auto1.de] INFO: Saving data for LS17715: {'auction_closing_time': 1774971352.0, 'created_time': 1773659805.278715, 'last_price_update_time': 1774868096.213038}
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS17715') HTTP/1.1" 204 0
2026-03-30 10:54:56 [auto1.de] INFO: Found listing with ID: NU16694
2026-03-30 10:54:56 [auto1.de] INFO: Found listing with ID: VM29679
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM29679%27 HTTP/1.1" 200 None
2026-03-30 10:54:56 [auto1.de] INFO: Scrape type for VM29679: 2
2026-03-30 10:54:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d9bc03e-780c-5792-9328-6300f136013b with identifier: VM29679
2026-03-30 10:54:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d9bc03e-780c-5792-9328-6300f136013b with scrape type 2
2026-03-30 10:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d9bc03e-780c-5792-9328-6300f136013b with scrape type 2
2026-03-30 10:54:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d9bc03e-780c-5792-9328-6300f136013b, identifier: VM29679
2026-03-30 10:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW68462/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:54:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d9bc03e-780c-5792-9328-6300f136013b with identifier: VM29679
2026-03-30 10:54:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d9bc03e-780c-5792-9328-6300f136013b with identifier: VM29679
2026-03-30 10:54:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d9bc03e-780c-5792-9328-6300f136013b with identifier: VM29679 to the API
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:11:55Z',
 'fuel_type': 'diesel',
 'id': '7d9bc03e-780c-5792-9328-6300f136013b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM29679',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 60301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-13',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 TDCi EcoBlue ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2022}
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM29679%27 HTTP/1.1" 200 None
2026-03-30 10:54:56 [auto1.de] INFO: Saving data for VM29679: {'auction_closing_time': 1774969915.0, 'created_time': 1772542306.651521, 'last_price_update_time': 1774868096.697622}
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM29679') HTTP/1.1" 204 0
2026-03-30 10:54:56 [auto1.de] INFO: Found listing with ID: FH51774
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH51774%27 HTTP/1.1" 200 None
2026-03-30 10:54:56 [auto1.de] INFO: Scrape type for FH51774: 2
2026-03-30 10:54:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01bd502e-9a08-5658-a6ea-eec20e03f3e6 with identifier: FH51774
2026-03-30 10:54:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01bd502e-9a08-5658-a6ea-eec20e03f3e6 with scrape type 2
2026-03-30 10:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01bd502e-9a08-5658-a6ea-eec20e03f3e6 with scrape type 2
2026-03-30 10:54:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01bd502e-9a08-5658-a6ea-eec20e03f3e6, identifier: FH51774
2026-03-30 10:54:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01bd502e-9a08-5658-a6ea-eec20e03f3e6 with identifier: FH51774
2026-03-30 10:54:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01bd502e-9a08-5658-a6ea-eec20e03f3e6 with identifier: FH51774
2026-03-30 10:54:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01bd502e-9a08-5658-a6ea-eec20e03f3e6 with identifier: FH51774 to the API
2026-03-30 10:54:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:42:51Z',
 'fuel_type': 'diesel',
 'id': '01bd502e-9a08-5658-a6ea-eec20e03f3e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH51774',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 79157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-29',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 290 L2 Trend',
 'transmission': 'manual',
 'trim': '290 L2 Trend',
 'year': 2017}
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH51774%27 HTTP/1.1" 200 None
2026-03-30 10:54:57 [auto1.de] INFO: Saving data for FH51774: {'auction_closing_time': 1774971771.0, 'created_time': 1773687380.048761, 'last_price_update_time': 1774868097.213685}
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH51774') HTTP/1.1" 204 0
2026-03-30 10:54:57 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 9525 | hits on page: 40
2026-03-30 10:54:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:57 [auto1.de] INFO: Found listing with ID: KX50009
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50009%27 HTTP/1.1" 200 None
2026-03-30 10:54:57 [auto1.de] INFO: Scrape type for KX50009: 2
2026-03-30 10:54:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f22eef99-8c54-5cdd-ba8a-d197e21151b6 with identifier: KX50009
2026-03-30 10:54:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f22eef99-8c54-5cdd-ba8a-d197e21151b6 with scrape type 2
2026-03-30 10:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f22eef99-8c54-5cdd-ba8a-d197e21151b6 with scrape type 2
2026-03-30 10:54:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f22eef99-8c54-5cdd-ba8a-d197e21151b6, identifier: KX50009
2026-03-30 10:54:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f22eef99-8c54-5cdd-ba8a-d197e21151b6 with identifier: KX50009
2026-03-30 10:54:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f22eef99-8c54-5cdd-ba8a-d197e21151b6 with identifier: KX50009
2026-03-30 10:54:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f22eef99-8c54-5cdd-ba8a-d197e21151b6 with identifier: KX50009 to the API
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:13:54Z',
 'fuel_type': 'petrol',
 'id': 'f22eef99-8c54-5cdd-ba8a-d197e21151b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX50009',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 149866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-29',
 'seller_name': None,
 'title': 'BMW 1er 125i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50009%27 HTTP/1.1" 200 None
2026-03-30 10:54:57 [auto1.de] INFO: Saving data for KX50009: {'auction_closing_time': 1774970034.0, 'created_time': 1773383788.831698, 'last_price_update_time': 1774868097.697114}
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX50009') HTTP/1.1" 204 0
2026-03-30 10:54:57 [auto1.de] INFO: Found listing with ID: XB67892
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB67892%27 HTTP/1.1" 200 None
2026-03-30 10:54:57 [auto1.de] INFO: Scrape type for XB67892: 2
2026-03-30 10:54:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c338ecb-4e1d-5520-924d-fe7fcf99d126 with identifier: XB67892
2026-03-30 10:54:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c338ecb-4e1d-5520-924d-fe7fcf99d126 with scrape type 2
2026-03-30 10:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c338ecb-4e1d-5520-924d-fe7fcf99d126 with scrape type 2
2026-03-30 10:54:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c338ecb-4e1d-5520-924d-fe7fcf99d126, identifier: XB67892
2026-03-30 10:54:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:57 [auto1.de] INFO: Found listing with ID: SJ22549
2026-03-30 10:54:57 [auto1.de] INFO: Found listing with ID: AZ58179
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ58179%27 HTTP/1.1" 200 None
2026-03-30 10:54:57 [auto1.de] INFO: Scrape type for AZ58179: 2
2026-03-30 10:54:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 651c600e-c7eb-5e62-8cd0-dee7ea664438 with identifier: AZ58179
2026-03-30 10:54:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 651c600e-c7eb-5e62-8cd0-dee7ea664438 with scrape type 2
2026-03-30 10:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 651c600e-c7eb-5e62-8cd0-dee7ea664438 with scrape type 2
2026-03-30 10:54:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 651c600e-c7eb-5e62-8cd0-dee7ea664438, identifier: AZ58179
2026-03-30 10:54:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c338ecb-4e1d-5520-924d-fe7fcf99d126 with identifier: XB67892
2026-03-30 10:54:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c338ecb-4e1d-5520-924d-fe7fcf99d126 with identifier: XB67892
2026-03-30 10:54:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c338ecb-4e1d-5520-924d-fe7fcf99d126 with identifier: XB67892 to the API
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-31T15:36:01Z',
 'fuel_type': 'petrol',
 'id': '2c338ecb-4e1d-5520-924d-fe7fcf99d126',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB67892',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 101876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-05',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 Travel',
 'transmission': 'automatic',
 'trim': 'Travel',
 'year': 2012}
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB67892%27 HTTP/1.1" 200 None
2026-03-30 10:54:58 [auto1.de] INFO: Saving data for XB67892: {'auction_closing_time': 1774971361.0, 'created_time': 1773772833.791404, 'last_price_update_time': 1774868098.389301}
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB67892') HTTP/1.1" 204 0
2026-03-30 10:54:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 651c600e-c7eb-5e62-8cd0-dee7ea664438 with identifier: AZ58179
2026-03-30 10:54:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 651c600e-c7eb-5e62-8cd0-dee7ea664438 with identifier: AZ58179
2026-03-30 10:54:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 651c600e-c7eb-5e62-8cd0-dee7ea664438 with identifier: AZ58179 to the API
2026-03-30 10:54:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-31T15:17:45Z',
 'fuel_type': 'petrol',
 'id': '651c600e-c7eb-5e62-8cd0-dee7ea664438',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ58179',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 25861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-06',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid GT-Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT-Line 4WD',
 'year': 2023}
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ58179%27 HTTP/1.1" 200 None
2026-03-30 10:54:59 [auto1.de] INFO: Saving data for AZ58179: {'auction_closing_time': 1774970265.0, 'created_time': 1774424133.375011, 'last_price_update_time': 1774868099.179192}
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ58179') HTTP/1.1" 204 0
2026-03-30 10:54:59 [auto1.de] INFO: Found listing with ID: DS57993
2026-03-30 10:54:59 [auto1.de] INFO: Found listing with ID: CL91899
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL91899%27 HTTP/1.1" 200 None
2026-03-30 10:54:59 [auto1.de] INFO: Scrape type for CL91899: 2
2026-03-30 10:54:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 581c613a-55e7-5d47-9b6a-53cbcc6f038e with identifier: CL91899
2026-03-30 10:54:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 581c613a-55e7-5d47-9b6a-53cbcc6f038e with scrape type 2
2026-03-30 10:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 581c613a-55e7-5d47-9b6a-53cbcc6f038e with scrape type 2
2026-03-30 10:54:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 581c613a-55e7-5d47-9b6a-53cbcc6f038e, identifier: CL91899
2026-03-30 10:54:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:54:59 [auto1.de] INFO: Found listing with ID: RE35722
2026-03-30 10:54:59 [auto1.de] INFO: Found listing with ID: FY00951
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY00951%27 HTTP/1.1" 200 None
2026-03-30 10:54:59 [auto1.de] INFO: Scrape type for FY00951: 2
2026-03-30 10:54:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab6d33dc-0438-5573-87a3-04103c88f324 with identifier: FY00951
2026-03-30 10:54:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab6d33dc-0438-5573-87a3-04103c88f324 with scrape type 2
2026-03-30 10:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab6d33dc-0438-5573-87a3-04103c88f324 with scrape type 2
2026-03-30 10:54:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab6d33dc-0438-5573-87a3-04103c88f324, identifier: FY00951
2026-03-30 10:54:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 581c613a-55e7-5d47-9b6a-53cbcc6f038e with identifier: CL91899
2026-03-30 10:54:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 581c613a-55e7-5d47-9b6a-53cbcc6f038e with identifier: CL91899
2026-03-30 10:54:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 581c613a-55e7-5d47-9b6a-53cbcc6f038e with identifier: CL91899 to the API
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:54:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-31T15:09:46Z',
 'fuel_type': 'petrol',
 'id': '581c613a-55e7-5d47-9b6a-53cbcc6f038e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL91899',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 154342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-25',
 'seller_name': None,
 'title': 'Mazda 5 2.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL91899%27 HTTP/1.1" 200 None
2026-03-30 10:54:59 [auto1.de] INFO: Saving data for CL91899: {'auction_closing_time': 1774969786.0, 'created_time': 1774349264.239586, 'last_price_update_time': 1774868099.790981}
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL91899') HTTP/1.1" 204 0
2026-03-30 10:54:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab6d33dc-0438-5573-87a3-04103c88f324 with identifier: FY00951
2026-03-30 10:54:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab6d33dc-0438-5573-87a3-04103c88f324 with identifier: FY00951
2026-03-30 10:54:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab6d33dc-0438-5573-87a3-04103c88f324 with identifier: FY00951 to the API
2026-03-30 10:54:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:17:48Z',
 'fuel_type': 'diesel',
 'id': 'ab6d33dc-0438-5573-87a3-04103c88f324',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY00951',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 193146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-06',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY00951%27 HTTP/1.1" 200 None
2026-03-30 10:55:00 [auto1.de] INFO: Saving data for FY00951: {'auction_closing_time': 1774970268.0, 'created_time': 1773946690.804496, 'last_price_update_time': 1774868100.245977}
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY00951') HTTP/1.1" 204 0
2026-03-30 10:55:00 [auto1.de] INFO: Found listing with ID: JB49732
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB49732%27 HTTP/1.1" 200 None
2026-03-30 10:55:00 [auto1.de] INFO: Scrape type for JB49732: 2
2026-03-30 10:55:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82a057a1-4352-517b-bc1f-b8099b10ae6e with identifier: JB49732
2026-03-30 10:55:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a057a1-4352-517b-bc1f-b8099b10ae6e with scrape type 2
2026-03-30 10:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82a057a1-4352-517b-bc1f-b8099b10ae6e with scrape type 2
2026-03-30 10:55:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82a057a1-4352-517b-bc1f-b8099b10ae6e, identifier: JB49732
2026-03-30 10:55:00 [auto1.de] INFO: Found listing with ID: MS56284
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS56284%27 HTTP/1.1" 200 None
2026-03-30 10:55:00 [auto1.de] INFO: Scrape type for MS56284: 2
2026-03-30 10:55:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b6a116d-285c-59fe-9a2f-677fc7b790f0 with identifier: MS56284
2026-03-30 10:55:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b6a116d-285c-59fe-9a2f-677fc7b790f0 with scrape type 2
2026-03-30 10:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b6a116d-285c-59fe-9a2f-677fc7b790f0 with scrape type 2
2026-03-30 10:55:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b6a116d-285c-59fe-9a2f-677fc7b790f0, identifier: MS56284
2026-03-30 10:55:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82a057a1-4352-517b-bc1f-b8099b10ae6e with identifier: JB49732
2026-03-30 10:55:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82a057a1-4352-517b-bc1f-b8099b10ae6e with identifier: JB49732
2026-03-30 10:55:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82a057a1-4352-517b-bc1f-b8099b10ae6e with identifier: JB49732 to the API
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:20:43Z',
 'fuel_type': 'diesel',
 'id': '82a057a1-4352-517b-bc1f-b8099b10ae6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB49732',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Espace',
 'odometer': 293337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-19',
 'seller_name': None,
 'title': 'Renault Grand Espace 2.0 dCi Espace Tech Run',
 'transmission': 'manual',
 'trim': 'Espace Tech Run',
 'year': 2007}
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB49732%27 HTTP/1.1" 200 None
2026-03-30 10:55:00 [auto1.de] INFO: Saving data for JB49732: {'auction_closing_time': 1774970443.0, 'created_time': 1773775260.280429, 'last_price_update_time': 1774868100.889507}
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB49732') HTTP/1.1" 204 0
2026-03-30 10:55:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b6a116d-285c-59fe-9a2f-677fc7b790f0 with identifier: MS56284
2026-03-30 10:55:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b6a116d-285c-59fe-9a2f-677fc7b790f0 with identifier: MS56284
2026-03-30 10:55:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b6a116d-285c-59fe-9a2f-677fc7b790f0 with identifier: MS56284 to the API
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:49:40Z',
 'fuel_type': 'petrol',
 'id': '4b6a116d-285c-59fe-9a2f-677fc7b790f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS56284',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 78565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-07',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Basic',
 'transmission': 'manual',
 'trim': 'Basic',
 'year': 2018}
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS56284%27 HTTP/1.1" 200 None
2026-03-30 10:55:01 [auto1.de] INFO: Saving data for MS56284: {'auction_closing_time': 1774972180.0, 'created_time': 1773946305.481714, 'last_price_update_time': 1774868101.26649}
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS56284') HTTP/1.1" 204 0
2026-03-30 10:55:01 [auto1.de] INFO: Found listing with ID: XV41644
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV41644%27 HTTP/1.1" 200 None
2026-03-30 10:55:01 [auto1.de] INFO: Scrape type for XV41644: 2
2026-03-30 10:55:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0872717-8e69-5c10-8e78-a0b25fae1dce with identifier: XV41644
2026-03-30 10:55:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0872717-8e69-5c10-8e78-a0b25fae1dce with scrape type 2
2026-03-30 10:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0872717-8e69-5c10-8e78-a0b25fae1dce with scrape type 2
2026-03-30 10:55:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0872717-8e69-5c10-8e78-a0b25fae1dce, identifier: XV41644
2026-03-30 10:55:01 [auto1.de] INFO: Found listing with ID: GZ67786
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ67786%27 HTTP/1.1" 200 None
2026-03-30 10:55:01 [auto1.de] INFO: Scrape type for GZ67786: 0
2026-03-30 10:55:01 [auto1.de] INFO: Found listing with ID: LU25444
2026-03-30 10:55:01 [auto1.de] INFO: Found listing with ID: GS24649
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS24649%27 HTTP/1.1" 200 None
2026-03-30 10:55:01 [auto1.de] INFO: Scrape type for GS24649: 2
2026-03-30 10:55:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e550522-e74d-5a53-91cd-d189f6df14ed with identifier: GS24649
2026-03-30 10:55:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e550522-e74d-5a53-91cd-d189f6df14ed with scrape type 2
2026-03-30 10:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e550522-e74d-5a53-91cd-d189f6df14ed with scrape type 2
2026-03-30 10:55:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e550522-e74d-5a53-91cd-d189f6df14ed, identifier: GS24649
2026-03-30 10:55:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0872717-8e69-5c10-8e78-a0b25fae1dce with identifier: XV41644
2026-03-30 10:55:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0872717-8e69-5c10-8e78-a0b25fae1dce with identifier: XV41644
2026-03-30 10:55:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0872717-8e69-5c10-8e78-a0b25fae1dce with identifier: XV41644 to the API
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:07:24Z',
 'fuel_type': 'petrol',
 'id': 'f0872717-8e69-5c10-8e78-a0b25fae1dce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV41644',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 102034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-22',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2016}
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV41644%27 HTTP/1.1" 200 None
2026-03-30 10:55:01 [auto1.de] INFO: Saving data for XV41644: {'auction_closing_time': 1774969644.0, 'created_time': 1773304573.466542, 'last_price_update_time': 1774868101.853501}
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV41644') HTTP/1.1" 204 0
2026-03-30 10:55:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e550522-e74d-5a53-91cd-d189f6df14ed with identifier: GS24649
2026-03-30 10:55:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e550522-e74d-5a53-91cd-d189f6df14ed with identifier: GS24649
2026-03-30 10:55:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e550522-e74d-5a53-91cd-d189f6df14ed with identifier: GS24649 to the API
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:31:15Z',
 'fuel_type': 'petrol',
 'id': '0e550522-e74d-5a53-91cd-d189f6df14ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS24649',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 94321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI Performance BlueMotion',
 'year': 2019}
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS24649%27 HTTP/1.1" 200 None
2026-03-30 10:55:02 [auto1.de] INFO: Saving data for GS24649: {'auction_closing_time': 1774971075.0, 'created_time': 1774463727.66799, 'last_price_update_time': 1774868102.863388}
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS24649') HTTP/1.1" 204 0
2026-03-30 10:55:02 [auto1.de] INFO: Found listing with ID: VB04886
2026-03-30 10:55:02 [auto1.de] INFO: Found listing with ID: YB47144
2026-03-30 10:55:02 [auto1.de] INFO: Found listing with ID: FD89008
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD89008%27 HTTP/1.1" 200 None
2026-03-30 10:55:02 [auto1.de] INFO: Scrape type for FD89008: 1
2026-03-30 10:55:02 [auto1.de] INFO: Found listing with ID: TX62945
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX62945%27 HTTP/1.1" 200 None
2026-03-30 10:55:02 [auto1.de] INFO: Scrape type for TX62945: 2
2026-03-30 10:55:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74876138-57aa-5bf0-9ff0-cbc325111bf6 with identifier: TX62945
2026-03-30 10:55:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74876138-57aa-5bf0-9ff0-cbc325111bf6 with scrape type 2
2026-03-30 10:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74876138-57aa-5bf0-9ff0-cbc325111bf6 with scrape type 2
2026-03-30 10:55:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74876138-57aa-5bf0-9ff0-cbc325111bf6, identifier: TX62945
2026-03-30 10:55:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74876138-57aa-5bf0-9ff0-cbc325111bf6 with identifier: TX62945
2026-03-30 10:55:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74876138-57aa-5bf0-9ff0-cbc325111bf6 with identifier: TX62945
2026-03-30 10:55:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74876138-57aa-5bf0-9ff0-cbc325111bf6 with identifier: TX62945 to the API
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:14:36Z',
 'fuel_type': 'diesel',
 'id': '74876138-57aa-5bf0-9ff0-cbc325111bf6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX62945',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 97366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-07',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX62945%27 HTTP/1.1" 200 None
2026-03-30 10:55:03 [auto1.de] INFO: Saving data for TX62945: {'auction_closing_time': 1774970076.0, 'created_time': 1773688623.68375, 'last_price_update_time': 1774868103.52877}
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX62945') HTTP/1.1" 204 0
2026-03-30 10:55:03 [auto1.de] INFO: Found listing with ID: LX10413
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX10413%27 HTTP/1.1" 200 None
2026-03-30 10:55:03 [auto1.de] INFO: Scrape type for LX10413: 2
2026-03-30 10:55:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6edc8b8-9c46-55b0-b322-fa9fccf3596a with identifier: LX10413
2026-03-30 10:55:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6edc8b8-9c46-55b0-b322-fa9fccf3596a with scrape type 2
2026-03-30 10:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6edc8b8-9c46-55b0-b322-fa9fccf3596a with scrape type 2
2026-03-30 10:55:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6edc8b8-9c46-55b0-b322-fa9fccf3596a, identifier: LX10413
2026-03-30 10:55:03 [auto1.de] INFO: Found listing with ID: CS66629
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS66629%27 HTTP/1.1" 200 None
2026-03-30 10:55:03 [auto1.de] INFO: Scrape type for CS66629: 2
2026-03-30 10:55:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 737dc1ac-57ea-55fe-a8e6-6b866c3ec1a3 with identifier: CS66629
2026-03-30 10:55:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 737dc1ac-57ea-55fe-a8e6-6b866c3ec1a3 with scrape type 2
2026-03-30 10:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 737dc1ac-57ea-55fe-a8e6-6b866c3ec1a3 with scrape type 2
2026-03-30 10:55:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 737dc1ac-57ea-55fe-a8e6-6b866c3ec1a3, identifier: CS66629
2026-03-30 10:55:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6edc8b8-9c46-55b0-b322-fa9fccf3596a with identifier: LX10413
2026-03-30 10:55:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6edc8b8-9c46-55b0-b322-fa9fccf3596a with identifier: LX10413
2026-03-30 10:55:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6edc8b8-9c46-55b0-b322-fa9fccf3596a with identifier: LX10413 to the API
2026-03-30 10:55:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:08:33Z',
 'fuel_type': 'petrol',
 'id': 'e6edc8b8-9c46-55b0-b322-fa9fccf3596a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX10413',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 164588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-04-16',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 1998}
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX10413%27 HTTP/1.1" 200 None
2026-03-30 10:55:04 [auto1.de] INFO: Saving data for LX10413: {'auction_closing_time': 1774969713.0, 'created_time': 1774416950.616251, 'last_price_update_time': 1774868104.251148}
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX10413') HTTP/1.1" 204 0
2026-03-30 10:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM04287> (referer: https://www.auto1.com/v1/car-details-view/FM04287/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 737dc1ac-57ea-55fe-a8e6-6b866c3ec1a3 with identifier: CS66629
2026-03-30 10:55:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 737dc1ac-57ea-55fe-a8e6-6b866c3ec1a3 with identifier: CS66629
2026-03-30 10:55:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 737dc1ac-57ea-55fe-a8e6-6b866c3ec1a3 with identifier: CS66629 to the API
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:32:04Z',
 'fuel_type': 'diesel',
 'id': '737dc1ac-57ea-55fe-a8e6-6b866c3ec1a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS66629',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 119167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-21',
 'seller_name': None,
 'title': 'BMW 1er 120d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS66629%27 HTTP/1.1" 200 None
2026-03-30 10:55:04 [auto1.de] INFO: Saving data for CS66629: {'auction_closing_time': 1774971124.0, 'created_time': 1774434977.853717, 'last_price_update_time': 1774868104.654041}
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS66629') HTTP/1.1" 204 0
2026-03-30 10:55:04 [auto1.de] INFO: Found listing with ID: TP09714
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP09714%27 HTTP/1.1" 200 None
2026-03-30 10:55:04 [auto1.de] INFO: Scrape type for TP09714: 2
2026-03-30 10:55:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d08f8a0d-0a11-531c-bce1-3770bc6ea0bc with identifier: TP09714
2026-03-30 10:55:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d08f8a0d-0a11-531c-bce1-3770bc6ea0bc with scrape type 2
2026-03-30 10:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d08f8a0d-0a11-531c-bce1-3770bc6ea0bc with scrape type 2
2026-03-30 10:55:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d08f8a0d-0a11-531c-bce1-3770bc6ea0bc, identifier: TP09714
2026-03-30 10:55:04 [scrapy.extensions.logstats] INFO: Crawled 719 pages (at 18 pages/min), scraped 760 items (at 107 items/min)
2026-03-30 10:55:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 10:55:04 [auto1.de] INFO: Found listing with ID: WG42712
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG42712%27 HTTP/1.1" 200 None
2026-03-30 10:55:04 [auto1.de] INFO: Scrape type for WG42712: 2
2026-03-30 10:55:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 165678e5-7eb0-506f-ade9-f7718e8a3e80 with identifier: WG42712
2026-03-30 10:55:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 165678e5-7eb0-506f-ade9-f7718e8a3e80 with scrape type 2
2026-03-30 10:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 165678e5-7eb0-506f-ade9-f7718e8a3e80 with scrape type 2
2026-03-30 10:55:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 165678e5-7eb0-506f-ade9-f7718e8a3e80, identifier: WG42712
2026-03-30 10:55:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d08f8a0d-0a11-531c-bce1-3770bc6ea0bc with identifier: TP09714
2026-03-30 10:55:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d08f8a0d-0a11-531c-bce1-3770bc6ea0bc with identifier: TP09714
2026-03-30 10:55:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d08f8a0d-0a11-531c-bce1-3770bc6ea0bc with identifier: TP09714 to the API
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-31T15:55:50Z',
 'fuel_type': 'petrol',
 'id': 'd08f8a0d-0a11-531c-bce1-3770bc6ea0bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP09714',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 121004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-26',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport P400 Mild-Hybrid HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2021}
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP09714%27 HTTP/1.1" 200 None
2026-03-30 10:55:05 [auto1.de] INFO: Saving data for TP09714: {'auction_closing_time': 1774972550.0, 'created_time': 1774349138.85092, 'last_price_update_time': 1774868105.326951}
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP09714') HTTP/1.1" 204 0
2026-03-30 10:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 165678e5-7eb0-506f-ade9-f7718e8a3e80 with identifier: WG42712
2026-03-30 10:55:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 165678e5-7eb0-506f-ade9-f7718e8a3e80 with identifier: WG42712
2026-03-30 10:55:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 165678e5-7eb0-506f-ade9-f7718e8a3e80 with identifier: WG42712 to the API
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:32:10Z',
 'fuel_type': 'petrol',
 'id': '165678e5-7eb0-506f-ade9-f7718e8a3e80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG42712',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 225773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG42712%27 HTTP/1.1" 200 None
2026-03-30 10:55:05 [auto1.de] INFO: Saving data for WG42712: {'auction_closing_time': 1774971130.0, 'created_time': 1774464544.689681, 'last_price_update_time': 1774868105.643965}
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG42712') HTTP/1.1" 204 0
2026-03-30 10:55:05 [auto1.de] INFO: Found listing with ID: XM71416
2026-03-30 10:55:05 [auto1.de] INFO: Found listing with ID: NC61383
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC61383%27 HTTP/1.1" 200 None
2026-03-30 10:55:05 [auto1.de] INFO: Scrape type for NC61383: 2
2026-03-30 10:55:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6319a66-3ca6-516c-8a7f-a35a816e5580 with identifier: NC61383
2026-03-30 10:55:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6319a66-3ca6-516c-8a7f-a35a816e5580 with scrape type 2
2026-03-30 10:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6319a66-3ca6-516c-8a7f-a35a816e5580 with scrape type 2
2026-03-30 10:55:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6319a66-3ca6-516c-8a7f-a35a816e5580, identifier: NC61383
2026-03-30 10:55:05 [auto1.de] INFO: Found listing with ID: TJ01230
2026-03-30 10:55:05 [auto1.de] INFO: Found listing with ID: XK45819
2026-03-30 10:55:05 [auto1.de] INFO: Found listing with ID: VC88612
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC88612%27 HTTP/1.1" 200 None
2026-03-30 10:55:05 [auto1.de] INFO: Scrape type for VC88612: 2
2026-03-30 10:55:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87a9dc4e-e125-506f-b900-0561c0906815 with identifier: VC88612
2026-03-30 10:55:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87a9dc4e-e125-506f-b900-0561c0906815 with scrape type 2
2026-03-30 10:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87a9dc4e-e125-506f-b900-0561c0906815 with scrape type 2
2026-03-30 10:55:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87a9dc4e-e125-506f-b900-0561c0906815, identifier: VC88612
2026-03-30 10:55:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6319a66-3ca6-516c-8a7f-a35a816e5580 with identifier: NC61383
2026-03-30 10:55:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6319a66-3ca6-516c-8a7f-a35a816e5580 with identifier: NC61383
2026-03-30 10:55:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6319a66-3ca6-516c-8a7f-a35a816e5580 with identifier: NC61383 to the API
2026-03-30 10:55:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:34:33Z',
 'fuel_type': 'gas',
 'id': 'f6319a66-3ca6-516c-8a7f-a35a816e5580',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC61383',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 101214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-03',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TGI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC61383%27 HTTP/1.1" 200 None
2026-03-30 10:55:07 [auto1.de] INFO: Saving data for NC61383: {'auction_closing_time': 1774971273.0, 'created_time': 1774379136.30484, 'last_price_update_time': 1774868107.074093}
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC61383') HTTP/1.1" 204 0
2026-03-30 10:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d54f346c-bea7-5397-b8ce-812dfc25fba2 with identifier: FM04287
2026-03-30 10:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d54f346c-bea7-5397-b8ce-812dfc25fba2 with scrape type 1
2026-03-30 10:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d54f346c-bea7-5397-b8ce-812dfc25fba2
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa4%252F3aa431994c2fb79950d192db54fdfae4%252Fpa%252FFM04287_ae49274565931ff6d85575648dab4fed.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a4/3aa431994c2fb79950d192db54fdfae4/pa/FM04287_ae49274565931ff6d85575648dab4fed.jpg already downloaded
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa4%252F3aa431994c2fb79950d192db54fdfae4%252Fpa%252FFM04287_1b28090220d4b33f04527b16e1313d05.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a4/3aa431994c2fb79950d192db54fdfae4/pa/FM04287_1b28090220d4b33f04527b16e1313d05.jpg already downloaded
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa4%252F3aa431994c2fb79950d192db54fdfae4%252Fpa%252FFM04287_7600a751b7a72ad3ebdefc4116508b6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a4/3aa431994c2fb79950d192db54fdfae4/pa/FM04287_7600a751b7a72ad3ebdefc4116508b6f.jpg already downloaded
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa4%252F3aa431994c2fb79950d192db54fdfae4%252Fpa%252FFM04287_ddde87aac7648e0b814b03437c61b8f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a4/3aa431994c2fb79950d192db54fdfae4/pa/FM04287_ddde87aac7648e0b814b03437c61b8f4.jpg already downloaded
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fa4%252F3aa431994c2fb79950d192db54fdfae4%252Fpa%252FFM04287_d65580f65c4a01e7f9340a91720d8e93.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a4/3aa431994c2fb79950d192db54fdfae4/pa/FM04287_d65580f65c4a01e7f9340a91720d8e93.jpg already downloaded
2026-03-30 10:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d54f346c-bea7-5397-b8ce-812dfc25fba2, identifier: FM04287
2026-03-30 10:55:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87a9dc4e-e125-506f-b900-0561c0906815 with identifier: VC88612
2026-03-30 10:55:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87a9dc4e-e125-506f-b900-0561c0906815 with identifier: VC88612
2026-03-30 10:55:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87a9dc4e-e125-506f-b900-0561c0906815 with identifier: VC88612 to the API
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:40:15Z',
 'fuel_type': 'petrol',
 'id': '87a9dc4e-e125-506f-b900-0561c0906815',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC88612',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 66988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-29',
 'seller_name': None,
 'title': 'Mazda 2 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2007}
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC88612%27 HTTP/1.1" 200 None
2026-03-30 10:55:07 [auto1.de] INFO: Saving data for VC88612: {'auction_closing_time': 1774971615.0, 'created_time': 1774467638.298783, 'last_price_update_time': 1774868107.787556}
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC88612') HTTP/1.1" 204 0
2026-03-30 10:55:07 [auto1.de] INFO: Found listing with ID: TP41556
2026-03-30 10:55:07 [auto1.de] INFO: Found listing with ID: SM51987
2026-03-30 10:55:07 [auto1.de] INFO: Found listing with ID: SK50734
2026-03-30 10:55:07 [auto1.de] INFO: Found listing with ID: GL43025
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL43025%27 HTTP/1.1" 200 None
2026-03-30 10:55:07 [auto1.de] INFO: Scrape type for GL43025: 2
2026-03-30 10:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4dbdb00-0550-5ba7-aa89-1ec124c5f0be with identifier: GL43025
2026-03-30 10:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4dbdb00-0550-5ba7-aa89-1ec124c5f0be with scrape type 2
2026-03-30 10:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4dbdb00-0550-5ba7-aa89-1ec124c5f0be with scrape type 2
2026-03-30 10:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4dbdb00-0550-5ba7-aa89-1ec124c5f0be, identifier: GL43025
2026-03-30 10:55:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d54f346c-bea7-5397-b8ce-812dfc25fba2 with identifier: FM04287
2026-03-30 10:55:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d54f346c-bea7-5397-b8ce-812dfc25fba2 with identifier: FM04287
2026-03-30 10:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d54f346c-bea7-5397-b8ce-812dfc25fba2 with identifier: FM04287 to the API
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FM04287>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:59:18Z',
 'fuel_type': 'diesel',
 'id': 'd54f346c-bea7-5397-b8ce-812dfc25fba2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM04287',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'BMW',
 'model': '3er',
 'odometer': 252661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img3a/a4/3aa431994c2fb79950d192db54fdfae4/pa/FM04287_ae49274565931ff6d85575648dab4fed.jpg',
                'https://img-pa.auto1.com/img3a/a4/3aa431994c2fb79950d192db54fdfae4/pa/FM04287_1b28090220d4b33f04527b16e1313d05.jpg',
                'https://img-pa.auto1.com/img3a/a4/3aa431994c2fb79950d192db54fdfae4/pa/FM04287_7600a751b7a72ad3ebdefc4116508b6f.jpg',
                'https://img-pa.auto1.com/img3a/a4/3aa431994c2fb79950d192db54fdfae4/pa/FM04287_ddde87aac7648e0b814b03437c61b8f4.jpg',
                'https://img-pa.auto1.com/img3a/a4/3aa431994c2fb79950d192db54fdfae4/pa/FM04287_d65580f65c4a01e7f9340a91720d8e93.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54f346c-bea7-5397-b8ce-812dfc25fba2/d54f346c-bea7-5397-b8ce-812dfc25fba2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a4/3aa431994c2fb79950d192db54fdfae4/pa/FM04287_ae49274565931ff6d85575648dab4fed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54f346c-bea7-5397-b8ce-812dfc25fba2/d54f346c-bea7-5397-b8ce-812dfc25fba2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a4/3aa431994c2fb79950d192db54fdfae4/pa/FM04287_1b28090220d4b33f04527b16e1313d05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54f346c-bea7-5397-b8ce-812dfc25fba2/d54f346c-bea7-5397-b8ce-812dfc25fba2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a4/3aa431994c2fb79950d192db54fdfae4/pa/FM04287_7600a751b7a72ad3ebdefc4116508b6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54f346c-bea7-5397-b8ce-812dfc25fba2/d54f346c-bea7-5397-b8ce-812dfc25fba2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a4/3aa431994c2fb79950d192db54fdfae4/pa/FM04287_ddde87aac7648e0b814b03437c61b8f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54f346c-bea7-5397-b8ce-812dfc25fba2/d54f346c-bea7-5397-b8ce-812dfc25fba2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/a4/3aa431994c2fb79950d192db54fdfae4/pa/FM04287_d65580f65c4a01e7f9340a91720d8e93.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM04287%27 HTTP/1.1" 200 None
2026-03-30 10:55:08 [auto1.de] INFO: Saving data for FM04287: {'created_time': 1774868108.666311, 'last_price_update_time': 1774868108.666324, 'auction_closing_time': 1774972758.0}
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM04287') HTTP/1.1" 204 0
2026-03-30 10:55:08 [auto1.de] INFO: Found listing with ID: DF78416
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF78416%27 HTTP/1.1" 200 None
2026-03-30 10:55:08 [auto1.de] INFO: Scrape type for DF78416: 2
2026-03-30 10:55:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7e97af7-251f-5b6e-85d2-8c75c41409ec with identifier: DF78416
2026-03-30 10:55:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7e97af7-251f-5b6e-85d2-8c75c41409ec with scrape type 2
2026-03-30 10:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7e97af7-251f-5b6e-85d2-8c75c41409ec with scrape type 2
2026-03-30 10:55:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7e97af7-251f-5b6e-85d2-8c75c41409ec, identifier: DF78416
2026-03-30 10:55:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4dbdb00-0550-5ba7-aa89-1ec124c5f0be with identifier: GL43025
2026-03-30 10:55:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4dbdb00-0550-5ba7-aa89-1ec124c5f0be with identifier: GL43025
2026-03-30 10:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4dbdb00-0550-5ba7-aa89-1ec124c5f0be with identifier: GL43025 to the API
2026-03-30 10:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:10:54Z',
 'fuel_type': 'petrol',
 'id': 'c4dbdb00-0550-5ba7-aa89-1ec124c5f0be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL43025',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 203716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-23',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2016}
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL43025%27 HTTP/1.1" 200 None
2026-03-30 10:55:09 [auto1.de] INFO: Saving data for GL43025: {'auction_closing_time': 1774969854.0, 'created_time': 1773659818.710144, 'last_price_update_time': 1774868109.203656}
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL43025') HTTP/1.1" 204 0
2026-03-30 10:55:09 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 9525 | hits on page: 40
2026-03-30 10:55:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7e97af7-251f-5b6e-85d2-8c75c41409ec with identifier: DF78416
2026-03-30 10:55:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7e97af7-251f-5b6e-85d2-8c75c41409ec with identifier: DF78416
2026-03-30 10:55:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7e97af7-251f-5b6e-85d2-8c75c41409ec with identifier: DF78416 to the API
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:15:10Z',
 'fuel_type': 'petrol',
 'id': 'b7e97af7-251f-5b6e-85d2-8c75c41409ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF78416',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 158201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-19',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Black Edition',
 'transmission': 'manual',
 'trim': 'Black Edition',
 'year': 2009}
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF78416%27 HTTP/1.1" 200 None
2026-03-30 10:55:09 [auto1.de] INFO: Saving data for DF78416: {'auction_closing_time': 1774970110.0, 'created_time': 1774435813.450622, 'last_price_update_time': 1774868109.556634}
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF78416') HTTP/1.1" 204 0
2026-03-30 10:55:09 [auto1.de] INFO: Found listing with ID: HE95422
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95422%27 HTTP/1.1" 200 None
2026-03-30 10:55:09 [auto1.de] INFO: Scrape type for HE95422: 2
2026-03-30 10:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48d16cdd-fb22-53d9-a317-d95ec13750ea with identifier: HE95422
2026-03-30 10:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48d16cdd-fb22-53d9-a317-d95ec13750ea with scrape type 2
2026-03-30 10:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48d16cdd-fb22-53d9-a317-d95ec13750ea with scrape type 2
2026-03-30 10:55:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48d16cdd-fb22-53d9-a317-d95ec13750ea, identifier: HE95422
2026-03-30 10:55:09 [auto1.de] INFO: Found listing with ID: HM31508
2026-03-30 10:55:09 [auto1.de] INFO: Found listing with ID: XB67892
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB67892%27 HTTP/1.1" 200 None
2026-03-30 10:55:09 [auto1.de] INFO: Scrape type for XB67892: 0
2026-03-30 10:55:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48d16cdd-fb22-53d9-a317-d95ec13750ea with identifier: HE95422
2026-03-30 10:55:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48d16cdd-fb22-53d9-a317-d95ec13750ea with identifier: HE95422
2026-03-30 10:55:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48d16cdd-fb22-53d9-a317-d95ec13750ea with identifier: HE95422 to the API
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:52:48Z',
 'fuel_type': 'petrol',
 'id': '48d16cdd-fb22-53d9-a317-d95ec13750ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE95422',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 25730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-28',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2025}
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95422%27 HTTP/1.1" 200 None
2026-03-30 10:55:10 [auto1.de] INFO: Saving data for HE95422: {'auction_closing_time': 1774972368.0, 'created_time': 1772542907.76721, 'last_price_update_time': 1774868110.074014}
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE95422') HTTP/1.1" 204 0
2026-03-30 10:55:10 [auto1.de] INFO: Found listing with ID: BC32667
2026-03-30 10:55:10 [auto1.de] INFO: Found listing with ID: NG90783
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG90783%27 HTTP/1.1" 200 None
2026-03-30 10:55:10 [auto1.de] INFO: Scrape type for NG90783: 2
2026-03-30 10:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 460c8df5-d865-58c3-8920-c18e48a88bf9 with identifier: NG90783
2026-03-30 10:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 460c8df5-d865-58c3-8920-c18e48a88bf9 with scrape type 2
2026-03-30 10:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 460c8df5-d865-58c3-8920-c18e48a88bf9 with scrape type 2
2026-03-30 10:55:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 460c8df5-d865-58c3-8920-c18e48a88bf9, identifier: NG90783
2026-03-30 10:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW68462> (referer: https://www.auto1.com/v1/car-details-view/CW68462/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:10 [auto1.de] INFO: Found listing with ID: SC29196
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC29196%27 HTTP/1.1" 200 None
2026-03-30 10:55:10 [auto1.de] INFO: Scrape type for SC29196: 2
2026-03-30 10:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e0ee037-1639-541e-9d7e-90371c3c736b with identifier: SC29196
2026-03-30 10:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e0ee037-1639-541e-9d7e-90371c3c736b with scrape type 2
2026-03-30 10:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e0ee037-1639-541e-9d7e-90371c3c736b with scrape type 2
2026-03-30 10:55:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e0ee037-1639-541e-9d7e-90371c3c736b, identifier: SC29196
2026-03-30 10:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 460c8df5-d865-58c3-8920-c18e48a88bf9 with identifier: NG90783
2026-03-30 10:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 460c8df5-d865-58c3-8920-c18e48a88bf9 with identifier: NG90783
2026-03-30 10:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 460c8df5-d865-58c3-8920-c18e48a88bf9 with identifier: NG90783 to the API
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-31T15:06:20Z',
 'fuel_type': 'petrol',
 'id': '460c8df5-d865-58c3-8920-c18e48a88bf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG90783',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 147988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-25',
 'seller_name': None,
 'title': 'Seat Ibiza 1.8 TSI Cupra',
 'transmission': 'manual',
 'trim': 'Cupra',
 'year': 2017}
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG90783%27 HTTP/1.1" 200 None
2026-03-30 10:55:10 [auto1.de] INFO: Saving data for NG90783: {'auction_closing_time': 1774969580.0, 'created_time': 1773772540.912598, 'last_price_update_time': 1774868110.649923}
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG90783') HTTP/1.1" 204 0
2026-03-30 10:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e0ee037-1639-541e-9d7e-90371c3c736b with identifier: SC29196
2026-03-30 10:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e0ee037-1639-541e-9d7e-90371c3c736b with identifier: SC29196
2026-03-30 10:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e0ee037-1639-541e-9d7e-90371c3c736b with identifier: SC29196 to the API
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:09:12Z',
 'fuel_type': 'petrol',
 'id': '7e0ee037-1639-541e-9d7e-90371c3c736b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC29196',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 94609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-16',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2016}
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC29196%27 HTTP/1.1" 200 None
2026-03-30 10:55:11 [auto1.de] INFO: Saving data for SC29196: {'auction_closing_time': 1774969752.0, 'created_time': 1773381479.736555, 'last_price_update_time': 1774868111.096777}
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC29196') HTTP/1.1" 204 0
2026-03-30 10:55:11 [auto1.de] INFO: Found listing with ID: ZY01103
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY01103%27 HTTP/1.1" 200 None
2026-03-30 10:55:11 [auto1.de] INFO: Scrape type for ZY01103: 2
2026-03-30 10:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c146ce6e-5ce7-5540-8105-06deac8653d9 with identifier: ZY01103
2026-03-30 10:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c146ce6e-5ce7-5540-8105-06deac8653d9 with scrape type 2
2026-03-30 10:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c146ce6e-5ce7-5540-8105-06deac8653d9 with scrape type 2
2026-03-30 10:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c146ce6e-5ce7-5540-8105-06deac8653d9, identifier: ZY01103
2026-03-30 10:55:11 [auto1.de] INFO: Found listing with ID: VF94022
2026-03-30 10:55:11 [auto1.de] INFO: Found listing with ID: AC06090
2026-03-30 10:55:11 [auto1.de] INFO: Found listing with ID: JE79565
2026-03-30 10:55:11 [auto1.de] INFO: Found listing with ID: TU19465
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU19465%27 HTTP/1.1" 200 None
2026-03-30 10:55:11 [auto1.de] INFO: Scrape type for TU19465: 1
2026-03-30 10:55:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c146ce6e-5ce7-5540-8105-06deac8653d9 with identifier: ZY01103
2026-03-30 10:55:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c146ce6e-5ce7-5540-8105-06deac8653d9 with identifier: ZY01103
2026-03-30 10:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c146ce6e-5ce7-5540-8105-06deac8653d9 with identifier: ZY01103 to the API
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:49:54Z',
 'fuel_type': 'petrol',
 'id': 'c146ce6e-5ce7-5540-8105-06deac8653d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY01103',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 229235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-05',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2011}
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY01103%27 HTTP/1.1" 200 None
2026-03-30 10:55:11 [auto1.de] INFO: Saving data for ZY01103: {'auction_closing_time': 1774972194.0, 'created_time': 1774380651.510591, 'last_price_update_time': 1774868111.594569}
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY01103') HTTP/1.1" 204 0
2026-03-30 10:55:11 [auto1.de] INFO: Found listing with ID: PT35689
2026-03-30 10:55:11 [auto1.de] INFO: Found listing with ID: TY67265
2026-03-30 10:55:11 [auto1.de] INFO: Found listing with ID: TC30897
2026-03-30 10:55:11 [auto1.de] INFO: Found listing with ID: XU08667
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU08667%27 HTTP/1.1" 200 None
2026-03-30 10:55:11 [auto1.de] INFO: Scrape type for XU08667: 2
2026-03-30 10:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86056b78-2174-5385-bf9b-9e10dc16f858 with identifier: XU08667
2026-03-30 10:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86056b78-2174-5385-bf9b-9e10dc16f858 with scrape type 2
2026-03-30 10:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86056b78-2174-5385-bf9b-9e10dc16f858 with scrape type 2
2026-03-30 10:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86056b78-2174-5385-bf9b-9e10dc16f858, identifier: XU08667
2026-03-30 10:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD89008/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:11 [auto1.de] INFO: Found listing with ID: ZA98162
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA98162%27 HTTP/1.1" 200 None
2026-03-30 10:55:11 [auto1.de] INFO: Scrape type for ZA98162: 2
2026-03-30 10:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1086bef-9338-5ca5-99fb-0f32f058a116 with identifier: ZA98162
2026-03-30 10:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1086bef-9338-5ca5-99fb-0f32f058a116 with scrape type 2
2026-03-30 10:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1086bef-9338-5ca5-99fb-0f32f058a116 with scrape type 2
2026-03-30 10:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1086bef-9338-5ca5-99fb-0f32f058a116, identifier: ZA98162
2026-03-30 10:55:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86056b78-2174-5385-bf9b-9e10dc16f858 with identifier: XU08667
2026-03-30 10:55:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86056b78-2174-5385-bf9b-9e10dc16f858 with identifier: XU08667
2026-03-30 10:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86056b78-2174-5385-bf9b-9e10dc16f858 with identifier: XU08667 to the API
2026-03-30 10:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:27:48Z',
 'fuel_type': 'diesel',
 'id': '86056b78-2174-5385-bf9b-9e10dc16f858',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU08667',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 55575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-15',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2018}
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU08667%27 HTTP/1.1" 200 None
2026-03-30 10:55:12 [auto1.de] INFO: Saving data for XU08667: {'auction_closing_time': 1774970868.0, 'created_time': 1773688921.760244, 'last_price_update_time': 1774868112.575389}
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU08667') HTTP/1.1" 204 0
2026-03-30 10:55:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e2964aa-964a-5700-a776-94c83ebc0320 with identifier: CW68462
2026-03-30 10:55:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e2964aa-964a-5700-a776-94c83ebc0320 with scrape type 1
2026-03-30 10:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e2964aa-964a-5700-a776-94c83ebc0320
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_6a0d0dcc8fc967bdf7b1e9577beff2f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_6a0d0dcc8fc967bdf7b1e9577beff2f5.jpg not downloaded yet
2026-03-30 10:55:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1086bef-9338-5ca5-99fb-0f32f058a116 with identifier: ZA98162
2026-03-30 10:55:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1086bef-9338-5ca5-99fb-0f32f058a116 with identifier: ZA98162
2026-03-30 10:55:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1086bef-9338-5ca5-99fb-0f32f058a116 with identifier: ZA98162 to the API
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 457,
 'expiration_date': '2026-03-31T15:01:02Z',
 'fuel_type': 'petrol',
 'id': 'b1086bef-9338-5ca5-99fb-0f32f058a116',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA98162',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 129434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-16',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 500 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA98162%27 HTTP/1.1" 200 None
2026-03-30 10:55:12 [auto1.de] INFO: Saving data for ZA98162: {'auction_closing_time': 1774969262.0, 'created_time': 1773688936.292979, 'last_price_update_time': 1774868112.986801}
2026-03-30 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA98162') HTTP/1.1" 204 0
2026-03-30 10:55:13 [auto1.de] INFO: Found listing with ID: UL26956
2026-03-30 10:55:13 [auto1.de] INFO: Found listing with ID: GV55146
2026-03-30 10:55:13 [auto1.de] INFO: Found listing with ID: CB64325
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB64325%27 HTTP/1.1" 200 None
2026-03-30 10:55:13 [auto1.de] INFO: Scrape type for CB64325: 2
2026-03-30 10:55:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 601f1dff-7234-5ccf-b5b5-46a698e19595 with identifier: CB64325
2026-03-30 10:55:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 601f1dff-7234-5ccf-b5b5-46a698e19595 with scrape type 2
2026-03-30 10:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 601f1dff-7234-5ccf-b5b5-46a698e19595 with scrape type 2
2026-03-30 10:55:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 601f1dff-7234-5ccf-b5b5-46a698e19595, identifier: CB64325
2026-03-30 10:55:13 [auto1.de] INFO: Found listing with ID: EX51640
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX51640%27 HTTP/1.1" 200 None
2026-03-30 10:55:13 [auto1.de] INFO: Scrape type for EX51640: 2
2026-03-30 10:55:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d1a3793-e724-5d64-8c61-d56aa726ad09 with identifier: EX51640
2026-03-30 10:55:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d1a3793-e724-5d64-8c61-d56aa726ad09 with scrape type 2
2026-03-30 10:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d1a3793-e724-5d64-8c61-d56aa726ad09 with scrape type 2
2026-03-30 10:55:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d1a3793-e724-5d64-8c61-d56aa726ad09, identifier: EX51640
2026-03-30 10:55:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 601f1dff-7234-5ccf-b5b5-46a698e19595 with identifier: CB64325
2026-03-30 10:55:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 601f1dff-7234-5ccf-b5b5-46a698e19595 with identifier: CB64325
2026-03-30 10:55:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 601f1dff-7234-5ccf-b5b5-46a698e19595 with identifier: CB64325 to the API
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-31T15:48:18Z',
 'fuel_type': 'diesel',
 'id': '601f1dff-7234-5ccf-b5b5-46a698e19595',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB64325',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 98206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Raptor',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Raptor',
 'year': 2020}
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB64325%27 HTTP/1.1" 200 None
2026-03-30 10:55:13 [auto1.de] INFO: Saving data for CB64325: {'auction_closing_time': 1774972098.0, 'created_time': 1773466535.903404, 'last_price_update_time': 1774868113.954208}
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB64325') HTTP/1.1" 204 0
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_7d816cfacb4cc488fade70a3fef2e0fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_7d816cfacb4cc488fade70a3fef2e0fc.jpg not downloaded yet
2026-03-30 10:55:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d1a3793-e724-5d64-8c61-d56aa726ad09 with identifier: EX51640
2026-03-30 10:55:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d1a3793-e724-5d64-8c61-d56aa726ad09 with identifier: EX51640
2026-03-30 10:55:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d1a3793-e724-5d64-8c61-d56aa726ad09 with identifier: EX51640 to the API
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:24:31Z',
 'fuel_type': 'diesel',
 'id': '6d1a3793-e724-5d64-8c61-d56aa726ad09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX51640',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 207328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-06',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2016}
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX51640%27 HTTP/1.1" 200 None
2026-03-30 10:55:14 [auto1.de] INFO: Saving data for EX51640: {'auction_closing_time': 1774970671.0, 'created_time': 1772545288.092751, 'last_price_update_time': 1774868114.469349}
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX51640') HTTP/1.1" 204 0
2026-03-30 10:55:14 [auto1.de] INFO: Found listing with ID: KM55226
2026-03-30 10:55:14 [auto1.de] INFO: Found listing with ID: PL31001
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL31001%27 HTTP/1.1" 200 None
2026-03-30 10:55:14 [auto1.de] INFO: Scrape type for PL31001: 2
2026-03-30 10:55:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c43bbe31-1813-5c38-94ee-74c2c6c57d78 with identifier: PL31001
2026-03-30 10:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c43bbe31-1813-5c38-94ee-74c2c6c57d78 with scrape type 2
2026-03-30 10:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c43bbe31-1813-5c38-94ee-74c2c6c57d78 with scrape type 2
2026-03-30 10:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c43bbe31-1813-5c38-94ee-74c2c6c57d78, identifier: PL31001
2026-03-30 10:55:14 [auto1.de] INFO: Found listing with ID: CW40346
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW40346%27 HTTP/1.1" 200 None
2026-03-30 10:55:14 [auto1.de] INFO: Scrape type for CW40346: 2
2026-03-30 10:55:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60c741dd-ca7e-582a-ad5d-3ed3ce77a194 with identifier: CW40346
2026-03-30 10:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60c741dd-ca7e-582a-ad5d-3ed3ce77a194 with scrape type 2
2026-03-30 10:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60c741dd-ca7e-582a-ad5d-3ed3ce77a194 with scrape type 2
2026-03-30 10:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60c741dd-ca7e-582a-ad5d-3ed3ce77a194, identifier: CW40346
2026-03-30 10:55:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c43bbe31-1813-5c38-94ee-74c2c6c57d78 with identifier: PL31001
2026-03-30 10:55:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c43bbe31-1813-5c38-94ee-74c2c6c57d78 with identifier: PL31001
2026-03-30 10:55:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c43bbe31-1813-5c38-94ee-74c2c6c57d78 with identifier: PL31001 to the API
2026-03-30 10:55:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:21:00Z',
 'fuel_type': 'petrol',
 'id': 'c43bbe31-1813-5c38-94ee-74c2c6c57d78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL31001',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 41392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-25',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 MyLive',
 'transmission': 'manual',
 'trim': 'MyLive',
 'year': 2011}
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL31001%27 HTTP/1.1" 200 None
2026-03-30 10:55:15 [auto1.de] INFO: Saving data for PL31001: {'auction_closing_time': 1774970460.0, 'created_time': 1773686156.577145, 'last_price_update_time': 1774868115.446719}
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL31001') HTTP/1.1" 204 0
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_8153275a2feafbbcc278352ea6f0869d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_8153275a2feafbbcc278352ea6f0869d.jpg not downloaded yet
2026-03-30 10:55:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60c741dd-ca7e-582a-ad5d-3ed3ce77a194 with identifier: CW40346
2026-03-30 10:55:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60c741dd-ca7e-582a-ad5d-3ed3ce77a194 with identifier: CW40346
2026-03-30 10:55:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60c741dd-ca7e-582a-ad5d-3ed3ce77a194 with identifier: CW40346 to the API
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:11:14Z',
 'fuel_type': 'hybrid',
 'id': '60c741dd-ca7e-582a-ad5d-3ed3ce77a194',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW40346',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 58619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-29',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID Priority',
 'transmission': 'automatic',
 'trim': 'Priority',
 'year': 2021}
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW40346%27 HTTP/1.1" 200 None
2026-03-30 10:55:15 [auto1.de] INFO: Saving data for CW40346: {'auction_closing_time': 1774969874.0, 'created_time': 1773400987.852639, 'last_price_update_time': 1774868115.850208}
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW40346') HTTP/1.1" 204 0
2026-03-30 10:55:15 [auto1.de] INFO: Found listing with ID: YX79581
2026-03-30 10:55:15 [auto1.de] INFO: Found listing with ID: HU81893
2026-03-30 10:55:15 [auto1.de] INFO: Found listing with ID: AU78717
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU78717%27 HTTP/1.1" 200 None
2026-03-30 10:55:15 [auto1.de] INFO: Scrape type for AU78717: 2
2026-03-30 10:55:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f42d35e-5146-5da8-bae3-cd947f1641e5 with identifier: AU78717
2026-03-30 10:55:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f42d35e-5146-5da8-bae3-cd947f1641e5 with scrape type 2
2026-03-30 10:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f42d35e-5146-5da8-bae3-cd947f1641e5 with scrape type 2
2026-03-30 10:55:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f42d35e-5146-5da8-bae3-cd947f1641e5, identifier: AU78717
2026-03-30 10:55:15 [auto1.de] INFO: Found listing with ID: VA69580
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA69580%27 HTTP/1.1" 200 None
2026-03-30 10:55:16 [auto1.de] INFO: Scrape type for VA69580: 2
2026-03-30 10:55:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 267d8613-6e18-5cb7-921e-c6b05d8bcd75 with identifier: VA69580
2026-03-30 10:55:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 267d8613-6e18-5cb7-921e-c6b05d8bcd75 with scrape type 2
2026-03-30 10:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 267d8613-6e18-5cb7-921e-c6b05d8bcd75 with scrape type 2
2026-03-30 10:55:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 267d8613-6e18-5cb7-921e-c6b05d8bcd75, identifier: VA69580
2026-03-30 10:55:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f42d35e-5146-5da8-bae3-cd947f1641e5 with identifier: AU78717
2026-03-30 10:55:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f42d35e-5146-5da8-bae3-cd947f1641e5 with identifier: AU78717
2026-03-30 10:55:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f42d35e-5146-5da8-bae3-cd947f1641e5 with identifier: AU78717 to the API
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-31T15:17:19Z',
 'fuel_type': 'diesel',
 'id': '1f42d35e-5146-5da8-bae3-cd947f1641e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU78717',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 186957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-22',
 'seller_name': None,
 'title': 'BMW X5 M50d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU78717%27 HTTP/1.1" 200 None
2026-03-30 10:55:16 [auto1.de] INFO: Saving data for AU78717: {'auction_closing_time': 1774970239.0, 'created_time': 1774377731.622548, 'last_price_update_time': 1774868116.913929}
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU78717') HTTP/1.1" 204 0
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_a84544bbc786338b47a5118a64d99e0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_a84544bbc786338b47a5118a64d99e0e.jpg not downloaded yet
2026-03-30 10:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_6a0d0dcc8fc967bdf7b1e9577beff2f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 267d8613-6e18-5cb7-921e-c6b05d8bcd75 with identifier: VA69580
2026-03-30 10:55:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 267d8613-6e18-5cb7-921e-c6b05d8bcd75 with identifier: VA69580
2026-03-30 10:55:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 267d8613-6e18-5cb7-921e-c6b05d8bcd75 with identifier: VA69580 to the API
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:56:15Z',
 'fuel_type': 'diesel',
 'id': '267d8613-6e18-5cb7-921e-c6b05d8bcd75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA69580',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 90966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-26',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 CDTI Kasten L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,7t',
 'year': 2017}
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA69580%27 HTTP/1.1" 200 None
2026-03-30 10:55:17 [auto1.de] INFO: Saving data for VA69580: {'auction_closing_time': 1774972575.0, 'created_time': 1773945342.863175, 'last_price_update_time': 1774868117.299762}
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA69580') HTTP/1.1" 204 0
2026-03-30 10:55:17 [auto1.de] INFO: Found listing with ID: CV04289
2026-03-30 10:55:17 [auto1.de] INFO: Found listing with ID: UY19971
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY19971%27 HTTP/1.1" 200 None
2026-03-30 10:55:17 [auto1.de] INFO: Scrape type for UY19971: 2
2026-03-30 10:55:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0839de0-5be6-53b3-ac5c-17189287ba53 with identifier: UY19971
2026-03-30 10:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0839de0-5be6-53b3-ac5c-17189287ba53 with scrape type 2
2026-03-30 10:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0839de0-5be6-53b3-ac5c-17189287ba53 with scrape type 2
2026-03-30 10:55:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0839de0-5be6-53b3-ac5c-17189287ba53, identifier: UY19971
2026-03-30 10:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:17 [auto1.de] INFO: Found listing with ID: KE44581
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE44581%27 HTTP/1.1" 200 None
2026-03-30 10:55:17 [auto1.de] INFO: Scrape type for KE44581: 2
2026-03-30 10:55:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c20ff28a-fe7d-59ad-bd61-c526b84f7ff5 with identifier: KE44581
2026-03-30 10:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c20ff28a-fe7d-59ad-bd61-c526b84f7ff5 with scrape type 2
2026-03-30 10:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c20ff28a-fe7d-59ad-bd61-c526b84f7ff5 with scrape type 2
2026-03-30 10:55:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c20ff28a-fe7d-59ad-bd61-c526b84f7ff5, identifier: KE44581
2026-03-30 10:55:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0839de0-5be6-53b3-ac5c-17189287ba53 with identifier: UY19971
2026-03-30 10:55:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0839de0-5be6-53b3-ac5c-17189287ba53 with identifier: UY19971
2026-03-30 10:55:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0839de0-5be6-53b3-ac5c-17189287ba53 with identifier: UY19971 to the API
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:12:49Z',
 'fuel_type': 'diesel',
 'id': 'd0839de0-5be6-53b3-ac5c-17189287ba53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY19971',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 134804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-29',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2014}
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY19971%27 HTTP/1.1" 200 None
2026-03-30 10:55:17 [auto1.de] INFO: Saving data for UY19971: {'auction_closing_time': 1774969969.0, 'created_time': 1773571680.244836, 'last_price_update_time': 1774868117.898325}
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY19971') HTTP/1.1" 204 0
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_8cc17d39e02379572bf57d0bfbceb5ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_8cc17d39e02379572bf57d0bfbceb5ef.jpg not downloaded yet
2026-03-30 10:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_7d816cfacb4cc488fade70a3fef2e0fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c20ff28a-fe7d-59ad-bd61-c526b84f7ff5 with identifier: KE44581
2026-03-30 10:55:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c20ff28a-fe7d-59ad-bd61-c526b84f7ff5 with identifier: KE44581
2026-03-30 10:55:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c20ff28a-fe7d-59ad-bd61-c526b84f7ff5 with identifier: KE44581 to the API
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:12:35Z',
 'fuel_type': 'diesel',
 'id': 'c20ff28a-fe7d-59ad-bd61-c526b84f7ff5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE44581',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 166717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE44581%27 HTTP/1.1" 200 None
2026-03-30 10:55:18 [auto1.de] INFO: Saving data for KE44581: {'auction_closing_time': 1774969955.0, 'created_time': 1773345592.819199, 'last_price_update_time': 1774868118.314755}
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE44581') HTTP/1.1" 204 0
2026-03-30 10:55:18 [auto1.de] INFO: Found listing with ID: ML79860
2026-03-30 10:55:18 [auto1.de] INFO: Found listing with ID: EW23969
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW23969%27 HTTP/1.1" 200 None
2026-03-30 10:55:18 [auto1.de] INFO: Scrape type for EW23969: 2
2026-03-30 10:55:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c764e0f-d184-5ee5-8a4c-63ba465fef59 with identifier: EW23969
2026-03-30 10:55:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c764e0f-d184-5ee5-8a4c-63ba465fef59 with scrape type 2
2026-03-30 10:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c764e0f-d184-5ee5-8a4c-63ba465fef59 with scrape type 2
2026-03-30 10:55:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c764e0f-d184-5ee5-8a4c-63ba465fef59, identifier: EW23969
2026-03-30 10:55:18 [auto1.de] INFO: Found listing with ID: JE17761
2026-03-30 10:55:18 [auto1.de] INFO: Found listing with ID: HS50383
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS50383%27 HTTP/1.1" 200 None
2026-03-30 10:55:18 [auto1.de] INFO: Scrape type for HS50383: 2
2026-03-30 10:55:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3949c849-05d0-53b2-aa79-033d22e5f06a with identifier: HS50383
2026-03-30 10:55:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3949c849-05d0-53b2-aa79-033d22e5f06a with scrape type 2
2026-03-30 10:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3949c849-05d0-53b2-aa79-033d22e5f06a with scrape type 2
2026-03-30 10:55:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3949c849-05d0-53b2-aa79-033d22e5f06a, identifier: HS50383
2026-03-30 10:55:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c764e0f-d184-5ee5-8a4c-63ba465fef59 with identifier: EW23969
2026-03-30 10:55:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c764e0f-d184-5ee5-8a4c-63ba465fef59 with identifier: EW23969
2026-03-30 10:55:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c764e0f-d184-5ee5-8a4c-63ba465fef59 with identifier: EW23969 to the API
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:59:18Z',
 'fuel_type': 'petrol',
 'id': '0c764e0f-d184-5ee5-8a4c-63ba465fef59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW23969',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 117767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-16',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW23969%27 HTTP/1.1" 200 None
2026-03-30 10:55:18 [auto1.de] INFO: Saving data for EW23969: {'auction_closing_time': 1774972758.0, 'created_time': 1774467717.961622, 'last_price_update_time': 1774868118.874713}
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW23969') HTTP/1.1" 204 0
2026-03-30 10:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_e633821e435f97ad167d4203cae6ee0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_e633821e435f97ad167d4203cae6ee0d.jpg not downloaded yet
2026-03-30 10:55:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3949c849-05d0-53b2-aa79-033d22e5f06a with identifier: HS50383
2026-03-30 10:55:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3949c849-05d0-53b2-aa79-033d22e5f06a with identifier: HS50383
2026-03-30 10:55:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3949c849-05d0-53b2-aa79-033d22e5f06a with identifier: HS50383 to the API
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:25:40Z',
 'fuel_type': 'petrol',
 'id': '3949c849-05d0-53b2-aa79-033d22e5f06a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS50383',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 205278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-19',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2006}
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS50383%27 HTTP/1.1" 200 None
2026-03-30 10:55:19 [auto1.de] INFO: Saving data for HS50383: {'auction_closing_time': 1774970740.0, 'created_time': 1774467511.618931, 'last_price_update_time': 1774868119.404942}
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS50383') HTTP/1.1" 204 0
2026-03-30 10:55:19 [auto1.de] INFO: Found listing with ID: PK80050
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK80050%27 HTTP/1.1" 200 None
2026-03-30 10:55:19 [auto1.de] INFO: Scrape type for PK80050: 2
2026-03-30 10:55:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94a96e53-fafc-5055-9731-d53d2993b406 with identifier: PK80050
2026-03-30 10:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94a96e53-fafc-5055-9731-d53d2993b406 with scrape type 2
2026-03-30 10:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94a96e53-fafc-5055-9731-d53d2993b406 with scrape type 2
2026-03-30 10:55:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94a96e53-fafc-5055-9731-d53d2993b406, identifier: PK80050
2026-03-30 10:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef501c550>
2026-03-30 10:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_6a0d0dcc8fc967bdf7b1e9577beff2f5.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_6a0d0dcc8fc967bdf7b1e9577beff2f5.jpg saved to cache
2026-03-30 10:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e2964aa-964a-5700-a776-94c83ebc0320
2026-03-30 10:55:19 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 9528 | hits on page: 40
2026-03-30 10:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_8153275a2feafbbcc278352ea6f0869d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:19 [auto1.de] INFO: Found listing with ID: TZ46793
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ46793%27 HTTP/1.1" 200 None
2026-03-30 10:55:19 [auto1.de] INFO: Scrape type for TZ46793: 2
2026-03-30 10:55:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 536913d0-d572-58a9-be6c-ce8ea2ce6412 with identifier: TZ46793
2026-03-30 10:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 536913d0-d572-58a9-be6c-ce8ea2ce6412 with scrape type 2
2026-03-30 10:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 536913d0-d572-58a9-be6c-ce8ea2ce6412 with scrape type 2
2026-03-30 10:55:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 536913d0-d572-58a9-be6c-ce8ea2ce6412, identifier: TZ46793
2026-03-30 10:55:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94a96e53-fafc-5055-9731-d53d2993b406 with identifier: PK80050
2026-03-30 10:55:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94a96e53-fafc-5055-9731-d53d2993b406 with identifier: PK80050
2026-03-30 10:55:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94a96e53-fafc-5055-9731-d53d2993b406 with identifier: PK80050 to the API
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-31T15:37:28Z',
 'fuel_type': 'petrol',
 'id': '94a96e53-fafc-5055-9731-d53d2993b406',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK80050',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 147942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-08',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.8 V6 Turbo OPC 4x4',
 'transmission': 'automatic',
 'trim': 'OPC 4x4',
 'year': 2011}
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK80050%27 HTTP/1.1" 200 None
2026-03-30 10:55:20 [auto1.de] INFO: Saving data for PK80050: {'auction_closing_time': 1774971448.0, 'created_time': 1773223784.416049, 'last_price_update_time': 1774868120.084361}
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK80050') HTTP/1.1" 204 0
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_c86faa0f86837d9dc0a5953df2e17ab1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_c86faa0f86837d9dc0a5953df2e17ab1.jpg not downloaded yet
2026-03-30 10:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_a84544bbc786338b47a5118a64d99e0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 536913d0-d572-58a9-be6c-ce8ea2ce6412 with identifier: TZ46793
2026-03-30 10:55:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 536913d0-d572-58a9-be6c-ce8ea2ce6412 with identifier: TZ46793
2026-03-30 10:55:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 536913d0-d572-58a9-be6c-ce8ea2ce6412 with identifier: TZ46793 to the API
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-31T15:22:42Z',
 'fuel_type': 'petrol',
 'id': '536913d0-d572-58a9-be6c-ce8ea2ce6412',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ46793',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 132936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-17',
 'seller_name': None,
 'title': 'Ford Galaxy 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2019}
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ46793%27 HTTP/1.1" 200 None
2026-03-30 10:55:20 [auto1.de] INFO: Saving data for TZ46793: {'auction_closing_time': 1774970562.0, 'created_time': 1774436822.335162, 'last_price_update_time': 1774868120.503874}
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ46793') HTTP/1.1" 204 0
2026-03-30 10:55:20 [auto1.de] INFO: Found listing with ID: EV61179
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV61179%27 HTTP/1.1" 200 None
2026-03-30 10:55:20 [auto1.de] INFO: Scrape type for EV61179: 1
2026-03-30 10:55:20 [auto1.de] INFO: Found listing with ID: JJ00785
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ00785%27 HTTP/1.1" 200 None
2026-03-30 10:55:20 [auto1.de] INFO: Scrape type for JJ00785: 2
2026-03-30 10:55:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 188ffda1-f7ca-5381-8474-3c171ab099bd with identifier: JJ00785
2026-03-30 10:55:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 188ffda1-f7ca-5381-8474-3c171ab099bd with scrape type 2
2026-03-30 10:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 188ffda1-f7ca-5381-8474-3c171ab099bd with scrape type 2
2026-03-30 10:55:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 188ffda1-f7ca-5381-8474-3c171ab099bd, identifier: JJ00785
2026-03-30 10:55:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a35590>
2026-03-30 10:55:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_7d816cfacb4cc488fade70a3fef2e0fc.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_7d816cfacb4cc488fade70a3fef2e0fc.jpg saved to cache
2026-03-30 10:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e2964aa-964a-5700-a776-94c83ebc0320
2026-03-30 10:55:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:20 [auto1.de] INFO: Found listing with ID: CW67580
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW67580%27 HTTP/1.1" 200 None
2026-03-30 10:55:20 [auto1.de] INFO: Scrape type for CW67580: 2
2026-03-30 10:55:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea60f9bf-b19e-5887-80cd-124fb2f4e742 with identifier: CW67580
2026-03-30 10:55:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea60f9bf-b19e-5887-80cd-124fb2f4e742 with scrape type 2
2026-03-30 10:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea60f9bf-b19e-5887-80cd-124fb2f4e742 with scrape type 2
2026-03-30 10:55:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea60f9bf-b19e-5887-80cd-124fb2f4e742, identifier: CW67580
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_a4d392ab90a07059c0c5212c39ea2baf.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_a4d392ab90a07059c0c5212c39ea2baf.jpg not downloaded yet
2026-03-30 10:55:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 188ffda1-f7ca-5381-8474-3c171ab099bd with identifier: JJ00785
2026-03-30 10:55:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 188ffda1-f7ca-5381-8474-3c171ab099bd with identifier: JJ00785
2026-03-30 10:55:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 188ffda1-f7ca-5381-8474-3c171ab099bd with identifier: JJ00785 to the API
2026-03-30 10:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:30:32Z',
 'fuel_type': 'diesel',
 'id': '188ffda1-f7ca-5381-8474-3c171ab099bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ00785',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 227517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-09',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 320 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2007}
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ00785%27 HTTP/1.1" 200 None
2026-03-30 10:55:21 [auto1.de] INFO: Saving data for JJ00785: {'auction_closing_time': 1774971032.0, 'created_time': 1774503335.196333, 'last_price_update_time': 1774868121.182246}
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ00785') HTTP/1.1" 204 0
2026-03-30 10:55:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea60f9bf-b19e-5887-80cd-124fb2f4e742 with identifier: CW67580
2026-03-30 10:55:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea60f9bf-b19e-5887-80cd-124fb2f4e742 with identifier: CW67580
2026-03-30 10:55:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea60f9bf-b19e-5887-80cd-124fb2f4e742 with identifier: CW67580 to the API
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:59:22Z',
 'fuel_type': 'diesel',
 'id': 'ea60f9bf-b19e-5887-80cd-124fb2f4e742',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW67580',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 163721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-23',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2015}
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW67580%27 HTTP/1.1" 200 None
2026-03-30 10:55:21 [auto1.de] INFO: Saving data for CW67580: {'auction_closing_time': 1774972762.0, 'created_time': 1773134233.775258, 'last_price_update_time': 1774868121.554575}
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW67580') HTTP/1.1" 204 0
2026-03-30 10:55:21 [auto1.de] INFO: Found listing with ID: EY37211
2026-03-30 10:55:21 [auto1.de] INFO: Found listing with ID: PH55867
2026-03-30 10:55:21 [auto1.de] INFO: Found listing with ID: YH45665
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH45665%27 HTTP/1.1" 200 None
2026-03-30 10:55:21 [auto1.de] INFO: Scrape type for YH45665: 1
2026-03-30 10:55:21 [auto1.de] INFO: Found listing with ID: JV02966
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV02966%27 HTTP/1.1" 200 None
2026-03-30 10:55:21 [auto1.de] INFO: Scrape type for JV02966: 2
2026-03-30 10:55:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d3147d4-748e-58f3-973c-80100afe4a68 with identifier: JV02966
2026-03-30 10:55:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d3147d4-748e-58f3-973c-80100afe4a68 with scrape type 2
2026-03-30 10:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d3147d4-748e-58f3-973c-80100afe4a68 with scrape type 2
2026-03-30 10:55:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d3147d4-748e-58f3-973c-80100afe4a68, identifier: JV02966
2026-03-30 10:55:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50f32d0>
2026-03-30 10:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_8153275a2feafbbcc278352ea6f0869d.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_8153275a2feafbbcc278352ea6f0869d.jpg saved to cache
2026-03-30 10:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e2964aa-964a-5700-a776-94c83ebc0320
2026-03-30 10:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_8cc17d39e02379572bf57d0bfbceb5ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:21 [auto1.de] INFO: Found listing with ID: NV71643
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV71643%27 HTTP/1.1" 200 None
2026-03-30 10:55:21 [auto1.de] INFO: Scrape type for NV71643: 2
2026-03-30 10:55:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc346d04-31e0-54d4-9e6a-fe3c0f0c5fa6 with identifier: NV71643
2026-03-30 10:55:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc346d04-31e0-54d4-9e6a-fe3c0f0c5fa6 with scrape type 2
2026-03-30 10:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc346d04-31e0-54d4-9e6a-fe3c0f0c5fa6 with scrape type 2
2026-03-30 10:55:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc346d04-31e0-54d4-9e6a-fe3c0f0c5fa6, identifier: NV71643
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_c1fbb52089c5b6f1be4e28c43d748bd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_c1fbb52089c5b6f1be4e28c43d748bd3.jpg not downloaded yet
2026-03-30 10:55:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d3147d4-748e-58f3-973c-80100afe4a68 with identifier: JV02966
2026-03-30 10:55:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d3147d4-748e-58f3-973c-80100afe4a68 with identifier: JV02966
2026-03-30 10:55:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d3147d4-748e-58f3-973c-80100afe4a68 with identifier: JV02966 to the API
2026-03-30 10:55:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:39:43Z',
 'fuel_type': 'diesel',
 'id': '3d3147d4-748e-58f3-973c-80100afe4a68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV02966',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 136836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-21',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi EcoBlue ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2021}
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV02966%27 HTTP/1.1" 200 None
2026-03-30 10:55:22 [auto1.de] INFO: Saving data for JV02966: {'auction_closing_time': 1774971583.0, 'created_time': 1774467738.557716, 'last_price_update_time': 1774868122.243617}
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV02966') HTTP/1.1" 204 0
2026-03-30 10:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_e633821e435f97ad167d4203cae6ee0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc346d04-31e0-54d4-9e6a-fe3c0f0c5fa6 with identifier: NV71643
2026-03-30 10:55:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc346d04-31e0-54d4-9e6a-fe3c0f0c5fa6 with identifier: NV71643
2026-03-30 10:55:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc346d04-31e0-54d4-9e6a-fe3c0f0c5fa6 with identifier: NV71643 to the API
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:20:15Z',
 'fuel_type': 'petrol',
 'id': 'fc346d04-31e0-54d4-9e6a-fe3c0f0c5fa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV71643',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 184167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-01-21',
 'seller_name': None,
 'title': 'Toyota Yaris 1.3 VVT-i Linea Sol',
 'transmission': 'manual',
 'trim': 'Linea Sol',
 'year': 2002}
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV71643%27 HTTP/1.1" 200 None
2026-03-30 10:55:22 [auto1.de] INFO: Saving data for NV71643: {'auction_closing_time': 1774970415.0, 'created_time': 1774380118.701556, 'last_price_update_time': 1774868122.625333}
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV71643') HTTP/1.1" 204 0
2026-03-30 10:55:22 [auto1.de] INFO: Found listing with ID: SS53525
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS53525%27 HTTP/1.1" 200 None
2026-03-30 10:55:22 [auto1.de] INFO: Scrape type for SS53525: 2
2026-03-30 10:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fdf0724-b1f4-589f-b69e-b0b3389a0e4b with identifier: SS53525
2026-03-30 10:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fdf0724-b1f4-589f-b69e-b0b3389a0e4b with scrape type 2
2026-03-30 10:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fdf0724-b1f4-589f-b69e-b0b3389a0e4b with scrape type 2
2026-03-30 10:55:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fdf0724-b1f4-589f-b69e-b0b3389a0e4b, identifier: SS53525
2026-03-30 10:55:22 [auto1.de] INFO: Found listing with ID: BW90089
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW90089%27 HTTP/1.1" 200 None
2026-03-30 10:55:22 [auto1.de] INFO: Scrape type for BW90089: 2
2026-03-30 10:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca15b613-b8e8-5e15-80c9-442138fc206f with identifier: BW90089
2026-03-30 10:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca15b613-b8e8-5e15-80c9-442138fc206f with scrape type 2
2026-03-30 10:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca15b613-b8e8-5e15-80c9-442138fc206f with scrape type 2
2026-03-30 10:55:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca15b613-b8e8-5e15-80c9-442138fc206f, identifier: BW90089
2026-03-30 10:55:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb46d0>
2026-03-30 10:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_a84544bbc786338b47a5118a64d99e0e.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_a84544bbc786338b47a5118a64d99e0e.jpg saved to cache
2026-03-30 10:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e2964aa-964a-5700-a776-94c83ebc0320
2026-03-30 10:55:22 [auto1.de] INFO: Found listing with ID: BR38332
2026-03-30 10:55:22 [auto1.de] INFO: Found listing with ID: FK66572
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK66572%27 HTTP/1.1" 200 None
2026-03-30 10:55:22 [auto1.de] INFO: Scrape type for FK66572: 2
2026-03-30 10:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61a0e896-aed8-57f9-8cf5-dc541338b64a with identifier: FK66572
2026-03-30 10:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61a0e896-aed8-57f9-8cf5-dc541338b64a with scrape type 2
2026-03-30 10:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61a0e896-aed8-57f9-8cf5-dc541338b64a with scrape type 2
2026-03-30 10:55:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61a0e896-aed8-57f9-8cf5-dc541338b64a, identifier: FK66572
2026-03-30 10:55:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fdf0724-b1f4-589f-b69e-b0b3389a0e4b with identifier: SS53525
2026-03-30 10:55:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fdf0724-b1f4-589f-b69e-b0b3389a0e4b with identifier: SS53525
2026-03-30 10:55:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fdf0724-b1f4-589f-b69e-b0b3389a0e4b with identifier: SS53525 to the API
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:52:06Z',
 'fuel_type': 'petrol',
 'id': '3fdf0724-b1f4-589f-b69e-b0b3389a0e4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS53525',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 90059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-10',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2011}
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS53525%27 HTTP/1.1" 200 None
2026-03-30 10:55:23 [auto1.de] INFO: Saving data for SS53525: {'auction_closing_time': 1774972326.0, 'created_time': 1773658595.106293, 'last_price_update_time': 1774868123.433449}
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS53525') HTTP/1.1" 204 0
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_ef67a4cf2f446556a37685c1d24d798f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_ef67a4cf2f446556a37685c1d24d798f.jpg not downloaded yet
2026-03-30 10:55:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca15b613-b8e8-5e15-80c9-442138fc206f with identifier: BW90089
2026-03-30 10:55:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca15b613-b8e8-5e15-80c9-442138fc206f with identifier: BW90089
2026-03-30 10:55:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca15b613-b8e8-5e15-80c9-442138fc206f with identifier: BW90089 to the API
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:34:06Z',
 'fuel_type': 'diesel',
 'id': 'ca15b613-b8e8-5e15-80c9-442138fc206f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW90089',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 179329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-05',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CDI BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Elegance',
 'year': 2012}
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW90089%27 HTTP/1.1" 200 None
2026-03-30 10:55:23 [auto1.de] INFO: Saving data for BW90089: {'auction_closing_time': 1774971246.0, 'created_time': 1774468186.759288, 'last_price_update_time': 1774868123.872361}
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW90089') HTTP/1.1" 204 0
2026-03-30 10:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU19465/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61a0e896-aed8-57f9-8cf5-dc541338b64a with identifier: FK66572
2026-03-30 10:55:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61a0e896-aed8-57f9-8cf5-dc541338b64a with identifier: FK66572
2026-03-30 10:55:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61a0e896-aed8-57f9-8cf5-dc541338b64a with identifier: FK66572 to the API
2026-03-30 10:55:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:32:12Z',
 'fuel_type': 'diesel',
 'id': '61a0e896-aed8-57f9-8cf5-dc541338b64a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK66572',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 251658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-27',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK66572%27 HTTP/1.1" 200 None
2026-03-30 10:55:24 [auto1.de] INFO: Saving data for FK66572: {'auction_closing_time': 1774971132.0, 'created_time': 1774381473.351695, 'last_price_update_time': 1774868124.203122}
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK66572') HTTP/1.1" 204 0
2026-03-30 10:55:24 [auto1.de] INFO: Found listing with ID: VZ80726
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ80726%27 HTTP/1.1" 200 None
2026-03-30 10:55:24 [auto1.de] INFO: Scrape type for VZ80726: 2
2026-03-30 10:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a5879ac-9053-5fe9-883c-3daf98e38dcc with identifier: VZ80726
2026-03-30 10:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a5879ac-9053-5fe9-883c-3daf98e38dcc with scrape type 2
2026-03-30 10:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a5879ac-9053-5fe9-883c-3daf98e38dcc with scrape type 2
2026-03-30 10:55:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a5879ac-9053-5fe9-883c-3daf98e38dcc, identifier: VZ80726
2026-03-30 10:55:24 [auto1.de] INFO: Found listing with ID: XE14279
2026-03-30 10:55:24 [auto1.de] INFO: Found listing with ID: UY98455
2026-03-30 10:55:24 [auto1.de] INFO: Found listing with ID: WG34535
2026-03-30 10:55:24 [auto1.de] INFO: Found listing with ID: UC07744
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC07744%27 HTTP/1.1" 200 None
2026-03-30 10:55:24 [auto1.de] INFO: Scrape type for UC07744: 2
2026-03-30 10:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53c34c63-103e-593d-b517-b853067d3d73 with identifier: UC07744
2026-03-30 10:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c34c63-103e-593d-b517-b853067d3d73 with scrape type 2
2026-03-30 10:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53c34c63-103e-593d-b517-b853067d3d73 with scrape type 2
2026-03-30 10:55:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53c34c63-103e-593d-b517-b853067d3d73, identifier: UC07744
2026-03-30 10:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5075a10>
2026-03-30 10:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_8cc17d39e02379572bf57d0bfbceb5ef.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_8cc17d39e02379572bf57d0bfbceb5ef.jpg saved to cache
2026-03-30 10:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e2964aa-964a-5700-a776-94c83ebc0320
2026-03-30 10:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_c86faa0f86837d9dc0a5953df2e17ab1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:24 [auto1.de] INFO: Found listing with ID: DC85616
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC85616%27 HTTP/1.1" 200 None
2026-03-30 10:55:24 [auto1.de] INFO: Scrape type for DC85616: 2
2026-03-30 10:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc3462b4-9371-58b4-b426-2b4c083db854 with identifier: DC85616
2026-03-30 10:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc3462b4-9371-58b4-b426-2b4c083db854 with scrape type 2
2026-03-30 10:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc3462b4-9371-58b4-b426-2b4c083db854 with scrape type 2
2026-03-30 10:55:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc3462b4-9371-58b4-b426-2b4c083db854, identifier: DC85616
2026-03-30 10:55:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a5879ac-9053-5fe9-883c-3daf98e38dcc with identifier: VZ80726
2026-03-30 10:55:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a5879ac-9053-5fe9-883c-3daf98e38dcc with identifier: VZ80726
2026-03-30 10:55:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a5879ac-9053-5fe9-883c-3daf98e38dcc with identifier: VZ80726 to the API
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:57:58Z',
 'fuel_type': 'diesel',
 'id': '8a5879ac-9053-5fe9-883c-3daf98e38dcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ80726',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 261020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-09',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D5 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2010}
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ80726%27 HTTP/1.1" 200 None
2026-03-30 10:55:24 [auto1.de] INFO: Saving data for VZ80726: {'auction_closing_time': 1774972678.0, 'created_time': 1774377338.519644, 'last_price_update_time': 1774868124.980463}
2026-03-30 10:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ80726') HTTP/1.1" 204 0
2026-03-30 10:55:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53c34c63-103e-593d-b517-b853067d3d73 with identifier: UC07744
2026-03-30 10:55:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53c34c63-103e-593d-b517-b853067d3d73 with identifier: UC07744
2026-03-30 10:55:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53c34c63-103e-593d-b517-b853067d3d73 with identifier: UC07744 to the API
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 103,
 'expiration_date': '2026-03-31T15:45:46Z',
 'fuel_type': 'petrol',
 'id': '53c34c63-103e-593d-b517-b853067d3d73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC07744',
 'listing': 'auction',
 'make': 'Daihatsu',
 'model': 'Materia',
 'odometer': 177572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-03',
 'seller_name': None,
 'title': 'Daihatsu Materia 1.5',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC07744%27 HTTP/1.1" 200 None
2026-03-30 10:55:25 [auto1.de] INFO: Saving data for UC07744: {'auction_closing_time': 1774971946.0, 'created_time': 1773382463.55283, 'last_price_update_time': 1774868125.700963}
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC07744') HTTP/1.1" 204 0
2026-03-30 10:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD89008> (referer: https://www.auto1.com/v1/car-details-view/FD89008/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e8fe10>
2026-03-30 10:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_e633821e435f97ad167d4203cae6ee0d.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_e633821e435f97ad167d4203cae6ee0d.jpg saved to cache
2026-03-30 10:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e2964aa-964a-5700-a776-94c83ebc0320
2026-03-30 10:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_a4d392ab90a07059c0c5212c39ea2baf.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc3462b4-9371-58b4-b426-2b4c083db854 with identifier: DC85616
2026-03-30 10:55:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc3462b4-9371-58b4-b426-2b4c083db854 with identifier: DC85616
2026-03-30 10:55:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc3462b4-9371-58b4-b426-2b4c083db854 with identifier: DC85616 to the API
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:27:41Z',
 'fuel_type': 'petrol',
 'id': 'cc3462b4-9371-58b4-b426-2b4c083db854',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC85616',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 91234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-07',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 350',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC85616%27 HTTP/1.1" 200 None
2026-03-30 10:55:26 [auto1.de] INFO: Saving data for DC85616: {'auction_closing_time': 1774970861.0, 'created_time': 1774416955.689961, 'last_price_update_time': 1774868126.095718}
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC85616') HTTP/1.1" 204 0
2026-03-30 10:55:26 [auto1.de] INFO: Found listing with ID: EA70503
2026-03-30 10:55:26 [auto1.de] INFO: Found listing with ID: LU14578
2026-03-30 10:55:26 [auto1.de] INFO: Found listing with ID: SK78109
2026-03-30 10:55:26 [auto1.de] INFO: Found listing with ID: RT55405
2026-03-30 10:55:26 [auto1.de] INFO: Found listing with ID: EJ11673
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ11673%27 HTTP/1.1" 200 None
2026-03-30 10:55:26 [auto1.de] INFO: Scrape type for EJ11673: 2
2026-03-30 10:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5c5ddef-ef49-5377-ab8d-6cec1768daca with identifier: EJ11673
2026-03-30 10:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5c5ddef-ef49-5377-ab8d-6cec1768daca with scrape type 2
2026-03-30 10:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5c5ddef-ef49-5377-ab8d-6cec1768daca with scrape type 2
2026-03-30 10:55:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5c5ddef-ef49-5377-ab8d-6cec1768daca, identifier: EJ11673
2026-03-30 10:55:26 [auto1.de] INFO: Found listing with ID: PB07846
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB07846%27 HTTP/1.1" 200 None
2026-03-30 10:55:26 [auto1.de] INFO: Scrape type for PB07846: 1
2026-03-30 10:55:26 [auto1.de] INFO: Found listing with ID: ZT79683
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT79683%27 HTTP/1.1" 200 None
2026-03-30 10:55:26 [auto1.de] INFO: Scrape type for ZT79683: 2
2026-03-30 10:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9975f8b2-ce97-5016-b7f2-d3447098069a with identifier: ZT79683
2026-03-30 10:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9975f8b2-ce97-5016-b7f2-d3447098069a with scrape type 2
2026-03-30 10:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9975f8b2-ce97-5016-b7f2-d3447098069a with scrape type 2
2026-03-30 10:55:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9975f8b2-ce97-5016-b7f2-d3447098069a, identifier: ZT79683
2026-03-30 10:55:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5c5ddef-ef49-5377-ab8d-6cec1768daca with identifier: EJ11673
2026-03-30 10:55:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5c5ddef-ef49-5377-ab8d-6cec1768daca with identifier: EJ11673
2026-03-30 10:55:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5c5ddef-ef49-5377-ab8d-6cec1768daca with identifier: EJ11673 to the API
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:55:05Z',
 'fuel_type': 'petrol',
 'id': 'e5c5ddef-ef49-5377-ab8d-6cec1768daca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ11673',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 51683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-17',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 TGDI GT",
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ11673%27 HTTP/1.1" 200 None
2026-03-30 10:55:26 [auto1.de] INFO: Saving data for EJ11673: {'auction_closing_time': 1774972505.0, 'created_time': 1774464474.715074, 'last_price_update_time': 1774868126.714386}
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ11673') HTTP/1.1" 204 0
2026-03-30 10:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_c1fbb52089c5b6f1be4e28c43d748bd3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9975f8b2-ce97-5016-b7f2-d3447098069a with identifier: ZT79683
2026-03-30 10:55:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9975f8b2-ce97-5016-b7f2-d3447098069a with identifier: ZT79683
2026-03-30 10:55:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9975f8b2-ce97-5016-b7f2-d3447098069a with identifier: ZT79683 to the API
2026-03-30 10:55:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:08:34Z',
 'fuel_type': 'diesel',
 'id': '9975f8b2-ce97-5016-b7f2-d3447098069a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT79683',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 289095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-26',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT79683%27 HTTP/1.1" 200 None
2026-03-30 10:55:27 [auto1.de] INFO: Saving data for ZT79683: {'auction_closing_time': 1774969714.0, 'created_time': 1773383194.114489, 'last_price_update_time': 1774868127.152697}
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT79683') HTTP/1.1" 204 0
2026-03-30 10:55:27 [auto1.de] INFO: Found listing with ID: SS47444
2026-03-30 10:55:27 [auto1.de] INFO: Found listing with ID: TD39885
2026-03-30 10:55:27 [auto1.de] INFO: Found listing with ID: VP92353
2026-03-30 10:55:27 [auto1.de] INFO: Found listing with ID: TP77311
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP77311%27 HTTP/1.1" 200 None
2026-03-30 10:55:27 [auto1.de] INFO: Scrape type for TP77311: 2
2026-03-30 10:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cffede6f-6849-576e-bb38-f52beaaa394c with identifier: TP77311
2026-03-30 10:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cffede6f-6849-576e-bb38-f52beaaa394c with scrape type 2
2026-03-30 10:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cffede6f-6849-576e-bb38-f52beaaa394c with scrape type 2
2026-03-30 10:55:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cffede6f-6849-576e-bb38-f52beaaa394c, identifier: TP77311
2026-03-30 10:55:27 [auto1.de] INFO: Found listing with ID: RL13206
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL13206%27 HTTP/1.1" 200 None
2026-03-30 10:55:27 [auto1.de] INFO: Scrape type for RL13206: 2
2026-03-30 10:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a76950a1-2396-57d3-8a8f-494ef05857f8 with identifier: RL13206
2026-03-30 10:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a76950a1-2396-57d3-8a8f-494ef05857f8 with scrape type 2
2026-03-30 10:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a76950a1-2396-57d3-8a8f-494ef05857f8 with scrape type 2
2026-03-30 10:55:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a76950a1-2396-57d3-8a8f-494ef05857f8, identifier: RL13206
2026-03-30 10:55:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef51059d0>
2026-03-30 10:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_c86faa0f86837d9dc0a5953df2e17ab1.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_c86faa0f86837d9dc0a5953df2e17ab1.jpg saved to cache
2026-03-30 10:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e2964aa-964a-5700-a776-94c83ebc0320
2026-03-30 10:55:27 [auto1.de] INFO: Found listing with ID: RK31511
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK31511%27 HTTP/1.1" 200 None
2026-03-30 10:55:27 [auto1.de] INFO: Scrape type for RK31511: 1
2026-03-30 10:55:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cffede6f-6849-576e-bb38-f52beaaa394c with identifier: TP77311
2026-03-30 10:55:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cffede6f-6849-576e-bb38-f52beaaa394c with identifier: TP77311
2026-03-30 10:55:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cffede6f-6849-576e-bb38-f52beaaa394c with identifier: TP77311 to the API
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:43:47Z',
 'fuel_type': 'petrol',
 'id': 'cffede6f-6849-576e-bb38-f52beaaa394c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP77311',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 15754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP77311%27 HTTP/1.1" 200 None
2026-03-30 10:55:27 [auto1.de] INFO: Saving data for TP77311: {'auction_closing_time': 1774971827.0, 'created_time': 1773946629.761561, 'last_price_update_time': 1774868127.913883}
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP77311') HTTP/1.1" 204 0
2026-03-30 10:55:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a76950a1-2396-57d3-8a8f-494ef05857f8 with identifier: RL13206
2026-03-30 10:55:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a76950a1-2396-57d3-8a8f-494ef05857f8 with identifier: RL13206
2026-03-30 10:55:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a76950a1-2396-57d3-8a8f-494ef05857f8 with identifier: RL13206 to the API
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:12:51Z',
 'fuel_type': 'diesel',
 'id': 'a76950a1-2396-57d3-8a8f-494ef05857f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL13206',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 230774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-13',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL13206%27 HTTP/1.1" 200 None
2026-03-30 10:55:28 [auto1.de] INFO: Saving data for RL13206: {'auction_closing_time': 1774969971.0, 'created_time': 1773305559.019779, 'last_price_update_time': 1774868128.311884}
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL13206') HTTP/1.1" 204 0
2026-03-30 10:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_ef67a4cf2f446556a37685c1d24d798f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:28 [auto1.de] INFO: Found listing with ID: WT89388
2026-03-30 10:55:28 [auto1.de] INFO: Found listing with ID: JU02065
2026-03-30 10:55:28 [auto1.de] INFO: Found listing with ID: JJ00785
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ00785%27 HTTP/1.1" 200 None
2026-03-30 10:55:28 [auto1.de] INFO: Scrape type for JJ00785: 0
2026-03-30 10:55:28 [auto1.de] INFO: Found listing with ID: JV02966
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV02966%27 HTTP/1.1" 200 None
2026-03-30 10:55:28 [auto1.de] INFO: Scrape type for JV02966: 0
2026-03-30 10:55:28 [auto1.de] INFO: Found listing with ID: BW90089
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW90089%27 HTTP/1.1" 200 None
2026-03-30 10:55:28 [auto1.de] INFO: Scrape type for BW90089: 0
2026-03-30 10:55:28 [auto1.de] INFO: Found listing with ID: NB55026
2026-03-30 10:55:28 [auto1.de] INFO: Found listing with ID: MS18045
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS18045%27 HTTP/1.1" 200 None
2026-03-30 10:55:28 [auto1.de] INFO: Scrape type for MS18045: 2
2026-03-30 10:55:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e21108f-c955-5c36-a2c5-33e3958bed06 with identifier: MS18045
2026-03-30 10:55:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e21108f-c955-5c36-a2c5-33e3958bed06 with scrape type 2
2026-03-30 10:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e21108f-c955-5c36-a2c5-33e3958bed06 with scrape type 2
2026-03-30 10:55:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e21108f-c955-5c36-a2c5-33e3958bed06, identifier: MS18045
2026-03-30 10:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead with identifier: FD89008
2026-03-30 10:55:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead with scrape type 1
2026-03-30 10:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed81ba38cc6cd45e30f55e8f09c7a10%252Fpa%252FFD89008_85aeab5805c4325d429cfb87c18ae701.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_85aeab5805c4325d429cfb87c18ae701.jpg not downloaded yet
2026-03-30 10:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50516d0>
2026-03-30 10:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_a4d392ab90a07059c0c5212c39ea2baf.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_a4d392ab90a07059c0c5212c39ea2baf.jpg saved to cache
2026-03-30 10:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e2964aa-964a-5700-a776-94c83ebc0320
2026-03-30 10:55:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:28 [auto1.de] INFO: Found listing with ID: AV36611
2026-03-30 10:55:28 [auto1.de] INFO: Found listing with ID: XT77229
2026-03-30 10:55:28 [auto1.de] INFO: Found listing with ID: GJ64200
2026-03-30 10:55:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e21108f-c955-5c36-a2c5-33e3958bed06 with identifier: MS18045
2026-03-30 10:55:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e21108f-c955-5c36-a2c5-33e3958bed06 with identifier: MS18045
2026-03-30 10:55:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e21108f-c955-5c36-a2c5-33e3958bed06 with identifier: MS18045 to the API
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:56:04Z',
 'fuel_type': 'diesel',
 'id': '4e21108f-c955-5c36-a2c5-33e3958bed06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS18045',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 15700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-06',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS18045%27 HTTP/1.1" 200 None
2026-03-30 10:55:28 [auto1.de] INFO: Saving data for MS18045: {'auction_closing_time': 1774972564.0, 'created_time': 1773726129.462789, 'last_price_update_time': 1774868128.946465}
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS18045') HTTP/1.1" 204 0
2026-03-30 10:55:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:29 [auto1.de] INFO: Found listing with ID: UW30649
2026-03-30 10:55:29 [auto1.de] INFO: Found listing with ID: WX32371
2026-03-30 10:55:29 [auto1.de] INFO: Found listing with ID: GK14765
2026-03-30 10:55:29 [auto1.de] INFO: Found listing with ID: NV49426
2026-03-30 10:55:29 [auto1.de] INFO: Found listing with ID: UP67859
2026-03-30 10:55:29 [auto1.de] INFO: Found listing with ID: HL85444
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL85444%27 HTTP/1.1" 200 None
2026-03-30 10:55:29 [auto1.de] INFO: Scrape type for HL85444: 2
2026-03-30 10:55:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2e69803-5b9a-5b8d-9831-908c7c30907b with identifier: HL85444
2026-03-30 10:55:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2e69803-5b9a-5b8d-9831-908c7c30907b with scrape type 2
2026-03-30 10:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2e69803-5b9a-5b8d-9831-908c7c30907b with scrape type 2
2026-03-30 10:55:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2e69803-5b9a-5b8d-9831-908c7c30907b, identifier: HL85444
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed81ba38cc6cd45e30f55e8f09c7a10%252Fpa%252FFD89008_59ae808092f4e068518683ef2fefb487.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_59ae808092f4e068518683ef2fefb487.jpg not downloaded yet
2026-03-30 10:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EV61179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c80490>
2026-03-30 10:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_c1fbb52089c5b6f1be4e28c43d748bd3.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_c1fbb52089c5b6f1be4e28c43d748bd3.jpg saved to cache
2026-03-30 10:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e2964aa-964a-5700-a776-94c83ebc0320
2026-03-30 10:55:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2e69803-5b9a-5b8d-9831-908c7c30907b with identifier: HL85444
2026-03-30 10:55:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2e69803-5b9a-5b8d-9831-908c7c30907b with identifier: HL85444
2026-03-30 10:55:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2e69803-5b9a-5b8d-9831-908c7c30907b with identifier: HL85444 to the API
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:07:52Z',
 'fuel_type': 'petrol',
 'id': 'f2e69803-5b9a-5b8d-9831-908c7c30907b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL85444',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 144022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-25',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL85444%27 HTTP/1.1" 200 None
2026-03-30 10:55:29 [auto1.de] INFO: Saving data for HL85444: {'auction_closing_time': 1774969672.0, 'created_time': 1773302229.681162, 'last_price_update_time': 1774868129.565502}
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL85444') HTTP/1.1" 204 0
2026-03-30 10:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f07510>
2026-03-30 10:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Ffc%252F8dfc7a301d02bd864a933cab7593dc96%252Fpa%252FCW68462_ef67a4cf2f446556a37685c1d24d798f.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_ef67a4cf2f446556a37685c1d24d798f.jpg saved to cache
2026-03-30 10:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e2964aa-964a-5700-a776-94c83ebc0320
2026-03-30 10:55:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e2964aa-964a-5700-a776-94c83ebc0320, skipping ID generation
2026-03-30 10:55:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e2964aa-964a-5700-a776-94c83ebc0320 with scrape type 1
2026-03-30 10:55:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e2964aa-964a-5700-a776-94c83ebc0320 sending to next pipeline
2026-03-30 10:55:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e2964aa-964a-5700-a776-94c83ebc0320, identifier: CW68462
2026-03-30 10:55:29 [auto1.de] INFO: Found listing with ID: CW51870
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW51870%27 HTTP/1.1" 200 None
2026-03-30 10:55:29 [auto1.de] INFO: Scrape type for CW51870: 1
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed81ba38cc6cd45e30f55e8f09c7a10%252Fpa%252FFD89008_f46618da4e9c086ce63fcb2ff813d33b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_f46618da4e9c086ce63fcb2ff813d33b.jpg not downloaded yet
2026-03-30 10:55:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e2964aa-964a-5700-a776-94c83ebc0320 with identifier: CW68462
2026-03-30 10:55:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e2964aa-964a-5700-a776-94c83ebc0320 with identifier: CW68462
2026-03-30 10:55:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e2964aa-964a-5700-a776-94c83ebc0320 with identifier: CW68462 to the API
2026-03-30 10:55:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_ef67a4cf2f446556a37685c1d24d798f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 227,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:08:55Z',
 'fuel_type': 'diesel',
 'id': '6e2964aa-964a-5700-a776-94c83ebc0320',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW68462',
 'listing': 'auction',
 'location': 'DE, Königsbrunn',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 142615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_6a0d0dcc8fc967bdf7b1e9577beff2f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_7d816cfacb4cc488fade70a3fef2e0fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_8153275a2feafbbcc278352ea6f0869d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_a84544bbc786338b47a5118a64d99e0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_8cc17d39e02379572bf57d0bfbceb5ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_e633821e435f97ad167d4203cae6ee0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_c86faa0f86837d9dc0a5953df2e17ab1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_a4d392ab90a07059c0c5212c39ea2baf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_c1fbb52089c5b6f1be4e28c43d748bd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2964aa-964a-5700-a776-94c83ebc0320/6e2964aa-964a-5700-a776-94c83ebc0320_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/fc/8dfc7a301d02bd864a933cab7593dc96/pa/CW68462_ef67a4cf2f446556a37685c1d24d798f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Beach Edition',
 'transmission': 'automatic',
 'trim': 'Beach Edition',
 'year': 2018}
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW68462%27 HTTP/1.1" 200 None
2026-03-30 10:55:30 [auto1.de] INFO: Saving data for CW68462: {'created_time': 1774868130.155012, 'last_price_update_time': 1774868130.155023, 'auction_closing_time': 1774969735.0}
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW68462') HTTP/1.1" 204 0
2026-03-30 10:55:30 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 9528 | hits on page: 40
2026-03-30 10:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH45665/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:30 [auto1.de] INFO: Found listing with ID: LU46905
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU46905%27 HTTP/1.1" 200 None
2026-03-30 10:55:30 [auto1.de] INFO: Scrape type for LU46905: 2
2026-03-30 10:55:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 977a70bd-e3e7-5a4e-bb0c-49274ee2796d with identifier: LU46905
2026-03-30 10:55:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 977a70bd-e3e7-5a4e-bb0c-49274ee2796d with scrape type 2
2026-03-30 10:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 977a70bd-e3e7-5a4e-bb0c-49274ee2796d with scrape type 2
2026-03-30 10:55:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 977a70bd-e3e7-5a4e-bb0c-49274ee2796d, identifier: LU46905
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed81ba38cc6cd45e30f55e8f09c7a10%252Fpa%252FFD89008_3a0ad826f59d4747ec97fe58b3cbb062.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_3a0ad826f59d4747ec97fe58b3cbb062.jpg not downloaded yet
2026-03-30 10:55:30 [auto1.de] INFO: Found listing with ID: YL58691
2026-03-30 10:55:30 [auto1.de] INFO: Found listing with ID: EX48924
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX48924%27 HTTP/1.1" 200 None
2026-03-30 10:55:30 [auto1.de] INFO: Scrape type for EX48924: 2
2026-03-30 10:55:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 092760ae-4028-5bbf-889d-9ddcfc2e45b5 with identifier: EX48924
2026-03-30 10:55:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 092760ae-4028-5bbf-889d-9ddcfc2e45b5 with scrape type 2
2026-03-30 10:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 092760ae-4028-5bbf-889d-9ddcfc2e45b5 with scrape type 2
2026-03-30 10:55:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 092760ae-4028-5bbf-889d-9ddcfc2e45b5, identifier: EX48924
2026-03-30 10:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_85aeab5805c4325d429cfb87c18ae701.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 977a70bd-e3e7-5a4e-bb0c-49274ee2796d with identifier: LU46905
2026-03-30 10:55:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 977a70bd-e3e7-5a4e-bb0c-49274ee2796d with identifier: LU46905
2026-03-30 10:55:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 977a70bd-e3e7-5a4e-bb0c-49274ee2796d with identifier: LU46905 to the API
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:57:15Z',
 'fuel_type': 'petrol',
 'id': '977a70bd-e3e7-5a4e-bb0c-49274ee2796d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU46905',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 91592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-16',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2016}
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU46905%27 HTTP/1.1" 200 None
2026-03-30 10:55:30 [auto1.de] INFO: Saving data for LU46905: {'auction_closing_time': 1774972635.0, 'created_time': 1773662015.217356, 'last_price_update_time': 1774868130.744421}
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU46905') HTTP/1.1" 204 0
2026-03-30 10:55:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 092760ae-4028-5bbf-889d-9ddcfc2e45b5 with identifier: EX48924
2026-03-30 10:55:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 092760ae-4028-5bbf-889d-9ddcfc2e45b5 with identifier: EX48924
2026-03-30 10:55:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 092760ae-4028-5bbf-889d-9ddcfc2e45b5 with identifier: EX48924 to the API
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:09:42Z',
 'fuel_type': 'petrol',
 'id': '092760ae-4028-5bbf-889d-9ddcfc2e45b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX48924',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 145119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-01-02',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 170 Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2005}
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX48924%27 HTTP/1.1" 200 None
2026-03-30 10:55:31 [auto1.de] INFO: Saving data for EX48924: {'auction_closing_time': 1774969782.0, 'created_time': 1774377988.132284, 'last_price_update_time': 1774868131.418033}
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX48924') HTTP/1.1" 204 0
2026-03-30 10:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:31 [auto1.de] INFO: Found listing with ID: AK84814
2026-03-30 10:55:31 [auto1.de] INFO: Found listing with ID: FR35172
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR35172%27 HTTP/1.1" 200 None
2026-03-30 10:55:31 [auto1.de] INFO: Scrape type for FR35172: 2
2026-03-30 10:55:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3f411bf-ce2d-54ed-9d36-dc5c6c73fd09 with identifier: FR35172
2026-03-30 10:55:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3f411bf-ce2d-54ed-9d36-dc5c6c73fd09 with scrape type 2
2026-03-30 10:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3f411bf-ce2d-54ed-9d36-dc5c6c73fd09 with scrape type 2
2026-03-30 10:55:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3f411bf-ce2d-54ed-9d36-dc5c6c73fd09, identifier: FR35172
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed81ba38cc6cd45e30f55e8f09c7a10%252Fpa%252FFD89008_9b00eb6583de6148ebb6454b607a6d43.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_9b00eb6583de6148ebb6454b607a6d43.jpg not downloaded yet
2026-03-30 10:55:31 [auto1.de] INFO: Found listing with ID: RP49857
2026-03-30 10:55:31 [auto1.de] INFO: Found listing with ID: EV18023
2026-03-30 10:55:31 [auto1.de] INFO: Found listing with ID: GR85769
2026-03-30 10:55:31 [auto1.de] INFO: Found listing with ID: GK45349
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK45349%27 HTTP/1.1" 200 None
2026-03-30 10:55:31 [auto1.de] INFO: Scrape type for GK45349: 2
2026-03-30 10:55:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3de78674-b716-5f1f-b94d-963c80c19215 with identifier: GK45349
2026-03-30 10:55:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3de78674-b716-5f1f-b94d-963c80c19215 with scrape type 2
2026-03-30 10:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3de78674-b716-5f1f-b94d-963c80c19215 with scrape type 2
2026-03-30 10:55:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3de78674-b716-5f1f-b94d-963c80c19215, identifier: GK45349
2026-03-30 10:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_59ae808092f4e068518683ef2fefb487.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3f411bf-ce2d-54ed-9d36-dc5c6c73fd09 with identifier: FR35172
2026-03-30 10:55:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3f411bf-ce2d-54ed-9d36-dc5c6c73fd09 with identifier: FR35172
2026-03-30 10:55:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3f411bf-ce2d-54ed-9d36-dc5c6c73fd09 with identifier: FR35172 to the API
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:59:48Z',
 'fuel_type': 'petrol',
 'id': 'e3f411bf-ce2d-54ed-9d36-dc5c6c73fd09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR35172',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 80881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-06',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.5 TSI ACT Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2023}
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR35172%27 HTTP/1.1" 200 None
2026-03-30 10:55:32 [auto1.de] INFO: Saving data for FR35172: {'auction_closing_time': 1774972788.0, 'created_time': 1773341513.241034, 'last_price_update_time': 1774868132.035488}
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR35172') HTTP/1.1" 204 0
2026-03-30 10:55:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3de78674-b716-5f1f-b94d-963c80c19215 with identifier: GK45349
2026-03-30 10:55:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3de78674-b716-5f1f-b94d-963c80c19215 with identifier: GK45349
2026-03-30 10:55:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3de78674-b716-5f1f-b94d-963c80c19215 with identifier: GK45349 to the API
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:24:20Z',
 'fuel_type': 'diesel',
 'id': '3de78674-b716-5f1f-b94d-963c80c19215',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK45349',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 104749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-21',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Sd4 SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2019}
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK45349%27 HTTP/1.1" 200 None
2026-03-30 10:55:32 [auto1.de] INFO: Saving data for GK45349: {'auction_closing_time': 1774970660.0, 'created_time': 1773688435.96458, 'last_price_update_time': 1774868132.524319}
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK45349') HTTP/1.1" 204 0
2026-03-30 10:55:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:32 [auto1.de] INFO: Found listing with ID: VL17014
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL17014%27 HTTP/1.1" 200 None
2026-03-30 10:55:32 [auto1.de] INFO: Scrape type for VL17014: 2
2026-03-30 10:55:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ac9c2ea-2b68-57f9-ab4d-a597c5c76e26 with identifier: VL17014
2026-03-30 10:55:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac9c2ea-2b68-57f9-ab4d-a597c5c76e26 with scrape type 2
2026-03-30 10:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ac9c2ea-2b68-57f9-ab4d-a597c5c76e26 with scrape type 2
2026-03-30 10:55:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ac9c2ea-2b68-57f9-ab4d-a597c5c76e26, identifier: VL17014
2026-03-30 10:55:32 [auto1.de] INFO: Found listing with ID: YW38649
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW38649%27 HTTP/1.1" 200 None
2026-03-30 10:55:32 [auto1.de] INFO: Scrape type for YW38649: 1
2026-03-30 10:55:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ac9c2ea-2b68-57f9-ab4d-a597c5c76e26 with identifier: VL17014
2026-03-30 10:55:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ac9c2ea-2b68-57f9-ab4d-a597c5c76e26 with identifier: VL17014
2026-03-30 10:55:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ac9c2ea-2b68-57f9-ab4d-a597c5c76e26 with identifier: VL17014 to the API
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:31:52Z',
 'fuel_type': 'diesel',
 'id': '8ac9c2ea-2b68-57f9-ab4d-a597c5c76e26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL17014',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce',
 'odometer': 110343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-31',
 'seller_name': None,
 'title': 'Toyota ProAce 1.5 D-4D L1 Kasten Meister',
 'transmission': 'manual',
 'trim': 'L1 Kasten Meister',
 'year': 2023}
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL17014%27 HTTP/1.1" 200 None
2026-03-30 10:55:33 [auto1.de] INFO: Saving data for VL17014: {'auction_closing_time': 1774971112.0, 'created_time': 1774118722.637692, 'last_price_update_time': 1774868133.052801}
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL17014') HTTP/1.1" 204 0
2026-03-30 10:55:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da3c10>
2026-03-30 10:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead/8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed81ba38cc6cd45e30f55e8f09c7a10%252Fpa%252FFD89008_85aeab5805c4325d429cfb87c18ae701.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_85aeab5805c4325d429cfb87c18ae701.jpg saved to cache
2026-03-30 10:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead
2026-03-30 10:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_f46618da4e9c086ce63fcb2ff813d33b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:33 [auto1.de] INFO: Found listing with ID: XY02302
2026-03-30 10:55:33 [auto1.de] INFO: Found listing with ID: ZU63901
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU63901%27 HTTP/1.1" 200 None
2026-03-30 10:55:33 [auto1.de] INFO: Scrape type for ZU63901: 2
2026-03-30 10:55:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29518189-c0c2-5a2e-8e6b-4b8116399a44 with identifier: ZU63901
2026-03-30 10:55:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29518189-c0c2-5a2e-8e6b-4b8116399a44 with scrape type 2
2026-03-30 10:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29518189-c0c2-5a2e-8e6b-4b8116399a44 with scrape type 2
2026-03-30 10:55:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29518189-c0c2-5a2e-8e6b-4b8116399a44, identifier: ZU63901
2026-03-30 10:55:33 [auto1.de] INFO: Found listing with ID: NP60172
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP60172%27 HTTP/1.1" 200 None
2026-03-30 10:55:33 [auto1.de] INFO: Scrape type for NP60172: 2
2026-03-30 10:55:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b09d56f9-d306-5a41-bf57-2c6e95ad5775 with identifier: NP60172
2026-03-30 10:55:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b09d56f9-d306-5a41-bf57-2c6e95ad5775 with scrape type 2
2026-03-30 10:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b09d56f9-d306-5a41-bf57-2c6e95ad5775 with scrape type 2
2026-03-30 10:55:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b09d56f9-d306-5a41-bf57-2c6e95ad5775, identifier: NP60172
2026-03-30 10:55:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29518189-c0c2-5a2e-8e6b-4b8116399a44 with identifier: ZU63901
2026-03-30 10:55:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29518189-c0c2-5a2e-8e6b-4b8116399a44 with identifier: ZU63901
2026-03-30 10:55:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29518189-c0c2-5a2e-8e6b-4b8116399a44 with identifier: ZU63901 to the API
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:12:21Z',
 'fuel_type': 'diesel',
 'id': '29518189-c0c2-5a2e-8e6b-4b8116399a44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU63901',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 155924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-03',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU63901%27 HTTP/1.1" 200 None
2026-03-30 10:55:33 [auto1.de] INFO: Saving data for ZU63901: {'auction_closing_time': 1774969941.0, 'created_time': 1773303292.237253, 'last_price_update_time': 1774868133.734596}
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU63901') HTTP/1.1" 204 0
2026-03-30 10:55:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b09d56f9-d306-5a41-bf57-2c6e95ad5775 with identifier: NP60172
2026-03-30 10:55:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b09d56f9-d306-5a41-bf57-2c6e95ad5775 with identifier: NP60172
2026-03-30 10:55:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b09d56f9-d306-5a41-bf57-2c6e95ad5775 with identifier: NP60172 to the API
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:11:20Z',
 'fuel_type': 'petrol',
 'id': 'b09d56f9-d306-5a41-bf57-2c6e95ad5775',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP60172',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 271926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-28',
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2019}
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP60172%27 HTTP/1.1" 200 None
2026-03-30 10:55:34 [auto1.de] INFO: Saving data for NP60172: {'auction_closing_time': 1774969880.0, 'created_time': 1774464058.244238, 'last_price_update_time': 1774868134.095656}
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP60172') HTTP/1.1" 204 0
2026-03-30 10:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4da1e10>
2026-03-30 10:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead/8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed81ba38cc6cd45e30f55e8f09c7a10%252Fpa%252FFD89008_59ae808092f4e068518683ef2fefb487.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_59ae808092f4e068518683ef2fefb487.jpg saved to cache
2026-03-30 10:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead
2026-03-30 10:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_3a0ad826f59d4747ec97fe58b3cbb062.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:34 [auto1.de] INFO: Found listing with ID: SF44435
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF44435%27 HTTP/1.1" 200 None
2026-03-30 10:55:34 [auto1.de] INFO: Scrape type for SF44435: 2
2026-03-30 10:55:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1c0962b-4b34-522c-a576-b8db0c6a2ca8 with identifier: SF44435
2026-03-30 10:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1c0962b-4b34-522c-a576-b8db0c6a2ca8 with scrape type 2
2026-03-30 10:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1c0962b-4b34-522c-a576-b8db0c6a2ca8 with scrape type 2
2026-03-30 10:55:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1c0962b-4b34-522c-a576-b8db0c6a2ca8, identifier: SF44435
2026-03-30 10:55:34 [auto1.de] INFO: Found listing with ID: LF70646
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF70646%27 HTTP/1.1" 200 None
2026-03-30 10:55:34 [auto1.de] INFO: Scrape type for LF70646: 2
2026-03-30 10:55:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e796e53-538f-508a-bfc3-d02831149dbc with identifier: LF70646
2026-03-30 10:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e796e53-538f-508a-bfc3-d02831149dbc with scrape type 2
2026-03-30 10:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e796e53-538f-508a-bfc3-d02831149dbc with scrape type 2
2026-03-30 10:55:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e796e53-538f-508a-bfc3-d02831149dbc, identifier: LF70646
2026-03-30 10:55:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1c0962b-4b34-522c-a576-b8db0c6a2ca8 with identifier: SF44435
2026-03-30 10:55:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1c0962b-4b34-522c-a576-b8db0c6a2ca8 with identifier: SF44435
2026-03-30 10:55:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1c0962b-4b34-522c-a576-b8db0c6a2ca8 with identifier: SF44435 to the API
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:54:31Z',
 'fuel_type': 'petrol',
 'id': 'd1c0962b-4b34-522c-a576-b8db0c6a2ca8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF44435',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 165891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-27',
 'seller_name': None,
 'title': 'BMW 1er 120i Edition M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'Edition M Sport Shadow',
 'year': 2018}
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF44435%27 HTTP/1.1" 200 None
2026-03-30 10:55:34 [auto1.de] INFO: Saving data for SF44435: {'auction_closing_time': 1774972471.0, 'created_time': 1774464312.39196, 'last_price_update_time': 1774868134.694166}
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF44435') HTTP/1.1" 204 0
2026-03-30 10:55:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e796e53-538f-508a-bfc3-d02831149dbc with identifier: LF70646
2026-03-30 10:55:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e796e53-538f-508a-bfc3-d02831149dbc with identifier: LF70646
2026-03-30 10:55:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e796e53-538f-508a-bfc3-d02831149dbc with identifier: LF70646 to the API
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:35:42Z',
 'fuel_type': 'petrol',
 'id': '4e796e53-538f-508a-bfc3-d02831149dbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF70646',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 118138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-13',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2014}
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF70646%27 HTTP/1.1" 200 None
2026-03-30 10:55:35 [auto1.de] INFO: Saving data for LF70646: {'auction_closing_time': 1774971342.0, 'created_time': 1773344565.223852, 'last_price_update_time': 1774868135.048172}
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF70646') HTTP/1.1" 204 0
2026-03-30 10:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB07846/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef51109d0>
2026-03-30 10:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead/8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed81ba38cc6cd45e30f55e8f09c7a10%252Fpa%252FFD89008_f46618da4e9c086ce63fcb2ff813d33b.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_f46618da4e9c086ce63fcb2ff813d33b.jpg saved to cache
2026-03-30 10:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead
2026-03-30 10:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_9b00eb6583de6148ebb6454b607a6d43.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:35 [auto1.de] INFO: Found listing with ID: KB01548
2026-03-30 10:55:35 [auto1.de] INFO: Found listing with ID: DC30306
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC30306%27 HTTP/1.1" 200 None
2026-03-30 10:55:35 [auto1.de] INFO: Scrape type for DC30306: 2
2026-03-30 10:55:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dd8d53f-f25c-5bc9-883b-ea83a4140c35 with identifier: DC30306
2026-03-30 10:55:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dd8d53f-f25c-5bc9-883b-ea83a4140c35 with scrape type 2
2026-03-30 10:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dd8d53f-f25c-5bc9-883b-ea83a4140c35 with scrape type 2
2026-03-30 10:55:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0dd8d53f-f25c-5bc9-883b-ea83a4140c35, identifier: DC30306
2026-03-30 10:55:35 [auto1.de] INFO: Found listing with ID: SY52709
2026-03-30 10:55:35 [auto1.de] INFO: Found listing with ID: XG30345
2026-03-30 10:55:35 [auto1.de] INFO: Found listing with ID: ZB54249
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB54249%27 HTTP/1.1" 200 None
2026-03-30 10:55:35 [auto1.de] INFO: Scrape type for ZB54249: 2
2026-03-30 10:55:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 470c89ff-88d2-54ed-86bd-cbe338e8a186 with identifier: ZB54249
2026-03-30 10:55:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 470c89ff-88d2-54ed-86bd-cbe338e8a186 with scrape type 2
2026-03-30 10:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 470c89ff-88d2-54ed-86bd-cbe338e8a186 with scrape type 2
2026-03-30 10:55:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 470c89ff-88d2-54ed-86bd-cbe338e8a186, identifier: ZB54249
2026-03-30 10:55:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0dd8d53f-f25c-5bc9-883b-ea83a4140c35 with identifier: DC30306
2026-03-30 10:55:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0dd8d53f-f25c-5bc9-883b-ea83a4140c35 with identifier: DC30306
2026-03-30 10:55:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0dd8d53f-f25c-5bc9-883b-ea83a4140c35 with identifier: DC30306 to the API
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:01:34Z',
 'fuel_type': 'petrol',
 'id': '0dd8d53f-f25c-5bc9-883b-ea83a4140c35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC30306',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 200369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-31',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 FSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2006}
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC30306%27 HTTP/1.1" 200 None
2026-03-30 10:55:35 [auto1.de] INFO: Saving data for DC30306: {'auction_closing_time': 1774969294.0, 'created_time': 1774292530.689933, 'last_price_update_time': 1774868135.646531}
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC30306') HTTP/1.1" 204 0
2026-03-30 10:55:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 470c89ff-88d2-54ed-86bd-cbe338e8a186 with identifier: ZB54249
2026-03-30 10:55:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 470c89ff-88d2-54ed-86bd-cbe338e8a186 with identifier: ZB54249
2026-03-30 10:55:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 470c89ff-88d2-54ed-86bd-cbe338e8a186 with identifier: ZB54249 to the API
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:50:43Z',
 'fuel_type': 'diesel',
 'id': '470c89ff-88d2-54ed-86bd-cbe338e8a186',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB54249',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 370708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-18',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Match BlueMotion',
 'transmission': 'automatic',
 'trim': 'Match BlueMotion',
 'year': 2012}
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB54249%27 HTTP/1.1" 200 None
2026-03-30 10:55:36 [auto1.de] INFO: Saving data for ZB54249: {'auction_closing_time': 1774972243.0, 'created_time': 1774463726.929811, 'last_price_update_time': 1774868136.112135}
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB54249') HTTP/1.1" 204 0
2026-03-30 10:55:36 [auto1.de] INFO: Found listing with ID: ZR85378
2026-03-30 10:55:36 [auto1.de] INFO: Found listing with ID: KA83204
2026-03-30 10:55:36 [auto1.de] INFO: Found listing with ID: NF06054
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF06054%27 HTTP/1.1" 200 None
2026-03-30 10:55:36 [auto1.de] INFO: Scrape type for NF06054: 2
2026-03-30 10:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7f3801a-8bda-5f74-8d7e-7318957e08e3 with identifier: NF06054
2026-03-30 10:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7f3801a-8bda-5f74-8d7e-7318957e08e3 with scrape type 2
2026-03-30 10:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7f3801a-8bda-5f74-8d7e-7318957e08e3 with scrape type 2
2026-03-30 10:55:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7f3801a-8bda-5f74-8d7e-7318957e08e3, identifier: NF06054
2026-03-30 10:55:36 [auto1.de] INFO: Found listing with ID: FP74638
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP74638%27 HTTP/1.1" 200 None
2026-03-30 10:55:36 [auto1.de] INFO: Scrape type for FP74638: 2
2026-03-30 10:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b2db8a3-b465-558a-8eec-65e456a4a081 with identifier: FP74638
2026-03-30 10:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b2db8a3-b465-558a-8eec-65e456a4a081 with scrape type 2
2026-03-30 10:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b2db8a3-b465-558a-8eec-65e456a4a081 with scrape type 2
2026-03-30 10:55:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b2db8a3-b465-558a-8eec-65e456a4a081, identifier: FP74638
2026-03-30 10:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU19465> (referer: https://www.auto1.com/v1/car-details-view/TU19465/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db8ad0>
2026-03-30 10:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead/8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed81ba38cc6cd45e30f55e8f09c7a10%252Fpa%252FFD89008_3a0ad826f59d4747ec97fe58b3cbb062.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_3a0ad826f59d4747ec97fe58b3cbb062.jpg saved to cache
2026-03-30 10:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead
2026-03-30 10:55:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7f3801a-8bda-5f74-8d7e-7318957e08e3 with identifier: NF06054
2026-03-30 10:55:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7f3801a-8bda-5f74-8d7e-7318957e08e3 with identifier: NF06054
2026-03-30 10:55:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7f3801a-8bda-5f74-8d7e-7318957e08e3 with identifier: NF06054 to the API
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:11:34Z',
 'fuel_type': 'diesel',
 'id': 'd7f3801a-8bda-5f74-8d7e-7318957e08e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF06054',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 346068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-01-27',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.9 TDI Special',
 'transmission': 'manual',
 'trim': 'Special',
 'year': 2002}
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF06054%27 HTTP/1.1" 200 None
2026-03-30 10:55:36 [auto1.de] INFO: Saving data for NF06054: {'auction_closing_time': 1774969894.0, 'created_time': 1774380869.843581, 'last_price_update_time': 1774868136.708599}
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF06054') HTTP/1.1" 204 0
2026-03-30 10:55:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b2db8a3-b465-558a-8eec-65e456a4a081 with identifier: FP74638
2026-03-30 10:55:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b2db8a3-b465-558a-8eec-65e456a4a081 with identifier: FP74638
2026-03-30 10:55:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b2db8a3-b465-558a-8eec-65e456a4a081 with identifier: FP74638 to the API
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:53:46Z',
 'fuel_type': 'diesel',
 'id': '1b2db8a3-b465-558a-8eec-65e456a4a081',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP74638',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 147391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-06',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP74638%27 HTTP/1.1" 200 None
2026-03-30 10:55:37 [auto1.de] INFO: Saving data for FP74638: {'auction_closing_time': 1774972426.0, 'created_time': 1774466312.836194, 'last_price_update_time': 1774868137.108031}
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP74638') HTTP/1.1" 204 0
2026-03-30 10:55:37 [auto1.de] INFO: Found listing with ID: YK59782
2026-03-30 10:55:37 [auto1.de] INFO: Found listing with ID: TE22896
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE22896%27 HTTP/1.1" 200 None
2026-03-30 10:55:37 [auto1.de] INFO: Scrape type for TE22896: 2
2026-03-30 10:55:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 273d0f47-5f09-56ae-9e2d-bc69797c454f with identifier: TE22896
2026-03-30 10:55:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 273d0f47-5f09-56ae-9e2d-bc69797c454f with scrape type 2
2026-03-30 10:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 273d0f47-5f09-56ae-9e2d-bc69797c454f with scrape type 2
2026-03-30 10:55:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 273d0f47-5f09-56ae-9e2d-bc69797c454f, identifier: TE22896
2026-03-30 10:55:37 [auto1.de] INFO: Found listing with ID: UM42416
2026-03-30 10:55:37 [auto1.de] INFO: Found listing with ID: CC84922
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC84922%27 HTTP/1.1" 200 None
2026-03-30 10:55:37 [auto1.de] INFO: Scrape type for CC84922: 2
2026-03-30 10:55:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293561e5-c5ab-5304-a6c9-b6d91fda4df4 with identifier: CC84922
2026-03-30 10:55:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293561e5-c5ab-5304-a6c9-b6d91fda4df4 with scrape type 2
2026-03-30 10:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 293561e5-c5ab-5304-a6c9-b6d91fda4df4 with scrape type 2
2026-03-30 10:55:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 293561e5-c5ab-5304-a6c9-b6d91fda4df4, identifier: CC84922
2026-03-30 10:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW51870/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 273d0f47-5f09-56ae-9e2d-bc69797c454f with identifier: TE22896
2026-03-30 10:55:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 273d0f47-5f09-56ae-9e2d-bc69797c454f with identifier: TE22896
2026-03-30 10:55:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 273d0f47-5f09-56ae-9e2d-bc69797c454f with identifier: TE22896 to the API
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:22:55Z',
 'fuel_type': 'diesel',
 'id': '273d0f47-5f09-56ae-9e2d-bc69797c454f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE22896',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 80654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-30',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE22896%27 HTTP/1.1" 200 None
2026-03-30 10:55:37 [auto1.de] INFO: Saving data for TE22896: {'auction_closing_time': 1774970575.0, 'created_time': 1773945917.632955, 'last_price_update_time': 1774868137.756013}
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE22896') HTTP/1.1" 204 0
2026-03-30 10:55:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 293561e5-c5ab-5304-a6c9-b6d91fda4df4 with identifier: CC84922
2026-03-30 10:55:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 293561e5-c5ab-5304-a6c9-b6d91fda4df4 with identifier: CC84922
2026-03-30 10:55:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 293561e5-c5ab-5304-a6c9-b6d91fda4df4 with identifier: CC84922 to the API
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:27:11Z',
 'fuel_type': 'petrol',
 'id': '293561e5-c5ab-5304-a6c9-b6d91fda4df4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC84922',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 164626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-22',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Prime-Line',
 'transmission': 'manual',
 'trim': 'Prime-Line',
 'year': 2017}
2026-03-30 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC84922%27 HTTP/1.1" 200 None
2026-03-30 10:55:38 [auto1.de] INFO: Saving data for CC84922: {'auction_closing_time': 1774970831.0, 'created_time': 1774435682.371102, 'last_price_update_time': 1774868138.110862}
2026-03-30 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC84922') HTTP/1.1" 204 0
2026-03-30 10:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb5e50>
2026-03-30 10:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead/8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed81ba38cc6cd45e30f55e8f09c7a10%252Fpa%252FFD89008_9b00eb6583de6148ebb6454b607a6d43.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_9b00eb6583de6148ebb6454b607a6d43.jpg saved to cache
2026-03-30 10:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead
2026-03-30 10:55:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead, skipping ID generation
2026-03-30 10:55:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead with scrape type 1
2026-03-30 10:55:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead sending to next pipeline
2026-03-30 10:55:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead, identifier: FD89008
2026-03-30 10:55:38 [auto1.de] INFO: Found listing with ID: GG85995
2026-03-30 10:55:38 [auto1.de] INFO: Found listing with ID: ZT91138
2026-03-30 10:55:38 [auto1.de] INFO: Found listing with ID: UL25580
2026-03-30 10:55:38 [auto1.de] INFO: Found listing with ID: LW97378
2026-03-30 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW97378%27 HTTP/1.1" 200 None
2026-03-30 10:55:38 [auto1.de] INFO: Scrape type for LW97378: 2
2026-03-30 10:55:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 197b371d-42e6-5db0-b54c-b580ae9d4ba1 with identifier: LW97378
2026-03-30 10:55:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 197b371d-42e6-5db0-b54c-b580ae9d4ba1 with scrape type 2
2026-03-30 10:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 197b371d-42e6-5db0-b54c-b580ae9d4ba1 with scrape type 2
2026-03-30 10:55:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 197b371d-42e6-5db0-b54c-b580ae9d4ba1, identifier: LW97378
2026-03-30 10:55:38 [auto1.de] INFO: Found listing with ID: PW66424
2026-03-30 10:55:38 [auto1.de] INFO: Found listing with ID: XH17587
2026-03-30 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH17587%27 HTTP/1.1" 200 None
2026-03-30 10:55:38 [auto1.de] INFO: Scrape type for XH17587: 2
2026-03-30 10:55:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a483e90-0df7-58c5-80f7-4857c23164e3 with identifier: XH17587
2026-03-30 10:55:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a483e90-0df7-58c5-80f7-4857c23164e3 with scrape type 2
2026-03-30 10:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a483e90-0df7-58c5-80f7-4857c23164e3 with scrape type 2
2026-03-30 10:55:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a483e90-0df7-58c5-80f7-4857c23164e3, identifier: XH17587
2026-03-30 10:55:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead with identifier: FD89008
2026-03-30 10:55:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead with identifier: FD89008
2026-03-30 10:55:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead with identifier: FD89008 to the API
2026-03-30 10:55:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_9b00eb6583de6148ebb6454b607a6d43.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:18:56Z',
 'fuel_type': 'petrol',
 'id': '8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD89008',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 118356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead/8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_85aeab5805c4325d429cfb87c18ae701.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead/8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_59ae808092f4e068518683ef2fefb487.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead/8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_f46618da4e9c086ce63fcb2ff813d33b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead/8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_3a0ad826f59d4747ec97fe58b3cbb062.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead/8b9b17f7-d6ac-5e60-a83b-ea85a2e91ead_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed81ba38cc6cd45e30f55e8f09c7a10/pa/FD89008_9b00eb6583de6148ebb6454b607a6d43.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Chevrolet Spark 1.2 LT+',
 'transmission': 'manual',
 'trim': 'LT+',
 'year': 2013}
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD89008%27 HTTP/1.1" 200 None
2026-03-30 10:55:39 [auto1.de] INFO: Saving data for FD89008: {'created_time': 1774868139.10375, 'last_price_update_time': 1774868139.103763, 'auction_closing_time': 1774970336.0}
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD89008') HTTP/1.1" 204 0
2026-03-30 10:55:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 197b371d-42e6-5db0-b54c-b580ae9d4ba1 with identifier: LW97378
2026-03-30 10:55:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 197b371d-42e6-5db0-b54c-b580ae9d4ba1 with identifier: LW97378
2026-03-30 10:55:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 197b371d-42e6-5db0-b54c-b580ae9d4ba1 with identifier: LW97378 to the API
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-31T15:27:34Z',
 'fuel_type': 'petrol',
 'id': '197b371d-42e6-5db0-b54c-b580ae9d4ba1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW97378',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 116951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-25',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2009}
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW97378%27 HTTP/1.1" 200 None
2026-03-30 10:55:39 [auto1.de] INFO: Saving data for LW97378: {'auction_closing_time': 1774970854.0, 'created_time': 1773341968.309102, 'last_price_update_time': 1774868139.614045}
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW97378') HTTP/1.1" 204 0
2026-03-30 10:55:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a483e90-0df7-58c5-80f7-4857c23164e3 with identifier: XH17587
2026-03-30 10:55:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a483e90-0df7-58c5-80f7-4857c23164e3 with identifier: XH17587
2026-03-30 10:55:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a483e90-0df7-58c5-80f7-4857c23164e3 with identifier: XH17587 to the API
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-31T15:40:52Z',
 'fuel_type': 'diesel',
 'id': '6a483e90-0df7-58c5-80f7-4857c23164e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH17587',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 120920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-04',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2019}
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH17587%27 HTTP/1.1" 200 None
2026-03-30 10:55:39 [auto1.de] INFO: Saving data for XH17587: {'auction_closing_time': 1774971652.0, 'created_time': 1773344736.948329, 'last_price_update_time': 1774868139.984613}
2026-03-30 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH17587') HTTP/1.1" 204 0
2026-03-30 10:55:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66e5f492-a47a-535b-81fc-fe496690ab4a with identifier: TU19465
2026-03-30 10:55:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66e5f492-a47a-535b-81fc-fe496690ab4a with scrape type 1
2026-03-30 10:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 66e5f492-a47a-535b-81fc-fe496690ab4a
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F9f%252F189fa96ac706c9bb613b8270bbd4077e%252Fpa%252FTU19465_b4493d93aeabbaf49c3467d5bbc0e0c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/9f/189fa96ac706c9bb613b8270bbd4077e/pa/TU19465_b4493d93aeabbaf49c3467d5bbc0e0c8.jpg already downloaded
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F9f%252F189fa96ac706c9bb613b8270bbd4077e%252Fpa%252FTU19465_dda6f1ad3244a00f1cc5f5e489667502.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/9f/189fa96ac706c9bb613b8270bbd4077e/pa/TU19465_dda6f1ad3244a00f1cc5f5e489667502.jpg already downloaded
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F9f%252F189fa96ac706c9bb613b8270bbd4077e%252Fpa%252FTU19465_5fc3d4b81ae54f539eca2b09a115ce53.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/9f/189fa96ac706c9bb613b8270bbd4077e/pa/TU19465_5fc3d4b81ae54f539eca2b09a115ce53.jpg already downloaded
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F9f%252F189fa96ac706c9bb613b8270bbd4077e%252Fpa%252FTU19465_336d9bd0b8ba5541ae9bdee06b8ec3b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/9f/189fa96ac706c9bb613b8270bbd4077e/pa/TU19465_336d9bd0b8ba5541ae9bdee06b8ec3b7.jpg already downloaded
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F9f%252F189fa96ac706c9bb613b8270bbd4077e%252Fpa%252FTU19465_51d7594b6ec37aa2c87e59ff008844e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/9f/189fa96ac706c9bb613b8270bbd4077e/pa/TU19465_51d7594b6ec37aa2c87e59ff008844e8.jpg already downloaded
2026-03-30 10:55:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66e5f492-a47a-535b-81fc-fe496690ab4a, identifier: TU19465
2026-03-30 10:55:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:40 [auto1.de] INFO: Found listing with ID: TS72437
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS72437%27 HTTP/1.1" 200 None
2026-03-30 10:55:40 [auto1.de] INFO: Scrape type for TS72437: 2
2026-03-30 10:55:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2747d65-9e53-5c04-ab80-afc3047aa356 with identifier: TS72437
2026-03-30 10:55:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2747d65-9e53-5c04-ab80-afc3047aa356 with scrape type 2
2026-03-30 10:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2747d65-9e53-5c04-ab80-afc3047aa356 with scrape type 2
2026-03-30 10:55:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2747d65-9e53-5c04-ab80-afc3047aa356, identifier: TS72437
2026-03-30 10:55:40 [auto1.de] INFO: Found listing with ID: JK25438
2026-03-30 10:55:40 [auto1.de] INFO: Found listing with ID: RX10275
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX10275%27 HTTP/1.1" 200 None
2026-03-30 10:55:40 [auto1.de] INFO: Scrape type for RX10275: 2
2026-03-30 10:55:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2086e46d-3754-5147-bd88-cc67ffc1e5f3 with identifier: RX10275
2026-03-30 10:55:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2086e46d-3754-5147-bd88-cc67ffc1e5f3 with scrape type 2
2026-03-30 10:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2086e46d-3754-5147-bd88-cc67ffc1e5f3 with scrape type 2
2026-03-30 10:55:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2086e46d-3754-5147-bd88-cc67ffc1e5f3, identifier: RX10275
2026-03-30 10:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH45665> (referer: https://www.auto1.com/v1/car-details-view/YH45665/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EV61179> (referer: https://www.auto1.com/v1/car-details-view/EV61179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW38649/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66e5f492-a47a-535b-81fc-fe496690ab4a with identifier: TU19465
2026-03-30 10:55:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66e5f492-a47a-535b-81fc-fe496690ab4a with identifier: TU19465
2026-03-30 10:55:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66e5f492-a47a-535b-81fc-fe496690ab4a with identifier: TU19465 to the API
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TU19465>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.8L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:38:23Z',
 'fuel_type': 'petrol',
 'id': '66e5f492-a47a-535b-81fc-fe496690ab4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU19465',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'BMW',
 'model': '3er',
 'odometer': 219458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img18/9f/189fa96ac706c9bb613b8270bbd4077e/pa/TU19465_b4493d93aeabbaf49c3467d5bbc0e0c8.jpg',
                'https://img-pa.auto1.com/img18/9f/189fa96ac706c9bb613b8270bbd4077e/pa/TU19465_dda6f1ad3244a00f1cc5f5e489667502.jpg',
                'https://img-pa.auto1.com/img18/9f/189fa96ac706c9bb613b8270bbd4077e/pa/TU19465_5fc3d4b81ae54f539eca2b09a115ce53.jpg',
                'https://img-pa.auto1.com/img18/9f/189fa96ac706c9bb613b8270bbd4077e/pa/TU19465_336d9bd0b8ba5541ae9bdee06b8ec3b7.jpg',
                'https://img-pa.auto1.com/img18/9f/189fa96ac706c9bb613b8270bbd4077e/pa/TU19465_51d7594b6ec37aa2c87e59ff008844e8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e5f492-a47a-535b-81fc-fe496690ab4a/66e5f492-a47a-535b-81fc-fe496690ab4a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/9f/189fa96ac706c9bb613b8270bbd4077e/pa/TU19465_b4493d93aeabbaf49c3467d5bbc0e0c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e5f492-a47a-535b-81fc-fe496690ab4a/66e5f492-a47a-535b-81fc-fe496690ab4a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/9f/189fa96ac706c9bb613b8270bbd4077e/pa/TU19465_dda6f1ad3244a00f1cc5f5e489667502.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e5f492-a47a-535b-81fc-fe496690ab4a/66e5f492-a47a-535b-81fc-fe496690ab4a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/9f/189fa96ac706c9bb613b8270bbd4077e/pa/TU19465_5fc3d4b81ae54f539eca2b09a115ce53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e5f492-a47a-535b-81fc-fe496690ab4a/66e5f492-a47a-535b-81fc-fe496690ab4a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/9f/189fa96ac706c9bb613b8270bbd4077e/pa/TU19465_336d9bd0b8ba5541ae9bdee06b8ec3b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e5f492-a47a-535b-81fc-fe496690ab4a/66e5f492-a47a-535b-81fc-fe496690ab4a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/9f/189fa96ac706c9bb613b8270bbd4077e/pa/TU19465_51d7594b6ec37aa2c87e59ff008844e8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 316ti',
 'transmission': 'manual',
 'trim': '',
 'year': 2001}
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU19465%27 HTTP/1.1" 200 None
2026-03-30 10:55:40 [auto1.de] INFO: Saving data for TU19465: {'created_time': 1774868140.819976, 'last_price_update_time': 1774868140.819991, 'auction_closing_time': 1774971503.0}
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU19465') HTTP/1.1" 204 0
2026-03-30 10:55:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2747d65-9e53-5c04-ab80-afc3047aa356 with identifier: TS72437
2026-03-30 10:55:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2747d65-9e53-5c04-ab80-afc3047aa356 with identifier: TS72437
2026-03-30 10:55:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2747d65-9e53-5c04-ab80-afc3047aa356 with identifier: TS72437 to the API
2026-03-30 10:55:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:46:32Z',
 'fuel_type': 'petrol',
 'id': 'e2747d65-9e53-5c04-ab80-afc3047aa356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS72437',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 5746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-29',
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2024}
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS72437%27 HTTP/1.1" 200 None
2026-03-30 10:55:41 [auto1.de] INFO: Saving data for TS72437: {'auction_closing_time': 1774971992.0, 'created_time': 1773689270.095413, 'last_price_update_time': 1774868141.191589}
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS72437') HTTP/1.1" 204 0
2026-03-30 10:55:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2086e46d-3754-5147-bd88-cc67ffc1e5f3 with identifier: RX10275
2026-03-30 10:55:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2086e46d-3754-5147-bd88-cc67ffc1e5f3 with identifier: RX10275
2026-03-30 10:55:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2086e46d-3754-5147-bd88-cc67ffc1e5f3 with identifier: RX10275 to the API
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:28:59Z',
 'fuel_type': 'petrol',
 'id': '2086e46d-3754-5147-bd88-cc67ffc1e5f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX10275',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 167632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-04',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 170 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2006}
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX10275%27 HTTP/1.1" 200 None
2026-03-30 10:55:41 [auto1.de] INFO: Saving data for RX10275: {'auction_closing_time': 1774970939.0, 'created_time': 1773775899.013553, 'last_price_update_time': 1774868141.552749}
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX10275') HTTP/1.1" 204 0
2026-03-30 10:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK31511/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:41 [auto1.de] INFO: Found listing with ID: XY32455
2026-03-30 10:55:41 [auto1.de] INFO: Found listing with ID: HF93344
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF93344%27 HTTP/1.1" 200 None
2026-03-30 10:55:41 [auto1.de] INFO: Scrape type for HF93344: 2
2026-03-30 10:55:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcafb3a4-d607-5a23-bc56-af15fd5c3a68 with identifier: HF93344
2026-03-30 10:55:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcafb3a4-d607-5a23-bc56-af15fd5c3a68 with scrape type 2
2026-03-30 10:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcafb3a4-d607-5a23-bc56-af15fd5c3a68 with scrape type 2
2026-03-30 10:55:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcafb3a4-d607-5a23-bc56-af15fd5c3a68, identifier: HF93344
2026-03-30 10:55:41 [auto1.de] INFO: Found listing with ID: JW40764
2026-03-30 10:55:41 [auto1.de] INFO: Found listing with ID: KK63097
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK63097%27 HTTP/1.1" 200 None
2026-03-30 10:55:41 [auto1.de] INFO: Scrape type for KK63097: 2
2026-03-30 10:55:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aee4eb38-ca82-5aa2-aaf6-6664f8fb60cf with identifier: KK63097
2026-03-30 10:55:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aee4eb38-ca82-5aa2-aaf6-6664f8fb60cf with scrape type 2
2026-03-30 10:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aee4eb38-ca82-5aa2-aaf6-6664f8fb60cf with scrape type 2
2026-03-30 10:55:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aee4eb38-ca82-5aa2-aaf6-6664f8fb60cf, identifier: KK63097
2026-03-30 10:55:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcafb3a4-d607-5a23-bc56-af15fd5c3a68 with identifier: HF93344
2026-03-30 10:55:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcafb3a4-d607-5a23-bc56-af15fd5c3a68 with identifier: HF93344
2026-03-30 10:55:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcafb3a4-d607-5a23-bc56-af15fd5c3a68 with identifier: HF93344 to the API
2026-03-30 10:55:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:40:17Z',
 'fuel_type': 'diesel',
 'id': 'fcafb3a4-d607-5a23-bc56-af15fd5c3a68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF93344',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 67083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-28',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Asphalt L2',
 'transmission': 'manual',
 'trim': 'Asphalt L2',
 'year': 2019}
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF93344%27 HTTP/1.1" 200 None
2026-03-30 10:55:42 [auto1.de] INFO: Saving data for HF93344: {'auction_closing_time': 1774971617.0, 'created_time': 1773382044.203802, 'last_price_update_time': 1774868142.129705}
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF93344') HTTP/1.1" 204 0
2026-03-30 10:55:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aee4eb38-ca82-5aa2-aaf6-6664f8fb60cf with identifier: KK63097
2026-03-30 10:55:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aee4eb38-ca82-5aa2-aaf6-6664f8fb60cf with identifier: KK63097
2026-03-30 10:55:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aee4eb38-ca82-5aa2-aaf6-6664f8fb60cf with identifier: KK63097 to the API
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:18:46Z',
 'fuel_type': 'petrol',
 'id': 'aee4eb38-ca82-5aa2-aaf6-6664f8fb60cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK63097',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 147434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2019}
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK63097%27 HTTP/1.1" 200 None
2026-03-30 10:55:42 [auto1.de] INFO: Saving data for KK63097: {'auction_closing_time': 1774970326.0, 'created_time': 1774349707.051872, 'last_price_update_time': 1774868142.473508}
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK63097') HTTP/1.1" 204 0
2026-03-30 10:55:42 [auto1.de] INFO: Found listing with ID: YC07614
2026-03-30 10:55:42 [auto1.de] INFO: Found listing with ID: VW33777
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW33777%27 HTTP/1.1" 200 None
2026-03-30 10:55:42 [auto1.de] INFO: Scrape type for VW33777: 2
2026-03-30 10:55:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1667c090-7918-55c6-a6ee-0b96366cf589 with identifier: VW33777
2026-03-30 10:55:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1667c090-7918-55c6-a6ee-0b96366cf589 with scrape type 2
2026-03-30 10:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1667c090-7918-55c6-a6ee-0b96366cf589 with scrape type 2
2026-03-30 10:55:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1667c090-7918-55c6-a6ee-0b96366cf589, identifier: VW33777
2026-03-30 10:55:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aee77f5f-2a87-56cd-a02b-d510ecc03b11 with identifier: YH45665
2026-03-30 10:55:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aee77f5f-2a87-56cd-a02b-d510ecc03b11 with scrape type 1
2026-03-30 10:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aee77f5f-2a87-56cd-a02b-d510ecc03b11
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_ca9550c04695cc77ec4d9cbe2ecb3130.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_ca9550c04695cc77ec4d9cbe2ecb3130.jpg not downloaded yet
2026-03-30 10:55:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcdedeae-5a12-5588-a8c3-1c11179a3ee6 with identifier: EV61179
2026-03-30 10:55:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcdedeae-5a12-5588-a8c3-1c11179a3ee6 with scrape type 1
2026-03-30 10:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcdedeae-5a12-5588-a8c3-1c11179a3ee6
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_5a47922ca85735d898acc2f99d47af06.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_5a47922ca85735d898acc2f99d47af06.jpg not downloaded yet
2026-03-30 10:55:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1667c090-7918-55c6-a6ee-0b96366cf589 with identifier: VW33777
2026-03-30 10:55:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1667c090-7918-55c6-a6ee-0b96366cf589 with identifier: VW33777
2026-03-30 10:55:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1667c090-7918-55c6-a6ee-0b96366cf589 with identifier: VW33777 to the API
2026-03-30 10:55:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-31T15:10:15Z',
 'fuel_type': 'petrol',
 'id': '1667c090-7918-55c6-a6ee-0b96366cf589',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW33777',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 83812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-06',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2017}
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW33777%27 HTTP/1.1" 200 None
2026-03-30 10:55:43 [auto1.de] INFO: Saving data for VW33777: {'auction_closing_time': 1774969815.0, 'created_time': 1774379721.536604, 'last_price_update_time': 1774868143.341151}
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW33777') HTTP/1.1" 204 0
2026-03-30 10:55:43 [auto1.de] INFO: Found listing with ID: ES32816
2026-03-30 10:55:43 [auto1.de] INFO: Found listing with ID: XX85563
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX85563%27 HTTP/1.1" 200 None
2026-03-30 10:55:43 [auto1.de] INFO: Scrape type for XX85563: 2
2026-03-30 10:55:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9576e0fa-5c69-52ab-a5a3-1ba72ed631be with identifier: XX85563
2026-03-30 10:55:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9576e0fa-5c69-52ab-a5a3-1ba72ed631be with scrape type 2
2026-03-30 10:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9576e0fa-5c69-52ab-a5a3-1ba72ed631be with scrape type 2
2026-03-30 10:55:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9576e0fa-5c69-52ab-a5a3-1ba72ed631be, identifier: XX85563
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_e323402e89eced0c9b78c584a19a5601.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_e323402e89eced0c9b78c584a19a5601.jpg not downloaded yet
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_a30250007b923dfbb60f193bdea25ef3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_a30250007b923dfbb60f193bdea25ef3.jpg not downloaded yet
2026-03-30 10:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9576e0fa-5c69-52ab-a5a3-1ba72ed631be with identifier: XX85563
2026-03-30 10:55:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9576e0fa-5c69-52ab-a5a3-1ba72ed631be with identifier: XX85563
2026-03-30 10:55:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9576e0fa-5c69-52ab-a5a3-1ba72ed631be with identifier: XX85563 to the API
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-31T15:01:18Z',
 'fuel_type': 'petrol',
 'id': '9576e0fa-5c69-52ab-a5a3-1ba72ed631be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX85563',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 10614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-26',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2024}
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX85563%27 HTTP/1.1" 200 None
2026-03-30 10:55:43 [auto1.de] INFO: Saving data for XX85563: {'auction_closing_time': 1774969278.0, 'created_time': 1774467955.605558, 'last_price_update_time': 1774868143.826393}
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX85563') HTTP/1.1" 204 0
2026-03-30 10:55:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:43 [auto1.de] INFO: Found listing with ID: AC43981
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC43981%27 HTTP/1.1" 200 None
2026-03-30 10:55:43 [auto1.de] INFO: Scrape type for AC43981: 2
2026-03-30 10:55:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4b2e216-6fd5-512a-a360-b5286bbd7077 with identifier: AC43981
2026-03-30 10:55:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4b2e216-6fd5-512a-a360-b5286bbd7077 with scrape type 2
2026-03-30 10:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4b2e216-6fd5-512a-a360-b5286bbd7077 with scrape type 2
2026-03-30 10:55:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4b2e216-6fd5-512a-a360-b5286bbd7077, identifier: AC43981
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_35db834c523be115abc6203d9f3bf555.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_35db834c523be115abc6203d9f3bf555.jpg not downloaded yet
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_bee9ee0d35d45d4ffd1e95ab37860d5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_bee9ee0d35d45d4ffd1e95ab37860d5d.jpg not downloaded yet
2026-03-30 10:55:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4b2e216-6fd5-512a-a360-b5286bbd7077 with identifier: AC43981
2026-03-30 10:55:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4b2e216-6fd5-512a-a360-b5286bbd7077 with identifier: AC43981
2026-03-30 10:55:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4b2e216-6fd5-512a-a360-b5286bbd7077 with identifier: AC43981 to the API
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:52:55Z',
 'fuel_type': 'petrol',
 'id': 'd4b2e216-6fd5-512a-a360-b5286bbd7077',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC43981',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 123516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-29',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 SIDI Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2014}
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC43981%27 HTTP/1.1" 200 None
2026-03-30 10:55:44 [auto1.de] INFO: Saving data for AC43981: {'auction_closing_time': 1774972375.0, 'created_time': 1773688608.774753, 'last_price_update_time': 1774868144.43828}
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC43981') HTTP/1.1" 204 0
2026-03-30 10:55:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:44 [auto1.de] INFO: Found listing with ID: SF11618
2026-03-30 10:55:44 [auto1.de] INFO: Found listing with ID: CF27323
2026-03-30 10:55:44 [auto1.de] INFO: Found listing with ID: BK72669
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK72669%27 HTTP/1.1" 200 None
2026-03-30 10:55:44 [auto1.de] INFO: Scrape type for BK72669: 2
2026-03-30 10:55:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0ab4830-a800-56c4-b37c-b98f0000f31b with identifier: BK72669
2026-03-30 10:55:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0ab4830-a800-56c4-b37c-b98f0000f31b with scrape type 2
2026-03-30 10:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0ab4830-a800-56c4-b37c-b98f0000f31b with scrape type 2
2026-03-30 10:55:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0ab4830-a800-56c4-b37c-b98f0000f31b, identifier: BK72669
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_0db421ea670a2f35e53de47e4dc58e6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_0db421ea670a2f35e53de47e4dc58e6e.jpg not downloaded yet
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_ba96aebf463dcf889085083294a021e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_ba96aebf463dcf889085083294a021e1.jpg not downloaded yet
2026-03-30 10:55:44 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 9528 | hits on page: 40
2026-03-30 10:55:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0ab4830-a800-56c4-b37c-b98f0000f31b with identifier: BK72669
2026-03-30 10:55:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0ab4830-a800-56c4-b37c-b98f0000f31b with identifier: BK72669
2026-03-30 10:55:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0ab4830-a800-56c4-b37c-b98f0000f31b with identifier: BK72669 to the API
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:25:51Z',
 'fuel_type': 'petrol',
 'id': 'c0ab4830-a800-56c4-b37c-b98f0000f31b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK72669',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 94894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-22',
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Trend 2WD',
 'transmission': 'manual',
 'trim': 'Trend 2WD',
 'year': 2018}
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK72669%27 HTTP/1.1" 200 None
2026-03-30 10:55:44 [auto1.de] INFO: Saving data for BK72669: {'auction_closing_time': 1774970751.0, 'created_time': 1774467630.747547, 'last_price_update_time': 1774868144.943276}
2026-03-30 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK72669') HTTP/1.1" 204 0
2026-03-30 10:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_5a47922ca85735d898acc2f99d47af06.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_ca9550c04695cc77ec4d9cbe2ecb3130.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:45 [auto1.de] INFO: Found listing with ID: GB55517
2026-03-30 10:55:45 [auto1.de] INFO: Found listing with ID: YL83790
2026-03-30 10:55:45 [auto1.de] INFO: Found listing with ID: RE14454
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE14454%27 HTTP/1.1" 200 None
2026-03-30 10:55:45 [auto1.de] INFO: Scrape type for RE14454: 2
2026-03-30 10:55:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2df1fd69-90dc-58bd-8fcf-ad2f4e4a742c with identifier: RE14454
2026-03-30 10:55:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2df1fd69-90dc-58bd-8fcf-ad2f4e4a742c with scrape type 2
2026-03-30 10:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2df1fd69-90dc-58bd-8fcf-ad2f4e4a742c with scrape type 2
2026-03-30 10:55:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2df1fd69-90dc-58bd-8fcf-ad2f4e4a742c, identifier: RE14454
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_b04591d6d7daa27bf082cb19910b542b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_b04591d6d7daa27bf082cb19910b542b.jpg not downloaded yet
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_b37a3b0c6d35a40dd2384a078c9ecce9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_b37a3b0c6d35a40dd2384a078c9ecce9.jpg not downloaded yet
2026-03-30 10:55:45 [auto1.de] INFO: Found listing with ID: CN59781
2026-03-30 10:55:45 [auto1.de] INFO: Found listing with ID: LU03314
2026-03-30 10:55:45 [auto1.de] INFO: Found listing with ID: UR23354
2026-03-30 10:55:45 [auto1.de] INFO: Found listing with ID: ZF95436
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF95436%27 HTTP/1.1" 200 None
2026-03-30 10:55:45 [auto1.de] INFO: Scrape type for ZF95436: 2
2026-03-30 10:55:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 547e6eda-e75f-5488-a432-8370ab0cf105 with identifier: ZF95436
2026-03-30 10:55:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 547e6eda-e75f-5488-a432-8370ab0cf105 with scrape type 2
2026-03-30 10:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 547e6eda-e75f-5488-a432-8370ab0cf105 with scrape type 2
2026-03-30 10:55:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 547e6eda-e75f-5488-a432-8370ab0cf105, identifier: ZF95436
2026-03-30 10:55:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_a30250007b923dfbb60f193bdea25ef3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_e323402e89eced0c9b78c584a19a5601.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2df1fd69-90dc-58bd-8fcf-ad2f4e4a742c with identifier: RE14454
2026-03-30 10:55:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2df1fd69-90dc-58bd-8fcf-ad2f4e4a742c with identifier: RE14454
2026-03-30 10:55:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2df1fd69-90dc-58bd-8fcf-ad2f4e4a742c with identifier: RE14454 to the API
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:10:57Z',
 'fuel_type': 'petrol',
 'id': '2df1fd69-90dc-58bd-8fcf-ad2f4e4a742c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE14454',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 184955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-15',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 250 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE14454%27 HTTP/1.1" 200 None
2026-03-30 10:55:45 [auto1.de] INFO: Saving data for RE14454: {'auction_closing_time': 1774969857.0, 'created_time': 1774466282.267327, 'last_price_update_time': 1774868145.654985}
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE14454') HTTP/1.1" 204 0
2026-03-30 10:55:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 547e6eda-e75f-5488-a432-8370ab0cf105 with identifier: ZF95436
2026-03-30 10:55:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 547e6eda-e75f-5488-a432-8370ab0cf105 with identifier: ZF95436
2026-03-30 10:55:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 547e6eda-e75f-5488-a432-8370ab0cf105 with identifier: ZF95436 to the API
2026-03-30 10:55:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:06:53Z',
 'fuel_type': 'petrol',
 'id': '547e6eda-e75f-5488-a432-8370ab0cf105',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF95436',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 62715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-23',
 'seller_name': None,
 'title': 'Audi A4 45 TFSI Mild-Hybrid quattro advanced',
 'transmission': 'automatic',
 'trim': 'quattro advanced',
 'year': 2020}
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF95436%27 HTTP/1.1" 200 None
2026-03-30 10:55:46 [auto1.de] INFO: Saving data for ZF95436: {'auction_closing_time': 1774969613.0, 'created_time': 1773305624.595099, 'last_price_update_time': 1774868146.178598}
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF95436') HTTP/1.1" 204 0
2026-03-30 10:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_bee9ee0d35d45d4ffd1e95ab37860d5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:46 [auto1.de] INFO: Found listing with ID: TZ82859
2026-03-30 10:55:46 [auto1.de] INFO: Found listing with ID: UA38092
2026-03-30 10:55:46 [auto1.de] INFO: Found listing with ID: ZA73263
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA73263%27 HTTP/1.1" 200 None
2026-03-30 10:55:46 [auto1.de] INFO: Scrape type for ZA73263: 2
2026-03-30 10:55:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37581b03-4ec0-5557-8ac0-b2612a496c43 with identifier: ZA73263
2026-03-30 10:55:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37581b03-4ec0-5557-8ac0-b2612a496c43 with scrape type 2
2026-03-30 10:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37581b03-4ec0-5557-8ac0-b2612a496c43 with scrape type 2
2026-03-30 10:55:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37581b03-4ec0-5557-8ac0-b2612a496c43, identifier: ZA73263
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_c49bc6d898d295164b1c8c057cda062a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_c49bc6d898d295164b1c8c057cda062a.jpg not downloaded yet
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_7ca1cfa930e13487dceac46ba076e506.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_7ca1cfa930e13487dceac46ba076e506.jpg not downloaded yet
2026-03-30 10:55:46 [auto1.de] INFO: Found listing with ID: UG13910
2026-03-30 10:55:46 [auto1.de] INFO: Found listing with ID: EU09282
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU09282%27 HTTP/1.1" 200 None
2026-03-30 10:55:46 [auto1.de] INFO: Scrape type for EU09282: 2
2026-03-30 10:55:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b9d88aa-b5a1-5c54-a498-905a9c00608a with identifier: EU09282
2026-03-30 10:55:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b9d88aa-b5a1-5c54-a498-905a9c00608a with scrape type 2
2026-03-30 10:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b9d88aa-b5a1-5c54-a498-905a9c00608a with scrape type 2
2026-03-30 10:55:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b9d88aa-b5a1-5c54-a498-905a9c00608a, identifier: EU09282
2026-03-30 10:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_35db834c523be115abc6203d9f3bf555.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37581b03-4ec0-5557-8ac0-b2612a496c43 with identifier: ZA73263
2026-03-30 10:55:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37581b03-4ec0-5557-8ac0-b2612a496c43 with identifier: ZA73263
2026-03-30 10:55:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37581b03-4ec0-5557-8ac0-b2612a496c43 with identifier: ZA73263 to the API
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T16:00:00Z',
 'fuel_type': 'petrol',
 'id': '37581b03-4ec0-5557-8ac0-b2612a496c43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA73263',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 216143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-02',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2006}
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA73263%27 HTTP/1.1" 200 None
2026-03-30 10:55:46 [auto1.de] INFO: Saving data for ZA73263: {'auction_closing_time': 1774972800.0, 'created_time': 1774416953.856742, 'last_price_update_time': 1774868146.850033}
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA73263') HTTP/1.1" 204 0
2026-03-30 10:55:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b9d88aa-b5a1-5c54-a498-905a9c00608a with identifier: EU09282
2026-03-30 10:55:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b9d88aa-b5a1-5c54-a498-905a9c00608a with identifier: EU09282
2026-03-30 10:55:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b9d88aa-b5a1-5c54-a498-905a9c00608a with identifier: EU09282 to the API
2026-03-30 10:55:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:56:39Z',
 'fuel_type': 'diesel',
 'id': '7b9d88aa-b5a1-5c54-a498-905a9c00608a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU09282',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 119759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-06',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 116 CDI Pro lang',
 'transmission': 'automatic',
 'trim': 'Pro lang',
 'year': 2020}
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU09282%27 HTTP/1.1" 200 None
2026-03-30 10:55:47 [auto1.de] INFO: Saving data for EU09282: {'auction_closing_time': 1774972599.0, 'created_time': 1774463876.832638, 'last_price_update_time': 1774868147.244749}
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU09282') HTTP/1.1" 204 0
2026-03-30 10:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db9c50>
2026-03-30 10:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_5a47922ca85735d898acc2f99d47af06.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_5a47922ca85735d898acc2f99d47af06.jpg saved to cache
2026-03-30 10:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcdedeae-5a12-5588-a8c3-1c11179a3ee6
2026-03-30 10:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f55e90>
2026-03-30 10:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_ca9550c04695cc77ec4d9cbe2ecb3130.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_ca9550c04695cc77ec4d9cbe2ecb3130.jpg saved to cache
2026-03-30 10:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aee77f5f-2a87-56cd-a02b-d510ecc03b11
2026-03-30 10:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_ba96aebf463dcf889085083294a021e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:47 [auto1.de] INFO: Found listing with ID: TR55482
2026-03-30 10:55:47 [auto1.de] INFO: Found listing with ID: WB89242
2026-03-30 10:55:47 [auto1.de] INFO: Found listing with ID: AP35212
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP35212%27 HTTP/1.1" 200 None
2026-03-30 10:55:47 [auto1.de] INFO: Scrape type for AP35212: 2
2026-03-30 10:55:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92150cbf-0752-52e7-ae30-882fe37a288f with identifier: AP35212
2026-03-30 10:55:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92150cbf-0752-52e7-ae30-882fe37a288f with scrape type 2
2026-03-30 10:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92150cbf-0752-52e7-ae30-882fe37a288f with scrape type 2
2026-03-30 10:55:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92150cbf-0752-52e7-ae30-882fe37a288f, identifier: AP35212
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_7f6b8a653de9bd68ca0b7143da8e0425.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_7f6b8a653de9bd68ca0b7143da8e0425.jpg not downloaded yet
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_07799046e47f42904f8b58d88c49a082.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_07799046e47f42904f8b58d88c49a082.jpg not downloaded yet
2026-03-30 10:55:47 [auto1.de] INFO: Found listing with ID: DS36264
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS36264%27 HTTP/1.1" 200 None
2026-03-30 10:55:47 [auto1.de] INFO: Scrape type for DS36264: 2
2026-03-30 10:55:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ab58fe3-ed2b-5fca-a136-3c336078ce6e with identifier: DS36264
2026-03-30 10:55:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ab58fe3-ed2b-5fca-a136-3c336078ce6e with scrape type 2
2026-03-30 10:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ab58fe3-ed2b-5fca-a136-3c336078ce6e with scrape type 2
2026-03-30 10:55:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ab58fe3-ed2b-5fca-a136-3c336078ce6e, identifier: DS36264
2026-03-30 10:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW51870> (referer: https://www.auto1.com/v1/car-details-view/CW51870/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_0db421ea670a2f35e53de47e4dc58e6e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92150cbf-0752-52e7-ae30-882fe37a288f with identifier: AP35212
2026-03-30 10:55:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92150cbf-0752-52e7-ae30-882fe37a288f with identifier: AP35212
2026-03-30 10:55:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92150cbf-0752-52e7-ae30-882fe37a288f with identifier: AP35212 to the API
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:35:52Z',
 'fuel_type': 'petrol',
 'id': '92150cbf-0752-52e7-ae30-882fe37a288f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP35212',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 232550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-09',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2006}
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP35212%27 HTTP/1.1" 200 None
2026-03-30 10:55:47 [auto1.de] INFO: Saving data for AP35212: {'auction_closing_time': 1774971352.0, 'created_time': 1774638408.329869, 'last_price_update_time': 1774868147.989626}
2026-03-30 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP35212') HTTP/1.1" 204 0
2026-03-30 10:55:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ab58fe3-ed2b-5fca-a136-3c336078ce6e with identifier: DS36264
2026-03-30 10:55:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ab58fe3-ed2b-5fca-a136-3c336078ce6e with identifier: DS36264
2026-03-30 10:55:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ab58fe3-ed2b-5fca-a136-3c336078ce6e with identifier: DS36264 to the API
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-31T15:09:10Z',
 'fuel_type': 'petrol',
 'id': '8ab58fe3-ed2b-5fca-a136-3c336078ce6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS36264',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 135991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS36264%27 HTTP/1.1" 200 None
2026-03-30 10:55:48 [auto1.de] INFO: Saving data for DS36264: {'auction_closing_time': 1774969750.0, 'created_time': 1774350082.919945, 'last_price_update_time': 1774868148.572715}
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS36264') HTTP/1.1" 204 0
2026-03-30 10:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef503e1d0>
2026-03-30 10:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_a30250007b923dfbb60f193bdea25ef3.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_a30250007b923dfbb60f193bdea25ef3.jpg saved to cache
2026-03-30 10:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcdedeae-5a12-5588-a8c3-1c11179a3ee6
2026-03-30 10:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4cad0d0>
2026-03-30 10:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_e323402e89eced0c9b78c584a19a5601.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_e323402e89eced0c9b78c584a19a5601.jpg saved to cache
2026-03-30 10:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aee77f5f-2a87-56cd-a02b-d510ecc03b11
2026-03-30 10:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5051ad0>
2026-03-30 10:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_bee9ee0d35d45d4ffd1e95ab37860d5d.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_bee9ee0d35d45d4ffd1e95ab37860d5d.jpg saved to cache
2026-03-30 10:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcdedeae-5a12-5588-a8c3-1c11179a3ee6
2026-03-30 10:55:48 [auto1.de] INFO: Found listing with ID: VS28124
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS28124%27 HTTP/1.1" 200 None
2026-03-30 10:55:48 [auto1.de] INFO: Scrape type for VS28124: 2
2026-03-30 10:55:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f79c4f26-f5e4-5609-a21b-8e7728d13416 with identifier: VS28124
2026-03-30 10:55:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f79c4f26-f5e4-5609-a21b-8e7728d13416 with scrape type 2
2026-03-30 10:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f79c4f26-f5e4-5609-a21b-8e7728d13416 with scrape type 2
2026-03-30 10:55:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f79c4f26-f5e4-5609-a21b-8e7728d13416, identifier: VS28124
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_c750b5450c36b2353cbdfc3ff7c38e44.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_c750b5450c36b2353cbdfc3ff7c38e44.jpg not downloaded yet
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_7c029d77f3360815c9a5d33878d10d32.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_7c029d77f3360815c9a5d33878d10d32.jpg not downloaded yet
2026-03-30 10:55:48 [auto1.de] INFO: Found listing with ID: NS90051
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS90051%27 HTTP/1.1" 200 None
2026-03-30 10:55:48 [auto1.de] INFO: Scrape type for NS90051: 2
2026-03-30 10:55:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5256fa13-69a1-5eda-a36b-a05bdb74fb15 with identifier: NS90051
2026-03-30 10:55:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5256fa13-69a1-5eda-a36b-a05bdb74fb15 with scrape type 2
2026-03-30 10:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5256fa13-69a1-5eda-a36b-a05bdb74fb15 with scrape type 2
2026-03-30 10:55:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5256fa13-69a1-5eda-a36b-a05bdb74fb15, identifier: NS90051
2026-03-30 10:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB07846> (referer: https://www.auto1.com/v1/car-details-view/PB07846/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59aacd0>
2026-03-30 10:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_35db834c523be115abc6203d9f3bf555.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_35db834c523be115abc6203d9f3bf555.jpg saved to cache
2026-03-30 10:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aee77f5f-2a87-56cd-a02b-d510ecc03b11
2026-03-30 10:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_b37a3b0c6d35a40dd2384a078c9ecce9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f79c4f26-f5e4-5609-a21b-8e7728d13416 with identifier: VS28124
2026-03-30 10:55:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f79c4f26-f5e4-5609-a21b-8e7728d13416 with identifier: VS28124
2026-03-30 10:55:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f79c4f26-f5e4-5609-a21b-8e7728d13416 with identifier: VS28124 to the API
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:23:14Z',
 'fuel_type': 'petrol',
 'id': 'f79c4f26-f5e4-5609-a21b-8e7728d13416',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS28124',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 111577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-29',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2016}
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS28124%27 HTTP/1.1" 200 None
2026-03-30 10:55:49 [auto1.de] INFO: Saving data for VS28124: {'auction_closing_time': 1774970594.0, 'created_time': 1774463799.231549, 'last_price_update_time': 1774868149.40598}
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS28124') HTTP/1.1" 204 0
2026-03-30 10:55:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5256fa13-69a1-5eda-a36b-a05bdb74fb15 with identifier: NS90051
2026-03-30 10:55:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5256fa13-69a1-5eda-a36b-a05bdb74fb15 with identifier: NS90051
2026-03-30 10:55:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5256fa13-69a1-5eda-a36b-a05bdb74fb15 with identifier: NS90051 to the API
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:19:17Z',
 'fuel_type': 'diesel',
 'id': '5256fa13-69a1-5eda-a36b-a05bdb74fb15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS90051',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 324800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-03',
 'seller_name': None,
 'title': 'Audi A6 2.7 V6 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS90051%27 HTTP/1.1" 200 None
2026-03-30 10:55:49 [auto1.de] INFO: Saving data for NS90051: {'auction_closing_time': 1774970357.0, 'created_time': 1773136311.36477, 'last_price_update_time': 1774868149.877362}
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS90051') HTTP/1.1" 204 0
2026-03-30 10:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e77b10>
2026-03-30 10:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_ba96aebf463dcf889085083294a021e1.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_ba96aebf463dcf889085083294a021e1.jpg saved to cache
2026-03-30 10:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcdedeae-5a12-5588-a8c3-1c11179a3ee6
2026-03-30 10:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_7ca1cfa930e13487dceac46ba076e506.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_b04591d6d7daa27bf082cb19910b542b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:49 [auto1.de] INFO: Found listing with ID: BH27116
2026-03-30 10:55:49 [auto1.de] INFO: Found listing with ID: WA93069
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_afe91b3433589854b717c61792bac726.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_afe91b3433589854b717c61792bac726.jpg not downloaded yet
2026-03-30 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_b4574fd84cc58856d6c16708b67e39d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_b4574fd84cc58856d6c16708b67e39d6.jpg not downloaded yet
2026-03-30 10:55:50 [auto1.de] INFO: Found listing with ID: GX62549
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX62549%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [auto1.de] INFO: Scrape type for GX62549: 1
2026-03-30 10:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW38649> (referer: https://www.auto1.com/v1/car-details-view/YW38649/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 814eadfd-9888-5bf6-b054-c59e6553fff4 with identifier: CW51870
2026-03-30 10:55:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 814eadfd-9888-5bf6-b054-c59e6553fff4 with scrape type 1
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 814eadfd-9888-5bf6-b054-c59e6553fff4
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_ac49fc6634e210b4d6cbbed0e9d16c8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_ac49fc6634e210b4d6cbbed0e9d16c8b.jpg not downloaded yet
2026-03-30 10:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fe3b50>
2026-03-30 10:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_0db421ea670a2f35e53de47e4dc58e6e.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_0db421ea670a2f35e53de47e4dc58e6e.jpg saved to cache
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aee77f5f-2a87-56cd-a02b-d510ecc03b11
2026-03-30 10:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_c49bc6d898d295164b1c8c057cda062a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_07799046e47f42904f8b58d88c49a082.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_cb592086fbddeea9270f00066e890099.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_cb592086fbddeea9270f00066e890099.jpg not downloaded yet
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_8bae277336795704042fb6dd36c3d27f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_8bae277336795704042fb6dd36c3d27f.jpg not downloaded yet
2026-03-30 10:55:50 [auto1.de] INFO: Found listing with ID: US16012
2026-03-30 10:55:50 [auto1.de] INFO: Found listing with ID: TN52823
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN52823%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [auto1.de] INFO: Scrape type for TN52823: 2
2026-03-30 10:55:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 178c478c-c49a-5980-b654-ec35df446f41 with identifier: TN52823
2026-03-30 10:55:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178c478c-c49a-5980-b654-ec35df446f41 with scrape type 2
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 178c478c-c49a-5980-b654-ec35df446f41 with scrape type 2
2026-03-30 10:55:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 178c478c-c49a-5980-b654-ec35df446f41, identifier: TN52823
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_857a37260a70da8c3e03b3b6d2ee7d48.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_857a37260a70da8c3e03b3b6d2ee7d48.jpg not downloaded yet
2026-03-30 10:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK31511> (referer: https://www.auto1.com/v1/car-details-view/RK31511/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb9d6b1d-ed6f-5150-b218-cf84e2d9a293 with identifier: PB07846
2026-03-30 10:55:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb9d6b1d-ed6f-5150-b218-cf84e2d9a293 with scrape type 1
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb9d6b1d-ed6f-5150-b218-cf84e2d9a293
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F02%252F9b0243433fdce131c95ad69b920cbb83%252Fpa%252FPB07846_efdfdcc0311c182e380d57907700527f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_efdfdcc0311c182e380d57907700527f.jpg already downloaded
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F02%252F9b0243433fdce131c95ad69b920cbb83%252Fpa%252FPB07846_d8f3d23ab90b0eaca79d64ed6b66ce13.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_d8f3d23ab90b0eaca79d64ed6b66ce13.jpg already downloaded
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F02%252F9b0243433fdce131c95ad69b920cbb83%252Fpa%252FPB07846_fbb5913822aea8af0f3c66950335b276.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_fbb5913822aea8af0f3c66950335b276.jpg already downloaded
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F02%252F9b0243433fdce131c95ad69b920cbb83%252Fpa%252FPB07846_aca0820b03ef50e380e403cdd96b519b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_aca0820b03ef50e380e403cdd96b519b.jpg already downloaded
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F02%252F9b0243433fdce131c95ad69b920cbb83%252Fpa%252FPB07846_c7f1cd2392a01922aec130f103b2ef6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_c7f1cd2392a01922aec130f103b2ef6e.jpg already downloaded
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F02%252F9b0243433fdce131c95ad69b920cbb83%252Fpa%252FPB07846_31c212a7308b863acb13305ea659b228.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_31c212a7308b863acb13305ea659b228.jpg already downloaded
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F02%252F9b0243433fdce131c95ad69b920cbb83%252Fpa%252FPB07846_1ec6715dd0850f993003f2d25bbc8b9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_1ec6715dd0850f993003f2d25bbc8b9e.jpg already downloaded
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F02%252F9b0243433fdce131c95ad69b920cbb83%252Fpa%252FPB07846_9dae53f833f51d559751963e1b792c43.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_9dae53f833f51d559751963e1b792c43.jpg already downloaded
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F02%252F9b0243433fdce131c95ad69b920cbb83%252Fpa%252FPB07846_df4e8158e39bddb8a2414e21585f392a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_df4e8158e39bddb8a2414e21585f392a.jpg already downloaded
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F02%252F9b0243433fdce131c95ad69b920cbb83%252Fpa%252FPB07846_9a8943cea55c762b4d14cd80e28129d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_9a8943cea55c762b4d14cd80e28129d2.jpg already downloaded
2026-03-30 10:55:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb9d6b1d-ed6f-5150-b218-cf84e2d9a293, identifier: PB07846
2026-03-30 10:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c55d0>
2026-03-30 10:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_b37a3b0c6d35a40dd2384a078c9ecce9.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_b37a3b0c6d35a40dd2384a078c9ecce9.jpg saved to cache
2026-03-30 10:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcdedeae-5a12-5588-a8c3-1c11179a3ee6
2026-03-30 10:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_7f6b8a653de9bd68ca0b7143da8e0425.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 178c478c-c49a-5980-b654-ec35df446f41 with identifier: TN52823
2026-03-30 10:55:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 178c478c-c49a-5980-b654-ec35df446f41 with identifier: TN52823
2026-03-30 10:55:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 178c478c-c49a-5980-b654-ec35df446f41 with identifier: TN52823 to the API
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:29:14Z',
 'fuel_type': 'diesel',
 'id': '178c478c-c49a-5980-b654-ec35df446f41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN52823',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 201270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-04',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN52823%27 HTTP/1.1" 200 None
2026-03-30 10:55:51 [auto1.de] INFO: Saving data for TN52823: {'auction_closing_time': 1774970954.0, 'created_time': 1773225818.889741, 'last_price_update_time': 1774868151.044156}
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN52823') HTTP/1.1" 204 0
2026-03-30 10:55:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb9d6b1d-ed6f-5150-b218-cf84e2d9a293 with identifier: PB07846
2026-03-30 10:55:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb9d6b1d-ed6f-5150-b218-cf84e2d9a293 with identifier: PB07846
2026-03-30 10:55:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb9d6b1d-ed6f-5150-b218-cf84e2d9a293 with identifier: PB07846 to the API
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PB07846>
{'auction_title': '',
 'c_o_2_emission_value': 46,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:15:01Z',
 'fuel_type': 'hybrid',
 'id': 'eb9d6b1d-ed6f-5150-b218-cf84e2d9a293',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB07846',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'make': 'BMW',
 'model': '2er',
 'odometer': 141433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_efdfdcc0311c182e380d57907700527f.jpg',
                'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_d8f3d23ab90b0eaca79d64ed6b66ce13.jpg',
                'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_fbb5913822aea8af0f3c66950335b276.jpg',
                'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_aca0820b03ef50e380e403cdd96b519b.jpg',
                'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_c7f1cd2392a01922aec130f103b2ef6e.jpg',
                'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_31c212a7308b863acb13305ea659b228.jpg',
                'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_1ec6715dd0850f993003f2d25bbc8b9e.jpg',
                'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_9dae53f833f51d559751963e1b792c43.jpg',
                'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_df4e8158e39bddb8a2414e21585f392a.jpg',
                'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_9a8943cea55c762b4d14cd80e28129d2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb9d6b1d-ed6f-5150-b218-cf84e2d9a293/eb9d6b1d-ed6f-5150-b218-cf84e2d9a293_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_efdfdcc0311c182e380d57907700527f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb9d6b1d-ed6f-5150-b218-cf84e2d9a293/eb9d6b1d-ed6f-5150-b218-cf84e2d9a293_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_d8f3d23ab90b0eaca79d64ed6b66ce13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb9d6b1d-ed6f-5150-b218-cf84e2d9a293/eb9d6b1d-ed6f-5150-b218-cf84e2d9a293_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_fbb5913822aea8af0f3c66950335b276.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb9d6b1d-ed6f-5150-b218-cf84e2d9a293/eb9d6b1d-ed6f-5150-b218-cf84e2d9a293_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_aca0820b03ef50e380e403cdd96b519b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb9d6b1d-ed6f-5150-b218-cf84e2d9a293/eb9d6b1d-ed6f-5150-b218-cf84e2d9a293_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_c7f1cd2392a01922aec130f103b2ef6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb9d6b1d-ed6f-5150-b218-cf84e2d9a293/eb9d6b1d-ed6f-5150-b218-cf84e2d9a293_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_31c212a7308b863acb13305ea659b228.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb9d6b1d-ed6f-5150-b218-cf84e2d9a293/eb9d6b1d-ed6f-5150-b218-cf84e2d9a293_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_1ec6715dd0850f993003f2d25bbc8b9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb9d6b1d-ed6f-5150-b218-cf84e2d9a293/eb9d6b1d-ed6f-5150-b218-cf84e2d9a293_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_9dae53f833f51d559751963e1b792c43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb9d6b1d-ed6f-5150-b218-cf84e2d9a293/eb9d6b1d-ed6f-5150-b218-cf84e2d9a293_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_df4e8158e39bddb8a2414e21585f392a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb9d6b1d-ed6f-5150-b218-cf84e2d9a293/eb9d6b1d-ed6f-5150-b218-cf84e2d9a293_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/02/9b0243433fdce131c95ad69b920cbb83/pa/PB07846_9a8943cea55c762b4d14cd80e28129d2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 225xe Active Tourer M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB07846%27 HTTP/1.1" 200 None
2026-03-30 10:55:51 [auto1.de] INFO: Saving data for PB07846: {'created_time': 1774868151.406763, 'last_price_update_time': 1774868151.406774, 'auction_closing_time': 1774970101.0}
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB07846') HTTP/1.1" 204 0
2026-03-30 10:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5072b10>
2026-03-30 10:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_7ca1cfa930e13487dceac46ba076e506.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_7ca1cfa930e13487dceac46ba076e506.jpg saved to cache
2026-03-30 10:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcdedeae-5a12-5588-a8c3-1c11179a3ee6
2026-03-30 10:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5a6e010>
2026-03-30 10:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_b04591d6d7daa27bf082cb19910b542b.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_b04591d6d7daa27bf082cb19910b542b.jpg saved to cache
2026-03-30 10:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aee77f5f-2a87-56cd-a02b-d510ecc03b11
2026-03-30 10:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_7c029d77f3360815c9a5d33878d10d32.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:51 [auto1.de] INFO: Found listing with ID: RE58657
2026-03-30 10:55:51 [auto1.de] INFO: Found listing with ID: UC67587
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC67587%27 HTTP/1.1" 200 None
2026-03-30 10:55:51 [auto1.de] INFO: Scrape type for UC67587: 2
2026-03-30 10:55:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd897983-c80e-5b75-b1a7-235a8388560b with identifier: UC67587
2026-03-30 10:55:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd897983-c80e-5b75-b1a7-235a8388560b with scrape type 2
2026-03-30 10:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd897983-c80e-5b75-b1a7-235a8388560b with scrape type 2
2026-03-30 10:55:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd897983-c80e-5b75-b1a7-235a8388560b, identifier: UC67587
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_cfcfbc62c9dd4a8b3cefb156286710b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_cfcfbc62c9dd4a8b3cefb156286710b3.jpg not downloaded yet
2026-03-30 10:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_c750b5450c36b2353cbdfc3ff7c38e44.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd897983-c80e-5b75-b1a7-235a8388560b with identifier: UC67587
2026-03-30 10:55:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd897983-c80e-5b75-b1a7-235a8388560b with identifier: UC67587
2026-03-30 10:55:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd897983-c80e-5b75-b1a7-235a8388560b with identifier: UC67587 to the API
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:11:58Z',
 'fuel_type': 'petrol',
 'id': 'bd897983-c80e-5b75-b1a7-235a8388560b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC67587',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 132972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-03',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Basic',
 'transmission': 'manual',
 'trim': 'Basic',
 'year': 2011}
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC67587%27 HTTP/1.1" 200 None
2026-03-30 10:55:52 [auto1.de] INFO: Saving data for UC67587: {'auction_closing_time': 1774969918.0, 'created_time': 1774463862.410407, 'last_price_update_time': 1774868152.034638}
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC67587') HTTP/1.1" 204 0
2026-03-30 10:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4b41dd0-e957-51af-b03d-ab97be688597 with identifier: YW38649
2026-03-30 10:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4b41dd0-e957-51af-b03d-ab97be688597 with scrape type 1
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c4b41dd0-e957-51af-b03d-ab97be688597
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fd2%252Fead2e29731a6b892176e54f2a95ece9d%252Fpa%252FYW38649_6e568e5dac20e950791d6d5587964526.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_6e568e5dac20e950791d6d5587964526.jpg not downloaded yet
2026-03-30 10:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50701d0>
2026-03-30 10:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_c49bc6d898d295164b1c8c057cda062a.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_c49bc6d898d295164b1c8c057cda062a.jpg saved to cache
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aee77f5f-2a87-56cd-a02b-d510ecc03b11
2026-03-30 10:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7cc5d90>
2026-03-30 10:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_07799046e47f42904f8b58d88c49a082.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_07799046e47f42904f8b58d88c49a082.jpg saved to cache
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcdedeae-5a12-5588-a8c3-1c11179a3ee6
2026-03-30 10:55:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356 with identifier: RK31511
2026-03-30 10:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356 with scrape type 1
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_e7053f7243cce3fcae35d36d90fe3301.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_e7053f7243cce3fcae35d36d90fe3301.jpg not downloaded yet
2026-03-30 10:55:52 [auto1.de] INFO: Found listing with ID: WS88926
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS88926%27 HTTP/1.1" 200 None
2026-03-30 10:55:52 [auto1.de] INFO: Scrape type for WS88926: 2
2026-03-30 10:55:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5a17e50-42dc-5f81-bc00-c91641f59b72 with identifier: WS88926
2026-03-30 10:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5a17e50-42dc-5f81-bc00-c91641f59b72 with scrape type 2
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5a17e50-42dc-5f81-bc00-c91641f59b72 with scrape type 2
2026-03-30 10:55:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5a17e50-42dc-5f81-bc00-c91641f59b72, identifier: WS88926
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_23cdd167765c471b942f9124c57d4e8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_23cdd167765c471b942f9124c57d4e8c.jpg not downloaded yet
2026-03-30 10:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_b4574fd84cc58856d6c16708b67e39d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_ac49fc6634e210b4d6cbbed0e9d16c8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_afe91b3433589854b717c61792bac726.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5a17e50-42dc-5f81-bc00-c91641f59b72 with identifier: WS88926
2026-03-30 10:55:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5a17e50-42dc-5f81-bc00-c91641f59b72 with identifier: WS88926
2026-03-30 10:55:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5a17e50-42dc-5f81-bc00-c91641f59b72 with identifier: WS88926 to the API
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:55:45Z',
 'fuel_type': 'petrol',
 'id': 'f5a17e50-42dc-5f81-bc00-c91641f59b72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS88926',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 100297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-08',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2018}
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS88926%27 HTTP/1.1" 200 None
2026-03-30 10:55:52 [auto1.de] INFO: Saving data for WS88926: {'auction_closing_time': 1774972545.0, 'created_time': 1773383441.078495, 'last_price_update_time': 1774868152.781537}
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS88926') HTTP/1.1" 204 0
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fd2%252Fead2e29731a6b892176e54f2a95ece9d%252Fpa%252FYW38649_dab1ba67b31ecb0fc7b775e57040c1a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_dab1ba67b31ecb0fc7b775e57040c1a2.jpg not downloaded yet
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_3801695835f70e2cd9672ba9a0a4f385.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_3801695835f70e2cd9672ba9a0a4f385.jpg not downloaded yet
2026-03-30 10:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ce0190>
2026-03-30 10:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_7f6b8a653de9bd68ca0b7143da8e0425.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_7f6b8a653de9bd68ca0b7143da8e0425.jpg saved to cache
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aee77f5f-2a87-56cd-a02b-d510ecc03b11
2026-03-30 10:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ee5490>
2026-03-30 10:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_7c029d77f3360815c9a5d33878d10d32.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_7c029d77f3360815c9a5d33878d10d32.jpg saved to cache
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcdedeae-5a12-5588-a8c3-1c11179a3ee6
2026-03-30 10:55:52 [auto1.de] INFO: Found listing with ID: GW79397
2026-03-30 10:55:52 [auto1.de] INFO: Found listing with ID: YS92150
2026-03-30 10:55:52 [auto1.de] INFO: Found listing with ID: WP32637
2026-03-30 10:55:52 [auto1.de] INFO: Found listing with ID: WA51646
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA51646%27 HTTP/1.1" 200 None
2026-03-30 10:55:52 [auto1.de] INFO: Scrape type for WA51646: 2
2026-03-30 10:55:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f70fe51d-234e-5208-ac78-52621639e6af with identifier: WA51646
2026-03-30 10:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f70fe51d-234e-5208-ac78-52621639e6af with scrape type 2
2026-03-30 10:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f70fe51d-234e-5208-ac78-52621639e6af with scrape type 2
2026-03-30 10:55:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f70fe51d-234e-5208-ac78-52621639e6af, identifier: WA51646
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_c0fc4dd113b2abf4924e13349b4c4172.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_c0fc4dd113b2abf4924e13349b4c4172.jpg not downloaded yet
2026-03-30 10:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ec2ad0>
2026-03-30 10:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_c750b5450c36b2353cbdfc3ff7c38e44.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_c750b5450c36b2353cbdfc3ff7c38e44.jpg saved to cache
2026-03-30 10:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aee77f5f-2a87-56cd-a02b-d510ecc03b11
2026-03-30 10:55:53 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 9529 | hits on page: 40
2026-03-30 10:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_8bae277336795704042fb6dd36c3d27f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f70fe51d-234e-5208-ac78-52621639e6af with identifier: WA51646
2026-03-30 10:55:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f70fe51d-234e-5208-ac78-52621639e6af with identifier: WA51646
2026-03-30 10:55:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f70fe51d-234e-5208-ac78-52621639e6af with identifier: WA51646 to the API
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:36:49Z',
 'fuel_type': 'petrol',
 'id': 'f70fe51d-234e-5208-ac78-52621639e6af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA51646',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 154633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-08',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket plus',
 'year': 2011}
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA51646%27 HTTP/1.1" 200 None
2026-03-30 10:55:53 [auto1.de] INFO: Saving data for WA51646: {'auction_closing_time': 1774971409.0, 'created_time': 1773688573.490406, 'last_price_update_time': 1774868153.460453}
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA51646') HTTP/1.1" 204 0
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fd2%252Fead2e29731a6b892176e54f2a95ece9d%252Fpa%252FYW38649_a825b2983ac243e61fad47abb6bc45bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_a825b2983ac243e61fad47abb6bc45bd.jpg not downloaded yet
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_aa5b8a74d12c734e6261edf33f35ae14.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_aa5b8a74d12c734e6261edf33f35ae14.jpg not downloaded yet
2026-03-30 10:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_857a37260a70da8c3e03b3b6d2ee7d48.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_cb592086fbddeea9270f00066e890099.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:53 [auto1.de] INFO: Found listing with ID: BD30878
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD30878%27 HTTP/1.1" 200 None
2026-03-30 10:55:53 [auto1.de] INFO: Scrape type for BD30878: 2
2026-03-30 10:55:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8bb5f9a-8891-517e-ab16-5022edd82ace with identifier: BD30878
2026-03-30 10:55:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8bb5f9a-8891-517e-ab16-5022edd82ace with scrape type 2
2026-03-30 10:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8bb5f9a-8891-517e-ab16-5022edd82ace with scrape type 2
2026-03-30 10:55:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8bb5f9a-8891-517e-ab16-5022edd82ace, identifier: BD30878
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_0574f9e8618c32f67e9cdcc19cde3c58.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_0574f9e8618c32f67e9cdcc19cde3c58.jpg not downloaded yet
2026-03-30 10:55:53 [auto1.de] INFO: Found listing with ID: ND88059
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND88059%27 HTTP/1.1" 200 None
2026-03-30 10:55:53 [auto1.de] INFO: Scrape type for ND88059: 2
2026-03-30 10:55:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe422a96-8fdb-5b21-ab6a-a95f1f9a210b with identifier: ND88059
2026-03-30 10:55:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe422a96-8fdb-5b21-ab6a-a95f1f9a210b with scrape type 2
2026-03-30 10:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe422a96-8fdb-5b21-ab6a-a95f1f9a210b with scrape type 2
2026-03-30 10:55:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe422a96-8fdb-5b21-ab6a-a95f1f9a210b, identifier: ND88059
2026-03-30 10:55:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5093ed0>
2026-03-30 10:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_b4574fd84cc58856d6c16708b67e39d6.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_b4574fd84cc58856d6c16708b67e39d6.jpg saved to cache
2026-03-30 10:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcdedeae-5a12-5588-a8c3-1c11179a3ee6
2026-03-30 10:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5b20b50>
2026-03-30 10:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_ac49fc6634e210b4d6cbbed0e9d16c8b.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_ac49fc6634e210b4d6cbbed0e9d16c8b.jpg saved to cache
2026-03-30 10:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 814eadfd-9888-5bf6-b054-c59e6553fff4
2026-03-30 10:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e94cd0>
2026-03-30 10:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_afe91b3433589854b717c61792bac726.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_afe91b3433589854b717c61792bac726.jpg saved to cache
2026-03-30 10:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aee77f5f-2a87-56cd-a02b-d510ecc03b11
2026-03-30 10:55:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8bb5f9a-8891-517e-ab16-5022edd82ace with identifier: BD30878
2026-03-30 10:55:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8bb5f9a-8891-517e-ab16-5022edd82ace with identifier: BD30878
2026-03-30 10:55:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8bb5f9a-8891-517e-ab16-5022edd82ace with identifier: BD30878 to the API
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:03:56Z',
 'fuel_type': 'petrol',
 'id': 'd8bb5f9a-8891-517e-ab16-5022edd82ace',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD30878',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 150608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-19',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2008}
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD30878%27 HTTP/1.1" 200 None
2026-03-30 10:55:54 [auto1.de] INFO: Saving data for BD30878: {'auction_closing_time': 1774969436.0, 'created_time': 1774380664.185108, 'last_price_update_time': 1774868154.369202}
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD30878') HTTP/1.1" 204 0
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fd2%252Fead2e29731a6b892176e54f2a95ece9d%252Fpa%252FYW38649_e3e9327364c5222c7f5805e7e2190194.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_e3e9327364c5222c7f5805e7e2190194.jpg not downloaded yet
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_493d6a15726e1c0ecc73224d15adc721.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_493d6a15726e1c0ecc73224d15adc721.jpg not downloaded yet
2026-03-30 10:55:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe422a96-8fdb-5b21-ab6a-a95f1f9a210b with identifier: ND88059
2026-03-30 10:55:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe422a96-8fdb-5b21-ab6a-a95f1f9a210b with identifier: ND88059
2026-03-30 10:55:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe422a96-8fdb-5b21-ab6a-a95f1f9a210b with identifier: ND88059 to the API
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:08:36Z',
 'fuel_type': 'petrol',
 'id': 'fe422a96-8fdb-5b21-ab6a-a95f1f9a210b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND88059',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 70024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-09',
 'seller_name': None,
 'title': 'Audi TT 45 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND88059%27 HTTP/1.1" 200 None
2026-03-30 10:55:54 [auto1.de] INFO: Saving data for ND88059: {'auction_closing_time': 1774969716.0, 'created_time': 1773917591.030456, 'last_price_update_time': 1774868154.780318}
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND88059') HTTP/1.1" 204 0
2026-03-30 10:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_e7053f7243cce3fcae35d36d90fe3301.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_6e568e5dac20e950791d6d5587964526.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:54 [auto1.de] INFO: Found listing with ID: KU76096
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU76096%27 HTTP/1.1" 200 None
2026-03-30 10:55:54 [auto1.de] INFO: Scrape type for KU76096: 2
2026-03-30 10:55:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e323960b-2c75-5436-93e6-f7c1ef75d2b6 with identifier: KU76096
2026-03-30 10:55:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e323960b-2c75-5436-93e6-f7c1ef75d2b6 with scrape type 2
2026-03-30 10:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e323960b-2c75-5436-93e6-f7c1ef75d2b6 with scrape type 2
2026-03-30 10:55:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e323960b-2c75-5436-93e6-f7c1ef75d2b6, identifier: KU76096
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_ae56905e858dbc7dea483fa44f461a22.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_ae56905e858dbc7dea483fa44f461a22.jpg not downloaded yet
2026-03-30 10:55:54 [auto1.de] INFO: Found listing with ID: XV11651
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV11651%27 HTTP/1.1" 200 None
2026-03-30 10:55:54 [auto1.de] INFO: Scrape type for XV11651: 2
2026-03-30 10:55:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c74aee55-eb0a-53f5-b4e2-0850c34da05c with identifier: XV11651
2026-03-30 10:55:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c74aee55-eb0a-53f5-b4e2-0850c34da05c with scrape type 2
2026-03-30 10:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c74aee55-eb0a-53f5-b4e2-0850c34da05c with scrape type 2
2026-03-30 10:55:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c74aee55-eb0a-53f5-b4e2-0850c34da05c, identifier: XV11651
2026-03-30 10:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4ec1c50>
2026-03-30 10:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F84%252Fc4843197c83ab6f97e5ecc6fa46748cf%252Fpa%252FEV61179_8bae277336795704042fb6dd36c3d27f.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_8bae277336795704042fb6dd36c3d27f.jpg saved to cache
2026-03-30 10:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcdedeae-5a12-5588-a8c3-1c11179a3ee6
2026-03-30 10:55:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcdedeae-5a12-5588-a8c3-1c11179a3ee6, skipping ID generation
2026-03-30 10:55:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcdedeae-5a12-5588-a8c3-1c11179a3ee6 with scrape type 1
2026-03-30 10:55:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcdedeae-5a12-5588-a8c3-1c11179a3ee6 sending to next pipeline
2026-03-30 10:55:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcdedeae-5a12-5588-a8c3-1c11179a3ee6, identifier: EV61179
2026-03-30 10:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_23cdd167765c471b942f9124c57d4e8c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e323960b-2c75-5436-93e6-f7c1ef75d2b6 with identifier: KU76096
2026-03-30 10:55:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e323960b-2c75-5436-93e6-f7c1ef75d2b6 with identifier: KU76096
2026-03-30 10:55:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e323960b-2c75-5436-93e6-f7c1ef75d2b6 with identifier: KU76096 to the API
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-31T15:18:54Z',
 'fuel_type': 'hybrid',
 'id': 'e323960b-2c75-5436-93e6-f7c1ef75d2b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU76096',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 35752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-17',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300de T 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': 'T 4Matic AMG Line',
 'year': 2023}
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU76096%27 HTTP/1.1" 200 None
2026-03-30 10:55:55 [auto1.de] INFO: Saving data for KU76096: {'auction_closing_time': 1774970334.0, 'created_time': 1774435666.175281, 'last_price_update_time': 1774868155.588564}
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU76096') HTTP/1.1" 204 0
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fd2%252Fead2e29731a6b892176e54f2a95ece9d%252Fpa%252FYW38649_8f0d95b34653d97fbf75bcf17c582898.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_8f0d95b34653d97fbf75bcf17c582898.jpg not downloaded yet
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_6fece630d3e4eb0f1a8a94c85e32ecc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_6fece630d3e4eb0f1a8a94c85e32ecc4.jpg not downloaded yet
2026-03-30 10:55:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c74aee55-eb0a-53f5-b4e2-0850c34da05c with identifier: XV11651
2026-03-30 10:55:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c74aee55-eb0a-53f5-b4e2-0850c34da05c with identifier: XV11651
2026-03-30 10:55:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c74aee55-eb0a-53f5-b4e2-0850c34da05c with identifier: XV11651 to the API
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:03:51Z',
 'fuel_type': 'diesel',
 'id': 'c74aee55-eb0a-53f5-b4e2-0850c34da05c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV11651',
 'listing': 'auction',
 'make': 'MG Rover',
 'model': '75',
 'odometer': 224015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-12-29',
 'seller_name': None,
 'title': 'MG Rover 75 2.0 CDT Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2002}
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV11651%27 HTTP/1.1" 200 None
2026-03-30 10:55:55 [auto1.de] INFO: Saving data for XV11651: {'auction_closing_time': 1774969431.0, 'created_time': 1774380255.687374, 'last_price_update_time': 1774868155.945794}
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV11651') HTTP/1.1" 204 0
2026-03-30 10:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GX62549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:55:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcdedeae-5a12-5588-a8c3-1c11179a3ee6 with identifier: EV61179
2026-03-30 10:55:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcdedeae-5a12-5588-a8c3-1c11179a3ee6 with identifier: EV61179
2026-03-30 10:55:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcdedeae-5a12-5588-a8c3-1c11179a3ee6 with identifier: EV61179 to the API
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_8bae277336795704042fb6dd36c3d27f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:09:38Z',
 'fuel_type': 'petrol',
 'id': 'fcdedeae-5a12-5588-a8c3-1c11179a3ee6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV61179',
 'listing': 'auction',
 'location': 'DE, Oberhausen',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 139646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_5a47922ca85735d898acc2f99d47af06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_a30250007b923dfbb60f193bdea25ef3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_bee9ee0d35d45d4ffd1e95ab37860d5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_ba96aebf463dcf889085083294a021e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_b37a3b0c6d35a40dd2384a078c9ecce9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_7ca1cfa930e13487dceac46ba076e506.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_07799046e47f42904f8b58d88c49a082.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_7c029d77f3360815c9a5d33878d10d32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_b4574fd84cc58856d6c16708b67e39d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdedeae-5a12-5588-a8c3-1c11179a3ee6/fcdedeae-5a12-5588-a8c3-1c11179a3ee6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/84/c4843197c83ab6f97e5ecc6fa46748cf/pa/EV61179_8bae277336795704042fb6dd36c3d27f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda CR-V 2.0 i-VTEC Elegance 2WD',
 'transmission': 'manual',
 'trim': 'Elegance 2WD',
 'year': 2015}
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV61179%27 HTTP/1.1" 200 None
2026-03-30 10:55:56 [auto1.de] INFO: Saving data for EV61179: {'created_time': 1774868156.344399, 'last_price_update_time': 1774868156.344411, 'auction_closing_time': 1774969778.0}
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV61179') HTTP/1.1" 204 0
2026-03-30 10:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fec690>
2026-03-30 10:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_857a37260a70da8c3e03b3b6d2ee7d48.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_857a37260a70da8c3e03b3b6d2ee7d48.jpg saved to cache
2026-03-30 10:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 814eadfd-9888-5bf6-b054-c59e6553fff4
2026-03-30 10:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59963d0>
2026-03-30 10:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F57%252F73578eb345bcb76e8e0c10a9307b0ed4%252Fpa%252FYH45665_cb592086fbddeea9270f00066e890099.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_cb592086fbddeea9270f00066e890099.jpg saved to cache
2026-03-30 10:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aee77f5f-2a87-56cd-a02b-d510ecc03b11
2026-03-30 10:55:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aee77f5f-2a87-56cd-a02b-d510ecc03b11, skipping ID generation
2026-03-30 10:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aee77f5f-2a87-56cd-a02b-d510ecc03b11 with scrape type 1
2026-03-30 10:55:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aee77f5f-2a87-56cd-a02b-d510ecc03b11 sending to next pipeline
2026-03-30 10:55:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aee77f5f-2a87-56cd-a02b-d510ecc03b11, identifier: YH45665
2026-03-30 10:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_3801695835f70e2cd9672ba9a0a4f385.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:56 [auto1.de] INFO: Found listing with ID: DE00247
2026-03-30 10:55:56 [auto1.de] INFO: Found listing with ID: FZ79276
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ79276%27 HTTP/1.1" 200 None
2026-03-30 10:55:56 [auto1.de] INFO: Scrape type for FZ79276: 2
2026-03-30 10:55:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8568e77d-0aa6-5882-ae94-9c692c585dac with identifier: FZ79276
2026-03-30 10:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8568e77d-0aa6-5882-ae94-9c692c585dac with scrape type 2
2026-03-30 10:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8568e77d-0aa6-5882-ae94-9c692c585dac with scrape type 2
2026-03-30 10:55:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8568e77d-0aa6-5882-ae94-9c692c585dac, identifier: FZ79276
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_5b20a365d6b6a6f042615d3c0240125d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_5b20a365d6b6a6f042615d3c0240125d.jpg not downloaded yet
2026-03-30 10:55:56 [auto1.de] INFO: Found listing with ID: MT13357
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT13357%27 HTTP/1.1" 200 None
2026-03-30 10:55:56 [auto1.de] INFO: Scrape type for MT13357: 2
2026-03-30 10:55:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db96d303-d285-516b-bfc3-fb7a9ad81c72 with identifier: MT13357
2026-03-30 10:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db96d303-d285-516b-bfc3-fb7a9ad81c72 with scrape type 2
2026-03-30 10:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db96d303-d285-516b-bfc3-fb7a9ad81c72 with scrape type 2
2026-03-30 10:55:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db96d303-d285-516b-bfc3-fb7a9ad81c72, identifier: MT13357
2026-03-30 10:55:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aee77f5f-2a87-56cd-a02b-d510ecc03b11 with identifier: YH45665
2026-03-30 10:55:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aee77f5f-2a87-56cd-a02b-d510ecc03b11 with identifier: YH45665
2026-03-30 10:55:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aee77f5f-2a87-56cd-a02b-d510ecc03b11 with identifier: YH45665 to the API
2026-03-30 10:55:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_cb592086fbddeea9270f00066e890099.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:20:10Z',
 'fuel_type': 'petrol',
 'id': 'aee77f5f-2a87-56cd-a02b-d510ecc03b11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH45665',
 'listing': 'auction',
 'location': 'DE, Königsbrunn',
 'make': 'BMW',
 'model': '3er',
 'odometer': 211553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_ca9550c04695cc77ec4d9cbe2ecb3130.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_e323402e89eced0c9b78c584a19a5601.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_35db834c523be115abc6203d9f3bf555.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_0db421ea670a2f35e53de47e4dc58e6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_b04591d6d7daa27bf082cb19910b542b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_c49bc6d898d295164b1c8c057cda062a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_7f6b8a653de9bd68ca0b7143da8e0425.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_c750b5450c36b2353cbdfc3ff7c38e44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_afe91b3433589854b717c61792bac726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee77f5f-2a87-56cd-a02b-d510ecc03b11/aee77f5f-2a87-56cd-a02b-d510ecc03b11_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/57/73578eb345bcb76e8e0c10a9307b0ed4/pa/YH45665_cb592086fbddeea9270f00066e890099.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 325i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH45665%27 HTTP/1.1" 200 None
2026-03-30 10:55:57 [auto1.de] INFO: Saving data for YH45665: {'created_time': 1774868157.197428, 'last_price_update_time': 1774868157.197441, 'auction_closing_time': 1774970410.0}
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH45665') HTTP/1.1" 204 0
2026-03-30 10:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_c0fc4dd113b2abf4924e13349b4c4172.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8568e77d-0aa6-5882-ae94-9c692c585dac with identifier: FZ79276
2026-03-30 10:55:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8568e77d-0aa6-5882-ae94-9c692c585dac with identifier: FZ79276
2026-03-30 10:55:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8568e77d-0aa6-5882-ae94-9c692c585dac with identifier: FZ79276 to the API
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:49:01Z',
 'fuel_type': 'diesel',
 'id': '8568e77d-0aa6-5882-ae94-9c692c585dac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ79276',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 183795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-03',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 300 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ79276%27 HTTP/1.1" 200 None
2026-03-30 10:55:57 [auto1.de] INFO: Saving data for FZ79276: {'auction_closing_time': 1774972141.0, 'created_time': 1773775570.981829, 'last_price_update_time': 1774868157.572487}
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ79276') HTTP/1.1" 204 0
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_a76d11cc99222729df5422ee73785d00.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_a76d11cc99222729df5422ee73785d00.jpg not downloaded yet
2026-03-30 10:55:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db96d303-d285-516b-bfc3-fb7a9ad81c72 with identifier: MT13357
2026-03-30 10:55:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db96d303-d285-516b-bfc3-fb7a9ad81c72 with identifier: MT13357
2026-03-30 10:55:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db96d303-d285-516b-bfc3-fb7a9ad81c72 with identifier: MT13357 to the API
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:22:55Z',
 'fuel_type': 'petrol',
 'id': 'db96d303-d285-516b-bfc3-fb7a9ad81c72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT13357',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 121544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-24',
 'seller_name': None,
 'title': 'BMW 1er 114i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT13357%27 HTTP/1.1" 200 None
2026-03-30 10:55:57 [auto1.de] INFO: Saving data for MT13357: {'auction_closing_time': 1774970575.0, 'created_time': 1773383134.649839, 'last_price_update_time': 1774868157.962532}
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT13357') HTTP/1.1" 204 0
2026-03-30 10:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_a825b2983ac243e61fad47abb6bc45bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_aa5b8a74d12c734e6261edf33f35ae14.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:58 [auto1.de] INFO: Found listing with ID: ZV01579
2026-03-30 10:55:58 [auto1.de] INFO: Found listing with ID: YJ24873
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ24873%27 HTTP/1.1" 200 None
2026-03-30 10:55:58 [auto1.de] INFO: Scrape type for YJ24873: 2
2026-03-30 10:55:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0249d1dc-ea24-5566-a3e3-155d1af0c5a1 with identifier: YJ24873
2026-03-30 10:55:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0249d1dc-ea24-5566-a3e3-155d1af0c5a1 with scrape type 2
2026-03-30 10:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0249d1dc-ea24-5566-a3e3-155d1af0c5a1 with scrape type 2
2026-03-30 10:55:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0249d1dc-ea24-5566-a3e3-155d1af0c5a1, identifier: YJ24873
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_537521ed04e8f1a30a2da029118cc6c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_537521ed04e8f1a30a2da029118cc6c2.jpg not downloaded yet
2026-03-30 10:55:58 [auto1.de] INFO: Found listing with ID: LC55419
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC55419%27 HTTP/1.1" 200 None
2026-03-30 10:55:58 [auto1.de] INFO: Scrape type for LC55419: 2
2026-03-30 10:55:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf1f890f-9dba-5094-8347-ea2acf95e670 with identifier: LC55419
2026-03-30 10:55:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf1f890f-9dba-5094-8347-ea2acf95e670 with scrape type 2
2026-03-30 10:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf1f890f-9dba-5094-8347-ea2acf95e670 with scrape type 2
2026-03-30 10:55:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf1f890f-9dba-5094-8347-ea2acf95e670, identifier: LC55419
2026-03-30 10:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5113690>
2026-03-30 10:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_e7053f7243cce3fcae35d36d90fe3301.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_e7053f7243cce3fcae35d36d90fe3301.jpg saved to cache
2026-03-30 10:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356
2026-03-30 10:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4caefd0>
2026-03-30 10:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b41dd0-e957-51af-b03d-ab97be688597/c4b41dd0-e957-51af-b03d-ab97be688597_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fd2%252Fead2e29731a6b892176e54f2a95ece9d%252Fpa%252FYW38649_6e568e5dac20e950791d6d5587964526.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_6e568e5dac20e950791d6d5587964526.jpg saved to cache
2026-03-30 10:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4b41dd0-e957-51af-b03d-ab97be688597
2026-03-30 10:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e22ad0>
2026-03-30 10:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_23cdd167765c471b942f9124c57d4e8c.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_23cdd167765c471b942f9124c57d4e8c.jpg saved to cache
2026-03-30 10:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 814eadfd-9888-5bf6-b054-c59e6553fff4
2026-03-30 10:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_e3e9327364c5222c7f5805e7e2190194.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_0574f9e8618c32f67e9cdcc19cde3c58.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0249d1dc-ea24-5566-a3e3-155d1af0c5a1 with identifier: YJ24873
2026-03-30 10:55:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0249d1dc-ea24-5566-a3e3-155d1af0c5a1 with identifier: YJ24873
2026-03-30 10:55:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0249d1dc-ea24-5566-a3e3-155d1af0c5a1 with identifier: YJ24873 to the API
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:17:39Z',
 'fuel_type': 'diesel',
 'id': '0249d1dc-ea24-5566-a3e3-155d1af0c5a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ24873',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 176385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-12',
 'seller_name': None,
 'title': 'BMW 3er 320d EfficientDynamics Sport Line',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Sport Line',
 'year': 2015}
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ24873%27 HTTP/1.1" 200 None
2026-03-30 10:55:58 [auto1.de] INFO: Saving data for YJ24873: {'auction_closing_time': 1774970259.0, 'created_time': 1773305176.56075, 'last_price_update_time': 1774868158.775292}
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ24873') HTTP/1.1" 204 0
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_8f0cdbb59f6934df5cd5956a4dcf97cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_8f0cdbb59f6934df5cd5956a4dcf97cb.jpg not downloaded yet
2026-03-30 10:55:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf1f890f-9dba-5094-8347-ea2acf95e670 with identifier: LC55419
2026-03-30 10:55:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf1f890f-9dba-5094-8347-ea2acf95e670 with identifier: LC55419
2026-03-30 10:55:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf1f890f-9dba-5094-8347-ea2acf95e670 with identifier: LC55419 to the API
2026-03-30 10:55:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:46:09Z',
 'fuel_type': 'petrol',
 'id': 'bf1f890f-9dba-5094-8347-ea2acf95e670',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC55419',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 100169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-07-03',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Fresh',
 'transmission': 'manual',
 'trim': 'Fresh',
 'year': 2002}
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC55419%27 HTTP/1.1" 200 None
2026-03-30 10:55:59 [auto1.de] INFO: Saving data for LC55419: {'auction_closing_time': 1774971969.0, 'created_time': 1774290981.093165, 'last_price_update_time': 1774868159.169059}
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC55419') HTTP/1.1" 204 0
2026-03-30 10:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_493d6a15726e1c0ecc73224d15adc721.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:59 [auto1.de] INFO: Found listing with ID: CL28270
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL28270%27 HTTP/1.1" 200 None
2026-03-30 10:55:59 [auto1.de] INFO: Scrape type for CL28270: 2
2026-03-30 10:55:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 571dc1dc-7efa-55fc-93db-5cfb33b10f37 with identifier: CL28270
2026-03-30 10:55:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 571dc1dc-7efa-55fc-93db-5cfb33b10f37 with scrape type 2
2026-03-30 10:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 571dc1dc-7efa-55fc-93db-5cfb33b10f37 with scrape type 2
2026-03-30 10:55:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 571dc1dc-7efa-55fc-93db-5cfb33b10f37, identifier: CL28270
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_e2fae3aa144817dc6d9d7766f4aaf7d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_e2fae3aa144817dc6d9d7766f4aaf7d5.jpg not downloaded yet
2026-03-30 10:55:59 [auto1.de] INFO: Found listing with ID: SW36019
2026-03-30 10:55:59 [auto1.de] INFO: Found listing with ID: ZV14288
2026-03-30 10:55:59 [auto1.de] INFO: Found listing with ID: UZ37057
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ37057%27 HTTP/1.1" 200 None
2026-03-30 10:55:59 [auto1.de] INFO: Scrape type for UZ37057: 1
2026-03-30 10:55:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5122a10>
2026-03-30 10:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_3801695835f70e2cd9672ba9a0a4f385.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_3801695835f70e2cd9672ba9a0a4f385.jpg saved to cache
2026-03-30 10:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356
2026-03-30 10:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f16190>
2026-03-30 10:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_c0fc4dd113b2abf4924e13349b4c4172.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_c0fc4dd113b2abf4924e13349b4c4172.jpg saved to cache
2026-03-30 10:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 814eadfd-9888-5bf6-b054-c59e6553fff4
2026-03-30 10:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_ae56905e858dbc7dea483fa44f461a22.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_cfcfbc62c9dd4a8b3cefb156286710b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:55:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 571dc1dc-7efa-55fc-93db-5cfb33b10f37 with identifier: CL28270
2026-03-30 10:55:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 571dc1dc-7efa-55fc-93db-5cfb33b10f37 with identifier: CL28270
2026-03-30 10:55:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 571dc1dc-7efa-55fc-93db-5cfb33b10f37 with identifier: CL28270 to the API
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:04:49Z',
 'fuel_type': 'petrol',
 'id': '571dc1dc-7efa-55fc-93db-5cfb33b10f37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL28270',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 44055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2023}
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL28270%27 HTTP/1.1" 200 None
2026-03-30 10:55:59 [auto1.de] INFO: Saving data for CL28270: {'auction_closing_time': 1774969489.0, 'created_time': 1773775009.872816, 'last_price_update_time': 1774868159.802064}
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL28270') HTTP/1.1" 204 0
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_368f715ff96899aaab6bd7a3e56d588b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_368f715ff96899aaab6bd7a3e56d588b.jpg not downloaded yet
2026-03-30 10:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c66b10>
2026-03-30 10:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b41dd0-e957-51af-b03d-ab97be688597/c4b41dd0-e957-51af-b03d-ab97be688597_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fd2%252Fead2e29731a6b892176e54f2a95ece9d%252Fpa%252FYW38649_a825b2983ac243e61fad47abb6bc45bd.jpg') HTTP/1.1" 204 0
2026-03-30 10:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_a825b2983ac243e61fad47abb6bc45bd.jpg saved to cache
2026-03-30 10:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c4b41dd0-e957-51af-b03d-ab97be688597
2026-03-30 10:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef80b6690>
2026-03-30 10:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_aa5b8a74d12c734e6261edf33f35ae14.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_aa5b8a74d12c734e6261edf33f35ae14.jpg saved to cache
2026-03-30 10:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356
2026-03-30 10:56:00 [auto1.de] INFO: Found listing with ID: GT95785
2026-03-30 10:56:00 [auto1.de] INFO: Found listing with ID: EW55752
2026-03-30 10:56:00 [auto1.de] INFO: Found listing with ID: RG17194
2026-03-30 10:56:00 [auto1.de] INFO: Found listing with ID: DA73332
2026-03-30 10:56:00 [auto1.de] INFO: Found listing with ID: AU19422
2026-03-30 10:56:00 [auto1.de] INFO: Found listing with ID: EJ51089
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ51089%27 HTTP/1.1" 200 None
2026-03-30 10:56:00 [auto1.de] INFO: Scrape type for EJ51089: 2
2026-03-30 10:56:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5797b2a4-3567-57ad-9dfc-cf5ee9f47aa9 with identifier: EJ51089
2026-03-30 10:56:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5797b2a4-3567-57ad-9dfc-cf5ee9f47aa9 with scrape type 2
2026-03-30 10:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5797b2a4-3567-57ad-9dfc-cf5ee9f47aa9 with scrape type 2
2026-03-30 10:56:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5797b2a4-3567-57ad-9dfc-cf5ee9f47aa9, identifier: EJ51089
2026-03-30 10:56:00 [auto1.de] INFO: Found listing with ID: VV73959
2026-03-30 10:56:00 [auto1.de] INFO: Found listing with ID: WL38814
2026-03-30 10:56:00 [auto1.de] INFO: Found listing with ID: SG57857
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG57857%27 HTTP/1.1" 200 None
2026-03-30 10:56:00 [auto1.de] INFO: Scrape type for SG57857: 2
2026-03-30 10:56:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e82b4b3f-af67-5fe7-a736-0700a2275e44 with identifier: SG57857
2026-03-30 10:56:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e82b4b3f-af67-5fe7-a736-0700a2275e44 with scrape type 2
2026-03-30 10:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e82b4b3f-af67-5fe7-a736-0700a2275e44 with scrape type 2
2026-03-30 10:56:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e82b4b3f-af67-5fe7-a736-0700a2275e44, identifier: SG57857
2026-03-30 10:56:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db4dd0>
2026-03-30 10:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b41dd0-e957-51af-b03d-ab97be688597/c4b41dd0-e957-51af-b03d-ab97be688597_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fd2%252Fead2e29731a6b892176e54f2a95ece9d%252Fpa%252FYW38649_e3e9327364c5222c7f5805e7e2190194.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_e3e9327364c5222c7f5805e7e2190194.jpg saved to cache
2026-03-30 10:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c4b41dd0-e957-51af-b03d-ab97be688597
2026-03-30 10:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e97290>
2026-03-30 10:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_0574f9e8618c32f67e9cdcc19cde3c58.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_0574f9e8618c32f67e9cdcc19cde3c58.jpg saved to cache
2026-03-30 10:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 814eadfd-9888-5bf6-b054-c59e6553fff4
2026-03-30 10:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_5b20a365d6b6a6f042615d3c0240125d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_6fece630d3e4eb0f1a8a94c85e32ecc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_8f0d95b34653d97fbf75bcf17c582898.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5797b2a4-3567-57ad-9dfc-cf5ee9f47aa9 with identifier: EJ51089
2026-03-30 10:56:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5797b2a4-3567-57ad-9dfc-cf5ee9f47aa9 with identifier: EJ51089
2026-03-30 10:56:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5797b2a4-3567-57ad-9dfc-cf5ee9f47aa9 with identifier: EJ51089 to the API
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:11:17Z',
 'fuel_type': 'petrol',
 'id': '5797b2a4-3567-57ad-9dfc-cf5ee9f47aa9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ51089',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 65186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-21',
 'seller_name': None,
 'title': 'Opel Grandland X 1.2 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2019}
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ51089%27 HTTP/1.1" 200 None
2026-03-30 10:56:00 [auto1.de] INFO: Saving data for EJ51089: {'auction_closing_time': 1774969877.0, 'created_time': 1774464752.078306, 'last_price_update_time': 1774868160.788516}
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ51089') HTTP/1.1" 204 0
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_70e8b8338b4b4208128b5e5454700be8.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_70e8b8338b4b4208128b5e5454700be8.jpg not downloaded yet
2026-03-30 10:56:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e82b4b3f-af67-5fe7-a736-0700a2275e44 with identifier: SG57857
2026-03-30 10:56:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e82b4b3f-af67-5fe7-a736-0700a2275e44 with identifier: SG57857
2026-03-30 10:56:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e82b4b3f-af67-5fe7-a736-0700a2275e44 with identifier: SG57857 to the API
2026-03-30 10:56:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:05:17Z',
 'fuel_type': 'diesel',
 'id': 'e82b4b3f-af67-5fe7-a736-0700a2275e44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG57857',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 117876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-08',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten EcoProfi',
 'transmission': 'manual',
 'trim': 'Kasten EcoProfi',
 'year': 2017}
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG57857%27 HTTP/1.1" 200 None
2026-03-30 10:56:01 [auto1.de] INFO: Saving data for SG57857: {'auction_closing_time': 1774969517.0, 'created_time': 1773305733.550615, 'last_price_update_time': 1774868161.251875}
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG57857') HTTP/1.1" 204 0
2026-03-30 10:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db4dd0>
2026-03-30 10:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_493d6a15726e1c0ecc73224d15adc721.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_493d6a15726e1c0ecc73224d15adc721.jpg saved to cache
2026-03-30 10:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356
2026-03-30 10:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_dab1ba67b31ecb0fc7b775e57040c1a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_a76d11cc99222729df5422ee73785d00.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:01 [auto1.de] INFO: Found listing with ID: FK65857
2026-03-30 10:56:01 [auto1.de] INFO: Found listing with ID: BH50029
2026-03-30 10:56:01 [auto1.de] INFO: Found listing with ID: LT62829
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT62829%27 HTTP/1.1" 200 None
2026-03-30 10:56:01 [auto1.de] INFO: Scrape type for LT62829: 2
2026-03-30 10:56:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 872eb76c-8e2f-56f8-aba1-909b29aea131 with identifier: LT62829
2026-03-30 10:56:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 872eb76c-8e2f-56f8-aba1-909b29aea131 with scrape type 2
2026-03-30 10:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 872eb76c-8e2f-56f8-aba1-909b29aea131 with scrape type 2
2026-03-30 10:56:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 872eb76c-8e2f-56f8-aba1-909b29aea131, identifier: LT62829
2026-03-30 10:56:01 [auto1.de] INFO: Found listing with ID: AF90097
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF90097%27 HTTP/1.1" 200 None
2026-03-30 10:56:01 [auto1.de] INFO: Scrape type for AF90097: 2
2026-03-30 10:56:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f186d672-9c08-5dd6-9804-2aaaaf7bd87e with identifier: AF90097
2026-03-30 10:56:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f186d672-9c08-5dd6-9804-2aaaaf7bd87e with scrape type 2
2026-03-30 10:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f186d672-9c08-5dd6-9804-2aaaaf7bd87e with scrape type 2
2026-03-30 10:56:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f186d672-9c08-5dd6-9804-2aaaaf7bd87e, identifier: AF90097
2026-03-30 10:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e64dd0>
2026-03-30 10:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_ae56905e858dbc7dea483fa44f461a22.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_ae56905e858dbc7dea483fa44f461a22.jpg saved to cache
2026-03-30 10:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 814eadfd-9888-5bf6-b054-c59e6553fff4
2026-03-30 10:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c3f2d0>
2026-03-30 10:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_cfcfbc62c9dd4a8b3cefb156286710b3.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_cfcfbc62c9dd4a8b3cefb156286710b3.jpg saved to cache
2026-03-30 10:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 814eadfd-9888-5bf6-b054-c59e6553fff4
2026-03-30 10:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_537521ed04e8f1a30a2da029118cc6c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 872eb76c-8e2f-56f8-aba1-909b29aea131 with identifier: LT62829
2026-03-30 10:56:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 872eb76c-8e2f-56f8-aba1-909b29aea131 with identifier: LT62829
2026-03-30 10:56:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 872eb76c-8e2f-56f8-aba1-909b29aea131 with identifier: LT62829 to the API
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:52:05Z',
 'fuel_type': 'petrol',
 'id': '872eb76c-8e2f-56f8-aba1-909b29aea131',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT62829',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 66313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-25',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2024}
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT62829%27 HTTP/1.1" 200 None
2026-03-30 10:56:02 [auto1.de] INFO: Saving data for LT62829: {'auction_closing_time': 1774972325.0, 'created_time': 1774349871.256768, 'last_price_update_time': 1774868162.045109}
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT62829') HTTP/1.1" 204 0
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_be13fe83c602a283c8fdd4752df0418b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_be13fe83c602a283c8fdd4752df0418b.jpg not downloaded yet
2026-03-30 10:56:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f186d672-9c08-5dd6-9804-2aaaaf7bd87e with identifier: AF90097
2026-03-30 10:56:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f186d672-9c08-5dd6-9804-2aaaaf7bd87e with identifier: AF90097
2026-03-30 10:56:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f186d672-9c08-5dd6-9804-2aaaaf7bd87e with identifier: AF90097 to the API
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:50:38Z',
 'fuel_type': 'diesel',
 'id': 'f186d672-9c08-5dd6-9804-2aaaaf7bd87e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF90097',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 153010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-20',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2011}
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF90097%27 HTTP/1.1" 200 None
2026-03-30 10:56:02 [auto1.de] INFO: Saving data for AF90097: {'auction_closing_time': 1774972238.0, 'created_time': 1773307618.290508, 'last_price_update_time': 1774868162.550537}
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF90097') HTTP/1.1" 204 0
2026-03-30 10:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_8f0cdbb59f6934df5cd5956a4dcf97cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:02 [auto1.de] INFO: Found listing with ID: LT67236
2026-03-30 10:56:02 [auto1.de] INFO: Found listing with ID: EN14758
2026-03-30 10:56:02 [auto1.de] INFO: Found listing with ID: SZ84834
2026-03-30 10:56:02 [auto1.de] INFO: Found listing with ID: XL03429
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL03429%27 HTTP/1.1" 200 None
2026-03-30 10:56:02 [auto1.de] INFO: Scrape type for XL03429: 2
2026-03-30 10:56:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8baef42a-423c-5b0a-86a4-b890b87c740c with identifier: XL03429
2026-03-30 10:56:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8baef42a-423c-5b0a-86a4-b890b87c740c with scrape type 2
2026-03-30 10:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8baef42a-423c-5b0a-86a4-b890b87c740c with scrape type 2
2026-03-30 10:56:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8baef42a-423c-5b0a-86a4-b890b87c740c, identifier: XL03429
2026-03-30 10:56:02 [auto1.de] INFO: Found listing with ID: EU60788
2026-03-30 10:56:02 [auto1.de] INFO: Found listing with ID: MN64369
2026-03-30 10:56:02 [auto1.de] INFO: Found listing with ID: EC42355
2026-03-30 10:56:02 [auto1.de] INFO: Found listing with ID: FP89516
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP89516%27 HTTP/1.1" 200 None
2026-03-30 10:56:02 [auto1.de] INFO: Scrape type for FP89516: 2
2026-03-30 10:56:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1de39762-8add-5a88-8dab-764e68b7a1a3 with identifier: FP89516
2026-03-30 10:56:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1de39762-8add-5a88-8dab-764e68b7a1a3 with scrape type 2
2026-03-30 10:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1de39762-8add-5a88-8dab-764e68b7a1a3 with scrape type 2
2026-03-30 10:56:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1de39762-8add-5a88-8dab-764e68b7a1a3, identifier: FP89516
2026-03-30 10:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5120210>
2026-03-30 10:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_5b20a365d6b6a6f042615d3c0240125d.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_5b20a365d6b6a6f042615d3c0240125d.jpg saved to cache
2026-03-30 10:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 814eadfd-9888-5bf6-b054-c59e6553fff4
2026-03-30 10:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e2c610>
2026-03-30 10:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_6fece630d3e4eb0f1a8a94c85e32ecc4.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_6fece630d3e4eb0f1a8a94c85e32ecc4.jpg saved to cache
2026-03-30 10:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356
2026-03-30 10:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5113c90>
2026-03-30 10:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b41dd0-e957-51af-b03d-ab97be688597/c4b41dd0-e957-51af-b03d-ab97be688597_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fd2%252Fead2e29731a6b892176e54f2a95ece9d%252Fpa%252FYW38649_8f0d95b34653d97fbf75bcf17c582898.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_8f0d95b34653d97fbf75bcf17c582898.jpg saved to cache
2026-03-30 10:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c4b41dd0-e957-51af-b03d-ab97be688597
2026-03-30 10:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_e2fae3aa144817dc6d9d7766f4aaf7d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8baef42a-423c-5b0a-86a4-b890b87c740c with identifier: XL03429
2026-03-30 10:56:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8baef42a-423c-5b0a-86a4-b890b87c740c with identifier: XL03429
2026-03-30 10:56:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8baef42a-423c-5b0a-86a4-b890b87c740c with identifier: XL03429 to the API
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:55:17Z',
 'fuel_type': 'diesel',
 'id': '8baef42a-423c-5b0a-86a4-b890b87c740c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL03429',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 189850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-28',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 2.0 Blue-HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2015}
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL03429%27 HTTP/1.1" 200 None
2026-03-30 10:56:03 [auto1.de] INFO: Saving data for XL03429: {'auction_closing_time': 1774972517.0, 'created_time': 1773304993.477775, 'last_price_update_time': 1774868163.317347}
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL03429') HTTP/1.1" 204 0
2026-03-30 10:56:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1de39762-8add-5a88-8dab-764e68b7a1a3 with identifier: FP89516
2026-03-30 10:56:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1de39762-8add-5a88-8dab-764e68b7a1a3 with identifier: FP89516
2026-03-30 10:56:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1de39762-8add-5a88-8dab-764e68b7a1a3 with identifier: FP89516 to the API
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:12:57Z',
 'fuel_type': 'petrol',
 'id': '1de39762-8add-5a88-8dab-764e68b7a1a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP89516',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 97794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion',
 'year': 2019}
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP89516%27 HTTP/1.1" 200 None
2026-03-30 10:56:03 [auto1.de] INFO: Saving data for FP89516: {'auction_closing_time': 1774969977.0, 'created_time': 1774377347.689732, 'last_price_update_time': 1774868163.68081}
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP89516') HTTP/1.1" 204 0
2026-03-30 10:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d5e490>
2026-03-30 10:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b41dd0-e957-51af-b03d-ab97be688597/c4b41dd0-e957-51af-b03d-ab97be688597_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fd2%252Fead2e29731a6b892176e54f2a95ece9d%252Fpa%252FYW38649_dab1ba67b31ecb0fc7b775e57040c1a2.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_dab1ba67b31ecb0fc7b775e57040c1a2.jpg saved to cache
2026-03-30 10:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c4b41dd0-e957-51af-b03d-ab97be688597
2026-03-30 10:56:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4b41dd0-e957-51af-b03d-ab97be688597, skipping ID generation
2026-03-30 10:56:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4b41dd0-e957-51af-b03d-ab97be688597 with scrape type 1
2026-03-30 10:56:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c4b41dd0-e957-51af-b03d-ab97be688597 sending to next pipeline
2026-03-30 10:56:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4b41dd0-e957-51af-b03d-ab97be688597, identifier: YW38649
2026-03-30 10:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50fea10>
2026-03-30 10:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_a76d11cc99222729df5422ee73785d00.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_a76d11cc99222729df5422ee73785d00.jpg saved to cache
2026-03-30 10:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356
2026-03-30 10:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_368f715ff96899aaab6bd7a3e56d588b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:03 [auto1.de] INFO: Found listing with ID: JY37927
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY37927%27 HTTP/1.1" 200 None
2026-03-30 10:56:03 [auto1.de] INFO: Scrape type for JY37927: 1
2026-03-30 10:56:03 [auto1.de] INFO: Found listing with ID: PG02615
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG02615%27 HTTP/1.1" 200 None
2026-03-30 10:56:03 [auto1.de] INFO: Scrape type for PG02615: 2
2026-03-30 10:56:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ae3228b-2ba8-57c8-8938-1893ecaf262f with identifier: PG02615
2026-03-30 10:56:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ae3228b-2ba8-57c8-8938-1893ecaf262f with scrape type 2
2026-03-30 10:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ae3228b-2ba8-57c8-8938-1893ecaf262f with scrape type 2
2026-03-30 10:56:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ae3228b-2ba8-57c8-8938-1893ecaf262f, identifier: PG02615
2026-03-30 10:56:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4b41dd0-e957-51af-b03d-ab97be688597 with identifier: YW38649
2026-03-30 10:56:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4b41dd0-e957-51af-b03d-ab97be688597 with identifier: YW38649
2026-03-30 10:56:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4b41dd0-e957-51af-b03d-ab97be688597 with identifier: YW38649 to the API
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_dab1ba67b31ecb0fc7b775e57040c1a2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 193,
 'expiration_date': '2026-03-31T15:42:14Z',
 'fuel_type': 'petrol',
 'id': 'c4b41dd0-e957-51af-b03d-ab97be688597',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW38649',
 'listing': 'auction',
 'location': 'Kaufbeuren',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 194202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b41dd0-e957-51af-b03d-ab97be688597/c4b41dd0-e957-51af-b03d-ab97be688597_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_6e568e5dac20e950791d6d5587964526.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b41dd0-e957-51af-b03d-ab97be688597/c4b41dd0-e957-51af-b03d-ab97be688597_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_dab1ba67b31ecb0fc7b775e57040c1a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b41dd0-e957-51af-b03d-ab97be688597/c4b41dd0-e957-51af-b03d-ab97be688597_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_a825b2983ac243e61fad47abb6bc45bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b41dd0-e957-51af-b03d-ab97be688597/c4b41dd0-e957-51af-b03d-ab97be688597_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_e3e9327364c5222c7f5805e7e2190194.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b41dd0-e957-51af-b03d-ab97be688597/c4b41dd0-e957-51af-b03d-ab97be688597_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/d2/ead2e29731a6b892176e54f2a95ece9d/pa/YW38649_8f0d95b34653d97fbf75bcf17c582898.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 Turbo Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2007}
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW38649%27 HTTP/1.1" 200 None
2026-03-30 10:56:04 [auto1.de] INFO: Saving data for YW38649: {'created_time': 1774868164.394614, 'last_price_update_time': 1774868164.394625, 'auction_closing_time': 1774971734.0}
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW38649') HTTP/1.1" 204 0
2026-03-30 10:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db6110>
2026-03-30 10:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_537521ed04e8f1a30a2da029118cc6c2.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_537521ed04e8f1a30a2da029118cc6c2.jpg saved to cache
2026-03-30 10:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 814eadfd-9888-5bf6-b054-c59e6553fff4
2026-03-30 10:56:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ae3228b-2ba8-57c8-8938-1893ecaf262f with identifier: PG02615
2026-03-30 10:56:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ae3228b-2ba8-57c8-8938-1893ecaf262f with identifier: PG02615
2026-03-30 10:56:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ae3228b-2ba8-57c8-8938-1893ecaf262f with identifier: PG02615 to the API
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:08:22Z',
 'fuel_type': 'diesel',
 'id': '0ae3228b-2ba8-57c8-8938-1893ecaf262f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG02615',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 264030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-29',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG02615%27 HTTP/1.1" 200 None
2026-03-30 10:56:04 [auto1.de] INFO: Saving data for PG02615: {'auction_closing_time': 1774969702.0, 'created_time': 1773688292.408268, 'last_price_update_time': 1774868164.770934}
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG02615') HTTP/1.1" 204 0
2026-03-30 10:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_70e8b8338b4b4208128b5e5454700be8.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:04 [scrapy.extensions.logstats] INFO: Crawled 746 pages (at 27 pages/min), scraped 861 items (at 101 items/min)
2026-03-30 10:56:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 10:56:04 [auto1.de] INFO: Found listing with ID: ND88059
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND88059%27 HTTP/1.1" 200 None
2026-03-30 10:56:04 [auto1.de] INFO: Scrape type for ND88059: 0
2026-03-30 10:56:04 [auto1.de] INFO: Found listing with ID: YV18372
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV18372%27 HTTP/1.1" 200 None
2026-03-30 10:56:04 [auto1.de] INFO: Scrape type for YV18372: 2
2026-03-30 10:56:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11f010ce-bcbd-5827-96f7-ba833b63c38e with identifier: YV18372
2026-03-30 10:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11f010ce-bcbd-5827-96f7-ba833b63c38e with scrape type 2
2026-03-30 10:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11f010ce-bcbd-5827-96f7-ba833b63c38e with scrape type 2
2026-03-30 10:56:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11f010ce-bcbd-5827-96f7-ba833b63c38e, identifier: YV18372
2026-03-30 10:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e89dd0>
2026-03-30 10:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_8f0cdbb59f6934df5cd5956a4dcf97cb.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_8f0cdbb59f6934df5cd5956a4dcf97cb.jpg saved to cache
2026-03-30 10:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356
2026-03-30 10:56:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5974310>
2026-03-30 10:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fb3%252F43b348c1b010cc9217dc559ce1ba6aa9%252Fpa%252FCW51870_e2fae3aa144817dc6d9d7766f4aaf7d5.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_e2fae3aa144817dc6d9d7766f4aaf7d5.jpg saved to cache
2026-03-30 10:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 814eadfd-9888-5bf6-b054-c59e6553fff4
2026-03-30 10:56:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 814eadfd-9888-5bf6-b054-c59e6553fff4, skipping ID generation
2026-03-30 10:56:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 814eadfd-9888-5bf6-b054-c59e6553fff4 with scrape type 1
2026-03-30 10:56:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 814eadfd-9888-5bf6-b054-c59e6553fff4 sending to next pipeline
2026-03-30 10:56:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 814eadfd-9888-5bf6-b054-c59e6553fff4, identifier: CW51870
2026-03-30 10:56:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11f010ce-bcbd-5827-96f7-ba833b63c38e with identifier: YV18372
2026-03-30 10:56:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11f010ce-bcbd-5827-96f7-ba833b63c38e with identifier: YV18372
2026-03-30 10:56:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11f010ce-bcbd-5827-96f7-ba833b63c38e with identifier: YV18372 to the API
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:07:17Z',
 'fuel_type': 'diesel',
 'id': '11f010ce-bcbd-5827-96f7-ba833b63c38e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV18372',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 215912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC',
 'transmission': 'automatic',
 'trim': 'T BlueTEC',
 'year': 2017}
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV18372%27 HTTP/1.1" 200 None
2026-03-30 10:56:05 [auto1.de] INFO: Saving data for YV18372: {'auction_closing_time': 1774969637.0, 'created_time': 1774351308.901307, 'last_price_update_time': 1774868165.505182}
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV18372') HTTP/1.1" 204 0
2026-03-30 10:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GX62549> (referer: https://www.auto1.com/v1/car-details-view/GX62549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 814eadfd-9888-5bf6-b054-c59e6553fff4 with identifier: CW51870
2026-03-30 10:56:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 814eadfd-9888-5bf6-b054-c59e6553fff4 with identifier: CW51870
2026-03-30 10:56:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 814eadfd-9888-5bf6-b054-c59e6553fff4 with identifier: CW51870 to the API
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_e2fae3aa144817dc6d9d7766f4aaf7d5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:25:17Z',
 'fuel_type': 'diesel',
 'id': '814eadfd-9888-5bf6-b054-c59e6553fff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW51870',
 'listing': 'auction',
 'location': 'DE, Kaarst',
 'make': 'Mazda',
 'model': '3',
 'odometer': 160635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_ac49fc6634e210b4d6cbbed0e9d16c8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_857a37260a70da8c3e03b3b6d2ee7d48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_cfcfbc62c9dd4a8b3cefb156286710b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_23cdd167765c471b942f9124c57d4e8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_c0fc4dd113b2abf4924e13349b4c4172.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_0574f9e8618c32f67e9cdcc19cde3c58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_ae56905e858dbc7dea483fa44f461a22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_5b20a365d6b6a6f042615d3c0240125d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_537521ed04e8f1a30a2da029118cc6c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_814eadfd-9888-5bf6-b054-c59e6553fff4/814eadfd-9888-5bf6-b054-c59e6553fff4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/b3/43b348c1b010cc9217dc559ce1ba6aa9/pa/CW51870_e2fae3aa144817dc6d9d7766f4aaf7d5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 3 2.2 Turbodiesel Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2014}
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW51870%27 HTTP/1.1" 200 None
2026-03-30 10:56:05 [auto1.de] INFO: Saving data for CW51870: {'created_time': 1774868165.987158, 'last_price_update_time': 1774868165.98717, 'auction_closing_time': 1774970717.0}
2026-03-30 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW51870') HTTP/1.1" 204 0
2026-03-30 10:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_be13fe83c602a283c8fdd4752df0418b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:06 [auto1.de] INFO: Found listing with ID: CC36364
2026-03-30 10:56:06 [auto1.de] INFO: Found listing with ID: CD38469
2026-03-30 10:56:06 [auto1.de] INFO: Found listing with ID: XX53475
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX53475%27 HTTP/1.1" 200 None
2026-03-30 10:56:06 [auto1.de] INFO: Scrape type for XX53475: 2
2026-03-30 10:56:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cb041d2-adc9-5083-ae7d-d0d07cdfea9d with identifier: XX53475
2026-03-30 10:56:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cb041d2-adc9-5083-ae7d-d0d07cdfea9d with scrape type 2
2026-03-30 10:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cb041d2-adc9-5083-ae7d-d0d07cdfea9d with scrape type 2
2026-03-30 10:56:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cb041d2-adc9-5083-ae7d-d0d07cdfea9d, identifier: XX53475
2026-03-30 10:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5036a10>
2026-03-30 10:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_368f715ff96899aaab6bd7a3e56d588b.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_368f715ff96899aaab6bd7a3e56d588b.jpg saved to cache
2026-03-30 10:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356
2026-03-30 10:56:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cb041d2-adc9-5083-ae7d-d0d07cdfea9d with identifier: XX53475
2026-03-30 10:56:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cb041d2-adc9-5083-ae7d-d0d07cdfea9d with identifier: XX53475
2026-03-30 10:56:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cb041d2-adc9-5083-ae7d-d0d07cdfea9d with identifier: XX53475 to the API
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:08:25Z',
 'fuel_type': 'petrol',
 'id': '6cb041d2-adc9-5083-ae7d-d0d07cdfea9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX53475',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan',
 'odometer': 126581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-17',
 'seller_name': None,
 'title': 'Dacia Logan 1.4 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2008}
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX53475%27 HTTP/1.1" 200 None
2026-03-30 10:56:06 [auto1.de] INFO: Saving data for XX53475: {'auction_closing_time': 1774969705.0, 'created_time': 1773984971.950209, 'last_price_update_time': 1774868166.55731}
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX53475') HTTP/1.1" 204 0
2026-03-30 10:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e68f50>
2026-03-30 10:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_70e8b8338b4b4208128b5e5454700be8.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_70e8b8338b4b4208128b5e5454700be8.jpg saved to cache
2026-03-30 10:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356
2026-03-30 10:56:06 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 9529 | hits on page: 40
2026-03-30 10:56:06 [auto1.de] INFO: Found listing with ID: BG92891
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG92891%27 HTTP/1.1" 200 None
2026-03-30 10:56:06 [auto1.de] INFO: Scrape type for BG92891: 2
2026-03-30 10:56:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c82b094e-b822-52d6-9691-8e038ad1c103 with identifier: BG92891
2026-03-30 10:56:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c82b094e-b822-52d6-9691-8e038ad1c103 with scrape type 2
2026-03-30 10:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c82b094e-b822-52d6-9691-8e038ad1c103 with scrape type 2
2026-03-30 10:56:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c82b094e-b822-52d6-9691-8e038ad1c103, identifier: BG92891
2026-03-30 10:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ37057/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c82b094e-b822-52d6-9691-8e038ad1c103 with identifier: BG92891
2026-03-30 10:56:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c82b094e-b822-52d6-9691-8e038ad1c103 with identifier: BG92891
2026-03-30 10:56:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c82b094e-b822-52d6-9691-8e038ad1c103 with identifier: BG92891 to the API
2026-03-30 10:56:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:00:39Z',
 'fuel_type': 'petrol',
 'id': 'c82b094e-b822-52d6-9691-8e038ad1c103',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG92891',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Veloster',
 'odometer': 130260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-21',
 'seller_name': None,
 'title': 'Hyundai Veloster 1.6 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG92891%27 HTTP/1.1" 200 None
2026-03-30 10:56:07 [auto1.de] INFO: Saving data for BG92891: {'auction_closing_time': 1774969239.0, 'created_time': 1773134637.344042, 'last_price_update_time': 1774868167.120007}
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG92891') HTTP/1.1" 204 0
2026-03-30 10:56:07 [auto1.de] INFO: Found listing with ID: YY27100
2026-03-30 10:56:07 [auto1.de] INFO: Found listing with ID: HF82525
2026-03-30 10:56:07 [auto1.de] INFO: Found listing with ID: DN72747
2026-03-30 10:56:07 [auto1.de] INFO: Found listing with ID: LU37598
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU37598%27 HTTP/1.1" 200 None
2026-03-30 10:56:07 [auto1.de] INFO: Scrape type for LU37598: 2
2026-03-30 10:56:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea2cbef7-d866-5ca3-a5a4-bc88ea651ed6 with identifier: LU37598
2026-03-30 10:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea2cbef7-d866-5ca3-a5a4-bc88ea651ed6 with scrape type 2
2026-03-30 10:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea2cbef7-d866-5ca3-a5a4-bc88ea651ed6 with scrape type 2
2026-03-30 10:56:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea2cbef7-d866-5ca3-a5a4-bc88ea651ed6, identifier: LU37598
2026-03-30 10:56:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df5e8ed8-98dd-5a11-819f-a56aa6ec8f97 with identifier: GX62549
2026-03-30 10:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df5e8ed8-98dd-5a11-819f-a56aa6ec8f97 with scrape type 1
2026-03-30 10:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df5e8ed8-98dd-5a11-819f-a56aa6ec8f97
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_e62e912a14601563fe471c4c3948746d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_e62e912a14601563fe471c4c3948746d.jpg not downloaded yet
2026-03-30 10:56:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5af3950>
2026-03-30 10:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F93%252F8a93939a4c681acef934b0867f27fa3b%252Fpa%252FRK31511_be13fe83c602a283c8fdd4752df0418b.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_be13fe83c602a283c8fdd4752df0418b.jpg saved to cache
2026-03-30 10:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356
2026-03-30 10:56:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356, skipping ID generation
2026-03-30 10:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356 with scrape type 1
2026-03-30 10:56:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356 sending to next pipeline
2026-03-30 10:56:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356, identifier: RK31511
2026-03-30 10:56:07 [auto1.de] INFO: Found listing with ID: MJ05239
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ05239%27 HTTP/1.1" 200 None
2026-03-30 10:56:07 [auto1.de] INFO: Scrape type for MJ05239: 0
2026-03-30 10:56:07 [auto1.de] INFO: Found listing with ID: EF16593
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF16593%27 HTTP/1.1" 200 None
2026-03-30 10:56:07 [auto1.de] INFO: Scrape type for EF16593: 2
2026-03-30 10:56:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6623012-fcda-5919-94e0-f323e708570b with identifier: EF16593
2026-03-30 10:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6623012-fcda-5919-94e0-f323e708570b with scrape type 2
2026-03-30 10:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6623012-fcda-5919-94e0-f323e708570b with scrape type 2
2026-03-30 10:56:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6623012-fcda-5919-94e0-f323e708570b, identifier: EF16593
2026-03-30 10:56:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea2cbef7-d866-5ca3-a5a4-bc88ea651ed6 with identifier: LU37598
2026-03-30 10:56:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea2cbef7-d866-5ca3-a5a4-bc88ea651ed6 with identifier: LU37598
2026-03-30 10:56:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea2cbef7-d866-5ca3-a5a4-bc88ea651ed6 with identifier: LU37598 to the API
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 103,
 'expiration_date': '2026-03-31T15:09:35Z',
 'fuel_type': 'diesel',
 'id': 'ea2cbef7-d866-5ca3-a5a4-bc88ea651ed6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU37598',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 245692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-23',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2010}
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU37598%27 HTTP/1.1" 200 None
2026-03-30 10:56:07 [auto1.de] INFO: Saving data for LU37598: {'auction_closing_time': 1774969775.0, 'created_time': 1773135530.025075, 'last_price_update_time': 1774868167.970219}
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU37598') HTTP/1.1" 204 0
2026-03-30 10:56:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356 with identifier: RK31511
2026-03-30 10:56:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356 with identifier: RK31511
2026-03-30 10:56:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 350b4ca9-6dfc-52f8-a4e6-e476c7b5d356 with identifier: RK31511 to the API
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_be13fe83c602a283c8fdd4752df0418b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:20:27Z',
 'fuel_type': 'diesel',
 'id': '350b4ca9-6dfc-52f8-a4e6-e476c7b5d356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK31511',
 'listing': 'auction',
 'location': 'DE, Königsbrunn',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 77429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_e7053f7243cce3fcae35d36d90fe3301.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_3801695835f70e2cd9672ba9a0a4f385.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_aa5b8a74d12c734e6261edf33f35ae14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_493d6a15726e1c0ecc73224d15adc721.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_6fece630d3e4eb0f1a8a94c85e32ecc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_a76d11cc99222729df5422ee73785d00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_8f0cdbb59f6934df5cd5956a4dcf97cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_368f715ff96899aaab6bd7a3e56d588b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_70e8b8338b4b4208128b5e5454700be8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_350b4ca9-6dfc-52f8-a4e6-e476c7b5d356/350b4ca9-6dfc-52f8-a4e6-e476c7b5d356_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/93/8a93939a4c681acef934b0867f27fa3b/pa/RK31511_be13fe83c602a283c8fdd4752df0418b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2022}
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK31511%27 HTTP/1.1" 200 None
2026-03-30 10:56:08 [auto1.de] INFO: Saving data for RK31511: {'created_time': 1774868168.351727, 'last_price_update_time': 1774868168.351739, 'auction_closing_time': 1774970427.0}
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK31511') HTTP/1.1" 204 0
2026-03-30 10:56:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6623012-fcda-5919-94e0-f323e708570b with identifier: EF16593
2026-03-30 10:56:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6623012-fcda-5919-94e0-f323e708570b with identifier: EF16593
2026-03-30 10:56:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6623012-fcda-5919-94e0-f323e708570b with identifier: EF16593 to the API
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:59:56Z',
 'fuel_type': 'petrol',
 'id': 'd6623012-fcda-5919-94e0-f323e708570b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF16593',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 85985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-12',
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF16593%27 HTTP/1.1" 200 None
2026-03-30 10:56:08 [auto1.de] INFO: Saving data for EF16593: {'auction_closing_time': 1774972796.0, 'created_time': 1774465732.724765, 'last_price_update_time': 1774868168.716828}
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF16593') HTTP/1.1" 204 0
2026-03-30 10:56:08 [auto1.de] INFO: Found listing with ID: PX72797
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX72797%27 HTTP/1.1" 200 None
2026-03-30 10:56:08 [auto1.de] INFO: Scrape type for PX72797: 2
2026-03-30 10:56:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 806ffe61-2911-5fc4-95a6-90939117140a with identifier: PX72797
2026-03-30 10:56:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 806ffe61-2911-5fc4-95a6-90939117140a with scrape type 2
2026-03-30 10:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 806ffe61-2911-5fc4-95a6-90939117140a with scrape type 2
2026-03-30 10:56:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 806ffe61-2911-5fc4-95a6-90939117140a, identifier: PX72797
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_78296c7180991d097bd73e4704fcd16e.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_78296c7180991d097bd73e4704fcd16e.jpg not downloaded yet
2026-03-30 10:56:08 [auto1.de] INFO: Found listing with ID: DY66816
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY66816%27 HTTP/1.1" 200 None
2026-03-30 10:56:08 [auto1.de] INFO: Scrape type for DY66816: 2
2026-03-30 10:56:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 280db769-3f76-5b9e-88ce-f138f311f8ec with identifier: DY66816
2026-03-30 10:56:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 280db769-3f76-5b9e-88ce-f138f311f8ec with scrape type 2
2026-03-30 10:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 280db769-3f76-5b9e-88ce-f138f311f8ec with scrape type 2
2026-03-30 10:56:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 280db769-3f76-5b9e-88ce-f138f311f8ec, identifier: DY66816
2026-03-30 10:56:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 806ffe61-2911-5fc4-95a6-90939117140a with identifier: PX72797
2026-03-30 10:56:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 806ffe61-2911-5fc4-95a6-90939117140a with identifier: PX72797
2026-03-30 10:56:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 806ffe61-2911-5fc4-95a6-90939117140a with identifier: PX72797 to the API
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:36:39Z',
 'fuel_type': 'diesel',
 'id': '806ffe61-2911-5fc4-95a6-90939117140a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX72797',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 233765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-13',
 'seller_name': None,
 'title': 'Audi A6 Allroad 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX72797%27 HTTP/1.1" 200 None
2026-03-30 10:56:09 [auto1.de] INFO: Saving data for PX72797: {'auction_closing_time': 1774971399.0, 'created_time': 1773687431.447493, 'last_price_update_time': 1774868169.347901}
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX72797') HTTP/1.1" 204 0
2026-03-30 10:56:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 280db769-3f76-5b9e-88ce-f138f311f8ec with identifier: DY66816
2026-03-30 10:56:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 280db769-3f76-5b9e-88ce-f138f311f8ec with identifier: DY66816
2026-03-30 10:56:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 280db769-3f76-5b9e-88ce-f138f311f8ec with identifier: DY66816 to the API
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:34:41Z',
 'fuel_type': 'diesel',
 'id': '280db769-3f76-5b9e-88ce-f138f311f8ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY66816',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 163084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-17',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY66816%27 HTTP/1.1" 200 None
2026-03-30 10:56:09 [auto1.de] INFO: Saving data for DY66816: {'auction_closing_time': 1774971281.0, 'created_time': 1773661645.495473, 'last_price_update_time': 1774868169.847226}
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY66816') HTTP/1.1" 204 0
2026-03-30 10:56:09 [auto1.de] INFO: Found listing with ID: UT71403
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT71403%27 HTTP/1.1" 200 None
2026-03-30 10:56:09 [auto1.de] INFO: Scrape type for UT71403: 2
2026-03-30 10:56:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ab0de13-5cbf-5b89-970d-36642c22eafd with identifier: UT71403
2026-03-30 10:56:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ab0de13-5cbf-5b89-970d-36642c22eafd with scrape type 2
2026-03-30 10:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ab0de13-5cbf-5b89-970d-36642c22eafd with scrape type 2
2026-03-30 10:56:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ab0de13-5cbf-5b89-970d-36642c22eafd, identifier: UT71403
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_6de7de241ee71da38ad879bd20a33c6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_6de7de241ee71da38ad879bd20a33c6a.jpg not downloaded yet
2026-03-30 10:56:09 [auto1.de] INFO: Found listing with ID: BE04791
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE04791%27 HTTP/1.1" 200 None
2026-03-30 10:56:10 [auto1.de] INFO: Scrape type for BE04791: 2
2026-03-30 10:56:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50aad838-2155-5433-a6a0-ee94f0e683d8 with identifier: BE04791
2026-03-30 10:56:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50aad838-2155-5433-a6a0-ee94f0e683d8 with scrape type 2
2026-03-30 10:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50aad838-2155-5433-a6a0-ee94f0e683d8 with scrape type 2
2026-03-30 10:56:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50aad838-2155-5433-a6a0-ee94f0e683d8, identifier: BE04791
2026-03-30 10:56:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ab0de13-5cbf-5b89-970d-36642c22eafd with identifier: UT71403
2026-03-30 10:56:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ab0de13-5cbf-5b89-970d-36642c22eafd with identifier: UT71403
2026-03-30 10:56:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ab0de13-5cbf-5b89-970d-36642c22eafd with identifier: UT71403 to the API
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:29:11Z',
 'fuel_type': 'diesel',
 'id': '9ab0de13-5cbf-5b89-970d-36642c22eafd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT71403',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 67143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2020}
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT71403%27 HTTP/1.1" 200 None
2026-03-30 10:56:10 [auto1.de] INFO: Saving data for UT71403: {'auction_closing_time': 1774970951.0, 'created_time': 1773302242.554925, 'last_price_update_time': 1774868170.47808}
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT71403') HTTP/1.1" 204 0
2026-03-30 10:56:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50aad838-2155-5433-a6a0-ee94f0e683d8 with identifier: BE04791
2026-03-30 10:56:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50aad838-2155-5433-a6a0-ee94f0e683d8 with identifier: BE04791
2026-03-30 10:56:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50aad838-2155-5433-a6a0-ee94f0e683d8 with identifier: BE04791 to the API
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:54:06Z',
 'fuel_type': 'diesel',
 'id': '50aad838-2155-5433-a6a0-ee94f0e683d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE04791',
 'listing': 'auction',
 'make': 'Iveco',
 'model': 'Daily',
 'odometer': 120462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-12',
 'seller_name': None,
 'title': 'Iveco Daily 3.0 Diesel Einzelkabine 35 C Radstand 4100',
 'transmission': 'automatic',
 'trim': 'Einzelkabine 35 C Radstand 4100',
 'year': 2018}
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE04791%27 HTTP/1.1" 200 None
2026-03-30 10:56:10 [auto1.de] INFO: Saving data for BE04791: {'auction_closing_time': 1774972446.0, 'created_time': 1774468240.242326, 'last_price_update_time': 1774868170.880512}
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE04791') HTTP/1.1" 204 0
2026-03-30 10:56:10 [auto1.de] INFO: Found listing with ID: FB21783
2026-03-30 10:56:10 [auto1.de] INFO: Found listing with ID: XS36937
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS36937%27 HTTP/1.1" 200 None
2026-03-30 10:56:10 [auto1.de] INFO: Scrape type for XS36937: 2
2026-03-30 10:56:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b97646e-9d8e-5c47-9d95-8fef644118c9 with identifier: XS36937
2026-03-30 10:56:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b97646e-9d8e-5c47-9d95-8fef644118c9 with scrape type 2
2026-03-30 10:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b97646e-9d8e-5c47-9d95-8fef644118c9 with scrape type 2
2026-03-30 10:56:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b97646e-9d8e-5c47-9d95-8fef644118c9, identifier: XS36937
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_c5d9cdeb8588c256fe1b5a466abd4d02.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_c5d9cdeb8588c256fe1b5a466abd4d02.jpg not downloaded yet
2026-03-30 10:56:11 [auto1.de] INFO: Found listing with ID: PR75210
2026-03-30 10:56:11 [auto1.de] INFO: Found listing with ID: XM97106
2026-03-30 10:56:11 [auto1.de] INFO: Found listing with ID: ZN42603
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN42603%27 HTTP/1.1" 200 None
2026-03-30 10:56:11 [auto1.de] INFO: Scrape type for ZN42603: 2
2026-03-30 10:56:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 454dee3a-6811-5d9f-99a3-576f7c9f3143 with identifier: ZN42603
2026-03-30 10:56:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 454dee3a-6811-5d9f-99a3-576f7c9f3143 with scrape type 2
2026-03-30 10:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 454dee3a-6811-5d9f-99a3-576f7c9f3143 with scrape type 2
2026-03-30 10:56:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 454dee3a-6811-5d9f-99a3-576f7c9f3143, identifier: ZN42603
2026-03-30 10:56:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b97646e-9d8e-5c47-9d95-8fef644118c9 with identifier: XS36937
2026-03-30 10:56:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b97646e-9d8e-5c47-9d95-8fef644118c9 with identifier: XS36937
2026-03-30 10:56:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b97646e-9d8e-5c47-9d95-8fef644118c9 with identifier: XS36937 to the API
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 213,
 'expiration_date': '2026-03-31T15:55:58Z',
 'fuel_type': 'petrol',
 'id': '3b97646e-9d8e-5c47-9d95-8fef644118c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS36937',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 85422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-14',
 'seller_name': None,
 'title': 'Nissan Juke 1.6 Nismo RS 4x4',
 'transmission': 'automatic',
 'trim': 'Nismo RS 4x4',
 'year': 2015}
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS36937%27 HTTP/1.1" 200 None
2026-03-30 10:56:11 [auto1.de] INFO: Saving data for XS36937: {'auction_closing_time': 1774972558.0, 'created_time': 1774463904.024314, 'last_price_update_time': 1774868171.482919}
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS36937') HTTP/1.1" 204 0
2026-03-30 10:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY37927/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_e62e912a14601563fe471c4c3948746d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 454dee3a-6811-5d9f-99a3-576f7c9f3143 with identifier: ZN42603
2026-03-30 10:56:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 454dee3a-6811-5d9f-99a3-576f7c9f3143 with identifier: ZN42603
2026-03-30 10:56:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 454dee3a-6811-5d9f-99a3-576f7c9f3143 with identifier: ZN42603 to the API
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:12:43Z',
 'fuel_type': 'diesel',
 'id': '454dee3a-6811-5d9f-99a3-576f7c9f3143',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN42603',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 249665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-18',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business Edition 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Business Edition 4Motion BlueMotion',
 'year': 2014}
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN42603%27 HTTP/1.1" 200 None
2026-03-30 10:56:11 [auto1.de] INFO: Saving data for ZN42603: {'auction_closing_time': 1774969963.0, 'created_time': 1774377401.075329, 'last_price_update_time': 1774868171.842881}
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN42603') HTTP/1.1" 204 0
2026-03-30 10:56:11 [auto1.de] INFO: Found listing with ID: FR24268
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR24268%27 HTTP/1.1" 200 None
2026-03-30 10:56:11 [auto1.de] INFO: Scrape type for FR24268: 2
2026-03-30 10:56:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abb061b7-ae2a-556f-8cad-8ae83c63b63d with identifier: FR24268
2026-03-30 10:56:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abb061b7-ae2a-556f-8cad-8ae83c63b63d with scrape type 2
2026-03-30 10:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abb061b7-ae2a-556f-8cad-8ae83c63b63d with scrape type 2
2026-03-30 10:56:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abb061b7-ae2a-556f-8cad-8ae83c63b63d, identifier: FR24268
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_b04e82ea13eea989557fbb9deaec22d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_b04e82ea13eea989557fbb9deaec22d5.jpg not downloaded yet
2026-03-30 10:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_78296c7180991d097bd73e4704fcd16e.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:11 [auto1.de] INFO: Found listing with ID: SU92551
2026-03-30 10:56:11 [auto1.de] INFO: Found listing with ID: FC82550
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC82550%27 HTTP/1.1" 200 None
2026-03-30 10:56:12 [auto1.de] INFO: Scrape type for FC82550: 2
2026-03-30 10:56:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11d52849-4c74-5e90-b001-e60845ac7489 with identifier: FC82550
2026-03-30 10:56:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11d52849-4c74-5e90-b001-e60845ac7489 with scrape type 2
2026-03-30 10:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11d52849-4c74-5e90-b001-e60845ac7489 with scrape type 2
2026-03-30 10:56:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11d52849-4c74-5e90-b001-e60845ac7489, identifier: FC82550
2026-03-30 10:56:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abb061b7-ae2a-556f-8cad-8ae83c63b63d with identifier: FR24268
2026-03-30 10:56:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abb061b7-ae2a-556f-8cad-8ae83c63b63d with identifier: FR24268
2026-03-30 10:56:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abb061b7-ae2a-556f-8cad-8ae83c63b63d with identifier: FR24268 to the API
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:11:58Z',
 'fuel_type': 'hybrid',
 'id': 'abb061b7-ae2a-556f-8cad-8ae83c63b63d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR24268',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 20732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-29',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300e T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2023}
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR24268%27 HTTP/1.1" 200 None
2026-03-30 10:56:12 [auto1.de] INFO: Saving data for FR24268: {'auction_closing_time': 1774969918.0, 'created_time': 1774424142.471602, 'last_price_update_time': 1774868172.416952}
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR24268') HTTP/1.1" 204 0
2026-03-30 10:56:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11d52849-4c74-5e90-b001-e60845ac7489 with identifier: FC82550
2026-03-30 10:56:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11d52849-4c74-5e90-b001-e60845ac7489 with identifier: FC82550
2026-03-30 10:56:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11d52849-4c74-5e90-b001-e60845ac7489 with identifier: FC82550 to the API
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:54:41Z',
 'fuel_type': 'diesel',
 'id': '11d52849-4c74-5e90-b001-e60845ac7489',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC82550',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 158262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-09',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 320 CDI 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2008}
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC82550%27 HTTP/1.1" 200 None
2026-03-30 10:56:12 [auto1.de] INFO: Saving data for FC82550: {'auction_closing_time': 1774972481.0, 'created_time': 1773304095.195447, 'last_price_update_time': 1774868172.814376}
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC82550') HTTP/1.1" 204 0
2026-03-30 10:56:12 [auto1.de] INFO: Found listing with ID: GL08454
2026-03-30 10:56:12 [auto1.de] INFO: Found listing with ID: NJ00528
2026-03-30 10:56:12 [auto1.de] INFO: Found listing with ID: NA02682
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA02682%27 HTTP/1.1" 200 None
2026-03-30 10:56:12 [auto1.de] INFO: Scrape type for NA02682: 2
2026-03-30 10:56:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bf71427-28aa-57fb-8625-4a040ce28fdc with identifier: NA02682
2026-03-30 10:56:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bf71427-28aa-57fb-8625-4a040ce28fdc with scrape type 2
2026-03-30 10:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bf71427-28aa-57fb-8625-4a040ce28fdc with scrape type 2
2026-03-30 10:56:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9bf71427-28aa-57fb-8625-4a040ce28fdc, identifier: NA02682
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_7eba8d11a47f1892d9eca81a4400190c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_7eba8d11a47f1892d9eca81a4400190c.jpg not downloaded yet
2026-03-30 10:56:12 [auto1.de] INFO: Found listing with ID: BF15182
2026-03-30 10:56:12 [auto1.de] INFO: Found listing with ID: XX51534
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX51534%27 HTTP/1.1" 200 None
2026-03-30 10:56:13 [auto1.de] INFO: Scrape type for XX51534: 2
2026-03-30 10:56:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71152f4d-82d8-5a0c-bae3-39dbbf7d976a with identifier: XX51534
2026-03-30 10:56:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71152f4d-82d8-5a0c-bae3-39dbbf7d976a with scrape type 2
2026-03-30 10:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71152f4d-82d8-5a0c-bae3-39dbbf7d976a with scrape type 2
2026-03-30 10:56:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71152f4d-82d8-5a0c-bae3-39dbbf7d976a, identifier: XX51534
2026-03-30 10:56:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9bf71427-28aa-57fb-8625-4a040ce28fdc with identifier: NA02682
2026-03-30 10:56:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9bf71427-28aa-57fb-8625-4a040ce28fdc with identifier: NA02682
2026-03-30 10:56:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9bf71427-28aa-57fb-8625-4a040ce28fdc with identifier: NA02682 to the API
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:46:41Z',
 'fuel_type': 'diesel',
 'id': '9bf71427-28aa-57fb-8625-4a040ce28fdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA02682',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vectra',
 'odometer': 270389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-23',
 'seller_name': None,
 'title': 'Opel Vectra 1.9 CDTI Edition Plus',
 'transmission': 'manual',
 'trim': 'Edition Plus',
 'year': 2008}
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA02682%27 HTTP/1.1" 200 None
2026-03-30 10:56:13 [auto1.de] INFO: Saving data for NA02682: {'auction_closing_time': 1774972001.0, 'created_time': 1773383185.846606, 'last_price_update_time': 1774868173.421927}
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA02682') HTTP/1.1" 204 0
2026-03-30 10:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef7850d50>
2026-03-30 10:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_e62e912a14601563fe471c4c3948746d.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_e62e912a14601563fe471c4c3948746d.jpg saved to cache
2026-03-30 10:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df5e8ed8-98dd-5a11-819f-a56aa6ec8f97
2026-03-30 10:56:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71152f4d-82d8-5a0c-bae3-39dbbf7d976a with identifier: XX51534
2026-03-30 10:56:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71152f4d-82d8-5a0c-bae3-39dbbf7d976a with identifier: XX51534
2026-03-30 10:56:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71152f4d-82d8-5a0c-bae3-39dbbf7d976a with identifier: XX51534 to the API
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:57:32Z',
 'fuel_type': 'diesel',
 'id': '71152f4d-82d8-5a0c-bae3-39dbbf7d976a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX51534',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 104201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-08',
 'seller_name': None,
 'title': 'Opel Combo Life 1.5 CDTI INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2019}
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX51534%27 HTTP/1.1" 200 None
2026-03-30 10:56:13 [auto1.de] INFO: Saving data for XX51534: {'auction_closing_time': 1774972652.0, 'created_time': 1773812127.785221, 'last_price_update_time': 1774868173.956109}
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX51534') HTTP/1.1" 204 0
2026-03-30 10:56:13 [auto1.de] INFO: Found listing with ID: NM13557
2026-03-30 10:56:13 [auto1.de] INFO: Found listing with ID: AZ21199
2026-03-30 10:56:13 [auto1.de] INFO: Found listing with ID: TA68581
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA68581%27 HTTP/1.1" 200 None
2026-03-30 10:56:13 [auto1.de] INFO: Scrape type for TA68581: 2
2026-03-30 10:56:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 816bef4a-e4ac-59df-9c0f-e0505d1283a4 with identifier: TA68581
2026-03-30 10:56:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 816bef4a-e4ac-59df-9c0f-e0505d1283a4 with scrape type 2
2026-03-30 10:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 816bef4a-e4ac-59df-9c0f-e0505d1283a4 with scrape type 2
2026-03-30 10:56:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 816bef4a-e4ac-59df-9c0f-e0505d1283a4, identifier: TA68581
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_ec343965a9fc0c195f877181aa5c82a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_ec343965a9fc0c195f877181aa5c82a9.jpg not downloaded yet
2026-03-30 10:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_c5d9cdeb8588c256fe1b5a466abd4d02.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:14 [auto1.de] INFO: Found listing with ID: LT69845
2026-03-30 10:56:14 [auto1.de] INFO: Found listing with ID: DW74206
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW74206%27 HTTP/1.1" 200 None
2026-03-30 10:56:14 [auto1.de] INFO: Scrape type for DW74206: 2
2026-03-30 10:56:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e9da498-0d65-54a0-8d11-09aaf72f964d with identifier: DW74206
2026-03-30 10:56:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e9da498-0d65-54a0-8d11-09aaf72f964d with scrape type 2
2026-03-30 10:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e9da498-0d65-54a0-8d11-09aaf72f964d with scrape type 2
2026-03-30 10:56:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e9da498-0d65-54a0-8d11-09aaf72f964d, identifier: DW74206
2026-03-30 10:56:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 816bef4a-e4ac-59df-9c0f-e0505d1283a4 with identifier: TA68581
2026-03-30 10:56:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 816bef4a-e4ac-59df-9c0f-e0505d1283a4 with identifier: TA68581
2026-03-30 10:56:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 816bef4a-e4ac-59df-9c0f-e0505d1283a4 with identifier: TA68581 to the API
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:35:40Z',
 'fuel_type': 'petrol',
 'id': '816bef4a-e4ac-59df-9c0f-e0505d1283a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA68581',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 61029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-06',
 'seller_name': None,
 'title': 'Fiat 500X 1.6 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2017}
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA68581%27 HTTP/1.1" 200 None
2026-03-30 10:56:14 [auto1.de] INFO: Saving data for TA68581: {'auction_closing_time': 1774971340.0, 'created_time': 1773137879.403145, 'last_price_update_time': 1774868174.573123}
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA68581') HTTP/1.1" 204 0
2026-03-30 10:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef50c6850>
2026-03-30 10:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_78296c7180991d097bd73e4704fcd16e.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_78296c7180991d097bd73e4704fcd16e.jpg saved to cache
2026-03-30 10:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df5e8ed8-98dd-5a11-819f-a56aa6ec8f97
2026-03-30 10:56:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e9da498-0d65-54a0-8d11-09aaf72f964d with identifier: DW74206
2026-03-30 10:56:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e9da498-0d65-54a0-8d11-09aaf72f964d with identifier: DW74206
2026-03-30 10:56:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e9da498-0d65-54a0-8d11-09aaf72f964d with identifier: DW74206 to the API
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:32:43Z',
 'fuel_type': 'petrol',
 'id': '0e9da498-0d65-54a0-8d11-09aaf72f964d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW74206',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 75019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-04',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 Style Salsa',
 'transmission': 'manual',
 'trim': 'Style Salsa',
 'year': 2013}
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW74206%27 HTTP/1.1" 200 None
2026-03-30 10:56:15 [auto1.de] INFO: Saving data for DW74206: {'auction_closing_time': 1774971163.0, 'created_time': 1773302321.02301, 'last_price_update_time': 1774868175.014406}
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW74206') HTTP/1.1" 204 0
2026-03-30 10:56:15 [auto1.de] INFO: Found listing with ID: XL72684
2026-03-30 10:56:15 [auto1.de] INFO: Found listing with ID: VZ54866
2026-03-30 10:56:15 [auto1.de] INFO: Found listing with ID: TH25711
2026-03-30 10:56:15 [auto1.de] INFO: Found listing with ID: MW50067
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW50067%27 HTTP/1.1" 200 None
2026-03-30 10:56:15 [auto1.de] INFO: Scrape type for MW50067: 2
2026-03-30 10:56:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5f1101e-9ffe-5037-8060-da131ec5c834 with identifier: MW50067
2026-03-30 10:56:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f1101e-9ffe-5037-8060-da131ec5c834 with scrape type 2
2026-03-30 10:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5f1101e-9ffe-5037-8060-da131ec5c834 with scrape type 2
2026-03-30 10:56:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5f1101e-9ffe-5037-8060-da131ec5c834, identifier: MW50067
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_e5ed43d93e892b26654ee7e5666b8b7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_e5ed43d93e892b26654ee7e5666b8b7d.jpg not downloaded yet
2026-03-30 10:56:15 [auto1.de] INFO: Found listing with ID: VU47981
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU47981%27 HTTP/1.1" 200 None
2026-03-30 10:56:15 [auto1.de] INFO: Scrape type for VU47981: 2
2026-03-30 10:56:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47627633-518c-538c-a275-b261b645ea3b with identifier: VU47981
2026-03-30 10:56:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47627633-518c-538c-a275-b261b645ea3b with scrape type 2
2026-03-30 10:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47627633-518c-538c-a275-b261b645ea3b with scrape type 2
2026-03-30 10:56:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47627633-518c-538c-a275-b261b645ea3b, identifier: VU47981
2026-03-30 10:56:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5f1101e-9ffe-5037-8060-da131ec5c834 with identifier: MW50067
2026-03-30 10:56:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5f1101e-9ffe-5037-8060-da131ec5c834 with identifier: MW50067
2026-03-30 10:56:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5f1101e-9ffe-5037-8060-da131ec5c834 with identifier: MW50067 to the API
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-31T15:19:06Z',
 'fuel_type': 'diesel',
 'id': 'c5f1101e-9ffe-5037-8060-da131ec5c834',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW50067',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 118715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-19',
 'seller_name': None,
 'title': 'Audi Q5 50 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW50067%27 HTTP/1.1" 200 None
2026-03-30 10:56:15 [auto1.de] INFO: Saving data for MW50067: {'auction_closing_time': 1774970346.0, 'created_time': 1774380588.740555, 'last_price_update_time': 1774868175.632222}
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW50067') HTTP/1.1" 204 0
2026-03-30 10:56:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47627633-518c-538c-a275-b261b645ea3b with identifier: VU47981
2026-03-30 10:56:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47627633-518c-538c-a275-b261b645ea3b with identifier: VU47981
2026-03-30 10:56:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47627633-518c-538c-a275-b261b645ea3b with identifier: VU47981 to the API
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 207,
 'expiration_date': '2026-03-31T15:00:20Z',
 'fuel_type': 'petrol',
 'id': '47627633-518c-538c-a275-b261b645ea3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU47981',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 31638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-14',
 'seller_name': None,
 'title': 'Audi A1 Sportback 40 TFSI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2023}
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU47981%27 HTTP/1.1" 200 None
2026-03-30 10:56:16 [auto1.de] INFO: Saving data for VU47981: {'auction_closing_time': 1774969220.0, 'created_time': 1773775451.947719, 'last_price_update_time': 1774868176.05998}
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU47981') HTTP/1.1" 204 0
2026-03-30 10:56:16 [auto1.de] INFO: Found listing with ID: SA11397
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11397%27 HTTP/1.1" 200 None
2026-03-30 10:56:16 [auto1.de] INFO: Scrape type for SA11397: 2
2026-03-30 10:56:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c01651a-8461-587a-8513-552f97c101ec with identifier: SA11397
2026-03-30 10:56:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c01651a-8461-587a-8513-552f97c101ec with scrape type 2
2026-03-30 10:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c01651a-8461-587a-8513-552f97c101ec with scrape type 2
2026-03-30 10:56:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c01651a-8461-587a-8513-552f97c101ec, identifier: SA11397
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_897af1ce9c021264399e780134ad05b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_897af1ce9c021264399e780134ad05b7.jpg not downloaded yet
2026-03-30 10:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef92d6fd0>
2026-03-30 10:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_c5d9cdeb8588c256fe1b5a466abd4d02.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_c5d9cdeb8588c256fe1b5a466abd4d02.jpg saved to cache
2026-03-30 10:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df5e8ed8-98dd-5a11-819f-a56aa6ec8f97
2026-03-30 10:56:16 [auto1.de] INFO: Found listing with ID: XP46744
2026-03-30 10:56:16 [auto1.de] INFO: Found listing with ID: MW86699
2026-03-30 10:56:16 [auto1.de] INFO: Found listing with ID: DA44712
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA44712%27 HTTP/1.1" 200 None
2026-03-30 10:56:16 [auto1.de] INFO: Scrape type for DA44712: 1
2026-03-30 10:56:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c01651a-8461-587a-8513-552f97c101ec with identifier: SA11397
2026-03-30 10:56:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c01651a-8461-587a-8513-552f97c101ec with identifier: SA11397
2026-03-30 10:56:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c01651a-8461-587a-8513-552f97c101ec with identifier: SA11397 to the API
2026-03-30 10:56:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:44:52Z',
 'fuel_type': 'diesel',
 'id': '1c01651a-8461-587a-8513-552f97c101ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA11397',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 121339,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-09',
 'seller_name': None,
 'title': 'Ford EcoSport 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11397%27 HTTP/1.1" 200 None
2026-03-30 10:56:17 [auto1.de] INFO: Saving data for SA11397: {'auction_closing_time': 1774971892.0, 'created_time': 1773136533.597007, 'last_price_update_time': 1774868177.152366}
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA11397') HTTP/1.1" 204 0
2026-03-30 10:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_ec343965a9fc0c195f877181aa5c82a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:17 [auto1.de] INFO: Found listing with ID: PJ34176
2026-03-30 10:56:17 [auto1.de] INFO: Found listing with ID: UE09477
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE09477%27 HTTP/1.1" 200 None
2026-03-30 10:56:17 [auto1.de] INFO: Scrape type for UE09477: 2
2026-03-30 10:56:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c2f8222-f567-5cce-9652-4b55b7b0a8ac with identifier: UE09477
2026-03-30 10:56:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c2f8222-f567-5cce-9652-4b55b7b0a8ac with scrape type 2
2026-03-30 10:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c2f8222-f567-5cce-9652-4b55b7b0a8ac with scrape type 2
2026-03-30 10:56:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c2f8222-f567-5cce-9652-4b55b7b0a8ac, identifier: UE09477
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_ad83f85e6a034d3f30ddc2a5c5e9ba78.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_ad83f85e6a034d3f30ddc2a5c5e9ba78.jpg not downloaded yet
2026-03-30 10:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ37057> (referer: https://www.auto1.com/v1/car-details-view/UZ37057/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:17 [auto1.de] INFO: Found listing with ID: MT86254
2026-03-30 10:56:17 [auto1.de] INFO: Found listing with ID: UH34281
2026-03-30 10:56:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c2f8222-f567-5cce-9652-4b55b7b0a8ac with identifier: UE09477
2026-03-30 10:56:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c2f8222-f567-5cce-9652-4b55b7b0a8ac with identifier: UE09477
2026-03-30 10:56:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c2f8222-f567-5cce-9652-4b55b7b0a8ac with identifier: UE09477 to the API
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:59:50Z',
 'fuel_type': 'petrol',
 'id': '3c2f8222-f567-5cce-9652-4b55b7b0a8ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE09477',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 73139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-04',
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2019}
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE09477%27 HTTP/1.1" 200 None
2026-03-30 10:56:17 [auto1.de] INFO: Saving data for UE09477: {'auction_closing_time': 1774972790.0, 'created_time': 1773345349.169675, 'last_price_update_time': 1774868177.813333}
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE09477') HTTP/1.1" 204 0
2026-03-30 10:56:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:17 [auto1.de] INFO: Found listing with ID: BU78099
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU78099%27 HTTP/1.1" 200 None
2026-03-30 10:56:17 [auto1.de] INFO: Scrape type for BU78099: 2
2026-03-30 10:56:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 509fdb7e-fbc7-5ca9-bb0f-0518329f1744 with identifier: BU78099
2026-03-30 10:56:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 509fdb7e-fbc7-5ca9-bb0f-0518329f1744 with scrape type 2
2026-03-30 10:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 509fdb7e-fbc7-5ca9-bb0f-0518329f1744 with scrape type 2
2026-03-30 10:56:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 509fdb7e-fbc7-5ca9-bb0f-0518329f1744, identifier: BU78099
2026-03-30 10:56:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 509fdb7e-fbc7-5ca9-bb0f-0518329f1744 with identifier: BU78099
2026-03-30 10:56:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 509fdb7e-fbc7-5ca9-bb0f-0518329f1744 with identifier: BU78099
2026-03-30 10:56:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 509fdb7e-fbc7-5ca9-bb0f-0518329f1744 with identifier: BU78099 to the API
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:17:24Z',
 'fuel_type': 'petrol',
 'id': '509fdb7e-fbc7-5ca9-bb0f-0518329f1744',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU78099',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 201500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-24',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU78099%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [auto1.de] INFO: Saving data for BU78099: {'auction_closing_time': 1774970244.0, 'created_time': 1774381337.853658, 'last_price_update_time': 1774868178.329024}
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU78099') HTTP/1.1" 204 0
2026-03-30 10:56:18 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 9530 | hits on page: 40
2026-03-30 10:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e899d0>
2026-03-30 10:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_ec343965a9fc0c195f877181aa5c82a9.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_ec343965a9fc0c195f877181aa5c82a9.jpg saved to cache
2026-03-30 10:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df5e8ed8-98dd-5a11-819f-a56aa6ec8f97
2026-03-30 10:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_e5ed43d93e892b26654ee7e5666b8b7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:18 [auto1.de] INFO: Found listing with ID: NA02612
2026-03-30 10:56:18 [auto1.de] INFO: Found listing with ID: SL68511
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL68511%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [auto1.de] INFO: Scrape type for SL68511: 2
2026-03-30 10:56:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fae655d-2593-545e-b1ee-c0e9351a6f56 with identifier: SL68511
2026-03-30 10:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fae655d-2593-545e-b1ee-c0e9351a6f56 with scrape type 2
2026-03-30 10:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fae655d-2593-545e-b1ee-c0e9351a6f56 with scrape type 2
2026-03-30 10:56:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fae655d-2593-545e-b1ee-c0e9351a6f56, identifier: SL68511
2026-03-30 10:56:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4 with identifier: UZ37057
2026-03-30 10:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4 with scrape type 1
2026-03-30 10:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fb8%252F9bb8300bbd19752eb6b04f2e387bbe38%252Fpa%252FUZ37057_ee2094432bd451c4018893318bd7c650.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_ee2094432bd451c4018893318bd7c650.jpg already downloaded
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fb8%252F9bb8300bbd19752eb6b04f2e387bbe38%252Fpa%252FUZ37057_902a4a07d3d4f92dfdf8966fb5539304.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_902a4a07d3d4f92dfdf8966fb5539304.jpg already downloaded
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fb8%252F9bb8300bbd19752eb6b04f2e387bbe38%252Fpa%252FUZ37057_f4c2a2a5dd1940f34b1206ad8bb987aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_f4c2a2a5dd1940f34b1206ad8bb987aa.jpg already downloaded
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fb8%252F9bb8300bbd19752eb6b04f2e387bbe38%252Fpa%252FUZ37057_5f6e19c28fb327081387b8c0ae71235f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_5f6e19c28fb327081387b8c0ae71235f.jpg already downloaded
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fb8%252F9bb8300bbd19752eb6b04f2e387bbe38%252Fpa%252FUZ37057_12fc65d38adf3bc2cb32bcd028c9181f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_12fc65d38adf3bc2cb32bcd028c9181f.jpg already downloaded
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fb8%252F9bb8300bbd19752eb6b04f2e387bbe38%252Fpa%252FUZ37057_aedf1ac5b482d308e26c31ec41df2b75.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_aedf1ac5b482d308e26c31ec41df2b75.jpg already downloaded
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fb8%252F9bb8300bbd19752eb6b04f2e387bbe38%252Fpa%252FUZ37057_8463866a85de349eb73b47dba8269619.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_8463866a85de349eb73b47dba8269619.jpg already downloaded
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fb8%252F9bb8300bbd19752eb6b04f2e387bbe38%252Fpa%252FUZ37057_f756246893acd38892ffcfbdbc9715b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_f756246893acd38892ffcfbdbc9715b2.jpg already downloaded
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fb8%252F9bb8300bbd19752eb6b04f2e387bbe38%252Fpa%252FUZ37057_99694e0988d8556c82b56fb3c70c2c21.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_99694e0988d8556c82b56fb3c70c2c21.jpg already downloaded
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fb8%252F9bb8300bbd19752eb6b04f2e387bbe38%252Fpa%252FUZ37057_5eafa5100032d5108cd987700375f166.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_5eafa5100032d5108cd987700375f166.jpg already downloaded
2026-03-30 10:56:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4, identifier: UZ37057
2026-03-30 10:56:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fae655d-2593-545e-b1ee-c0e9351a6f56 with identifier: SL68511
2026-03-30 10:56:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fae655d-2593-545e-b1ee-c0e9351a6f56 with identifier: SL68511
2026-03-30 10:56:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fae655d-2593-545e-b1ee-c0e9351a6f56 with identifier: SL68511 to the API
2026-03-30 10:56:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:16:49Z',
 'fuel_type': 'petrol',
 'id': '0fae655d-2593-545e-b1ee-c0e9351a6f56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL68511',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 128592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-26',
 'seller_name': None,
 'title': 'Chevrolet Spark 1.0 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2011}
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL68511%27 HTTP/1.1" 200 None
2026-03-30 10:56:19 [auto1.de] INFO: Saving data for SL68511: {'auction_closing_time': 1774970209.0, 'created_time': 1773306501.887591, 'last_price_update_time': 1774868179.25338}
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL68511') HTTP/1.1" 204 0
2026-03-30 10:56:19 [auto1.de] INFO: Found listing with ID: TP76478
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP76478%27 HTTP/1.1" 200 None
2026-03-30 10:56:19 [auto1.de] INFO: Scrape type for TP76478: 2
2026-03-30 10:56:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21391a57-9070-521b-b428-90730a01d5b5 with identifier: TP76478
2026-03-30 10:56:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21391a57-9070-521b-b428-90730a01d5b5 with scrape type 2
2026-03-30 10:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21391a57-9070-521b-b428-90730a01d5b5 with scrape type 2
2026-03-30 10:56:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21391a57-9070-521b-b428-90730a01d5b5, identifier: TP76478
2026-03-30 10:56:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4 with identifier: UZ37057
2026-03-30 10:56:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4 with identifier: UZ37057
2026-03-30 10:56:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4 with identifier: UZ37057 to the API
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UZ37057>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:09:50Z',
 'fuel_type': 'petrol',
 'id': '8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ37057',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 86812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_ee2094432bd451c4018893318bd7c650.jpg',
                'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_902a4a07d3d4f92dfdf8966fb5539304.jpg',
                'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_f4c2a2a5dd1940f34b1206ad8bb987aa.jpg',
                'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_5f6e19c28fb327081387b8c0ae71235f.jpg',
                'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_12fc65d38adf3bc2cb32bcd028c9181f.jpg',
                'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_aedf1ac5b482d308e26c31ec41df2b75.jpg',
                'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_8463866a85de349eb73b47dba8269619.jpg',
                'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_f756246893acd38892ffcfbdbc9715b2.jpg',
                'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_99694e0988d8556c82b56fb3c70c2c21.jpg',
                'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_5eafa5100032d5108cd987700375f166.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4/8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_ee2094432bd451c4018893318bd7c650.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4/8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2016475,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_902a4a07d3d4f92dfdf8966fb5539304.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4/8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_f4c2a2a5dd1940f34b1206ad8bb987aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4/8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2010967,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_5f6e19c28fb327081387b8c0ae71235f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4/8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_12fc65d38adf3bc2cb32bcd028c9181f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4/8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_aedf1ac5b482d308e26c31ec41df2b75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4/8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1964907,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_8463866a85de349eb73b47dba8269619.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4/8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_f756246893acd38892ffcfbdbc9715b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4/8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_99694e0988d8556c82b56fb3c70c2c21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4/8602bced-8e0a-5bf7-b3a8-ef577ad3d2a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/b8/9bb8300bbd19752eb6b04f2e387bbe38/pa/UZ37057_5eafa5100032d5108cd987700375f166.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2013}
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ37057%27 HTTP/1.1" 200 None
2026-03-30 10:56:19 [auto1.de] INFO: Saving data for UZ37057: {'created_time': 1774868179.755707, 'last_price_update_time': 1774868179.755719, 'auction_closing_time': 1774969790.0}
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ37057') HTTP/1.1" 204 0
2026-03-30 10:56:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_897af1ce9c021264399e780134ad05b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:19 [auto1.de] INFO: Found listing with ID: LD55315
2026-03-30 10:56:19 [auto1.de] INFO: Found listing with ID: SF57435
2026-03-30 10:56:19 [auto1.de] INFO: Found listing with ID: JU05593
2026-03-30 10:56:19 [auto1.de] INFO: Found listing with ID: HB96099
2026-03-30 10:56:19 [auto1.de] INFO: Found listing with ID: VZ64604
2026-03-30 10:56:19 [auto1.de] INFO: Found listing with ID: GU26871
2026-03-30 10:56:19 [auto1.de] INFO: Found listing with ID: HX97789
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX97789%27 HTTP/1.1" 200 None
2026-03-30 10:56:19 [auto1.de] INFO: Scrape type for HX97789: 2
2026-03-30 10:56:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e064b3e1-833b-5203-9124-973f985e09e4 with identifier: HX97789
2026-03-30 10:56:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e064b3e1-833b-5203-9124-973f985e09e4 with scrape type 2
2026-03-30 10:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e064b3e1-833b-5203-9124-973f985e09e4 with scrape type 2
2026-03-30 10:56:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e064b3e1-833b-5203-9124-973f985e09e4, identifier: HX97789
2026-03-30 10:56:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21391a57-9070-521b-b428-90730a01d5b5 with identifier: TP76478
2026-03-30 10:56:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21391a57-9070-521b-b428-90730a01d5b5 with identifier: TP76478
2026-03-30 10:56:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21391a57-9070-521b-b428-90730a01d5b5 with identifier: TP76478 to the API
2026-03-30 10:56:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 285,
 'expiration_date': '2026-03-31T15:07:03Z',
 'fuel_type': 'petrol',
 'id': '21391a57-9070-521b-b428-90730a01d5b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP76478',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 88765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-30',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.6 V6 Overland',
 'transmission': 'automatic',
 'trim': 'Overland',
 'year': 2017}
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP76478%27 HTTP/1.1" 200 None
2026-03-30 10:56:20 [auto1.de] INFO: Saving data for TP76478: {'auction_closing_time': 1774969623.0, 'created_time': 1773688750.640697, 'last_price_update_time': 1774868180.2593}
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP76478') HTTP/1.1" 204 0
2026-03-30 10:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_ad83f85e6a034d3f30ddc2a5c5e9ba78.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e064b3e1-833b-5203-9124-973f985e09e4 with identifier: HX97789
2026-03-30 10:56:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e064b3e1-833b-5203-9124-973f985e09e4 with identifier: HX97789
2026-03-30 10:56:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e064b3e1-833b-5203-9124-973f985e09e4 with identifier: HX97789 to the API
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:58:06Z',
 'fuel_type': 'diesel',
 'id': 'e064b3e1-833b-5203-9124-973f985e09e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX97789',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 187422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-24',
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2013}
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX97789%27 HTTP/1.1" 200 None
2026-03-30 10:56:20 [auto1.de] INFO: Saving data for HX97789: {'auction_closing_time': 1774972686.0, 'created_time': 1773135828.808219, 'last_price_update_time': 1774868180.68513}
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX97789') HTTP/1.1" 204 0
2026-03-30 10:56:20 [auto1.de] INFO: Found listing with ID: PV23969
2026-03-30 10:56:20 [auto1.de] INFO: Found listing with ID: SE81381
2026-03-30 10:56:20 [auto1.de] INFO: Found listing with ID: VP65266
2026-03-30 10:56:20 [auto1.de] INFO: Found listing with ID: LF99231
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF99231%27 HTTP/1.1" 200 None
2026-03-30 10:56:20 [auto1.de] INFO: Scrape type for LF99231: 2
2026-03-30 10:56:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82e68b2a-be17-52f4-918a-bc29de1df960 with identifier: LF99231
2026-03-30 10:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82e68b2a-be17-52f4-918a-bc29de1df960 with scrape type 2
2026-03-30 10:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82e68b2a-be17-52f4-918a-bc29de1df960 with scrape type 2
2026-03-30 10:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82e68b2a-be17-52f4-918a-bc29de1df960, identifier: LF99231
2026-03-30 10:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e97ad0>
2026-03-30 10:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_e5ed43d93e892b26654ee7e5666b8b7d.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_e5ed43d93e892b26654ee7e5666b8b7d.jpg saved to cache
2026-03-30 10:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df5e8ed8-98dd-5a11-819f-a56aa6ec8f97
2026-03-30 10:56:20 [auto1.de] INFO: Found listing with ID: CT48596
2026-03-30 10:56:20 [auto1.de] INFO: Found listing with ID: WX56329
2026-03-30 10:56:20 [auto1.de] INFO: Found listing with ID: FX29035
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX29035%27 HTTP/1.1" 200 None
2026-03-30 10:56:20 [auto1.de] INFO: Scrape type for FX29035: 2
2026-03-30 10:56:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 462c81a8-9410-5895-aa58-81460ec6940a with identifier: FX29035
2026-03-30 10:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 462c81a8-9410-5895-aa58-81460ec6940a with scrape type 2
2026-03-30 10:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 462c81a8-9410-5895-aa58-81460ec6940a with scrape type 2
2026-03-30 10:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 462c81a8-9410-5895-aa58-81460ec6940a, identifier: FX29035
2026-03-30 10:56:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82e68b2a-be17-52f4-918a-bc29de1df960 with identifier: LF99231
2026-03-30 10:56:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82e68b2a-be17-52f4-918a-bc29de1df960 with identifier: LF99231
2026-03-30 10:56:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82e68b2a-be17-52f4-918a-bc29de1df960 with identifier: LF99231 to the API
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:49:57Z',
 'fuel_type': 'hybrid',
 'id': '82e68b2a-be17-52f4-918a-bc29de1df960',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF99231',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 40075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-31',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI iV RS First Edition',
 'transmission': 'automatic',
 'trim': 'RS First Edition',
 'year': 2021}
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF99231%27 HTTP/1.1" 200 None
2026-03-30 10:56:21 [auto1.de] INFO: Saving data for LF99231: {'auction_closing_time': 1774972197.0, 'created_time': 1773306241.204464, 'last_price_update_time': 1774868181.359189}
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF99231') HTTP/1.1" 204 0
2026-03-30 10:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY37927> (referer: https://www.auto1.com/v1/car-details-view/JY37927/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 462c81a8-9410-5895-aa58-81460ec6940a with identifier: FX29035
2026-03-30 10:56:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 462c81a8-9410-5895-aa58-81460ec6940a with identifier: FX29035
2026-03-30 10:56:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 462c81a8-9410-5895-aa58-81460ec6940a with identifier: FX29035 to the API
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-31T15:52:28Z',
 'fuel_type': 'hybrid',
 'id': '462c81a8-9410-5895-aa58-81460ec6940a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX29035',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'RX-Serie',
 'odometer': 138076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-02',
 'seller_name': None,
 'title': 'Lexus RX-Serie RX 400h Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2008}
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX29035%27 HTTP/1.1" 200 None
2026-03-30 10:56:21 [auto1.de] INFO: Saving data for FX29035: {'auction_closing_time': 1774972348.0, 'created_time': 1774463759.725404, 'last_price_update_time': 1774868181.69035}
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX29035') HTTP/1.1" 204 0
2026-03-30 10:56:21 [auto1.de] INFO: Found listing with ID: PW87460
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW87460%27 HTTP/1.1" 200 None
2026-03-30 10:56:21 [auto1.de] INFO: Scrape type for PW87460: 2
2026-03-30 10:56:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 991c7e17-680c-5a56-a667-089072abe84c with identifier: PW87460
2026-03-30 10:56:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 991c7e17-680c-5a56-a667-089072abe84c with scrape type 2
2026-03-30 10:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 991c7e17-680c-5a56-a667-089072abe84c with scrape type 2
2026-03-30 10:56:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 991c7e17-680c-5a56-a667-089072abe84c, identifier: PW87460
2026-03-30 10:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef852f350>
2026-03-30 10:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_897af1ce9c021264399e780134ad05b7.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_897af1ce9c021264399e780134ad05b7.jpg saved to cache
2026-03-30 10:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df5e8ed8-98dd-5a11-819f-a56aa6ec8f97
2026-03-30 10:56:21 [auto1.de] INFO: Found listing with ID: FU46952
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU46952%27 HTTP/1.1" 200 None
2026-03-30 10:56:21 [auto1.de] INFO: Scrape type for FU46952: 2
2026-03-30 10:56:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa2e1300-63e1-5c9b-80fe-8c6c22019aaa with identifier: FU46952
2026-03-30 10:56:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa2e1300-63e1-5c9b-80fe-8c6c22019aaa with scrape type 2
2026-03-30 10:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa2e1300-63e1-5c9b-80fe-8c6c22019aaa with scrape type 2
2026-03-30 10:56:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa2e1300-63e1-5c9b-80fe-8c6c22019aaa, identifier: FU46952
2026-03-30 10:56:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 991c7e17-680c-5a56-a667-089072abe84c with identifier: PW87460
2026-03-30 10:56:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 991c7e17-680c-5a56-a667-089072abe84c with identifier: PW87460
2026-03-30 10:56:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 991c7e17-680c-5a56-a667-089072abe84c with identifier: PW87460 to the API
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:35:44Z',
 'fuel_type': 'petrol',
 'id': '991c7e17-680c-5a56-a667-089072abe84c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW87460',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 122887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-06',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Track & Field 4Motion',
 'transmission': 'manual',
 'trim': 'Track & Field 4Motion',
 'year': 2013}
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW87460%27 HTTP/1.1" 200 None
2026-03-30 10:56:22 [auto1.de] INFO: Saving data for PW87460: {'auction_closing_time': 1774971344.0, 'created_time': 1773306909.208447, 'last_price_update_time': 1774868182.329659}
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW87460') HTTP/1.1" 204 0
2026-03-30 10:56:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa2e1300-63e1-5c9b-80fe-8c6c22019aaa with identifier: FU46952
2026-03-30 10:56:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa2e1300-63e1-5c9b-80fe-8c6c22019aaa with identifier: FU46952
2026-03-30 10:56:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa2e1300-63e1-5c9b-80fe-8c6c22019aaa with identifier: FU46952 to the API
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:14:33Z',
 'fuel_type': 'petrol',
 'id': 'aa2e1300-63e1-5c9b-80fe-8c6c22019aaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU46952',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 38116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2019}
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU46952%27 HTTP/1.1" 200 None
2026-03-30 10:56:22 [auto1.de] INFO: Saving data for FU46952: {'auction_closing_time': 1774970073.0, 'created_time': 1773307548.069449, 'last_price_update_time': 1774868182.761182}
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU46952') HTTP/1.1" 204 0
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: FV18875
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: KP08574
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: JE85586
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE85586%27 HTTP/1.1" 200 None
2026-03-30 10:56:22 [auto1.de] INFO: Scrape type for JE85586: 2
2026-03-30 10:56:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 974ae670-6437-5bff-8cc9-87aca6625ae7 with identifier: JE85586
2026-03-30 10:56:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 974ae670-6437-5bff-8cc9-87aca6625ae7 with scrape type 2
2026-03-30 10:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 974ae670-6437-5bff-8cc9-87aca6625ae7 with scrape type 2
2026-03-30 10:56:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 974ae670-6437-5bff-8cc9-87aca6625ae7, identifier: JE85586
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: FH56609
2026-03-30 10:56:22 [auto1.de] INFO: Found listing with ID: ZP20879
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP20879%27 HTTP/1.1" 200 None
2026-03-30 10:56:23 [auto1.de] INFO: Scrape type for ZP20879: 2
2026-03-30 10:56:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cd49dd6-26b6-5da8-96ac-01cef17dcd87 with identifier: ZP20879
2026-03-30 10:56:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd49dd6-26b6-5da8-96ac-01cef17dcd87 with scrape type 2
2026-03-30 10:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cd49dd6-26b6-5da8-96ac-01cef17dcd87 with scrape type 2
2026-03-30 10:56:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cd49dd6-26b6-5da8-96ac-01cef17dcd87, identifier: ZP20879
2026-03-30 10:56:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 974ae670-6437-5bff-8cc9-87aca6625ae7 with identifier: JE85586
2026-03-30 10:56:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 974ae670-6437-5bff-8cc9-87aca6625ae7 with identifier: JE85586
2026-03-30 10:56:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 974ae670-6437-5bff-8cc9-87aca6625ae7 with identifier: JE85586 to the API
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:14:05Z',
 'fuel_type': 'diesel',
 'id': '974ae670-6437-5bff-8cc9-87aca6625ae7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE85586',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 136552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-16',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30d Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE85586%27 HTTP/1.1" 200 None
2026-03-30 10:56:23 [auto1.de] INFO: Saving data for JE85586: {'auction_closing_time': 1774970045.0, 'created_time': 1774378095.305865, 'last_price_update_time': 1774868183.425179}
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE85586') HTTP/1.1" 204 0
2026-03-30 10:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef59abd10>
2026-03-30 10:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_ad83f85e6a034d3f30ddc2a5c5e9ba78.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_ad83f85e6a034d3f30ddc2a5c5e9ba78.jpg saved to cache
2026-03-30 10:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df5e8ed8-98dd-5a11-819f-a56aa6ec8f97
2026-03-30 10:56:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b89a4235-7799-56f3-9cef-37e695e92600 with identifier: JY37927
2026-03-30 10:56:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b89a4235-7799-56f3-9cef-37e695e92600 with scrape type 1
2026-03-30 10:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b89a4235-7799-56f3-9cef-37e695e92600
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_6270ecbd4f5b409c277401feb381dd30.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_6270ecbd4f5b409c277401feb381dd30.jpg not downloaded yet
2026-03-30 10:56:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cd49dd6-26b6-5da8-96ac-01cef17dcd87 with identifier: ZP20879
2026-03-30 10:56:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cd49dd6-26b6-5da8-96ac-01cef17dcd87 with identifier: ZP20879
2026-03-30 10:56:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cd49dd6-26b6-5da8-96ac-01cef17dcd87 with identifier: ZP20879 to the API
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:01:54Z',
 'fuel_type': 'petrol',
 'id': '5cd49dd6-26b6-5da8-96ac-01cef17dcd87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP20879',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 90151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-19',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Vision 4WD',
 'transmission': 'automatic',
 'trim': 'Vision 4WD',
 'year': 2018}
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP20879%27 HTTP/1.1" 200 None
2026-03-30 10:56:23 [auto1.de] INFO: Saving data for ZP20879: {'auction_closing_time': 1774969314.0, 'created_time': 1774380201.888021, 'last_price_update_time': 1774868183.908868}
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP20879') HTTP/1.1" 204 0
2026-03-30 10:56:23 [auto1.de] INFO: Found listing with ID: WM67864
2026-03-30 10:56:23 [auto1.de] INFO: Found listing with ID: PG06086
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG06086%27 HTTP/1.1" 200 None
2026-03-30 10:56:23 [auto1.de] INFO: Scrape type for PG06086: 2
2026-03-30 10:56:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e6de403-be42-5364-a70e-6a3afeff5877 with identifier: PG06086
2026-03-30 10:56:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e6de403-be42-5364-a70e-6a3afeff5877 with scrape type 2
2026-03-30 10:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e6de403-be42-5364-a70e-6a3afeff5877 with scrape type 2
2026-03-30 10:56:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e6de403-be42-5364-a70e-6a3afeff5877, identifier: PG06086
2026-03-30 10:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA44712/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:24 [auto1.de] INFO: Found listing with ID: HV43954
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV43954%27 HTTP/1.1" 200 None
2026-03-30 10:56:24 [auto1.de] INFO: Scrape type for HV43954: 2
2026-03-30 10:56:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63bfeadc-bcf4-5dee-8b96-2a8b0ec0877d with identifier: HV43954
2026-03-30 10:56:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63bfeadc-bcf4-5dee-8b96-2a8b0ec0877d with scrape type 2
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63bfeadc-bcf4-5dee-8b96-2a8b0ec0877d with scrape type 2
2026-03-30 10:56:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63bfeadc-bcf4-5dee-8b96-2a8b0ec0877d, identifier: HV43954
2026-03-30 10:56:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e6de403-be42-5364-a70e-6a3afeff5877 with identifier: PG06086
2026-03-30 10:56:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e6de403-be42-5364-a70e-6a3afeff5877 with identifier: PG06086
2026-03-30 10:56:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e6de403-be42-5364-a70e-6a3afeff5877 with identifier: PG06086 to the API
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:52:11Z',
 'fuel_type': 'petrol',
 'id': '4e6de403-be42-5364-a70e-6a3afeff5877',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG06086',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 139313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-16',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2014}
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG06086%27 HTTP/1.1" 200 None
2026-03-30 10:56:24 [auto1.de] INFO: Saving data for PG06086: {'auction_closing_time': 1774972331.0, 'created_time': 1773387363.252462, 'last_price_update_time': 1774868184.418143}
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG06086') HTTP/1.1" 204 0
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_9605475b0a447cfbb85ae5ef936f54b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_9605475b0a447cfbb85ae5ef936f54b3.jpg not downloaded yet
2026-03-30 10:56:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63bfeadc-bcf4-5dee-8b96-2a8b0ec0877d with identifier: HV43954
2026-03-30 10:56:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63bfeadc-bcf4-5dee-8b96-2a8b0ec0877d with identifier: HV43954
2026-03-30 10:56:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63bfeadc-bcf4-5dee-8b96-2a8b0ec0877d with identifier: HV43954 to the API
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:29:48Z',
 'fuel_type': 'diesel',
 'id': '63bfeadc-bcf4-5dee-8b96-2a8b0ec0877d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV43954',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 279029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-04',
 'seller_name': None,
 'title': 'Volvo XC90 2.4 D5 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2007}
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV43954%27 HTTP/1.1" 200 None
2026-03-30 10:56:24 [auto1.de] INFO: Saving data for HV43954: {'auction_closing_time': 1774970988.0, 'created_time': 1773133236.549468, 'last_price_update_time': 1774868184.781617}
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV43954') HTTP/1.1" 204 0
2026-03-30 10:56:24 [auto1.de] INFO: Found listing with ID: CG60356
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG60356%27 HTTP/1.1" 200 None
2026-03-30 10:56:24 [auto1.de] INFO: Scrape type for CG60356: 2
2026-03-30 10:56:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 873e5935-ff96-5db3-baae-69d05595a42f with identifier: CG60356
2026-03-30 10:56:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 873e5935-ff96-5db3-baae-69d05595a42f with scrape type 2
2026-03-30 10:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 873e5935-ff96-5db3-baae-69d05595a42f with scrape type 2
2026-03-30 10:56:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 873e5935-ff96-5db3-baae-69d05595a42f, identifier: CG60356
2026-03-30 10:56:24 [auto1.de] INFO: Found listing with ID: TP76478
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP76478%27 HTTP/1.1" 200 None
2026-03-30 10:56:24 [auto1.de] INFO: Scrape type for TP76478: 0
2026-03-30 10:56:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 873e5935-ff96-5db3-baae-69d05595a42f with identifier: CG60356
2026-03-30 10:56:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 873e5935-ff96-5db3-baae-69d05595a42f with identifier: CG60356
2026-03-30 10:56:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 873e5935-ff96-5db3-baae-69d05595a42f with identifier: CG60356 to the API
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-31T15:08:56Z',
 'fuel_type': 'petrol',
 'id': '873e5935-ff96-5db3-baae-69d05595a42f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG60356',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Optima',
 'odometer': 83054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-20',
 'seller_name': None,
 'title': 'Kia Optima 2.0 TGDI GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG60356%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [auto1.de] INFO: Saving data for CG60356: {'auction_closing_time': 1774969736.0, 'created_time': 1774435702.863802, 'last_price_update_time': 1774868185.235451}
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG60356') HTTP/1.1" 204 0
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_da583fc44720cda3c408baed008b332a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_da583fc44720cda3c408baed008b332a.jpg not downloaded yet
2026-03-30 10:56:25 [auto1.de] INFO: Found listing with ID: UP12847
2026-03-30 10:56:25 [auto1.de] INFO: Found listing with ID: GA58316
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58316%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [auto1.de] INFO: Scrape type for GA58316: 2
2026-03-30 10:56:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f09eee0c-9e5d-548d-8042-2b9c0b067de1 with identifier: GA58316
2026-03-30 10:56:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f09eee0c-9e5d-548d-8042-2b9c0b067de1 with scrape type 2
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f09eee0c-9e5d-548d-8042-2b9c0b067de1 with scrape type 2
2026-03-30 10:56:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f09eee0c-9e5d-548d-8042-2b9c0b067de1, identifier: GA58316
2026-03-30 10:56:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f09eee0c-9e5d-548d-8042-2b9c0b067de1 with identifier: GA58316
2026-03-30 10:56:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f09eee0c-9e5d-548d-8042-2b9c0b067de1 with identifier: GA58316
2026-03-30 10:56:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f09eee0c-9e5d-548d-8042-2b9c0b067de1 with identifier: GA58316 to the API
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:35:46Z',
 'fuel_type': 'petrol',
 'id': 'f09eee0c-9e5d-548d-8042-2b9c0b067de1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA58316',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 195604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-29',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58316%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [auto1.de] INFO: Saving data for GA58316: {'auction_closing_time': 1774971346.0, 'created_time': 1774380560.432708, 'last_price_update_time': 1774868185.722488}
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA58316') HTTP/1.1" 204 0
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_85edfe0c929d7d11e7f1b640a120c9e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_85edfe0c929d7d11e7f1b640a120c9e6.jpg not downloaded yet
2026-03-30 10:56:25 [auto1.de] INFO: Found listing with ID: DF16911
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF16911%27 HTTP/1.1" 200 None
2026-03-30 10:56:25 [auto1.de] INFO: Scrape type for DF16911: 2
2026-03-30 10:56:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0db33fc-1192-571c-a623-629297914cf8 with identifier: DF16911
2026-03-30 10:56:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0db33fc-1192-571c-a623-629297914cf8 with scrape type 2
2026-03-30 10:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0db33fc-1192-571c-a623-629297914cf8 with scrape type 2
2026-03-30 10:56:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0db33fc-1192-571c-a623-629297914cf8, identifier: DF16911
2026-03-30 10:56:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_6270ecbd4f5b409c277401feb381dd30.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0db33fc-1192-571c-a623-629297914cf8 with identifier: DF16911
2026-03-30 10:56:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0db33fc-1192-571c-a623-629297914cf8 with identifier: DF16911
2026-03-30 10:56:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0db33fc-1192-571c-a623-629297914cf8 with identifier: DF16911 to the API
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:47:35Z',
 'fuel_type': 'petrol',
 'id': 'c0db33fc-1192-571c-a623-629297914cf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF16911',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 159093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-11',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF16911%27 HTTP/1.1" 200 None
2026-03-30 10:56:26 [auto1.de] INFO: Saving data for DF16911: {'auction_closing_time': 1774972055.0, 'created_time': 1773224657.713755, 'last_price_update_time': 1774868186.235566}
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF16911') HTTP/1.1" 204 0
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_6bd49c1eb8ecd9ff917e5cd6fc5ff752.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_6bd49c1eb8ecd9ff917e5cd6fc5ff752.jpg not downloaded yet
2026-03-30 10:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_9605475b0a447cfbb85ae5ef936f54b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:26 [auto1.de] INFO: Found listing with ID: TW14325
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW14325%27 HTTP/1.1" 200 None
2026-03-30 10:56:26 [auto1.de] INFO: Scrape type for TW14325: 2
2026-03-30 10:56:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 850adfaa-1b2c-55f2-866c-563350dbbd88 with identifier: TW14325
2026-03-30 10:56:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 850adfaa-1b2c-55f2-866c-563350dbbd88 with scrape type 2
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 850adfaa-1b2c-55f2-866c-563350dbbd88 with scrape type 2
2026-03-30 10:56:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 850adfaa-1b2c-55f2-866c-563350dbbd88, identifier: TW14325
2026-03-30 10:56:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 850adfaa-1b2c-55f2-866c-563350dbbd88 with identifier: TW14325
2026-03-30 10:56:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 850adfaa-1b2c-55f2-866c-563350dbbd88 with identifier: TW14325
2026-03-30 10:56:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 850adfaa-1b2c-55f2-866c-563350dbbd88 with identifier: TW14325 to the API
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 390,
 'expiration_date': '2026-03-31T15:27:34Z',
 'fuel_type': 'petrol',
 'id': '850adfaa-1b2c-55f2-866c-563350dbbd88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW14325',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 137995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-01',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 450 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW14325%27 HTTP/1.1" 200 None
2026-03-30 10:56:26 [auto1.de] INFO: Saving data for TW14325: {'auction_closing_time': 1774970854.0, 'created_time': 1773946311.963411, 'last_price_update_time': 1774868186.773288}
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW14325') HTTP/1.1" 204 0
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_80cd7a26681566fefd316edd584bdbe9.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_80cd7a26681566fefd316edd584bdbe9.jpg not downloaded yet
2026-03-30 10:56:26 [auto1.de] INFO: Found listing with ID: WA27160
2026-03-30 10:56:26 [auto1.de] INFO: Found listing with ID: TY90085
2026-03-30 10:56:26 [auto1.de] INFO: Found listing with ID: HN33663
2026-03-30 10:56:26 [auto1.de] INFO: Found listing with ID: FX70736
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX70736%27 HTTP/1.1" 200 None
2026-03-30 10:56:26 [auto1.de] INFO: Scrape type for FX70736: 2
2026-03-30 10:56:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96391ed0-d7a9-5720-8db7-db3827412720 with identifier: FX70736
2026-03-30 10:56:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96391ed0-d7a9-5720-8db7-db3827412720 with scrape type 2
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96391ed0-d7a9-5720-8db7-db3827412720 with scrape type 2
2026-03-30 10:56:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96391ed0-d7a9-5720-8db7-db3827412720, identifier: FX70736
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4e504d0>
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_0.jpg HTTP/1.1" 201 0
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_6270ecbd4f5b409c277401feb381dd30.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_6270ecbd4f5b409c277401feb381dd30.jpg saved to cache
2026-03-30 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b89a4235-7799-56f3-9cef-37e695e92600
2026-03-30 10:56:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96391ed0-d7a9-5720-8db7-db3827412720 with identifier: FX70736
2026-03-30 10:56:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96391ed0-d7a9-5720-8db7-db3827412720 with identifier: FX70736
2026-03-30 10:56:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96391ed0-d7a9-5720-8db7-db3827412720 with identifier: FX70736 to the API
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:17:13Z',
 'fuel_type': 'diesel',
 'id': '96391ed0-d7a9-5720-8db7-db3827412720',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX70736',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Navara Pick-up',
 'odometer': 184032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-30',
 'seller_name': None,
 'title': 'Nissan Navara Pick-up 2.5 dCi Double Cab LE 4x4',
 'transmission': 'automatic',
 'trim': 'Double Cab LE 4x4',
 'year': 2008}
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX70736%27 HTTP/1.1" 200 None
2026-03-30 10:56:27 [auto1.de] INFO: Saving data for FX70736: {'auction_closing_time': 1774970233.0, 'created_time': 1774379566.066672, 'last_price_update_time': 1774868187.32976}
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX70736') HTTP/1.1" 204 0
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_06ce7f433f41e6d182185a2f455b982f.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_06ce7f433f41e6d182185a2f455b982f.jpg not downloaded yet
2026-03-30 10:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_da583fc44720cda3c408baed008b332a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_85edfe0c929d7d11e7f1b640a120c9e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:27 [auto1.de] INFO: Found listing with ID: CY30248
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY30248%27 HTTP/1.1" 200 None
2026-03-30 10:56:27 [auto1.de] INFO: Scrape type for CY30248: 2
2026-03-30 10:56:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa0b558d-62eb-5ad8-851a-0056c5f9030a with identifier: CY30248
2026-03-30 10:56:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa0b558d-62eb-5ad8-851a-0056c5f9030a with scrape type 2
2026-03-30 10:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa0b558d-62eb-5ad8-851a-0056c5f9030a with scrape type 2
2026-03-30 10:56:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa0b558d-62eb-5ad8-851a-0056c5f9030a, identifier: CY30248
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb7210>
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_1.jpg HTTP/1.1" 201 0
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_9605475b0a447cfbb85ae5ef936f54b3.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_9605475b0a447cfbb85ae5ef936f54b3.jpg saved to cache
2026-03-30 10:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b89a4235-7799-56f3-9cef-37e695e92600
2026-03-30 10:56:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa0b558d-62eb-5ad8-851a-0056c5f9030a with identifier: CY30248
2026-03-30 10:56:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa0b558d-62eb-5ad8-851a-0056c5f9030a with identifier: CY30248
2026-03-30 10:56:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa0b558d-62eb-5ad8-851a-0056c5f9030a with identifier: CY30248 to the API
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:06:29Z',
 'fuel_type': 'petrol',
 'id': 'fa0b558d-62eb-5ad8-851a-0056c5f9030a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY30248',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 60149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-27',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2014}
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY30248%27 HTTP/1.1" 200 None
2026-03-30 10:56:27 [auto1.de] INFO: Saving data for CY30248: {'auction_closing_time': 1774969589.0, 'created_time': 1773305482.856138, 'last_price_update_time': 1774868187.944332}
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY30248') HTTP/1.1" 204 0
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_f721160155974a0618888a07d195ba80.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_f721160155974a0618888a07d195ba80.jpg not downloaded yet
2026-03-30 10:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_6bd49c1eb8ecd9ff917e5cd6fc5ff752.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:27 [auto1.de] INFO: Found listing with ID: HS46985
2026-03-30 10:56:27 [auto1.de] INFO: Found listing with ID: BW50194
2026-03-30 10:56:27 [auto1.de] INFO: Found listing with ID: JH99279
2026-03-30 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH99279%27 HTTP/1.1" 200 None
2026-03-30 10:56:28 [auto1.de] INFO: Scrape type for JH99279: 2
2026-03-30 10:56:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c094e7-1454-5dcc-9991-7defab44a396 with identifier: JH99279
2026-03-30 10:56:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c094e7-1454-5dcc-9991-7defab44a396 with scrape type 2
2026-03-30 10:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c094e7-1454-5dcc-9991-7defab44a396 with scrape type 2
2026-03-30 10:56:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36c094e7-1454-5dcc-9991-7defab44a396, identifier: JH99279
2026-03-30 10:56:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36c094e7-1454-5dcc-9991-7defab44a396 with identifier: JH99279
2026-03-30 10:56:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36c094e7-1454-5dcc-9991-7defab44a396 with identifier: JH99279
2026-03-30 10:56:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36c094e7-1454-5dcc-9991-7defab44a396 with identifier: JH99279 to the API
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-31T15:45:46Z',
 'fuel_type': 'diesel',
 'id': '36c094e7-1454-5dcc-9991-7defab44a396',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH99279',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'XV',
 'odometer': 239632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-10',
 'seller_name': None,
 'title': 'Subaru XV 2.0 Diesel Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2012}
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH99279%27 HTTP/1.1" 200 None
2026-03-30 10:56:28 [auto1.de] INFO: Saving data for JH99279: {'auction_closing_time': 1774971946.0, 'created_time': 1774468246.760148, 'last_price_update_time': 1774868188.414737}
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH99279') HTTP/1.1" 204 0
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_9d95f29ce95d504ae795e1ece7f5ab1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_9d95f29ce95d504ae795e1ece7f5ab1b.jpg not downloaded yet
2026-03-30 10:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_80cd7a26681566fefd316edd584bdbe9.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:28 [auto1.de] INFO: Found listing with ID: PX60465
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX60465%27 HTTP/1.1" 200 None
2026-03-30 10:56:28 [auto1.de] INFO: Scrape type for PX60465: 2
2026-03-30 10:56:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d870057-7035-53cf-b66b-715b3b49a2e3 with identifier: PX60465
2026-03-30 10:56:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d870057-7035-53cf-b66b-715b3b49a2e3 with scrape type 2
2026-03-30 10:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d870057-7035-53cf-b66b-715b3b49a2e3 with scrape type 2
2026-03-30 10:56:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d870057-7035-53cf-b66b-715b3b49a2e3, identifier: PX60465
2026-03-30 10:56:28 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 9530 | hits on page: 40
2026-03-30 10:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4fb8350>
2026-03-30 10:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_da583fc44720cda3c408baed008b332a.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_da583fc44720cda3c408baed008b332a.jpg saved to cache
2026-03-30 10:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b89a4235-7799-56f3-9cef-37e695e92600
2026-03-30 10:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5ad5250>
2026-03-30 10:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_3.jpg HTTP/1.1" 201 0
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_85edfe0c929d7d11e7f1b640a120c9e6.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_85edfe0c929d7d11e7f1b640a120c9e6.jpg saved to cache
2026-03-30 10:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b89a4235-7799-56f3-9cef-37e695e92600
2026-03-30 10:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_06ce7f433f41e6d182185a2f455b982f.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d870057-7035-53cf-b66b-715b3b49a2e3 with identifier: PX60465
2026-03-30 10:56:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d870057-7035-53cf-b66b-715b3b49a2e3 with identifier: PX60465
2026-03-30 10:56:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d870057-7035-53cf-b66b-715b3b49a2e3 with identifier: PX60465 to the API
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-31T15:41:39Z',
 'fuel_type': 'diesel',
 'id': '7d870057-7035-53cf-b66b-715b3b49a2e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX60465',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 41425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-09',
 'seller_name': None,
 'title': 'BMW 5er 530d Mild-Hybrid xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2023}
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX60465%27 HTTP/1.1" 200 None
2026-03-30 10:56:28 [auto1.de] INFO: Saving data for PX60465: {'auction_closing_time': 1774971699.0, 'created_time': 1773776102.88206, 'last_price_update_time': 1774868188.968564}
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX60465') HTTP/1.1" 204 0
2026-03-30 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_8234bb318af71831da0276fae036530a.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_8234bb318af71831da0276fae036530a.jpg not downloaded yet
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: RA28898
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: HX50499
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX50499%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for HX50499: 2
2026-03-30 10:56:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93db7945-de48-5745-80f4-13c7bcfdcdcc with identifier: HX50499
2026-03-30 10:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93db7945-de48-5745-80f4-13c7bcfdcdcc with scrape type 2
2026-03-30 10:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93db7945-de48-5745-80f4-13c7bcfdcdcc with scrape type 2
2026-03-30 10:56:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93db7945-de48-5745-80f4-13c7bcfdcdcc, identifier: HX50499
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: WR22738
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: RU48636
2026-03-30 10:56:29 [auto1.de] INFO: Found listing with ID: GU24584
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU24584%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Scrape type for GU24584: 2
2026-03-30 10:56:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e388b45a-c057-5cc6-a918-82eeee6362db with identifier: GU24584
2026-03-30 10:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e388b45a-c057-5cc6-a918-82eeee6362db with scrape type 2
2026-03-30 10:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e388b45a-c057-5cc6-a918-82eeee6362db with scrape type 2
2026-03-30 10:56:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e388b45a-c057-5cc6-a918-82eeee6362db, identifier: GU24584
2026-03-30 10:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4d759d0>
2026-03-30 10:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_6bd49c1eb8ecd9ff917e5cd6fc5ff752.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_6bd49c1eb8ecd9ff917e5cd6fc5ff752.jpg saved to cache
2026-03-30 10:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b89a4235-7799-56f3-9cef-37e695e92600
2026-03-30 10:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93db7945-de48-5745-80f4-13c7bcfdcdcc with identifier: HX50499
2026-03-30 10:56:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93db7945-de48-5745-80f4-13c7bcfdcdcc with identifier: HX50499
2026-03-30 10:56:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93db7945-de48-5745-80f4-13c7bcfdcdcc with identifier: HX50499 to the API
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:10:29Z',
 'fuel_type': 'diesel',
 'id': '93db7945-de48-5745-80f4-13c7bcfdcdcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX50499',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 144910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Lounge BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX50499%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Saving data for HX50499: {'auction_closing_time': 1774969829.0, 'created_time': 1773303234.065479, 'last_price_update_time': 1774868189.589381}
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX50499') HTTP/1.1" 204 0
2026-03-30 10:56:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e388b45a-c057-5cc6-a918-82eeee6362db with identifier: GU24584
2026-03-30 10:56:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e388b45a-c057-5cc6-a918-82eeee6362db with identifier: GU24584
2026-03-30 10:56:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e388b45a-c057-5cc6-a918-82eeee6362db with identifier: GU24584 to the API
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:19:01Z',
 'fuel_type': 'diesel',
 'id': 'e388b45a-c057-5cc6-a918-82eeee6362db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU24584',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 104991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-22',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU24584%27 HTTP/1.1" 200 None
2026-03-30 10:56:29 [auto1.de] INFO: Saving data for GU24584: {'auction_closing_time': 1774970341.0, 'created_time': 1774379627.686332, 'last_price_update_time': 1774868189.968454}
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU24584') HTTP/1.1" 204 0
2026-03-30 10:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4db6190>
2026-03-30 10:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_80cd7a26681566fefd316edd584bdbe9.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_80cd7a26681566fefd316edd584bdbe9.jpg saved to cache
2026-03-30 10:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b89a4235-7799-56f3-9cef-37e695e92600
2026-03-30 10:56:30 [auto1.de] INFO: Found listing with ID: AG44550
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44550%27 HTTP/1.1" 200 None
2026-03-30 10:56:30 [auto1.de] INFO: Scrape type for AG44550: 2
2026-03-30 10:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c139aec-e127-5e44-9ea5-60253bfffb12 with identifier: AG44550
2026-03-30 10:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c139aec-e127-5e44-9ea5-60253bfffb12 with scrape type 2
2026-03-30 10:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c139aec-e127-5e44-9ea5-60253bfffb12 with scrape type 2
2026-03-30 10:56:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c139aec-e127-5e44-9ea5-60253bfffb12, identifier: AG44550
2026-03-30 10:56:30 [auto1.de] INFO: Found listing with ID: SC69057
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC69057%27 HTTP/1.1" 200 None
2026-03-30 10:56:30 [auto1.de] INFO: Scrape type for SC69057: 2
2026-03-30 10:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df7e1845-96e7-5cf6-9580-f9bf42075f9a with identifier: SC69057
2026-03-30 10:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df7e1845-96e7-5cf6-9580-f9bf42075f9a with scrape type 2
2026-03-30 10:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df7e1845-96e7-5cf6-9580-f9bf42075f9a with scrape type 2
2026-03-30 10:56:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df7e1845-96e7-5cf6-9580-f9bf42075f9a, identifier: SC69057
2026-03-30 10:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA44712> (referer: https://www.auto1.com/v1/car-details-view/DA44712/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4f89090>
2026-03-30 10:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_6.jpg HTTP/1.1" 201 0
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_06ce7f433f41e6d182185a2f455b982f.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_06ce7f433f41e6d182185a2f455b982f.jpg saved to cache
2026-03-30 10:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b89a4235-7799-56f3-9cef-37e695e92600
2026-03-30 10:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_f721160155974a0618888a07d195ba80.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c139aec-e127-5e44-9ea5-60253bfffb12 with identifier: AG44550
2026-03-30 10:56:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c139aec-e127-5e44-9ea5-60253bfffb12 with identifier: AG44550
2026-03-30 10:56:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c139aec-e127-5e44-9ea5-60253bfffb12 with identifier: AG44550 to the API
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:08:40Z',
 'fuel_type': 'petrol',
 'id': '8c139aec-e127-5e44-9ea5-60253bfffb12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG44550',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 159323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-15',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Style BlueMotion',
 'transmission': 'manual',
 'trim': 'Style BlueMotion',
 'year': 2011}
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44550%27 HTTP/1.1" 200 None
2026-03-30 10:56:30 [auto1.de] INFO: Saving data for AG44550: {'auction_closing_time': 1774969720.0, 'created_time': 1774464534.649249, 'last_price_update_time': 1774868190.942341}
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG44550') HTTP/1.1" 204 0
2026-03-30 10:56:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df7e1845-96e7-5cf6-9580-f9bf42075f9a with identifier: SC69057
2026-03-30 10:56:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df7e1845-96e7-5cf6-9580-f9bf42075f9a with identifier: SC69057
2026-03-30 10:56:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df7e1845-96e7-5cf6-9580-f9bf42075f9a with identifier: SC69057 to the API
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 114,
 'expiration_date': '2026-03-31T15:18:18Z',
 'fuel_type': 'petrol',
 'id': 'df7e1845-96e7-5cf6-9580-f9bf42075f9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC69057',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 135952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-29',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC69057%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Saving data for SC69057: {'auction_closing_time': 1774970298.0, 'created_time': 1773305754.451333, 'last_price_update_time': 1774868192.255233}
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC69057') HTTP/1.1" 204 0
2026-03-30 10:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_9d95f29ce95d504ae795e1ece7f5ab1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: ZJ46963
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ46963%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for ZJ46963: 2
2026-03-30 10:56:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72630cc8-fbc9-5789-946d-75b0bed33f78 with identifier: ZJ46963
2026-03-30 10:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72630cc8-fbc9-5789-946d-75b0bed33f78 with scrape type 2
2026-03-30 10:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72630cc8-fbc9-5789-946d-75b0bed33f78 with scrape type 2
2026-03-30 10:56:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72630cc8-fbc9-5789-946d-75b0bed33f78, identifier: ZJ46963
2026-03-30 10:56:32 [auto1.de] INFO: Found listing with ID: GZ10091
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ10091%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Scrape type for GZ10091: 2
2026-03-30 10:56:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c6c09bc-ef92-5345-8185-95c1dd58ef39 with identifier: GZ10091
2026-03-30 10:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c6c09bc-ef92-5345-8185-95c1dd58ef39 with scrape type 2
2026-03-30 10:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c6c09bc-ef92-5345-8185-95c1dd58ef39 with scrape type 2
2026-03-30 10:56:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c6c09bc-ef92-5345-8185-95c1dd58ef39, identifier: GZ10091
2026-03-30 10:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_6de7de241ee71da38ad879bd20a33c6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_8234bb318af71831da0276fae036530a.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72630cc8-fbc9-5789-946d-75b0bed33f78 with identifier: ZJ46963
2026-03-30 10:56:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72630cc8-fbc9-5789-946d-75b0bed33f78 with identifier: ZJ46963
2026-03-30 10:56:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72630cc8-fbc9-5789-946d-75b0bed33f78 with identifier: ZJ46963 to the API
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:14:57Z',
 'fuel_type': 'diesel',
 'id': '72630cc8-fbc9-5789-946d-75b0bed33f78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ46963',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 162634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-24',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ46963%27 HTTP/1.1" 200 None
2026-03-30 10:56:32 [auto1.de] INFO: Saving data for ZJ46963: {'auction_closing_time': 1774970097.0, 'created_time': 1773305468.183396, 'last_price_update_time': 1774868192.871}
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ46963') HTTP/1.1" 204 0
2026-03-30 10:56:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c6c09bc-ef92-5345-8185-95c1dd58ef39 with identifier: GZ10091
2026-03-30 10:56:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c6c09bc-ef92-5345-8185-95c1dd58ef39 with identifier: GZ10091
2026-03-30 10:56:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c6c09bc-ef92-5345-8185-95c1dd58ef39 with identifier: GZ10091 to the API
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:59:16Z',
 'fuel_type': 'petrol',
 'id': '9c6c09bc-ef92-5345-8185-95c1dd58ef39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ10091',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '124 Spider',
 'odometer': 64080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-05',
 'seller_name': None,
 'title': 'Abarth 124 Spider GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ10091%27 HTTP/1.1" 200 None
2026-03-30 10:56:33 [auto1.de] INFO: Saving data for GZ10091: {'auction_closing_time': 1774972756.0, 'created_time': 1774463923.80474, 'last_price_update_time': 1774868193.25365}
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ10091') HTTP/1.1" 204 0
2026-03-30 10:56:33 [auto1.de] INFO: Found listing with ID: XC07507
2026-03-30 10:56:33 [auto1.de] INFO: Found listing with ID: TJ17702
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ17702%27 HTTP/1.1" 200 None
2026-03-30 10:56:33 [auto1.de] INFO: Scrape type for TJ17702: 2
2026-03-30 10:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b0c8ee2-c7bc-544d-9d04-6c1de6e997de with identifier: TJ17702
2026-03-30 10:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b0c8ee2-c7bc-544d-9d04-6c1de6e997de with scrape type 2
2026-03-30 10:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b0c8ee2-c7bc-544d-9d04-6c1de6e997de with scrape type 2
2026-03-30 10:56:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b0c8ee2-c7bc-544d-9d04-6c1de6e997de, identifier: TJ17702
2026-03-30 10:56:33 [auto1.de] INFO: Found listing with ID: KX05344
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX05344%27 HTTP/1.1" 200 None
2026-03-30 10:56:33 [auto1.de] INFO: Scrape type for KX05344: 2
2026-03-30 10:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6291fcc9-cf3b-507f-8085-a9d7aecdc589 with identifier: KX05344
2026-03-30 10:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6291fcc9-cf3b-507f-8085-a9d7aecdc589 with scrape type 2
2026-03-30 10:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6291fcc9-cf3b-507f-8085-a9d7aecdc589 with scrape type 2
2026-03-30 10:56:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6291fcc9-cf3b-507f-8085-a9d7aecdc589, identifier: KX05344
2026-03-30 10:56:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b0c8ee2-c7bc-544d-9d04-6c1de6e997de with identifier: TJ17702
2026-03-30 10:56:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b0c8ee2-c7bc-544d-9d04-6c1de6e997de with identifier: TJ17702
2026-03-30 10:56:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b0c8ee2-c7bc-544d-9d04-6c1de6e997de with identifier: TJ17702 to the API
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:12:21Z',
 'fuel_type': 'diesel',
 'id': '1b0c8ee2-c7bc-544d-9d04-6c1de6e997de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ17702',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 98857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-26',
 'seller_name': None,
 'title': 'Ford Ranger 3.2 TDCi Doppelkabine Limited 4x4',
 'transmission': 'automatic',
 'trim': 'Doppelkabine Limited 4x4',
 'year': 2018}
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ17702%27 HTTP/1.1" 200 None
2026-03-30 10:56:33 [auto1.de] INFO: Saving data for TJ17702: {'auction_closing_time': 1774969941.0, 'created_time': 1773305395.809929, 'last_price_update_time': 1774868193.845124}
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ17702') HTTP/1.1" 204 0
2026-03-30 10:56:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6291fcc9-cf3b-507f-8085-a9d7aecdc589 with identifier: KX05344
2026-03-30 10:56:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6291fcc9-cf3b-507f-8085-a9d7aecdc589 with identifier: KX05344
2026-03-30 10:56:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6291fcc9-cf3b-507f-8085-a9d7aecdc589 with identifier: KX05344 to the API
2026-03-30 10:56:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:56:16Z',
 'fuel_type': 'petrol',
 'id': '6291fcc9-cf3b-507f-8085-a9d7aecdc589',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX05344',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 180596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-08-31',
 'seller_name': None,
 'title': 'BMW 3er 316i',
 'transmission': 'manual',
 'trim': '',
 'year': 1996}
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX05344%27 HTTP/1.1" 200 None
2026-03-30 10:56:34 [auto1.de] INFO: Saving data for KX05344: {'auction_closing_time': 1774972576.0, 'created_time': 1774378380.769628, 'last_price_update_time': 1774868194.194723}
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX05344') HTTP/1.1" 204 0
2026-03-30 10:56:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f27867bc-436a-5b19-b18e-33cfe536333b with identifier: DA44712
2026-03-30 10:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f27867bc-436a-5b19-b18e-33cfe536333b with scrape type 1
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f27867bc-436a-5b19-b18e-33cfe536333b
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b9201bbaa76c13809fc69f32988d2%252Fpa%252FDA44712_80b568d1dde40c992d9483577b5a83ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_80b568d1dde40c992d9483577b5a83ce.jpg already downloaded
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b9201bbaa76c13809fc69f32988d2%252Fpa%252FDA44712_5768ee6474e09532d48fe8b8093a3828.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_5768ee6474e09532d48fe8b8093a3828.jpg already downloaded
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b9201bbaa76c13809fc69f32988d2%252Fpa%252FDA44712_f158824952fc522e7c67e1ad2aab7030.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_f158824952fc522e7c67e1ad2aab7030.jpg already downloaded
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b9201bbaa76c13809fc69f32988d2%252Fpa%252FDA44712_dbc52510854c77c9c91559e81b239c6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_dbc52510854c77c9c91559e81b239c6b.jpg already downloaded
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b9201bbaa76c13809fc69f32988d2%252Fpa%252FDA44712_2bae65073fda5db00aa64b6cc017699b.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_2bae65073fda5db00aa64b6cc017699b.jpg already downloaded
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b9201bbaa76c13809fc69f32988d2%252Fpa%252FDA44712_c7766e3d359769d06ebcf5dcae162281.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_c7766e3d359769d06ebcf5dcae162281.jpg already downloaded
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b9201bbaa76c13809fc69f32988d2%252Fpa%252FDA44712_a85126381b6384af875a58b6c58cb26d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_a85126381b6384af875a58b6c58cb26d.jpg already downloaded
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b9201bbaa76c13809fc69f32988d2%252Fpa%252FDA44712_be422eebd1fbfbba4ca989b44edb4a15.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_be422eebd1fbfbba4ca989b44edb4a15.jpg already downloaded
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b9201bbaa76c13809fc69f32988d2%252Fpa%252FDA44712_8f1678e608e9753a00feb5dab630d13d.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_8f1678e608e9753a00feb5dab630d13d.jpg already downloaded
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b9201bbaa76c13809fc69f32988d2%252Fpa%252FDA44712_0a7aedb93953d2485bd8242a2d76340c.jpg%27 HTTP/1.1" 200 None
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_0a7aedb93953d2485bd8242a2d76340c.jpg already downloaded
2026-03-30 10:56:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f27867bc-436a-5b19-b18e-33cfe536333b, identifier: DA44712
2026-03-30 10:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef4c98690>
2026-03-30 10:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_7.jpg HTTP/1.1" 201 0
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_f721160155974a0618888a07d195ba80.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_f721160155974a0618888a07d195ba80.jpg saved to cache
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b89a4235-7799-56f3-9cef-37e695e92600
2026-03-30 10:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef505f7d0>
2026-03-30 10:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_8.jpg HTTP/1.1" 201 0
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_9d95f29ce95d504ae795e1ece7f5ab1b.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_9d95f29ce95d504ae795e1ece7f5ab1b.jpg saved to cache
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b89a4235-7799-56f3-9cef-37e695e92600
2026-03-30 10:56:34 [auto1.de] INFO: Found listing with ID: CT53281
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53281%27 HTTP/1.1" 200 None
2026-03-30 10:56:34 [auto1.de] INFO: Scrape type for CT53281: 2
2026-03-30 10:56:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37b5fbd7-b18e-51e5-9850-2b308e20cd2c with identifier: CT53281
2026-03-30 10:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37b5fbd7-b18e-51e5-9850-2b308e20cd2c with scrape type 2
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37b5fbd7-b18e-51e5-9850-2b308e20cd2c with scrape type 2
2026-03-30 10:56:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37b5fbd7-b18e-51e5-9850-2b308e20cd2c, identifier: CT53281
2026-03-30 10:56:34 [auto1.de] INFO: Found listing with ID: LT00985
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT00985%27 HTTP/1.1" 200 None
2026-03-30 10:56:34 [auto1.de] INFO: Scrape type for LT00985: 2
2026-03-30 10:56:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df0aad6d-a040-5b4f-bf17-bdf1ffb56a06 with identifier: LT00985
2026-03-30 10:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df0aad6d-a040-5b4f-bf17-bdf1ffb56a06 with scrape type 2
2026-03-30 10:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df0aad6d-a040-5b4f-bf17-bdf1ffb56a06 with scrape type 2
2026-03-30 10:56:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df0aad6d-a040-5b4f-bf17-bdf1ffb56a06, identifier: LT00985
2026-03-30 10:56:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f27867bc-436a-5b19-b18e-33cfe536333b with identifier: DA44712
2026-03-30 10:56:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f27867bc-436a-5b19-b18e-33cfe536333b with identifier: DA44712
2026-03-30 10:56:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f27867bc-436a-5b19-b18e-33cfe536333b with identifier: DA44712 to the API
2026-03-30 10:56:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DA44712>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:55:47Z',
 'fuel_type': 'petrol',
 'id': 'f27867bc-436a-5b19-b18e-33cfe536333b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA44712',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 113966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_80b568d1dde40c992d9483577b5a83ce.jpg',
                'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_5768ee6474e09532d48fe8b8093a3828.jpg',
                'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_f158824952fc522e7c67e1ad2aab7030.jpg',
                'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_dbc52510854c77c9c91559e81b239c6b.jpg',
                'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_2bae65073fda5db00aa64b6cc017699b.jpg',
                'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_c7766e3d359769d06ebcf5dcae162281.jpg',
                'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_a85126381b6384af875a58b6c58cb26d.jpg',
                'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_be422eebd1fbfbba4ca989b44edb4a15.jpg',
                'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_8f1678e608e9753a00feb5dab630d13d.jpg',
                'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_0a7aedb93953d2485bd8242a2d76340c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27867bc-436a-5b19-b18e-33cfe536333b/f27867bc-436a-5b19-b18e-33cfe536333b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_80b568d1dde40c992d9483577b5a83ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27867bc-436a-5b19-b18e-33cfe536333b/f27867bc-436a-5b19-b18e-33cfe536333b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_5768ee6474e09532d48fe8b8093a3828.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27867bc-436a-5b19-b18e-33cfe536333b/f27867bc-436a-5b19-b18e-33cfe536333b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_f158824952fc522e7c67e1ad2aab7030.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27867bc-436a-5b19-b18e-33cfe536333b/f27867bc-436a-5b19-b18e-33cfe536333b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_dbc52510854c77c9c91559e81b239c6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27867bc-436a-5b19-b18e-33cfe536333b/f27867bc-436a-5b19-b18e-33cfe536333b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_2bae65073fda5db00aa64b6cc017699b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27867bc-436a-5b19-b18e-33cfe536333b/f27867bc-436a-5b19-b18e-33cfe536333b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_c7766e3d359769d06ebcf5dcae162281.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27867bc-436a-5b19-b18e-33cfe536333b/f27867bc-436a-5b19-b18e-33cfe536333b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_a85126381b6384af875a58b6c58cb26d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27867bc-436a-5b19-b18e-33cfe536333b/f27867bc-436a-5b19-b18e-33cfe536333b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_be422eebd1fbfbba4ca989b44edb4a15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27867bc-436a-5b19-b18e-33cfe536333b/f27867bc-436a-5b19-b18e-33cfe536333b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_8f1678e608e9753a00feb5dab630d13d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27867bc-436a-5b19-b18e-33cfe536333b/f27867bc-436a-5b19-b18e-33cfe536333b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b9201bbaa76c13809fc69f32988d2/pa/DA44712_0a7aedb93953d2485bd8242a2d76340c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2018}
2026-03-30 10:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA44712%27 HTTP/1.1" 200 None
2026-03-30 10:56:35 [auto1.de] INFO: Saving data for DA44712: {'created_time': 1774868195.151042, 'last_price_update_time': 1774868195.151053, 'auction_closing_time': 1774972547.0}
2026-03-30 10:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA44712') HTTP/1.1" 204 0
2026-03-30 10:56:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37b5fbd7-b18e-51e5-9850-2b308e20cd2c with identifier: CT53281
2026-03-30 10:56:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37b5fbd7-b18e-51e5-9850-2b308e20cd2c with identifier: CT53281
2026-03-30 10:56:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37b5fbd7-b18e-51e5-9850-2b308e20cd2c with identifier: CT53281 to the API
2026-03-30 10:56:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:55:15Z',
 'fuel_type': 'diesel',
 'id': '37b5fbd7-b18e-51e5-9850-2b308e20cd2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT53281',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 180176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-24',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Mild-Hybrid Prime 4WD',
 'transmission': 'automatic',
 'trim': 'Prime 4WD',
 'year': 2021}
2026-03-30 10:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53281%27 HTTP/1.1" 200 None
2026-03-30 10:56:35 [auto1.de] INFO: Saving data for CT53281: {'auction_closing_time': 1774972515.0, 'created_time': 1774503332.166283, 'last_price_update_time': 1774868195.652163}
2026-03-30 10:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT53281') HTTP/1.1" 204 0
2026-03-30 10:56:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df0aad6d-a040-5b4f-bf17-bdf1ffb56a06 with identifier: LT00985
2026-03-30 10:56:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df0aad6d-a040-5b4f-bf17-bdf1ffb56a06 with identifier: LT00985
2026-03-30 10:56:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df0aad6d-a040-5b4f-bf17-bdf1ffb56a06 with identifier: LT00985 to the API
2026-03-30 10:56:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:35:27Z',
 'fuel_type': 'petrol',
 'id': 'df0aad6d-a040-5b4f-bf17-bdf1ffb56a06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT00985',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 279176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-22',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-30 10:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT00985%27 HTTP/1.1" 200 None
2026-03-30 10:56:35 [auto1.de] INFO: Saving data for LT00985: {'auction_closing_time': 1774971327.0, 'created_time': 1773224444.655928, 'last_price_update_time': 1774868195.995163}
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT00985') HTTP/1.1" 204 0
2026-03-30 10:56:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5111190>
2026-03-30 10:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_2.jpg HTTP/1.1" 201 0
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_6de7de241ee71da38ad879bd20a33c6a.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_6de7de241ee71da38ad879bd20a33c6a.jpg saved to cache
2026-03-30 10:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df5e8ed8-98dd-5a11-819f-a56aa6ec8f97
2026-03-30 10:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef501d710>
2026-03-30 10:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_9.jpg HTTP/1.1" 201 0
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Ff4%252F3ff4bc33e6d72726758e44361bf6de17%252Fpa%252FJY37927_8234bb318af71831da0276fae036530a.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_8234bb318af71831da0276fae036530a.jpg saved to cache
2026-03-30 10:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b89a4235-7799-56f3-9cef-37e695e92600
2026-03-30 10:56:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b89a4235-7799-56f3-9cef-37e695e92600, skipping ID generation
2026-03-30 10:56:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b89a4235-7799-56f3-9cef-37e695e92600 with scrape type 1
2026-03-30 10:56:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b89a4235-7799-56f3-9cef-37e695e92600 sending to next pipeline
2026-03-30 10:56:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b89a4235-7799-56f3-9cef-37e695e92600, identifier: JY37927
2026-03-30 10:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_b04e82ea13eea989557fbb9deaec22d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:36 [auto1.de] INFO: Found listing with ID: BK50422
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK50422%27 HTTP/1.1" 200 None
2026-03-30 10:56:36 [auto1.de] INFO: Scrape type for BK50422: 2
2026-03-30 10:56:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c6fef0c-6332-5a86-b50e-27afc9dc2cff with identifier: BK50422
2026-03-30 10:56:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c6fef0c-6332-5a86-b50e-27afc9dc2cff with scrape type 2
2026-03-30 10:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c6fef0c-6332-5a86-b50e-27afc9dc2cff with scrape type 2
2026-03-30 10:56:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c6fef0c-6332-5a86-b50e-27afc9dc2cff, identifier: BK50422
2026-03-30 10:56:36 [auto1.de] INFO: Found listing with ID: PN40620
2026-03-30 10:56:36 [auto1.de] INFO: Found listing with ID: MJ50234
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ50234%27 HTTP/1.1" 200 None
2026-03-30 10:56:36 [auto1.de] INFO: Scrape type for MJ50234: 2
2026-03-30 10:56:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a392522e-5309-5fc5-8ef5-050bbdbba4a5 with identifier: MJ50234
2026-03-30 10:56:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a392522e-5309-5fc5-8ef5-050bbdbba4a5 with scrape type 2
2026-03-30 10:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a392522e-5309-5fc5-8ef5-050bbdbba4a5 with scrape type 2
2026-03-30 10:56:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a392522e-5309-5fc5-8ef5-050bbdbba4a5, identifier: MJ50234
2026-03-30 10:56:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b89a4235-7799-56f3-9cef-37e695e92600 with identifier: JY37927
2026-03-30 10:56:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b89a4235-7799-56f3-9cef-37e695e92600 with identifier: JY37927
2026-03-30 10:56:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b89a4235-7799-56f3-9cef-37e695e92600 with identifier: JY37927 to the API
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_8234bb318af71831da0276fae036530a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 204,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 330,
 'expiration_date': '2026-03-31T15:40:25Z',
 'fuel_type': 'petrol',
 'id': 'b89a4235-7799-56f3-9cef-37e695e92600',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY37927',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Maserati',
 'model': 'Grecale',
 'odometer': 89768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_6270ecbd4f5b409c277401feb381dd30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_9605475b0a447cfbb85ae5ef936f54b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_da583fc44720cda3c408baed008b332a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_85edfe0c929d7d11e7f1b640a120c9e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_6bd49c1eb8ecd9ff917e5cd6fc5ff752.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_80cd7a26681566fefd316edd584bdbe9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_06ce7f433f41e6d182185a2f455b982f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_f721160155974a0618888a07d195ba80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_9d95f29ce95d504ae795e1ece7f5ab1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b89a4235-7799-56f3-9cef-37e695e92600/b89a4235-7799-56f3-9cef-37e695e92600_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/f4/3ff4bc33e6d72726758e44361bf6de17/pa/JY37927_8234bb318af71831da0276fae036530a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Maserati Grecale 2.0 Turbo Mild-Hybrid Modena AWD',
 'transmission': 'automatic',
 'trim': 'Modena AWD',
 'year': 2022}
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY37927%27 HTTP/1.1" 200 None
2026-03-30 10:56:36 [auto1.de] INFO: Saving data for JY37927: {'created_time': 1774868196.981702, 'last_price_update_time': 1774868196.98171, 'auction_closing_time': 1774971625.0}
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY37927') HTTP/1.1" 204 0
2026-03-30 10:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_7eba8d11a47f1892d9eca81a4400190c.jpg> (referer: https://www.auto1.com/)
2026-03-30 10:56:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c6fef0c-6332-5a86-b50e-27afc9dc2cff with identifier: BK50422
2026-03-30 10:56:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c6fef0c-6332-5a86-b50e-27afc9dc2cff with identifier: BK50422
2026-03-30 10:56:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c6fef0c-6332-5a86-b50e-27afc9dc2cff with identifier: BK50422 to the API
2026-03-30 10:56:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:40:15Z',
 'fuel_type': 'diesel',
 'id': '3c6fef0c-6332-5a86-b50e-27afc9dc2cff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK50422',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 90980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-12',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2026-03-30 10:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK50422%27 HTTP/1.1" 200 None
2026-03-30 10:56:37 [auto1.de] INFO: Saving data for BK50422: {'auction_closing_time': 1774971615.0, 'created_time': 1773772608.46419, 'last_price_update_time': 1774868197.293858}
2026-03-30 10:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK50422') HTTP/1.1" 204 0
2026-03-30 10:56:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a392522e-5309-5fc5-8ef5-050bbdbba4a5 with identifier: MJ50234
2026-03-30 10:56:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a392522e-5309-5fc5-8ef5-050bbdbba4a5 with identifier: MJ50234
2026-03-30 10:56:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a392522e-5309-5fc5-8ef5-050bbdbba4a5 with identifier: MJ50234 to the API
2026-03-30 10:56:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:39:28Z',
 'fuel_type': 'petrol',
 'id': 'a392522e-5309-5fc5-8ef5-050bbdbba4a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ50234',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 132496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-05',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2014}
2026-03-30 10:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ50234%27 HTTP/1.1" 200 None
2026-03-30 10:56:38 [auto1.de] INFO: Saving data for MJ50234: {'auction_closing_time': 1774971568.0, 'created_time': 1773689248.570974, 'last_price_update_time': 1774868198.226415}
2026-03-30 10:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ50234') HTTP/1.1" 204 0
2026-03-30 10:56:38 [auto1.de] INFO: Found listing with ID: WF84421
2026-03-30 10:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF84421%27 HTTP/1.1" 200 None
2026-03-30 10:56:38 [auto1.de] INFO: Scrape type for WF84421: 2
2026-03-30 10:56:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35ccd4f3-a1a9-58f9-b086-de1574cae797 with identifier: WF84421
2026-03-30 10:56:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35ccd4f3-a1a9-58f9-b086-de1574cae797 with scrape type 2
2026-03-30 10:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35ccd4f3-a1a9-58f9-b086-de1574cae797 with scrape type 2
2026-03-30 10:56:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35ccd4f3-a1a9-58f9-b086-de1574cae797, identifier: WF84421
2026-03-30 10:56:38 [auto1.de] INFO: Found listing with ID: EZ29207
2026-03-30 10:56:38 [auto1.de] INFO: Found listing with ID: KW20728
2026-03-30 10:56:38 [auto1.de] INFO: Found listing with ID: LA45338
2026-03-30 10:56:38 [auto1.de] INFO: Found listing with ID: FD13282
2026-03-30 10:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD13282%27 HTTP/1.1" 200 None
2026-03-30 10:56:38 [auto1.de] INFO: Scrape type for FD13282: 2
2026-03-30 10:56:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a928937-729b-518a-b601-54c1d938ce69 with identifier: FD13282
2026-03-30 10:56:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a928937-729b-518a-b601-54c1d938ce69 with scrape type 2
2026-03-30 10:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a928937-729b-518a-b601-54c1d938ce69 with scrape type 2
2026-03-30 10:56:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a928937-729b-518a-b601-54c1d938ce69, identifier: FD13282
2026-03-30 10:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35ccd4f3-a1a9-58f9-b086-de1574cae797 with identifier: WF84421
2026-03-30 10:56:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35ccd4f3-a1a9-58f9-b086-de1574cae797 with identifier: WF84421
2026-03-30 10:56:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35ccd4f3-a1a9-58f9-b086-de1574cae797 with identifier: WF84421 to the API
2026-03-30 10:56:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:08:40Z',
 'fuel_type': 'diesel',
 'id': '35ccd4f3-a1a9-58f9-b086-de1574cae797',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF84421',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 50461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-20',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi EcoBlue Wildtrak e-4WD Doppelkabine',
 'transmission': 'automatic',
 'trim': 'Wildtrak e-4WD Doppelkabine',
 'year': 2023}
2026-03-30 10:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF84421%27 HTTP/1.1" 200 None
2026-03-30 10:56:38 [auto1.de] INFO: Saving data for WF84421: {'auction_closing_time': 1774969720.0, 'created_time': 1774348630.581429, 'last_price_update_time': 1774868198.792169}
2026-03-30 10:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF84421') HTTP/1.1" 204 0
2026-03-30 10:56:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a928937-729b-518a-b601-54c1d938ce69 with identifier: FD13282
2026-03-30 10:56:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a928937-729b-518a-b601-54c1d938ce69 with identifier: FD13282
2026-03-30 10:56:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a928937-729b-518a-b601-54c1d938ce69 with identifier: FD13282 to the API
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:58:32Z',
 'fuel_type': 'diesel',
 'id': '7a928937-729b-518a-b601-54c1d938ce69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD13282',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 131051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-16',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2008}
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD13282%27 HTTP/1.1" 200 None
2026-03-30 10:56:39 [auto1.de] INFO: Saving data for FD13282: {'auction_closing_time': 1774972712.0, 'created_time': 1773725725.255824, 'last_price_update_time': 1774868199.243389}
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD13282') HTTP/1.1" 204 0
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: MR23969
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23969%27 HTTP/1.1" 200 None
2026-03-30 10:56:39 [auto1.de] INFO: Scrape type for MR23969: 2
2026-03-30 10:56:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5222662-27ef-5c50-abd4-535d7792ebef with identifier: MR23969
2026-03-30 10:56:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5222662-27ef-5c50-abd4-535d7792ebef with scrape type 2
2026-03-30 10:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5222662-27ef-5c50-abd4-535d7792ebef with scrape type 2
2026-03-30 10:56:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5222662-27ef-5c50-abd4-535d7792ebef, identifier: MR23969
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: FP43907
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: LE88532
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE88532%27 HTTP/1.1" 200 None
2026-03-30 10:56:39 [auto1.de] INFO: Scrape type for LE88532: 0
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: PL37483
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL37483%27 HTTP/1.1" 200 None
2026-03-30 10:56:39 [auto1.de] INFO: Scrape type for PL37483: 0
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: SR56375
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR56375%27 HTTP/1.1" 200 None
2026-03-30 10:56:39 [auto1.de] INFO: Scrape type for SR56375: 0
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: CP67844
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: JW60141
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: LD36602
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: XH94103
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH94103%27 HTTP/1.1" 200 None
2026-03-30 10:56:39 [auto1.de] INFO: Scrape type for XH94103: 0
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: LW48159
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: CX13675
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX13675%27 HTTP/1.1" 200 None
2026-03-30 10:56:39 [auto1.de] INFO: Scrape type for CX13675: 0
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: WP33305
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: RZ13865
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: WB34474
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: MD28081
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD28081%27 HTTP/1.1" 200 None
2026-03-30 10:56:39 [auto1.de] INFO: Scrape type for MD28081: 0
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: ES68106
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68106%27 HTTP/1.1" 200 None
2026-03-30 10:56:39 [auto1.de] INFO: Scrape type for ES68106: 0
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: FN23082
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN23082%27 HTTP/1.1" 200 None
2026-03-30 10:56:39 [auto1.de] INFO: Scrape type for FN23082: 0
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: HS86233
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS86233%27 HTTP/1.1" 200 None
2026-03-30 10:56:39 [auto1.de] INFO: Scrape type for HS86233: 0
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: DE92254
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: FF42934
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: LJ09333
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: VH09784
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH09784%27 HTTP/1.1" 200 None
2026-03-30 10:56:39 [auto1.de] INFO: Scrape type for VH09784: 0
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: HL66127
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: RT03172
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: FL34122
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL34122%27 HTTP/1.1" 200 None
2026-03-30 10:56:39 [auto1.de] INFO: Scrape type for FL34122: 0
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: MU80081
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU80081%27 HTTP/1.1" 200 None
2026-03-30 10:56:39 [auto1.de] INFO: Scrape type for MU80081: 0
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: BP88986
2026-03-30 10:56:39 [auto1.de] INFO: Found listing with ID: PK44731
2026-03-30 10:56:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5982350>
2026-03-30 10:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_4.jpg HTTP/1.1" 201 0
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_b04e82ea13eea989557fbb9deaec22d5.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_b04e82ea13eea989557fbb9deaec22d5.jpg saved to cache
2026-03-30 10:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df5e8ed8-98dd-5a11-819f-a56aa6ec8f97
2026-03-30 10:56:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 10:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 10:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9ef5035250>
2026-03-30 10:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 10:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_5.jpg HTTP/1.1" 201 0
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fde%252Fb3de0eaca9d7f234f0e9fafaaee3b545%252Fpa%252FGX62549_7eba8d11a47f1892d9eca81a4400190c.jpg') HTTP/1.1" 204 0
2026-03-30 10:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_7eba8d11a47f1892d9eca81a4400190c.jpg saved to cache
2026-03-30 10:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df5e8ed8-98dd-5a11-819f-a56aa6ec8f97
2026-03-30 10:56:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df5e8ed8-98dd-5a11-819f-a56aa6ec8f97, skipping ID generation
2026-03-30 10:56:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df5e8ed8-98dd-5a11-819f-a56aa6ec8f97 with scrape type 1
2026-03-30 10:56:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df5e8ed8-98dd-5a11-819f-a56aa6ec8f97 sending to next pipeline
2026-03-30 10:56:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df5e8ed8-98dd-5a11-819f-a56aa6ec8f97, identifier: GX62549
2026-03-30 10:56:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5222662-27ef-5c50-abd4-535d7792ebef with identifier: MR23969
2026-03-30 10:56:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5222662-27ef-5c50-abd4-535d7792ebef with identifier: MR23969
2026-03-30 10:56:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5222662-27ef-5c50-abd4-535d7792ebef with identifier: MR23969 to the API
2026-03-30 10:56:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:28:09Z',
 'fuel_type': 'petrol',
 'id': 'c5222662-27ef-5c50-abd4-535d7792ebef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR23969',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 138536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-03',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2019}
2026-03-30 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23969%27 HTTP/1.1" 200 None
2026-03-30 10:56:40 [auto1.de] INFO: Saving data for MR23969: {'auction_closing_time': 1774970889.0, 'created_time': 1773303955.498187, 'last_price_update_time': 1774868200.282412}
2026-03-30 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR23969') HTTP/1.1" 204 0
2026-03-30 10:56:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df5e8ed8-98dd-5a11-819f-a56aa6ec8f97 with identifier: GX62549
2026-03-30 10:56:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df5e8ed8-98dd-5a11-819f-a56aa6ec8f97 with identifier: GX62549
2026-03-30 10:56:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df5e8ed8-98dd-5a11-819f-a56aa6ec8f97 with identifier: GX62549 to the API
2026-03-30 10:56:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_7eba8d11a47f1892d9eca81a4400190c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:03:34Z',
 'fuel_type': 'diesel',
 'id': 'df5e8ed8-98dd-5a11-819f-a56aa6ec8f97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX62549',
 'listing': 'auction',
 'location': 'DE, Herborn',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 135857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_e62e912a14601563fe471c4c3948746d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_78296c7180991d097bd73e4704fcd16e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2864471,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_6de7de241ee71da38ad879bd20a33c6a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_c5d9cdeb8588c256fe1b5a466abd4d02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2903170,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_b04e82ea13eea989557fbb9deaec22d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2889422,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_7eba8d11a47f1892d9eca81a4400190c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_ec343965a9fc0c195f877181aa5c82a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_e5ed43d93e892b26654ee7e5666b8b7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_897af1ce9c021264399e780134ad05b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5e8ed8-98dd-5a11-819f-a56aa6ec8f97/df5e8ed8-98dd-5a11-819f-a56aa6ec8f97_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/de/b3de0eaca9d7f234f0e9fafaaee3b545/pa/GX62549_ad83f85e6a034d3f30ddc2a5c5e9ba78.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Vitara 1.6 DDiS Comfort+ 4x4',
 'transmission': 'manual',
 'trim': 'Comfort+ 4x4',
 'year': 2016}
2026-03-30 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX62549%27 HTTP/1.1" 200 None
2026-03-30 10:56:40 [auto1.de] INFO: Saving data for GX62549: {'created_time': 1774868200.777044, 'last_price_update_time': 1774868200.777055, 'auction_closing_time': 1774969414.0}
2026-03-30 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX62549') HTTP/1.1" 204 0
2026-03-30 10:56:40 [auto1.de] INFO: Found listing with ID: PP91103
2026-03-30 10:56:40 [auto1.de] INFO: Found listing with ID: LK15200
2026-03-30 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK15200%27 HTTP/1.1" 200 None
2026-03-30 10:56:40 [auto1.de] INFO: Scrape type for LK15200: 2
2026-03-30 10:56:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38a64a3b-7ec5-5a3b-8cc6-51234bfc0b12 with identifier: LK15200
2026-03-30 10:56:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38a64a3b-7ec5-5a3b-8cc6-51234bfc0b12 with scrape type 2
2026-03-30 10:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38a64a3b-7ec5-5a3b-8cc6-51234bfc0b12 with scrape type 2
2026-03-30 10:56:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38a64a3b-7ec5-5a3b-8cc6-51234bfc0b12, identifier: LK15200
2026-03-30 10:56:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38a64a3b-7ec5-5a3b-8cc6-51234bfc0b12 with identifier: LK15200
2026-03-30 10:56:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38a64a3b-7ec5-5a3b-8cc6-51234bfc0b12 with identifier: LK15200
2026-03-30 10:56:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38a64a3b-7ec5-5a3b-8cc6-51234bfc0b12 with identifier: LK15200 to the API
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:26:29Z',
 'fuel_type': 'petrol',
 'id': '38a64a3b-7ec5-5a3b-8cc6-51234bfc0b12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK15200',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 180525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-26',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK15200%27 HTTP/1.1" 200 None
2026-03-30 10:56:41 [auto1.de] INFO: Saving data for LK15200: {'auction_closing_time': 1774970789.0, 'created_time': 1773658193.615465, 'last_price_update_time': 1774868201.266785}
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK15200') HTTP/1.1" 204 0
2026-03-30 10:56:41 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 9531 | hits on page: 40
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: CR45674
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: MA62044
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: CT54176
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT54176%27 HTTP/1.1" 200 None
2026-03-30 10:56:41 [auto1.de] INFO: Scrape type for CT54176: 2
2026-03-30 10:56:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55b6db25-4440-5769-8d0c-e707a90dcf38 with identifier: CT54176
2026-03-30 10:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55b6db25-4440-5769-8d0c-e707a90dcf38 with scrape type 2
2026-03-30 10:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55b6db25-4440-5769-8d0c-e707a90dcf38 with scrape type 2
2026-03-30 10:56:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55b6db25-4440-5769-8d0c-e707a90dcf38, identifier: CT54176
2026-03-30 10:56:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55b6db25-4440-5769-8d0c-e707a90dcf38 with identifier: CT54176
2026-03-30 10:56:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55b6db25-4440-5769-8d0c-e707a90dcf38 with identifier: CT54176
2026-03-30 10:56:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55b6db25-4440-5769-8d0c-e707a90dcf38 with identifier: CT54176 to the API
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:56:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:42:17Z',
 'fuel_type': 'petrol',
 'id': '55b6db25-4440-5769-8d0c-e707a90dcf38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT54176',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 93479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-13',
 'seller_name': None,
 'title': 'Hyundai ix20 1.6 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2016}
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT54176%27 HTTP/1.1" 200 None
2026-03-30 10:56:41 [auto1.de] INFO: Saving data for CT54176: {'auction_closing_time': 1774971737.0, 'created_time': 1774467645.367171, 'last_price_update_time': 1774868201.747112}
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT54176') HTTP/1.1" 204 0
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: PK44731
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: BP08791
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP08791%27 HTTP/1.1" 200 None
2026-03-30 10:56:41 [auto1.de] INFO: Scrape type for BP08791: 0
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: YJ10280
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ10280%27 HTTP/1.1" 200 None
2026-03-30 10:56:41 [auto1.de] INFO: Scrape type for YJ10280: 0
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: CE25056
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE25056%27 HTTP/1.1" 200 None
2026-03-30 10:56:41 [auto1.de] INFO: Scrape type for CE25056: 0
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: FK56908
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK56908%27 HTTP/1.1" 200 None
2026-03-30 10:56:41 [auto1.de] INFO: Scrape type for FK56908: 0
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: ZU35501
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU35501%27 HTTP/1.1" 200 None
2026-03-30 10:56:41 [auto1.de] INFO: Scrape type for ZU35501: 0
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: FV09782
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: CW81112
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW81112%27 HTTP/1.1" 200 None
2026-03-30 10:56:41 [auto1.de] INFO: Scrape type for CW81112: 0
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: HW93090
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93090%27 HTTP/1.1" 200 None
2026-03-30 10:56:41 [auto1.de] INFO: Scrape type for HW93090: 0
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: XW62515
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: NC54536
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: UJ91538
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ91538%27 HTTP/1.1" 200 None
2026-03-30 10:56:41 [auto1.de] INFO: Scrape type for UJ91538: 0
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: ZC81938
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: VL46234
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL46234%27 HTTP/1.1" 200 None
2026-03-30 10:56:41 [auto1.de] INFO: Scrape type for VL46234: 0
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: CA30799
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: BY18801
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18801%27 HTTP/1.1" 200 None
2026-03-30 10:56:41 [auto1.de] INFO: Scrape type for BY18801: 0
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: LE94201
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE94201%27 HTTP/1.1" 200 None
2026-03-30 10:56:41 [auto1.de] INFO: Scrape type for LE94201: 0
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: YU07668
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU07668%27 HTTP/1.1" 200 None
2026-03-30 10:56:41 [auto1.de] INFO: Scrape type for YU07668: 0
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: GR50767
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR50767%27 HTTP/1.1" 200 None
2026-03-30 10:56:41 [auto1.de] INFO: Scrape type for GR50767: 0
2026-03-30 10:56:41 [auto1.de] INFO: Found listing with ID: GG43334
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG43334%27 HTTP/1.1" 200 None
2026-03-30 10:56:42 [auto1.de] INFO: Scrape type for GG43334: 0
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: ZL47575
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL47575%27 HTTP/1.1" 200 None
2026-03-30 10:56:42 [auto1.de] INFO: Scrape type for ZL47575: 0
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: KY88001
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: LN11972
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11972%27 HTTP/1.1" 200 None
2026-03-30 10:56:42 [auto1.de] INFO: Scrape type for LN11972: 0
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: RN93387
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: ZZ22411
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: CS08298
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS08298%27 HTTP/1.1" 200 None
2026-03-30 10:56:42 [auto1.de] INFO: Scrape type for CS08298: 0
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: EL87499
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL87499%27 HTTP/1.1" 200 None
2026-03-30 10:56:42 [auto1.de] INFO: Scrape type for EL87499: 0
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: CU51755
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51755%27 HTTP/1.1" 200 None
2026-03-30 10:56:42 [auto1.de] INFO: Scrape type for CU51755: 0
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: LE51560
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE51560%27 HTTP/1.1" 200 None
2026-03-30 10:56:42 [auto1.de] INFO: Scrape type for LE51560: 0
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: PY43658
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: PH95596
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH95596%27 HTTP/1.1" 200 None
2026-03-30 10:56:42 [auto1.de] INFO: Scrape type for PH95596: 0
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: MN27803
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: LX54044
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX54044%27 HTTP/1.1" 200 None
2026-03-30 10:56:42 [auto1.de] INFO: Scrape type for LX54044: 0
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: FC32673
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC32673%27 HTTP/1.1" 200 None
2026-03-30 10:56:42 [auto1.de] INFO: Scrape type for FC32673: 0
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: YA43957
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: WP05993
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP05993%27 HTTP/1.1" 200 None
2026-03-30 10:56:42 [auto1.de] INFO: Scrape type for WP05993: 0
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: KF61768
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: VD73221
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: FM79917
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM79917%27 HTTP/1.1" 200 None
2026-03-30 10:56:42 [auto1.de] INFO: Scrape type for FM79917: 0
2026-03-30 10:56:42 [auto1.de] INFO: Found listing with ID: MY93423
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY93423%27 HTTP/1.1" 200 None
2026-03-30 10:56:42 [auto1.de] INFO: Scrape type for MY93423: 0
2026-03-30 10:56:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:48 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 9532 | hits on page: 40
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: MY93423
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY93423%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for MY93423: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: JS17929
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: LW15180
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: NY45531
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: SB57558
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: LC01777
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: JT74267
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: LF00427
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF00427%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for LF00427: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: MU75641
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: HV93263
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV93263%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for HV93263: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: KT31788
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: PY86398
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY86398%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for PY86398: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: JT36836
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: FH56090
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: MS42171
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS42171%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for MS42171: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: AE33479
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE33479%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for AE33479: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: JR74397
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR74397%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for JR74397: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: VU57107
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: DX26542
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX26542%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for DX26542: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: SN70569
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN70569%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for SN70569: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: JD23265
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23265%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for JD23265: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: VR87804
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR87804%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for VR87804: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: KM31933
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: LW16241
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: YP91302
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP91302%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for YP91302: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: GG82433
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG82433%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for GG82433: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: EH94652
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH94652%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for EH94652: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: XV47342
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: VT28358
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: AD89648
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD89648%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for AD89648: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: YM49351
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: EP59038
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP59038%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for EP59038: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: XE63092
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: GS35122
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: VT89208
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: GA83394
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA83394%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for GA83394: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: VS58629
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS58629%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for VS58629: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: ND00067
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND00067%27 HTTP/1.1" 200 None
2026-03-30 10:56:48 [auto1.de] INFO: Scrape type for ND00067: 0
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: SH97654
2026-03-30 10:56:48 [auto1.de] INFO: Found listing with ID: KW34435
2026-03-30 10:56:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:49 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 9533 | hits on page: 40
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: KW34435
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: WB92909
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: WX92371
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX92371%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for WX92371: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: XY85080
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY85080%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for XY85080: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: SV18640
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: LL54952
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL54952%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for LL54952: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: DM70532
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70532%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for DM70532: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: EA23074
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: RM09243
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM09243%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for RM09243: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: CW91808
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: FK98396
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK98396%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for FK98396: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: TS14604
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: GA97720
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA97720%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for GA97720: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: CT77406
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT77406%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for CT77406: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: DB10875
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB10875%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for DB10875: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: JG98331
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: NH29659
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH29659%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for NH29659: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: JS22549
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: WU48136
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: KZ13921
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ13921%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for KZ13921: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: GR74650
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: XT03032
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT03032%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for XT03032: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: DZ69719
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: LC58523
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: XM80704
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: MS18756
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS18756%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for MS18756: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: BH54798
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH54798%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for BH54798: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: WU88616
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: ZM28041
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM28041%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for ZM28041: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: SM60062
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: UD08597
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD08597%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for UD08597: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: KU34267
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: CT69735
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT69735%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for CT69735: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: NA97113
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: KH68440
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: NM38216
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: DS39411
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: KA78171
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: DL52557
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL52557%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for DL52557: 0
2026-03-30 10:56:49 [auto1.de] INFO: Found listing with ID: KK91301
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK91301%27 HTTP/1.1" 200 None
2026-03-30 10:56:49 [auto1.de] INFO: Scrape type for KK91301: 0
2026-03-30 10:56:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:56:51 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 9533 | hits on page: 40
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: XP97772
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: AS97650
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS97650%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for AS97650: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: GJ82091
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: VV40094
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: WJ35456
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ35456%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for WJ35456: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: XF49404
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF49404%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for XF49404: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: KE08458
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: UM54862
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM54862%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for UM54862: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: TH95550
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: RL71472
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: XG52732
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG52732%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for XG52732: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: ZH99212
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: AF65109
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: VC66912
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: PF21402
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF21402%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for PF21402: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: FY91209
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91209%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for FY91209: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: HC53321
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: PT02757
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: UY83334
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: KD43899
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: CU14282
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: HN95943
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN95943%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for HN95943: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: YM22646
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: BU66338
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: UX53934
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: YU36554
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU36554%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for YU36554: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: RP11152
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: YZ97980
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ97980%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for YZ97980: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: SA90137
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: JW05825
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW05825%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for JW05825: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: AK76136
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: RN76659
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: MK13186
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: YZ92306
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ92306%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for YZ92306: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: FJ41734
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ41734%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for FJ41734: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: XS76137
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: DY62455
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY62455%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for DY62455: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: MM64069
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM64069%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for MM64069: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: TE08407
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE08407%27 HTTP/1.1" 200 None
2026-03-30 10:56:51 [auto1.de] INFO: Scrape type for TE08407: 0
2026-03-30 10:56:51 [auto1.de] INFO: Found listing with ID: GL59238
2026-03-30 10:56:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:03 [scrapy.extensions.logstats] INFO: Crawled 756 pages (at 10 pages/min), scraped 925 items (at 64 items/min)
2026-03-30 10:57:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 10:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:28 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 9536 | hits on page: 40
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: MM64069
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM64069%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for MM64069: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: TE08407
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE08407%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for TE08407: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: GL59238
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: CC88338
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: MG02873
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG02873%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for MG02873: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: LC10044
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: BY54192
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY54192%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for BY54192: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: PF70269
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: AF76763
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF76763%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for AF76763: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: YA34461
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA34461%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for YA34461: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: ES39418
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES39418%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for ES39418: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: VK59895
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK59895%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for VK59895: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: YC86222
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC86222%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for YC86222: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: HP20518
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP20518%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for HP20518: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: TA49456
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA49456%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for TA49456: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: YR12178
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: MR49496
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR49496%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for MR49496: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: MN22228
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN22228%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for MN22228: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: CR26660
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: PH88321
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: MD97257
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: FV82403
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: SR89713
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: EK84177
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: FB79973
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB79973%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for FB79973: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: YB11592
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: FJ58055
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: FC64824
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: BN35753
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: SA32858
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA32858%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for SA32858: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: JA20872
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: VN21885
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: KN60852
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN60852%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for KN60852: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: FL96741
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: HJ41200
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: PF91020
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: NF54912
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF54912%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for NF54912: 0
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: KK55590
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: WP07187
2026-03-30 10:57:28 [auto1.de] INFO: Found listing with ID: LH84474
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH84474%27 HTTP/1.1" 200 None
2026-03-30 10:57:28 [auto1.de] INFO: Scrape type for LH84474: 0
2026-03-30 10:57:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:30 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 9537 | hits on page: 40
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: LH84474
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH84474%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for LH84474: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: ZK41607
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK41607%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for ZK41607: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: YM31567
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: US29975
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US29975%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for US29975: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: TV42528
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: XK43796
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: CB34821
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB34821%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for CB34821: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: GU29210
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: UZ92171
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ92171%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for UZ92171: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: TA32643
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA32643%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for TA32643: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: VB44523
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: KU64879
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: YE54237
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: XZ96479
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ96479%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for XZ96479: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: SU53309
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: VL69924
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL69924%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for VL69924: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: VH72223
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH72223%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for VH72223: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: LN72061
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN72061%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for LN72061: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: YR94789
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: FU89113
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU89113%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for FU89113: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: LY71761
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY71761%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for LY71761: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: FE80519
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: MC31762
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC31762%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for MC31762: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: VZ67143
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ67143%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for VZ67143: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: EF20977
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: UD38277
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: DS53999
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS53999%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for DS53999: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: SG45173
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: AY72100
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: CL04690
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL04690%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for CL04690: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: UH91278
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH91278%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for UH91278: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: SG73532
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: HY62017
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: KM62528
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: AF02059
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF02059%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for AF02059: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: XC72019
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC72019%27 HTTP/1.1" 200 None
2026-03-30 10:57:30 [auto1.de] INFO: Scrape type for XC72019: 0
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: HG55526
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: AE75299
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: EL20809
2026-03-30 10:57:30 [auto1.de] INFO: Found listing with ID: RM36813
2026-03-30 10:57:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:31 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 9537 | hits on page: 40
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: ND85219
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: AH35551
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH35551%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for AH35551: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: EM14245
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM14245%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for EM14245: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: PV86472
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: VJ37696
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ37696%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for VJ37696: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: VY63136
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: GM66597
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: UZ22488
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ22488%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for UZ22488: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: PX60208
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: DE91366
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE91366%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for DE91366: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: TW83791
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: LC46015
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: GR51738
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: VE81778
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: HX51661
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX51661%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for HX51661: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: FK17584
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK17584%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for FK17584: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: ND90480
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: ZG41092
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG41092%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for ZG41092: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: WP00727
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: BZ91502
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: NC83571
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC83571%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for NC83571: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: XZ84287
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: SM33942
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM33942%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for SM33942: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: YW60751
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW60751%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for YW60751: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: PC62388
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: ZL97952
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL97952%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for ZL97952: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: YR16927
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR16927%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for YR16927: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: NY36854
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: XT70791
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: KW33977
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW33977%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for KW33977: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: TR81994
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR81994%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for TR81994: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: EE94897
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE94897%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for EE94897: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: LN73232
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN73232%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for LN73232: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: AY88007
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY88007%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for AY88007: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: CY03369
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY03369%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for CY03369: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: CM48950
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM48950%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for CM48950: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: GG80957
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG80957%27 HTTP/1.1" 200 None
2026-03-30 10:57:31 [auto1.de] INFO: Scrape type for GG80957: 0
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: UX22346
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: GB09367
2026-03-30 10:57:31 [auto1.de] INFO: Found listing with ID: EG89523
2026-03-30 10:57:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:32 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 9537 | hits on page: 40
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: PE93085
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: WM94615
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM94615%27 HTTP/1.1" 200 None
2026-03-30 10:57:32 [auto1.de] INFO: Scrape type for WM94615: 0
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: KV84716
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV84716%27 HTTP/1.1" 200 None
2026-03-30 10:57:32 [auto1.de] INFO: Scrape type for KV84716: 0
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: BS29922
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: DB31408
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: YK86609
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: WG79560
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: PC84380
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: GM71398
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM71398%27 HTTP/1.1" 200 None
2026-03-30 10:57:32 [auto1.de] INFO: Scrape type for GM71398: 0
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: ML46855
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML46855%27 HTTP/1.1" 200 None
2026-03-30 10:57:32 [auto1.de] INFO: Scrape type for ML46855: 0
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: YC00634
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: JD44610
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: WC68946
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: CM75281
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM75281%27 HTTP/1.1" 200 None
2026-03-30 10:57:32 [auto1.de] INFO: Scrape type for CM75281: 0
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: UN10442
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: BS87926
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: RY52055
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY52055%27 HTTP/1.1" 200 None
2026-03-30 10:57:32 [auto1.de] INFO: Scrape type for RY52055: 0
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: NE14712
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: CE86831
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: JC54567
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC54567%27 HTTP/1.1" 200 None
2026-03-30 10:57:32 [auto1.de] INFO: Scrape type for JC54567: 0
2026-03-30 10:57:32 [auto1.de] INFO: Found listing with ID: AJ98197
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ98197%27 HTTP/1.1" 200 None
2026-03-30 10:57:33 [auto1.de] INFO: Scrape type for AJ98197: 0
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: HA89318
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89318%27 HTTP/1.1" 200 None
2026-03-30 10:57:33 [auto1.de] INFO: Scrape type for HA89318: 0
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: LC13671
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC13671%27 HTTP/1.1" 200 None
2026-03-30 10:57:33 [auto1.de] INFO: Scrape type for LC13671: 0
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: GG09705
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: FJ28912
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: NT37937
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT37937%27 HTTP/1.1" 200 None
2026-03-30 10:57:33 [auto1.de] INFO: Scrape type for NT37937: 0
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: HK26466
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK26466%27 HTTP/1.1" 200 None
2026-03-30 10:57:33 [auto1.de] INFO: Scrape type for HK26466: 0
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: EG62319
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG62319%27 HTTP/1.1" 200 None
2026-03-30 10:57:33 [auto1.de] INFO: Scrape type for EG62319: 0
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: CT63766
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: MH30608
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: YF33441
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: VN84329
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: DK08351
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK08351%27 HTTP/1.1" 200 None
2026-03-30 10:57:33 [auto1.de] INFO: Scrape type for DK08351: 0
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: LU02094
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU02094%27 HTTP/1.1" 200 None
2026-03-30 10:57:33 [auto1.de] INFO: Scrape type for LU02094: 0
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: LX46621
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX46621%27 HTTP/1.1" 200 None
2026-03-30 10:57:33 [auto1.de] INFO: Scrape type for LX46621: 0
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: VJ16820
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: LC23112
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: SS89837
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: DE25074
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE25074%27 HTTP/1.1" 200 None
2026-03-30 10:57:33 [auto1.de] INFO: Scrape type for DE25074: 0
2026-03-30 10:57:33 [auto1.de] INFO: Found listing with ID: FF52766
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF52766%27 HTTP/1.1" 200 None
2026-03-30 10:57:33 [auto1.de] INFO: Scrape type for FF52766: 0
2026-03-30 10:57:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:34 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 9538 | hits on page: 40
2026-03-30 10:57:34 [auto1.de] INFO: Found listing with ID: FF52766
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF52766%27 HTTP/1.1" 200 None
2026-03-30 10:57:34 [auto1.de] INFO: Scrape type for FF52766: 0
2026-03-30 10:57:34 [auto1.de] INFO: Found listing with ID: CT52786
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT52786%27 HTTP/1.1" 200 None
2026-03-30 10:57:34 [auto1.de] INFO: Scrape type for CT52786: 0
2026-03-30 10:57:34 [auto1.de] INFO: Found listing with ID: VT05900
2026-03-30 10:57:34 [auto1.de] INFO: Found listing with ID: NR70794
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR70794%27 HTTP/1.1" 200 None
2026-03-30 10:57:34 [auto1.de] INFO: Scrape type for NR70794: 0
2026-03-30 10:57:34 [auto1.de] INFO: Found listing with ID: MS10711
2026-03-30 10:57:34 [auto1.de] INFO: Found listing with ID: YK91002
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK91002%27 HTTP/1.1" 200 None
2026-03-30 10:57:34 [auto1.de] INFO: Scrape type for YK91002: 0
2026-03-30 10:57:34 [auto1.de] INFO: Found listing with ID: ZF79650
2026-03-30 10:57:34 [auto1.de] INFO: Found listing with ID: TR42945
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR42945%27 HTTP/1.1" 200 None
2026-03-30 10:57:34 [auto1.de] INFO: Scrape type for TR42945: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: DA75370
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: TN32839
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32839%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for TN32839: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: SY11471
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: CF57490
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF57490%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for CF57490: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: XA59462
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: XE05025
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05025%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for XE05025: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: RH52660
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH52660%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for RH52660: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: UC30179
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: SV97177
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV97177%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for SV97177: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: MK30505
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK30505%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for MK30505: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: FM76670
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM76670%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for FM76670: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: XF39485
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF39485%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for XF39485: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: XH71010
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: LD10656
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD10656%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for LD10656: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: MS24005
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: XL44945
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: UX16759
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX16759%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for UX16759: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: WU59517
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU59517%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for WU59517: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: ND84220
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: SB50693
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB50693%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for SB50693: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: AS63846
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS63846%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for AS63846: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: DZ51927
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: ZD23730
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD23730%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for ZD23730: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: YK76722
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: LX13795
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX13795%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for LX13795: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: HE06850
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE06850%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for HE06850: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: EB21377
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB21377%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for EB21377: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: FU32442
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: NH59879
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH59879%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for NH59879: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: HE72355
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE72355%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for HE72355: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: SC06159
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06159%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for SC06159: 0
2026-03-30 10:57:35 [auto1.de] INFO: Found listing with ID: WD01270
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD01270%27 HTTP/1.1" 200 None
2026-03-30 10:57:35 [auto1.de] INFO: Scrape type for WD01270: 0
2026-03-30 10:57:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:36 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 9538 | hits on page: 40
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: FP18966
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP18966%27 HTTP/1.1" 200 None
2026-03-30 10:57:36 [auto1.de] INFO: Scrape type for FP18966: 0
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: LU76842
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU76842%27 HTTP/1.1" 200 None
2026-03-30 10:57:36 [auto1.de] INFO: Scrape type for LU76842: 0
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: HE37410
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE37410%27 HTTP/1.1" 200 None
2026-03-30 10:57:36 [auto1.de] INFO: Scrape type for HE37410: 0
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: EN21542
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN21542%27 HTTP/1.1" 200 None
2026-03-30 10:57:36 [auto1.de] INFO: Scrape type for EN21542: 0
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: PW82256
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: ZU35260
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: LT86298
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT86298%27 HTTP/1.1" 200 None
2026-03-30 10:57:36 [auto1.de] INFO: Scrape type for LT86298: 0
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: KK61253
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: KK35526
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: VW77341
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW77341%27 HTTP/1.1" 200 None
2026-03-30 10:57:36 [auto1.de] INFO: Scrape type for VW77341: 0
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: WZ77198
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ77198%27 HTTP/1.1" 200 None
2026-03-30 10:57:36 [auto1.de] INFO: Scrape type for WZ77198: 0
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: TG94099
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: YU83796
2026-03-30 10:57:36 [auto1.de] INFO: Found listing with ID: UC27013
2026-03-30 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC27013%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for UC27013: 0
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: HJ07036
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ07036%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for HJ07036: 0
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: ZL07849
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: CK09368
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: TX17036
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: NH50671
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH50671%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for NH50671: 0
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: JZ46683
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ46683%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for JZ46683: 0
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: KT14337
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: VP04465
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP04465%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for VP04465: 0
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: SE69152
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: UH00780
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: NN66793
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: MB72804
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB72804%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for MB72804: 0
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: XL83626
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL83626%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for XL83626: 0
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: NH44567
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: YB27715
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB27715%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for YB27715: 0
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: RC35240
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: CN96399
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: SW53580
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW53580%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for SW53580: 0
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: CM53141
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM53141%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for CM53141: 0
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: BR53160
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: ZU01908
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU01908%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for ZU01908: 0
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: SB15541
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB15541%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for SB15541: 0
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: CX00387
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: ZJ50870
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ50870%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for ZJ50870: 0
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: SA09294
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA09294%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for SA09294: 0
2026-03-30 10:57:37 [auto1.de] INFO: Found listing with ID: US58549
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US58549%27 HTTP/1.1" 200 None
2026-03-30 10:57:37 [auto1.de] INFO: Scrape type for US58549: 0
2026-03-30 10:57:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:38 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 9538 | hits on page: 40
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: XS09920
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS09920%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for XS09920: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: TB77328
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: TH98147
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH98147%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for TH98147: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: RE75426
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: ML92935
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: RZ20134
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ20134%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for RZ20134: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: SB11032
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: GW45177
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW45177%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for GW45177: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: PH37878
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: TS70088
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: SR07530
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR07530%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for SR07530: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: ZG29710
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: HH97697
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH97697%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for HH97697: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: LZ90334
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: CD25494
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: XV83798
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: XC52601
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: EA67051
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: ZB59914
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59914%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for ZB59914: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: TJ43394
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ43394%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for TJ43394: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: LS48573
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS48573%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for LS48573: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: ZT46656
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT46656%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for ZT46656: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: EV60549
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: XP13096
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: LZ55907
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: PY11088
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY11088%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for PY11088: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: NC09398
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC09398%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for NC09398: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: RY54075
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY54075%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for RY54075: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: SN65200
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: GW59315
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: KP40220
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP40220%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for KP40220: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: LE91288
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE91288%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for LE91288: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: MZ36812
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: FM88493
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: KX98673
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98673%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for KX98673: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: XW15114
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: TC34492
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: CL81037
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: CX20587
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX20587%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for CX20587: 0
2026-03-30 10:57:38 [auto1.de] INFO: Found listing with ID: FA98768
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA98768%27 HTTP/1.1" 200 None
2026-03-30 10:57:38 [auto1.de] INFO: Scrape type for FA98768: 0
2026-03-30 10:57:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:39 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 9538 | hits on page: 40
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: VE81864
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE81864%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Scrape type for VE81864: 0
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: TD89084
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: NA47397
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA47397%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Scrape type for NA47397: 0
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: NJ85165
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ85165%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Scrape type for NJ85165: 0
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: MS93141
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS93141%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Scrape type for MS93141: 0
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: PY91444
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: MT16554
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT16554%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Scrape type for MT16554: 0
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: UJ03238
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ03238%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Scrape type for UJ03238: 0
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: MJ68387
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ68387%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Scrape type for MJ68387: 0
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: CL53186
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL53186%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Scrape type for CL53186: 0
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: ZT52694
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT52694%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Scrape type for ZT52694: 0
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: VG52459
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: HX90718
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: VD66153
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: ZE47556
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: UX02896
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX02896%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Scrape type for UX02896: 0
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: DD06486
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD06486%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Scrape type for DD06486: 0
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: BF72847
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF72847%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Scrape type for BF72847: 0
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: GB26940
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB26940%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Scrape type for GB26940: 0
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: VT33840
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: GC65720
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: FG52095
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG52095%27 HTTP/1.1" 200 None
2026-03-30 10:57:39 [auto1.de] INFO: Scrape type for FG52095: 0
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: HR38686
2026-03-30 10:57:39 [auto1.de] INFO: Found listing with ID: VK11112
2026-03-30 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK11112%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Scrape type for VK11112: 0
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: CX31809
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX31809%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Scrape type for CX31809: 0
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: XR03491
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR03491%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Scrape type for XR03491: 0
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: XN56575
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: CX99229
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX99229%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Scrape type for CX99229: 0
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: UB29489
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB29489%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Scrape type for UB29489: 0
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: EC79499
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79499%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Scrape type for EC79499: 0
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: ZW29576
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW29576%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Scrape type for ZW29576: 0
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: RJ65711
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ65711%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Scrape type for RJ65711: 0
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: PT66900
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT66900%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Scrape type for PT66900: 0
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: AH96089
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: MM27884
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: DD72399
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD72399%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Scrape type for DD72399: 0
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: BZ48067
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: LE66161
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE66161%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Scrape type for LE66161: 0
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: UA27287
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA27287%27 HTTP/1.1" 200 None
2026-03-30 10:57:40 [auto1.de] INFO: Scrape type for UA27287: 0
2026-03-30 10:57:40 [auto1.de] INFO: Found listing with ID: ME76972
2026-03-30 10:57:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:41 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 9538 | hits on page: 40
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: TG05254
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: JA57202
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: SK58991
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: XZ11049
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: NF89910
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF89910%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for NF89910: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: FE38357
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: ZX71728
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: ZM89162
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: DW65340
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW65340%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for DW65340: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: MU67757
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU67757%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for MU67757: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: PC88628
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: KL56138
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL56138%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for KL56138: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: GD26673
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: HT75427
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: YK11401
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK11401%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for YK11401: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: FH85509
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: GT95887
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: RY03254
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY03254%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for RY03254: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: HC65117
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC65117%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for HC65117: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: GB84908
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB84908%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for GB84908: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: EK94658
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK94658%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for EK94658: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: ED11962
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED11962%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for ED11962: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: VN83925
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: XT16299
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT16299%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for XT16299: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: UP75905
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: MY33164
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: VF16052
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: XX48334
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX48334%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for XX48334: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: DB70642
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: HR43739
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR43739%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for HR43739: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: EG30770
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: SK51252
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: HT21123
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT21123%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for HT21123: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: DZ62505
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ62505%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for DZ62505: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: WH88293
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH88293%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for WH88293: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: RF59698
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF59698%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for RF59698: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: XW26615
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: UM20037
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM20037%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for UM20037: 0
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: JB45196
2026-03-30 10:57:41 [auto1.de] INFO: Found listing with ID: CW07169
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW07169%27 HTTP/1.1" 200 None
2026-03-30 10:57:41 [auto1.de] INFO: Scrape type for CW07169: 0
2026-03-30 10:57:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:43 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 9538 | hits on page: 40
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: CS17567
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS17567%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for CS17567: 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: LY36951
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: CX43876
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX43876%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for CX43876: 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: UX30776
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: SP41930
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: MF04152
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: GJ50570
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: VR14324
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: PA10623
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: YF78149
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: ZB29861
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: RM92330
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: KU93017
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: AD78216
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: JH04930
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH04930%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for JH04930: 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: VK94539
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK94539%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for VK94539: 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: SZ33813
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: EL52621
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: DV12193
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV12193%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for DV12193: 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: GK03673
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK03673%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for GK03673: 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: RY37161
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY37161%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for RY37161: 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: UU64568
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU64568%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for UU64568: 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: AN57238
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN57238%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for AN57238: 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: FY49050
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: EA94412
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: KD88298
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: HD75815
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: AL25278
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: VW31483
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW31483%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for VW31483: 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: UN85261
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: DE44108
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: PS73688
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS73688%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for PS73688: 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: HK59987
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK59987%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for HK59987: 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: KU46528
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: GG93073
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG93073%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for GG93073: 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: JV37184
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37184%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for JV37184: 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: CS96512
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS96512%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for CS96512: 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: AV64350
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV64350%27 HTTP/1.1" 200 None
2026-03-30 10:57:43 [auto1.de] INFO: Scrape type for AV64350: 0
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: FN76281
2026-03-30 10:57:43 [auto1.de] INFO: Found listing with ID: TT64948
2026-03-30 10:57:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:44 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 9538 | hits on page: 40
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: YM08945
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: KB35641
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: AC60710
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: HB23810
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB23810%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for HB23810: 0
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: PJ19730
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: TD77753
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: BF77211
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: PN21197
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: MJ18001
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ18001%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for MJ18001: 0
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: AE43577
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: YG65441
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG65441%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for YG65441: 0
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: AG29353
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: TZ85703
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: UR86054
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: TY20529
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY20529%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for TY20529: 0
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: RX59443
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: UB75058
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: TE16173
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE16173%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for TE16173: 0
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: SC19124
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC19124%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for SC19124: 0
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: YT41914
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT41914%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for YT41914: 0
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: SV96004
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV96004%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for SV96004: 0
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: CF37997
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: FA11917
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: DX58927
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: XD63498
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD63498%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for XD63498: 0
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: JB86449
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86449%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for JB86449: 0
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: WP35762
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: UZ06003
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: FU96820
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU96820%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for FU96820: 0
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: LZ51048
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: CS88634
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: VV53605
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: YS60575
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: HL59368
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL59368%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for HL59368: 0
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: DG33425
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: GD75642
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: DB45885
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: SF11828
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF11828%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for SF11828: 0
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: RY63211
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY63211%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for RY63211: 0
2026-03-30 10:57:44 [auto1.de] INFO: Found listing with ID: RM00087
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM00087%27 HTTP/1.1" 200 None
2026-03-30 10:57:44 [auto1.de] INFO: Scrape type for RM00087: 0
2026-03-30 10:57:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:45 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 9539 | hits on page: 40
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: RM00087
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM00087%27 HTTP/1.1" 200 None
2026-03-30 10:57:45 [auto1.de] INFO: Scrape type for RM00087: 0
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: JE79553
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: LM55241
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: HH37402
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH37402%27 HTTP/1.1" 200 None
2026-03-30 10:57:45 [auto1.de] INFO: Scrape type for HH37402: 0
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: GN88157
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN88157%27 HTTP/1.1" 200 None
2026-03-30 10:57:45 [auto1.de] INFO: Scrape type for GN88157: 0
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: TN02521
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: DJ06926
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: HP46959
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: EP15828
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: CD29935
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: BX02893
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: TF97551
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: UW91893
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: RD82198
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD82198%27 HTTP/1.1" 200 None
2026-03-30 10:57:45 [auto1.de] INFO: Scrape type for RD82198: 0
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: HH96934
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: YR25521
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: TF02726
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF02726%27 HTTP/1.1" 200 None
2026-03-30 10:57:45 [auto1.de] INFO: Scrape type for TF02726: 0
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: RE43747
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: KJ12622
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ12622%27 HTTP/1.1" 200 None
2026-03-30 10:57:45 [auto1.de] INFO: Scrape type for KJ12622: 0
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: HG84341
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: MB78581
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: BP06971
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP06971%27 HTTP/1.1" 200 None
2026-03-30 10:57:45 [auto1.de] INFO: Scrape type for BP06971: 0
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: ET95564
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET95564%27 HTTP/1.1" 200 None
2026-03-30 10:57:45 [auto1.de] INFO: Scrape type for ET95564: 0
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: TB48945
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB48945%27 HTTP/1.1" 200 None
2026-03-30 10:57:45 [auto1.de] INFO: Scrape type for TB48945: 0
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: KP65433
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: LG15498
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG15498%27 HTTP/1.1" 200 None
2026-03-30 10:57:45 [auto1.de] INFO: Scrape type for LG15498: 0
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: VG83409
2026-03-30 10:57:45 [auto1.de] INFO: Found listing with ID: PV53792
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV53792%27 HTTP/1.1" 200 None
2026-03-30 10:57:46 [auto1.de] INFO: Scrape type for PV53792: 0
2026-03-30 10:57:46 [auto1.de] INFO: Found listing with ID: BN18490
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN18490%27 HTTP/1.1" 200 None
2026-03-30 10:57:46 [auto1.de] INFO: Scrape type for BN18490: 0
2026-03-30 10:57:46 [auto1.de] INFO: Found listing with ID: XD17470
2026-03-30 10:57:46 [auto1.de] INFO: Found listing with ID: FN61491
2026-03-30 10:57:46 [auto1.de] INFO: Found listing with ID: FK15614
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK15614%27 HTTP/1.1" 200 None
2026-03-30 10:57:46 [auto1.de] INFO: Scrape type for FK15614: 0
2026-03-30 10:57:46 [auto1.de] INFO: Found listing with ID: BN13564
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN13564%27 HTTP/1.1" 200 None
2026-03-30 10:57:46 [auto1.de] INFO: Scrape type for BN13564: 0
2026-03-30 10:57:46 [auto1.de] INFO: Found listing with ID: TC53143
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC53143%27 HTTP/1.1" 200 None
2026-03-30 10:57:46 [auto1.de] INFO: Scrape type for TC53143: 0
2026-03-30 10:57:46 [auto1.de] INFO: Found listing with ID: DP33373
2026-03-30 10:57:46 [auto1.de] INFO: Found listing with ID: RS49275
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS49275%27 HTTP/1.1" 200 None
2026-03-30 10:57:46 [auto1.de] INFO: Scrape type for RS49275: 0
2026-03-30 10:57:46 [auto1.de] INFO: Found listing with ID: NT12498
2026-03-30 10:57:46 [auto1.de] INFO: Found listing with ID: AF38150
2026-03-30 10:57:46 [auto1.de] INFO: Found listing with ID: HU95530
2026-03-30 10:57:46 [auto1.de] INFO: Found listing with ID: DR13547
2026-03-30 10:57:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:47 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 9539 | hits on page: 40
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: EW76258
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: AV87266
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV87266%27 HTTP/1.1" 200 None
2026-03-30 10:57:47 [auto1.de] INFO: Scrape type for AV87266: 0
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: PV47102
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV47102%27 HTTP/1.1" 200 None
2026-03-30 10:57:47 [auto1.de] INFO: Scrape type for PV47102: 0
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: AU31378
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU31378%27 HTTP/1.1" 200 None
2026-03-30 10:57:47 [auto1.de] INFO: Scrape type for AU31378: 0
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: GZ16727
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: RW74261
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: UW81873
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: US20964
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US20964%27 HTTP/1.1" 200 None
2026-03-30 10:57:47 [auto1.de] INFO: Scrape type for US20964: 0
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: YG60561
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: MU83144
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: DN83607
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: CH63331
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: AW55090
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: DF41364
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF41364%27 HTTP/1.1" 200 None
2026-03-30 10:57:47 [auto1.de] INFO: Scrape type for DF41364: 0
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: KS24021
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: FG90508
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG90508%27 HTTP/1.1" 200 None
2026-03-30 10:57:47 [auto1.de] INFO: Scrape type for FG90508: 0
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: HX93212
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: YM41627
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM41627%27 HTTP/1.1" 200 None
2026-03-30 10:57:47 [auto1.de] INFO: Scrape type for YM41627: 0
2026-03-30 10:57:47 [auto1.de] INFO: Found listing with ID: DW80278
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW80278%27 HTTP/1.1" 200 None
2026-03-30 10:57:47 [auto1.de] INFO: Scrape type for DW80278: 0
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: FH27884
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH27884%27 HTTP/1.1" 200 None
2026-03-30 10:57:48 [auto1.de] INFO: Scrape type for FH27884: 0
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: YE99980
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: NE04560
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: JT04540
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT04540%27 HTTP/1.1" 200 None
2026-03-30 10:57:48 [auto1.de] INFO: Scrape type for JT04540: 0
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: AN60739
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN60739%27 HTTP/1.1" 200 None
2026-03-30 10:57:48 [auto1.de] INFO: Scrape type for AN60739: 0
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: BM26089
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM26089%27 HTTP/1.1" 200 None
2026-03-30 10:57:48 [auto1.de] INFO: Scrape type for BM26089: 0
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: YY75784
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY75784%27 HTTP/1.1" 200 None
2026-03-30 10:57:48 [auto1.de] INFO: Scrape type for YY75784: 0
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: SY47476
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: HN83229
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: AF40953
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF40953%27 HTTP/1.1" 200 None
2026-03-30 10:57:48 [auto1.de] INFO: Scrape type for AF40953: 0
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: VC76519
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC76519%27 HTTP/1.1" 200 None
2026-03-30 10:57:48 [auto1.de] INFO: Scrape type for VC76519: 0
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: PS21174
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: YJ43291
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: MM49725
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: TZ88543
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ88543%27 HTTP/1.1" 200 None
2026-03-30 10:57:48 [auto1.de] INFO: Scrape type for TZ88543: 0
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: AL17171
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: VZ09254
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ09254%27 HTTP/1.1" 200 None
2026-03-30 10:57:48 [auto1.de] INFO: Scrape type for VZ09254: 0
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: SS05467
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS05467%27 HTTP/1.1" 200 None
2026-03-30 10:57:48 [auto1.de] INFO: Scrape type for SS05467: 0
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: RF02857
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: ZM27094
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM27094%27 HTTP/1.1" 200 None
2026-03-30 10:57:48 [auto1.de] INFO: Scrape type for ZM27094: 0
2026-03-30 10:57:48 [auto1.de] INFO: Found listing with ID: GF71499
2026-03-30 10:57:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:58 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 9541 | hits on page: 40
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: ZM27094
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM27094%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for ZM27094: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: GF71499
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: EN37654
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: SK33918
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: VV18496
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV18496%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for VV18496: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: BN15380
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: TE38995
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE38995%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for TE38995: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: GM10989
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: KX99318
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX99318%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for KX99318: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: UC44293
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC44293%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for UC44293: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: DT29379
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT29379%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for DT29379: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: MY20439
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: MM40978
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: PX34024
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX34024%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for PX34024: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: NZ57035
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: FT91283
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: LH58112
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH58112%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for LH58112: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: HJ00196
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: CD55313
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: LY25058
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: FA41844
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: ST24513
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST24513%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for ST24513: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: ZY45638
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY45638%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for ZY45638: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: ZS74444
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: ET18482
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: SV36392
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV36392%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for SV36392: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: AV80430
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: EK76620
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK76620%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for EK76620: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: GX57450
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX57450%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for GX57450: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: ZW22441
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW22441%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for ZW22441: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: VS99519
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: FR72780
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR72780%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for FR72780: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: ZS81921
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: YR18351
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: BP99192
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: TK82535
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK82535%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for TK82535: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: SR73766
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: NR41937
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR41937%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for NR41937: 0
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: JD16678
2026-03-30 10:57:58 [auto1.de] INFO: Found listing with ID: DP71871
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP71871%27 HTTP/1.1" 200 None
2026-03-30 10:57:58 [auto1.de] INFO: Scrape type for DP71871: 0
2026-03-30 10:57:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:57:59 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 9541 | hits on page: 40
2026-03-30 10:57:59 [auto1.de] INFO: Found listing with ID: PC52157
2026-03-30 10:57:59 [auto1.de] INFO: Found listing with ID: YL08953
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL08953%27 HTTP/1.1" 200 None
2026-03-30 10:57:59 [auto1.de] INFO: Scrape type for YL08953: 0
2026-03-30 10:57:59 [auto1.de] INFO: Found listing with ID: RS18612
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS18612%27 HTTP/1.1" 200 None
2026-03-30 10:57:59 [auto1.de] INFO: Scrape type for RS18612: 0
2026-03-30 10:57:59 [auto1.de] INFO: Found listing with ID: AB94973
2026-03-30 10:57:59 [auto1.de] INFO: Found listing with ID: VL32137
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL32137%27 HTTP/1.1" 200 None
2026-03-30 10:57:59 [auto1.de] INFO: Scrape type for VL32137: 0
2026-03-30 10:57:59 [auto1.de] INFO: Found listing with ID: DB97906
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB97906%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for DB97906: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: DZ46114
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: ZL58365
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL58365%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for ZL58365: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: SH12390
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: ED21052
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: KB70594
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB70594%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for KB70594: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: JF05487
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF05487%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for JF05487: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: XE53561
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE53561%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for XE53561: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: ZS93402
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS93402%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for ZS93402: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: TS21217
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS21217%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for TS21217: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: VC14600
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: EN27989
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: BP13198
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: PV48618
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV48618%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for PV48618: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: WM91773
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91773%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for WM91773: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: JB80786
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: MJ09553
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: JA13261
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: FV55966
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV55966%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for FV55966: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: SY32033
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY32033%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for SY32033: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: FY66164
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY66164%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for FY66164: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: FG89265
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG89265%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for FG89265: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: NJ23402
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: VM87282
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: SJ00642
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: KP36820
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP36820%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for KP36820: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: SN63221
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN63221%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for SN63221: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: EM09093
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM09093%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for EM09093: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: GH85781
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: LV95619
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: HT22196
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: XY36888
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY36888%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for XY36888: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: ZS85717
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85717%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for ZS85717: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: KC21551
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC21551%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for KC21551: 0
2026-03-30 10:58:00 [auto1.de] INFO: Found listing with ID: GF22355
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF22355%27 HTTP/1.1" 200 None
2026-03-30 10:58:00 [auto1.de] INFO: Scrape type for GF22355: 0
2026-03-30 10:58:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:58:01 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 9542 | hits on page: 40
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: GF22355
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF22355%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for GF22355: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: VX60164
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX60164%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for VX60164: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: VV62637
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV62637%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for VV62637: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: BY75346
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: CC27418
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: HT72839
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: SW78620
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW78620%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for SW78620: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: XC84450
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC84450%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for XC84450: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: LT35519
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT35519%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for LT35519: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: UY47574
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY47574%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for UY47574: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: RC64435
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64435%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for RC64435: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: KU11171
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU11171%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for KU11171: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: JB30434
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB30434%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for JB30434: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: MP54327
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP54327%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for MP54327: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: KG86059
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: FZ65862
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: XU97028
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: TF75057
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF75057%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for TF75057: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: TG66732
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG66732%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for TG66732: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: KX83375
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX83375%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for KX83375: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: DM93215
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: EK40849
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK40849%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for EK40849: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: PU51927
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU51927%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for PU51927: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: PL78548
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78548%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for PL78548: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: FD53596
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD53596%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for FD53596: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: RD37486
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD37486%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for RD37486: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: HW52746
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW52746%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for HW52746: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: PX20909
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: CL67420
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL67420%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for CL67420: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: CC87438
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC87438%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for CC87438: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: KA69379
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69379%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for KA69379: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: WM40779
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: CJ14168
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ14168%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for CJ14168: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: FR51775
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR51775%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for FR51775: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: VP95743
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: BV91761
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV91761%27 HTTP/1.1" 200 None
2026-03-30 10:58:01 [auto1.de] INFO: Scrape type for BV91761: 0
2026-03-30 10:58:01 [auto1.de] INFO: Found listing with ID: UP50948
2026-03-30 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP50948%27 HTTP/1.1" 200 None
2026-03-30 10:58:02 [auto1.de] INFO: Scrape type for UP50948: 0
2026-03-30 10:58:02 [auto1.de] INFO: Found listing with ID: CY77324
2026-03-30 10:58:02 [auto1.de] INFO: Found listing with ID: TX22736
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX22736%27 HTTP/1.1" 200 None
2026-03-30 10:58:02 [auto1.de] INFO: Scrape type for TX22736: 0
2026-03-30 10:58:02 [auto1.de] INFO: Found listing with ID: KP46159
2026-03-30 10:58:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:03 [scrapy.extensions.logstats] INFO: Crawled 772 pages (at 16 pages/min), scraped 925 items (at 0 items/min)
2026-03-30 10:58:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 10:58:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:58:04 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 9542 | hits on page: 40
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: YF64568
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF64568%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for YF64568: 0
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: AA32108
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: EN61962
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN61962%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for EN61962: 0
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: ZG21023
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG21023%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for ZG21023: 0
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: BB43937
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB43937%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for BB43937: 0
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: XC39500
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: SZ69357
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ69357%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for SZ69357: 0
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: BP51481
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: MU18409
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: AA81624
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: XW22041
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW22041%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for XW22041: 0
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: MV69505
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: GT74179
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: ZP13586
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: LT01619
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: YW85241
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: UX63116
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: BX27275
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: XK12555
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: ZJ08126
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ08126%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for ZJ08126: 0
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: VN44067
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN44067%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for VN44067: 0
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: BR93746
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR93746%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for BR93746: 0
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62397%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for PC62397: 0
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV60507%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for JV60507: 0
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR63828%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for ZR63828: 0
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: PW74632
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: ME72449
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN45872%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for GN45872: 0
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72396%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for RV72396: 0
2026-03-30 10:58:04 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88253%27 HTTP/1.1" 200 None
2026-03-30 10:58:04 [auto1.de] INFO: Scrape type for PY88253: 2
2026-03-30 10:58:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75c6bbf5-cd1a-5123-a7ef-9c6280ff4c85 with identifier: PY88253
2026-03-30 10:58:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75c6bbf5-cd1a-5123-a7ef-9c6280ff4c85 with scrape type 2
2026-03-30 10:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75c6bbf5-cd1a-5123-a7ef-9c6280ff4c85 with scrape type 2
2026-03-30 10:58:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75c6bbf5-cd1a-5123-a7ef-9c6280ff4c85, identifier: PY88253
2026-03-30 10:58:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75c6bbf5-cd1a-5123-a7ef-9c6280ff4c85 with identifier: PY88253
2026-03-30 10:58:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75c6bbf5-cd1a-5123-a7ef-9c6280ff4c85 with identifier: PY88253
2026-03-30 10:58:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75c6bbf5-cd1a-5123-a7ef-9c6280ff4c85 with identifier: PY88253 to the API
2026-03-30 10:58:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:49:28Z',
 'fuel_type': 'petrol',
 'id': '75c6bbf5-cd1a-5123-a7ef-9c6280ff4c85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY88253',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 243875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-05',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 FSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88253%27 HTTP/1.1" 200 None
2026-03-30 10:58:05 [auto1.de] INFO: Saving data for PY88253: {'auction_closing_time': 1774885768.0, 'created_time': 1774637471.782482, 'last_price_update_time': 1774868285.178367}
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY88253') HTTP/1.1" 204 0
2026-03-30 10:58:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:05 [auto1.de] INFO: Found listing with ID: GE15008
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE15008%27 HTTP/1.1" 200 None
2026-03-30 10:58:05 [auto1.de] INFO: Scrape type for GE15008: 2
2026-03-30 10:58:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eef62774-b546-5532-8e6c-22f5401805e0 with identifier: GE15008
2026-03-30 10:58:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eef62774-b546-5532-8e6c-22f5401805e0 with scrape type 2
2026-03-30 10:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eef62774-b546-5532-8e6c-22f5401805e0 with scrape type 2
2026-03-30 10:58:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eef62774-b546-5532-8e6c-22f5401805e0, identifier: GE15008
2026-03-30 10:58:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eef62774-b546-5532-8e6c-22f5401805e0 with identifier: GE15008
2026-03-30 10:58:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eef62774-b546-5532-8e6c-22f5401805e0 with identifier: GE15008
2026-03-30 10:58:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eef62774-b546-5532-8e6c-22f5401805e0 with identifier: GE15008 to the API
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:39:40Z',
 'fuel_type': 'petrol',
 'id': 'eef62774-b546-5532-8e6c-22f5401805e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE15008',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 62240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-21',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.2 PureTech Seduction',
 'transmission': 'manual',
 'trim': 'Seduction',
 'year': 2016}
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE15008%27 HTTP/1.1" 200 None
2026-03-30 10:58:05 [auto1.de] INFO: Saving data for GE15008: {'auction_closing_time': 1774885180.0, 'created_time': 1773427925.471678, 'last_price_update_time': 1774868285.947009}
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE15008') HTTP/1.1" 204 0
2026-03-30 10:58:05 [auto1.de] INFO: Found listing with ID: SA16616
2026-03-30 10:58:05 [auto1.de] INFO: Found listing with ID: FH74417
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH74417%27 HTTP/1.1" 200 None
2026-03-30 10:58:05 [auto1.de] INFO: Scrape type for FH74417: 2
2026-03-30 10:58:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89e9e7b3-0326-5acb-a298-430d509a6015 with identifier: FH74417
2026-03-30 10:58:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89e9e7b3-0326-5acb-a298-430d509a6015 with scrape type 2
2026-03-30 10:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89e9e7b3-0326-5acb-a298-430d509a6015 with scrape type 2
2026-03-30 10:58:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89e9e7b3-0326-5acb-a298-430d509a6015, identifier: FH74417
2026-03-30 10:58:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89e9e7b3-0326-5acb-a298-430d509a6015 with identifier: FH74417
2026-03-30 10:58:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89e9e7b3-0326-5acb-a298-430d509a6015 with identifier: FH74417
2026-03-30 10:58:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89e9e7b3-0326-5acb-a298-430d509a6015 with identifier: FH74417 to the API
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:25:19Z',
 'fuel_type': 'petrol',
 'id': '89e9e7b3-0326-5acb-a298-430d509a6015',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH74417',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Agila',
 'odometer': 101214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-06',
 'seller_name': None,
 'title': 'Opel Agila 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2006}
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH74417%27 HTTP/1.1" 200 None
2026-03-30 10:58:06 [auto1.de] INFO: Saving data for FH74417: {'auction_closing_time': 1774884319.0, 'created_time': 1773427108.757869, 'last_price_update_time': 1774868286.330912}
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH74417') HTTP/1.1" 204 0
2026-03-30 10:58:06 [auto1.de] INFO: Found listing with ID: RG72110
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG72110%27 HTTP/1.1" 200 None
2026-03-30 10:58:06 [auto1.de] INFO: Scrape type for RG72110: 2
2026-03-30 10:58:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0877b22f-dbfc-5a33-ac77-b84c59a694c2 with identifier: RG72110
2026-03-30 10:58:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0877b22f-dbfc-5a33-ac77-b84c59a694c2 with scrape type 2
2026-03-30 10:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0877b22f-dbfc-5a33-ac77-b84c59a694c2 with scrape type 2
2026-03-30 10:58:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0877b22f-dbfc-5a33-ac77-b84c59a694c2, identifier: RG72110
2026-03-30 10:58:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0877b22f-dbfc-5a33-ac77-b84c59a694c2 with identifier: RG72110
2026-03-30 10:58:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0877b22f-dbfc-5a33-ac77-b84c59a694c2 with identifier: RG72110
2026-03-30 10:58:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0877b22f-dbfc-5a33-ac77-b84c59a694c2 with identifier: RG72110 to the API
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:04:54Z',
 'fuel_type': 'petrol',
 'id': '0877b22f-dbfc-5a33-ac77-b84c59a694c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG72110',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 114028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-10',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG72110%27 HTTP/1.1" 200 None
2026-03-30 10:58:06 [auto1.de] INFO: Saving data for RG72110: {'auction_closing_time': 1774883094.0, 'created_time': 1774551744.491053, 'last_price_update_time': 1774868286.713152}
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG72110') HTTP/1.1" 204 0
2026-03-30 10:58:06 [auto1.de] INFO: Found listing with ID: HN36676
2026-03-30 10:58:06 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-30 10:58:06 [auto1.de] INFO: Found listing with ID: AB70277
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB70277%27 HTTP/1.1" 200 None
2026-03-30 10:58:06 [auto1.de] INFO: Scrape type for AB70277: 2
2026-03-30 10:58:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebc2c45f-6c3d-5f0c-a84d-406887c2f31b with identifier: AB70277
2026-03-30 10:58:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebc2c45f-6c3d-5f0c-a84d-406887c2f31b with scrape type 2
2026-03-30 10:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebc2c45f-6c3d-5f0c-a84d-406887c2f31b with scrape type 2
2026-03-30 10:58:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebc2c45f-6c3d-5f0c-a84d-406887c2f31b, identifier: AB70277
2026-03-30 10:58:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebc2c45f-6c3d-5f0c-a84d-406887c2f31b with identifier: AB70277
2026-03-30 10:58:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebc2c45f-6c3d-5f0c-a84d-406887c2f31b with identifier: AB70277
2026-03-30 10:58:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebc2c45f-6c3d-5f0c-a84d-406887c2f31b with identifier: AB70277 to the API
2026-03-30 10:58:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:24:03Z',
 'fuel_type': 'petrol',
 'id': 'ebc2c45f-6c3d-5f0c-a84d-406887c2f31b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB70277',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 46386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-07',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2020}
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB70277%27 HTTP/1.1" 200 None
2026-03-30 10:58:07 [auto1.de] INFO: Saving data for AB70277: {'auction_closing_time': 1774884243.0, 'created_time': 1774780539.750724, 'last_price_update_time': 1774868287.129378}
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB70277') HTTP/1.1" 204 0
2026-03-30 10:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:58:07 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 9541 | hits on page: 40
2026-03-30 10:58:07 [auto1.de] INFO: Found listing with ID: HM22337
2026-03-30 10:58:07 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34146%27 HTTP/1.1" 200 None
2026-03-30 10:58:07 [auto1.de] INFO: Scrape type for PJ34146: 2
2026-03-30 10:58:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a28deb8-8b6a-5aae-ba24-fce951aaaecd with identifier: PJ34146
2026-03-30 10:58:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a28deb8-8b6a-5aae-ba24-fce951aaaecd with scrape type 2
2026-03-30 10:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a28deb8-8b6a-5aae-ba24-fce951aaaecd with scrape type 2
2026-03-30 10:58:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a28deb8-8b6a-5aae-ba24-fce951aaaecd, identifier: PJ34146
2026-03-30 10:58:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a28deb8-8b6a-5aae-ba24-fce951aaaecd with identifier: PJ34146
2026-03-30 10:58:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a28deb8-8b6a-5aae-ba24-fce951aaaecd with identifier: PJ34146
2026-03-30 10:58:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a28deb8-8b6a-5aae-ba24-fce951aaaecd with identifier: PJ34146 to the API
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:16:16Z',
 'fuel_type': 'diesel',
 'id': '7a28deb8-8b6a-5aae-ba24-fce951aaaecd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ34146',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 146352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-23',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34146%27 HTTP/1.1" 200 None
2026-03-30 10:58:08 [auto1.de] INFO: Saving data for PJ34146: {'auction_closing_time': 1774883776.0, 'created_time': 1774637597.74455, 'last_price_update_time': 1774868288.339243}
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ34146') HTTP/1.1" 204 0
2026-03-30 10:58:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:08 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY59919%27 HTTP/1.1" 200 None
2026-03-30 10:58:08 [auto1.de] INFO: Scrape type for PY59919: 2
2026-03-30 10:58:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75ba8a96-e98b-5632-88bf-e3c1cc1dc068 with identifier: PY59919
2026-03-30 10:58:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75ba8a96-e98b-5632-88bf-e3c1cc1dc068 with scrape type 2
2026-03-30 10:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75ba8a96-e98b-5632-88bf-e3c1cc1dc068 with scrape type 2
2026-03-30 10:58:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75ba8a96-e98b-5632-88bf-e3c1cc1dc068, identifier: PY59919
2026-03-30 10:58:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75ba8a96-e98b-5632-88bf-e3c1cc1dc068 with identifier: PY59919
2026-03-30 10:58:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75ba8a96-e98b-5632-88bf-e3c1cc1dc068 with identifier: PY59919
2026-03-30 10:58:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75ba8a96-e98b-5632-88bf-e3c1cc1dc068 with identifier: PY59919 to the API
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:26:27Z',
 'fuel_type': 'diesel',
 'id': '75ba8a96-e98b-5632-88bf-e3c1cc1dc068',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY59919',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 405941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-01',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY59919%27 HTTP/1.1" 200 None
2026-03-30 10:58:08 [auto1.de] INFO: Saving data for PY59919: {'auction_closing_time': 1774884387.0, 'created_time': 1773427395.861488, 'last_price_update_time': 1774868288.743473}
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY59919') HTTP/1.1" 204 0
2026-03-30 10:58:08 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU78317%27 HTTP/1.1" 200 None
2026-03-30 10:58:08 [auto1.de] INFO: Scrape type for SU78317: 2
2026-03-30 10:58:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37425829-4c42-59fd-a6b6-3843e707f888 with identifier: SU78317
2026-03-30 10:58:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37425829-4c42-59fd-a6b6-3843e707f888 with scrape type 2
2026-03-30 10:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37425829-4c42-59fd-a6b6-3843e707f888 with scrape type 2
2026-03-30 10:58:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37425829-4c42-59fd-a6b6-3843e707f888, identifier: SU78317
2026-03-30 10:58:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37425829-4c42-59fd-a6b6-3843e707f888 with identifier: SU78317
2026-03-30 10:58:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37425829-4c42-59fd-a6b6-3843e707f888 with identifier: SU78317
2026-03-30 10:58:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37425829-4c42-59fd-a6b6-3843e707f888 with identifier: SU78317 to the API
2026-03-30 10:58:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:11:12Z',
 'fuel_type': 'petrol',
 'id': '37425829-4c42-59fd-a6b6-3843e707f888',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU78317',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 215017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-11',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Kompressor T Classic',
 'transmission': 'automatic',
 'trim': 'T Classic',
 'year': 2005}
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU78317%27 HTTP/1.1" 200 None
2026-03-30 10:58:09 [auto1.de] INFO: Saving data for SU78317: {'auction_closing_time': 1774883472.0, 'created_time': 1773427069.121503, 'last_price_update_time': 1774868289.180438}
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU78317') HTTP/1.1" 204 0
2026-03-30 10:58:09 [auto1.de] INFO: Found listing with ID: MP03054
2026-03-30 10:58:09 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-30 10:58:09 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE10482%27 HTTP/1.1" 200 None
2026-03-30 10:58:09 [auto1.de] INFO: Scrape type for BE10482: 2
2026-03-30 10:58:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 525eb71d-9630-5d4d-bb37-9e6b41754f7a with identifier: BE10482
2026-03-30 10:58:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 525eb71d-9630-5d4d-bb37-9e6b41754f7a with scrape type 2
2026-03-30 10:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 525eb71d-9630-5d4d-bb37-9e6b41754f7a with scrape type 2
2026-03-30 10:58:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 525eb71d-9630-5d4d-bb37-9e6b41754f7a, identifier: BE10482
2026-03-30 10:58:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 525eb71d-9630-5d4d-bb37-9e6b41754f7a with identifier: BE10482
2026-03-30 10:58:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 525eb71d-9630-5d4d-bb37-9e6b41754f7a with identifier: BE10482
2026-03-30 10:58:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 525eb71d-9630-5d4d-bb37-9e6b41754f7a with identifier: BE10482 to the API
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:05:22Z',
 'fuel_type': 'petrol',
 'id': '525eb71d-9630-5d4d-bb37-9e6b41754f7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE10482',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Seicento',
 'odometer': 90751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-11-30',
 'seller_name': None,
 'title': 'Fiat Seicento 1.1 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2004}
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE10482%27 HTTP/1.1" 200 None
2026-03-30 10:58:09 [auto1.de] INFO: Saving data for BE10482: {'auction_closing_time': 1774883122.0, 'created_time': 1774378553.355722, 'last_price_update_time': 1774868289.691376}
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE10482') HTTP/1.1" 204 0
2026-03-30 10:58:09 [auto1.de] INFO: Found listing with ID: JM25076
2026-03-30 10:58:09 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-30 10:58:09 [auto1.de] INFO: Found listing with ID: CR70620
2026-03-30 10:58:09 [auto1.de] INFO: Found listing with ID: DY40129
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY40129%27 HTTP/1.1" 200 None
2026-03-30 10:58:09 [auto1.de] INFO: Scrape type for DY40129: 2
2026-03-30 10:58:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1359aa8a-0d75-5924-8f59-ed5b9ede1629 with identifier: DY40129
2026-03-30 10:58:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1359aa8a-0d75-5924-8f59-ed5b9ede1629 with scrape type 2
2026-03-30 10:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1359aa8a-0d75-5924-8f59-ed5b9ede1629 with scrape type 2
2026-03-30 10:58:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1359aa8a-0d75-5924-8f59-ed5b9ede1629, identifier: DY40129
2026-03-30 10:58:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1359aa8a-0d75-5924-8f59-ed5b9ede1629 with identifier: DY40129
2026-03-30 10:58:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1359aa8a-0d75-5924-8f59-ed5b9ede1629 with identifier: DY40129
2026-03-30 10:58:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1359aa8a-0d75-5924-8f59-ed5b9ede1629 with identifier: DY40129 to the API
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:53:21Z',
 'fuel_type': 'petrol',
 'id': '1359aa8a-0d75-5924-8f59-ed5b9ede1629',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY40129',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 156492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-29',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2009}
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY40129%27 HTTP/1.1" 200 None
2026-03-30 10:58:10 [auto1.de] INFO: Saving data for DY40129: {'auction_closing_time': 1774886001.0, 'created_time': 1774550960.024995, 'last_price_update_time': 1774868290.112758}
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY40129') HTTP/1.1" 204 0
2026-03-30 10:58:10 [auto1.de] INFO: Found listing with ID: BV77129
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV77129%27 HTTP/1.1" 200 None
2026-03-30 10:58:10 [auto1.de] INFO: Scrape type for BV77129: 2
2026-03-30 10:58:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62f99909-de8b-5553-94d5-2011cfc2b9e7 with identifier: BV77129
2026-03-30 10:58:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62f99909-de8b-5553-94d5-2011cfc2b9e7 with scrape type 2
2026-03-30 10:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62f99909-de8b-5553-94d5-2011cfc2b9e7 with scrape type 2
2026-03-30 10:58:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62f99909-de8b-5553-94d5-2011cfc2b9e7, identifier: BV77129
2026-03-30 10:58:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62f99909-de8b-5553-94d5-2011cfc2b9e7 with identifier: BV77129
2026-03-30 10:58:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62f99909-de8b-5553-94d5-2011cfc2b9e7 with identifier: BV77129
2026-03-30 10:58:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62f99909-de8b-5553-94d5-2011cfc2b9e7 with identifier: BV77129 to the API
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:29:00Z',
 'fuel_type': 'petrol',
 'id': '62f99909-de8b-5553-94d5-2011cfc2b9e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV77129',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 244815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-11',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV77129%27 HTTP/1.1" 200 None
2026-03-30 10:58:10 [auto1.de] INFO: Saving data for BV77129: {'auction_closing_time': 1774884540.0, 'created_time': 1773307986.011677, 'last_price_update_time': 1774868290.509861}
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV77129') HTTP/1.1" 204 0
2026-03-30 10:58:10 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-30 10:58:10 [auto1.de] INFO: Found listing with ID: PX43483
2026-03-30 10:58:10 [auto1.de] INFO: Found listing with ID: YH32466
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH32466%27 HTTP/1.1" 200 None
2026-03-30 10:58:10 [auto1.de] INFO: Scrape type for YH32466: 2
2026-03-30 10:58:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c37d971-0f8c-55e9-98e0-025af895a389 with identifier: YH32466
2026-03-30 10:58:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c37d971-0f8c-55e9-98e0-025af895a389 with scrape type 2
2026-03-30 10:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c37d971-0f8c-55e9-98e0-025af895a389 with scrape type 2
2026-03-30 10:58:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c37d971-0f8c-55e9-98e0-025af895a389, identifier: YH32466
2026-03-30 10:58:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c37d971-0f8c-55e9-98e0-025af895a389 with identifier: YH32466
2026-03-30 10:58:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c37d971-0f8c-55e9-98e0-025af895a389 with identifier: YH32466
2026-03-30 10:58:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c37d971-0f8c-55e9-98e0-025af895a389 with identifier: YH32466 to the API
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:08:33Z',
 'fuel_type': 'petrol',
 'id': '4c37d971-0f8c-55e9-98e0-025af895a389',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH32466',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 203061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-20',
 'seller_name': None,
 'title': 'BMW 5er 530i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2006}
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH32466%27 HTTP/1.1" 200 None
2026-03-30 10:58:10 [auto1.de] INFO: Saving data for YH32466: {'auction_closing_time': 1774883313.0, 'created_time': 1774637387.970716, 'last_price_update_time': 1774868290.908414}
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH32466') HTTP/1.1" 204 0
2026-03-30 10:58:11 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW96632%27 HTTP/1.1" 200 None
2026-03-30 10:58:11 [auto1.de] INFO: Scrape type for ZW96632: 2
2026-03-30 10:58:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dcad5ed-5aff-582a-bde0-e25947a26f78 with identifier: ZW96632
2026-03-30 10:58:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dcad5ed-5aff-582a-bde0-e25947a26f78 with scrape type 2
2026-03-30 10:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dcad5ed-5aff-582a-bde0-e25947a26f78 with scrape type 2
2026-03-30 10:58:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0dcad5ed-5aff-582a-bde0-e25947a26f78, identifier: ZW96632
2026-03-30 10:58:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0dcad5ed-5aff-582a-bde0-e25947a26f78 with identifier: ZW96632
2026-03-30 10:58:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0dcad5ed-5aff-582a-bde0-e25947a26f78 with identifier: ZW96632
2026-03-30 10:58:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0dcad5ed-5aff-582a-bde0-e25947a26f78 with identifier: ZW96632 to the API
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:02:08Z',
 'fuel_type': 'petrol',
 'id': '0dcad5ed-5aff-582a-bde0-e25947a26f78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW96632',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 196939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1991-08-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 1991}
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW96632%27 HTTP/1.1" 200 None
2026-03-30 10:58:11 [auto1.de] INFO: Saving data for ZW96632: {'auction_closing_time': 1774882928.0, 'created_time': 1774637454.154318, 'last_price_update_time': 1774868291.425264}
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW96632') HTTP/1.1" 204 0
2026-03-30 10:58:11 [auto1.de] INFO: Found listing with ID: KS38701
2026-03-30 10:58:11 [auto1.de] INFO: Found listing with ID: ZY10708
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY10708%27 HTTP/1.1" 200 None
2026-03-30 10:58:11 [auto1.de] INFO: Scrape type for ZY10708: 2
2026-03-30 10:58:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with identifier: ZY10708
2026-03-30 10:58:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with scrape type 2
2026-03-30 10:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with scrape type 2
2026-03-30 10:58:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a54fcc7-6ab6-5592-b8b5-67a35b373d89, identifier: ZY10708
2026-03-30 10:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:58:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with identifier: ZY10708
2026-03-30 10:58:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with identifier: ZY10708
2026-03-30 10:58:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with identifier: ZY10708 to the API
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:00:52Z',
 'fuel_type': 'diesel',
 'id': '4a54fcc7-6ab6-5592-b8b5-67a35b373d89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY10708',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 200063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-11',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2009}
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY10708%27 HTTP/1.1" 200 None
2026-03-30 10:58:11 [auto1.de] INFO: Saving data for ZY10708: {'auction_closing_time': 1774882852.0, 'created_time': 1773554115.392072, 'last_price_update_time': 1774868291.838921}
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY10708') HTTP/1.1" 204 0
2026-03-30 10:58:11 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW88180%27 HTTP/1.1" 200 None
2026-03-30 10:58:11 [auto1.de] INFO: Scrape type for NW88180: 2
2026-03-30 10:58:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aa08549-c2cd-5f81-9f18-18137acf81b0 with identifier: NW88180
2026-03-30 10:58:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aa08549-c2cd-5f81-9f18-18137acf81b0 with scrape type 2
2026-03-30 10:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aa08549-c2cd-5f81-9f18-18137acf81b0 with scrape type 2
2026-03-30 10:58:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9aa08549-c2cd-5f81-9f18-18137acf81b0, identifier: NW88180
2026-03-30 10:58:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9aa08549-c2cd-5f81-9f18-18137acf81b0 with identifier: NW88180
2026-03-30 10:58:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9aa08549-c2cd-5f81-9f18-18137acf81b0 with identifier: NW88180
2026-03-30 10:58:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9aa08549-c2cd-5f81-9f18-18137acf81b0 with identifier: NW88180 to the API
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:57:55Z',
 'fuel_type': 'petrol',
 'id': '9aa08549-c2cd-5f81-9f18-18137acf81b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW88180',
 'listing': 'auction',
 'make': 'Dodge',
 'model': 'Caliber',
 'odometer': 212137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-18',
 'seller_name': None,
 'title': 'Dodge Caliber 2.0 SXT',
 'transmission': 'automatic',
 'trim': 'SXT',
 'year': 2007}
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW88180%27 HTTP/1.1" 200 None
2026-03-30 10:58:12 [auto1.de] INFO: Saving data for NW88180: {'auction_closing_time': 1774886275.0, 'created_time': 1773861442.905958, 'last_price_update_time': 1774868292.259983}
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW88180') HTTP/1.1" 204 0
2026-03-30 10:58:12 [auto1.de] INFO: Found listing with ID: HC26014
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC26014%27 HTTP/1.1" 200 None
2026-03-30 10:58:12 [auto1.de] INFO: Scrape type for HC26014: 2
2026-03-30 10:58:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a152687b-cb8f-54d8-8aaa-db4c00b5d621 with identifier: HC26014
2026-03-30 10:58:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a152687b-cb8f-54d8-8aaa-db4c00b5d621 with scrape type 2
2026-03-30 10:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a152687b-cb8f-54d8-8aaa-db4c00b5d621 with scrape type 2
2026-03-30 10:58:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a152687b-cb8f-54d8-8aaa-db4c00b5d621, identifier: HC26014
2026-03-30 10:58:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a152687b-cb8f-54d8-8aaa-db4c00b5d621 with identifier: HC26014
2026-03-30 10:58:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a152687b-cb8f-54d8-8aaa-db4c00b5d621 with identifier: HC26014
2026-03-30 10:58:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a152687b-cb8f-54d8-8aaa-db4c00b5d621 with identifier: HC26014 to the API
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:53:27Z',
 'fuel_type': 'petrol',
 'id': 'a152687b-cb8f-54d8-8aaa-db4c00b5d621',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC26014',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 158699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-17',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2008}
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC26014%27 HTTP/1.1" 200 None
2026-03-30 10:58:12 [auto1.de] INFO: Saving data for HC26014: {'auction_closing_time': 1774886007.0, 'created_time': 1774550875.716594, 'last_price_update_time': 1774868292.650274}
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC26014') HTTP/1.1" 204 0
2026-03-30 10:58:12 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 9542 | hits on page: 40
2026-03-30 10:58:12 [auto1.de] INFO: Found listing with ID: LN64409
2026-03-30 10:58:12 [auto1.de] INFO: Found listing with ID: JS58048
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS58048%27 HTTP/1.1" 200 None
2026-03-30 10:58:12 [auto1.de] INFO: Scrape type for JS58048: 2
2026-03-30 10:58:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b184eea-ae70-5c25-8b65-ab06576dccf1 with identifier: JS58048
2026-03-30 10:58:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b184eea-ae70-5c25-8b65-ab06576dccf1 with scrape type 2
2026-03-30 10:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b184eea-ae70-5c25-8b65-ab06576dccf1 with scrape type 2
2026-03-30 10:58:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b184eea-ae70-5c25-8b65-ab06576dccf1, identifier: JS58048
2026-03-30 10:58:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b184eea-ae70-5c25-8b65-ab06576dccf1 with identifier: JS58048
2026-03-30 10:58:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b184eea-ae70-5c25-8b65-ab06576dccf1 with identifier: JS58048
2026-03-30 10:58:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b184eea-ae70-5c25-8b65-ab06576dccf1 with identifier: JS58048 to the API
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:17:54Z',
 'fuel_type': 'petrol',
 'id': '8b184eea-ae70-5c25-8b65-ab06576dccf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS58048',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 200542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-13',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2012}
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS58048%27 HTTP/1.1" 200 None
2026-03-30 10:58:13 [auto1.de] INFO: Saving data for JS58048: {'auction_closing_time': 1774883874.0, 'created_time': 1774638008.360211, 'last_price_update_time': 1774868293.075814}
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS58048') HTTP/1.1" 204 0
2026-03-30 10:58:13 [auto1.de] INFO: Found listing with ID: RC32924
2026-03-30 10:58:13 [auto1.de] INFO: Found listing with ID: VY63295
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY63295%27 HTTP/1.1" 200 None
2026-03-30 10:58:13 [auto1.de] INFO: Scrape type for VY63295: 2
2026-03-30 10:58:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8cd9b73-547c-5910-94f4-0a5ca644366d with identifier: VY63295
2026-03-30 10:58:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8cd9b73-547c-5910-94f4-0a5ca644366d with scrape type 2
2026-03-30 10:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8cd9b73-547c-5910-94f4-0a5ca644366d with scrape type 2
2026-03-30 10:58:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8cd9b73-547c-5910-94f4-0a5ca644366d, identifier: VY63295
2026-03-30 10:58:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:13 [auto1.de] INFO: Found listing with ID: KY70270
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY70270%27 HTTP/1.1" 200 None
2026-03-30 10:58:13 [auto1.de] INFO: Scrape type for KY70270: 2
2026-03-30 10:58:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 440dbb43-1235-5d4e-b323-5866c691c9ab with identifier: KY70270
2026-03-30 10:58:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 440dbb43-1235-5d4e-b323-5866c691c9ab with scrape type 2
2026-03-30 10:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 440dbb43-1235-5d4e-b323-5866c691c9ab with scrape type 2
2026-03-30 10:58:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 440dbb43-1235-5d4e-b323-5866c691c9ab, identifier: KY70270
2026-03-30 10:58:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8cd9b73-547c-5910-94f4-0a5ca644366d with identifier: VY63295
2026-03-30 10:58:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8cd9b73-547c-5910-94f4-0a5ca644366d with identifier: VY63295
2026-03-30 10:58:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8cd9b73-547c-5910-94f4-0a5ca644366d with identifier: VY63295 to the API
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:56:45Z',
 'fuel_type': 'diesel',
 'id': 'b8cd9b73-547c-5910-94f4-0a5ca644366d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY63295',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 82887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-07',
 'seller_name': None,
 'title': 'Jaguar XF 20d R-Sport AWD',
 'transmission': 'automatic',
 'trim': 'R-Sport AWD',
 'year': 2019}
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY63295%27 HTTP/1.1" 200 None
2026-03-30 10:58:13 [auto1.de] INFO: Saving data for VY63295: {'auction_closing_time': 1774886205.0, 'created_time': 1774780559.091825, 'last_price_update_time': 1774868293.602521}
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY63295') HTTP/1.1" 204 0
2026-03-30 10:58:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 440dbb43-1235-5d4e-b323-5866c691c9ab with identifier: KY70270
2026-03-30 10:58:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 440dbb43-1235-5d4e-b323-5866c691c9ab with identifier: KY70270
2026-03-30 10:58:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 440dbb43-1235-5d4e-b323-5866c691c9ab with identifier: KY70270 to the API
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:13:30Z',
 'fuel_type': 'diesel',
 'id': '440dbb43-1235-5d4e-b323-5866c691c9ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY70270',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 314100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-30',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2004}
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY70270%27 HTTP/1.1" 200 None
2026-03-30 10:58:13 [auto1.de] INFO: Saving data for KY70270: {'auction_closing_time': 1774883610.0, 'created_time': 1773427180.089786, 'last_price_update_time': 1774868293.89344}
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY70270') HTTP/1.1" 204 0
2026-03-30 10:58:13 [auto1.de] INFO: Found listing with ID: AA06623
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA06623%27 HTTP/1.1" 200 None
2026-03-30 10:58:13 [auto1.de] INFO: Scrape type for AA06623: 2
2026-03-30 10:58:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8e7d56a-3463-567e-917f-3a2456aea3ae with identifier: AA06623
2026-03-30 10:58:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8e7d56a-3463-567e-917f-3a2456aea3ae with scrape type 2
2026-03-30 10:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8e7d56a-3463-567e-917f-3a2456aea3ae with scrape type 2
2026-03-30 10:58:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8e7d56a-3463-567e-917f-3a2456aea3ae, identifier: AA06623
2026-03-30 10:58:14 [auto1.de] INFO: Found listing with ID: BB56040
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB56040%27 HTTP/1.1" 200 None
2026-03-30 10:58:14 [auto1.de] INFO: Scrape type for BB56040: 2
2026-03-30 10:58:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with identifier: BB56040
2026-03-30 10:58:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with scrape type 2
2026-03-30 10:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with scrape type 2
2026-03-30 10:58:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9a534c9-34d5-59fb-bf33-9dea223ec2d1, identifier: BB56040
2026-03-30 10:58:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8e7d56a-3463-567e-917f-3a2456aea3ae with identifier: AA06623
2026-03-30 10:58:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8e7d56a-3463-567e-917f-3a2456aea3ae with identifier: AA06623
2026-03-30 10:58:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8e7d56a-3463-567e-917f-3a2456aea3ae with identifier: AA06623 to the API
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:33:40Z',
 'fuel_type': 'petrol',
 'id': 'f8e7d56a-3463-567e-917f-3a2456aea3ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA06623',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 186143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-29',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 THP Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2010}
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA06623%27 HTTP/1.1" 200 None
2026-03-30 10:58:14 [auto1.de] INFO: Saving data for AA06623: {'auction_closing_time': 1774884820.0, 'created_time': 1774550682.858944, 'last_price_update_time': 1774868294.429482}
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA06623') HTTP/1.1" 204 0
2026-03-30 10:58:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with identifier: BB56040
2026-03-30 10:58:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with identifier: BB56040
2026-03-30 10:58:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with identifier: BB56040 to the API
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:20:47Z',
 'fuel_type': 'diesel',
 'id': 'b9a534c9-34d5-59fb-bf33-9dea223ec2d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB56040',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 291837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-30',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2006}
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB56040%27 HTTP/1.1" 200 None
2026-03-30 10:58:14 [auto1.de] INFO: Saving data for BB56040: {'auction_closing_time': 1774884047.0, 'created_time': 1773383028.801324, 'last_price_update_time': 1774868294.829074}
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB56040') HTTP/1.1" 204 0
2026-03-30 10:58:14 [auto1.de] INFO: Found listing with ID: XN76849
2026-03-30 10:58:14 [auto1.de] INFO: Found listing with ID: XF10018
2026-03-30 10:58:14 [auto1.de] INFO: Found listing with ID: KV42803
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV42803%27 HTTP/1.1" 200 None
2026-03-30 10:58:14 [auto1.de] INFO: Scrape type for KV42803: 2
2026-03-30 10:58:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3770eb57-43b8-5eb1-ba3f-633244321d1d with identifier: KV42803
2026-03-30 10:58:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3770eb57-43b8-5eb1-ba3f-633244321d1d with scrape type 2
2026-03-30 10:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3770eb57-43b8-5eb1-ba3f-633244321d1d with scrape type 2
2026-03-30 10:58:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3770eb57-43b8-5eb1-ba3f-633244321d1d, identifier: KV42803
2026-03-30 10:58:15 [auto1.de] INFO: Found listing with ID: RC36772
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC36772%27 HTTP/1.1" 200 None
2026-03-30 10:58:15 [auto1.de] INFO: Scrape type for RC36772: 2
2026-03-30 10:58:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44694af2-e304-579f-975e-20af8a2f9a1f with identifier: RC36772
2026-03-30 10:58:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44694af2-e304-579f-975e-20af8a2f9a1f with scrape type 2
2026-03-30 10:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44694af2-e304-579f-975e-20af8a2f9a1f with scrape type 2
2026-03-30 10:58:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44694af2-e304-579f-975e-20af8a2f9a1f, identifier: RC36772
2026-03-30 10:58:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3770eb57-43b8-5eb1-ba3f-633244321d1d with identifier: KV42803
2026-03-30 10:58:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3770eb57-43b8-5eb1-ba3f-633244321d1d with identifier: KV42803
2026-03-30 10:58:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3770eb57-43b8-5eb1-ba3f-633244321d1d with identifier: KV42803 to the API
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:41:40Z',
 'fuel_type': 'petrol',
 'id': '3770eb57-43b8-5eb1-ba3f-633244321d1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV42803',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 140734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-05',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Edition+',
 'transmission': 'manual',
 'trim': 'Edition+',
 'year': 2009}
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV42803%27 HTTP/1.1" 200 None
2026-03-30 10:58:15 [auto1.de] INFO: Saving data for KV42803: {'auction_closing_time': 1774885300.0, 'created_time': 1774550914.846322, 'last_price_update_time': 1774868295.442326}
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV42803') HTTP/1.1" 204 0
2026-03-30 10:58:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44694af2-e304-579f-975e-20af8a2f9a1f with identifier: RC36772
2026-03-30 10:58:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44694af2-e304-579f-975e-20af8a2f9a1f with identifier: RC36772
2026-03-30 10:58:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44694af2-e304-579f-975e-20af8a2f9a1f with identifier: RC36772 to the API
2026-03-30 10:58:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:22:03Z',
 'fuel_type': 'diesel',
 'id': '44694af2-e304-579f-975e-20af8a2f9a1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC36772',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 116223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-23',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d T Plus',
 'transmission': 'automatic',
 'trim': 'T Plus',
 'year': 2017}
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC36772%27 HTTP/1.1" 200 None
2026-03-30 10:58:16 [auto1.de] INFO: Saving data for RC36772: {'auction_closing_time': 1774884123.0, 'created_time': 1774550901.915807, 'last_price_update_time': 1774868296.399711}
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC36772') HTTP/1.1" 204 0
2026-03-30 10:58:16 [auto1.de] INFO: Found listing with ID: TJ48176
2026-03-30 10:58:16 [auto1.de] INFO: Found listing with ID: NH05952
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH05952%27 HTTP/1.1" 200 None
2026-03-30 10:58:16 [auto1.de] INFO: Scrape type for NH05952: 2
2026-03-30 10:58:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2371f6f-43d1-5fd7-9147-8c9a3f9dbbd8 with identifier: NH05952
2026-03-30 10:58:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2371f6f-43d1-5fd7-9147-8c9a3f9dbbd8 with scrape type 2
2026-03-30 10:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2371f6f-43d1-5fd7-9147-8c9a3f9dbbd8 with scrape type 2
2026-03-30 10:58:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2371f6f-43d1-5fd7-9147-8c9a3f9dbbd8, identifier: NH05952
2026-03-30 10:58:16 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-30 10:58:16 [auto1.de] INFO: Found listing with ID: UG24074
2026-03-30 10:58:16 [auto1.de] INFO: Found listing with ID: ZA01516
2026-03-30 10:58:16 [auto1.de] INFO: Found listing with ID: NX65869
2026-03-30 10:58:16 [auto1.de] INFO: Found listing with ID: KF39369
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39369%27 HTTP/1.1" 200 None
2026-03-30 10:58:16 [auto1.de] INFO: Scrape type for KF39369: 2
2026-03-30 10:58:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with identifier: KF39369
2026-03-30 10:58:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with scrape type 2
2026-03-30 10:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with scrape type 2
2026-03-30 10:58:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829, identifier: KF39369
2026-03-30 10:58:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2371f6f-43d1-5fd7-9147-8c9a3f9dbbd8 with identifier: NH05952
2026-03-30 10:58:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2371f6f-43d1-5fd7-9147-8c9a3f9dbbd8 with identifier: NH05952
2026-03-30 10:58:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2371f6f-43d1-5fd7-9147-8c9a3f9dbbd8 with identifier: NH05952 to the API
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:41:14Z',
 'fuel_type': 'petrol',
 'id': 'd2371f6f-43d1-5fd7-9147-8c9a3f9dbbd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH05952',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 73614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-11',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Essentiel',
 'transmission': 'manual',
 'trim': 'Essentiel',
 'year': 2017}
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH05952%27 HTTP/1.1" 200 None
2026-03-30 10:58:16 [auto1.de] INFO: Saving data for NH05952: {'auction_closing_time': 1774885274.0, 'created_time': 1773224310.812995, 'last_price_update_time': 1774868296.967386}
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH05952') HTTP/1.1" 204 0
2026-03-30 10:58:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with identifier: KF39369
2026-03-30 10:58:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with identifier: KF39369
2026-03-30 10:58:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with identifier: KF39369 to the API
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:12:24Z',
 'fuel_type': 'petrol',
 'id': '9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF39369',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Almera',
 'odometer': 125567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-21',
 'seller_name': None,
 'title': 'Nissan Almera 1.5 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2005}
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39369%27 HTTP/1.1" 200 None
2026-03-30 10:58:17 [auto1.de] INFO: Saving data for KF39369: {'auction_closing_time': 1774883544.0, 'created_time': 1774551653.069878, 'last_price_update_time': 1774868297.377392}
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF39369') HTTP/1.1" 204 0
2026-03-30 10:58:17 [auto1.de] INFO: Found listing with ID: MM90300
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM90300%27 HTTP/1.1" 200 None
2026-03-30 10:58:17 [auto1.de] INFO: Scrape type for MM90300: 2
2026-03-30 10:58:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7456e56-261e-58f8-a61a-a335e61b2856 with identifier: MM90300
2026-03-30 10:58:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7456e56-261e-58f8-a61a-a335e61b2856 with scrape type 2
2026-03-30 10:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7456e56-261e-58f8-a61a-a335e61b2856 with scrape type 2
2026-03-30 10:58:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7456e56-261e-58f8-a61a-a335e61b2856, identifier: MM90300
2026-03-30 10:58:17 [auto1.de] INFO: Found listing with ID: CX65130
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX65130%27 HTTP/1.1" 200 None
2026-03-30 10:58:17 [auto1.de] INFO: Scrape type for CX65130: 2
2026-03-30 10:58:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18a5206f-4341-5979-b6ed-a93b1da77879 with identifier: CX65130
2026-03-30 10:58:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18a5206f-4341-5979-b6ed-a93b1da77879 with scrape type 2
2026-03-30 10:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18a5206f-4341-5979-b6ed-a93b1da77879 with scrape type 2
2026-03-30 10:58:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18a5206f-4341-5979-b6ed-a93b1da77879, identifier: CX65130
2026-03-30 10:58:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7456e56-261e-58f8-a61a-a335e61b2856 with identifier: MM90300
2026-03-30 10:58:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7456e56-261e-58f8-a61a-a335e61b2856 with identifier: MM90300
2026-03-30 10:58:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7456e56-261e-58f8-a61a-a335e61b2856 with identifier: MM90300 to the API
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:12:56Z',
 'fuel_type': 'petrol',
 'id': 'f7456e56-261e-58f8-a61a-a335e61b2856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM90300',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 226749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-07-16',
 'seller_name': None,
 'title': 'BMW 5er 525i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2001}
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM90300%27 HTTP/1.1" 200 None
2026-03-30 10:58:17 [auto1.de] INFO: Saving data for MM90300: {'auction_closing_time': 1774883576.0, 'created_time': 1774550674.525616, 'last_price_update_time': 1774868297.875686}
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM90300') HTTP/1.1" 204 0
2026-03-30 10:58:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18a5206f-4341-5979-b6ed-a93b1da77879 with identifier: CX65130
2026-03-30 10:58:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18a5206f-4341-5979-b6ed-a93b1da77879 with identifier: CX65130
2026-03-30 10:58:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18a5206f-4341-5979-b6ed-a93b1da77879 with identifier: CX65130 to the API
2026-03-30 10:58:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:11:14Z',
 'fuel_type': 'petrol',
 'id': '18a5206f-4341-5979-b6ed-a93b1da77879',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX65130',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 209805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-03',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 Invite',
 'transmission': 'manual',
 'trim': 'Invite',
 'year': 2005}
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX65130%27 HTTP/1.1" 200 None
2026-03-30 10:58:18 [auto1.de] INFO: Saving data for CX65130: {'auction_closing_time': 1774883474.0, 'created_time': 1773401243.954496, 'last_price_update_time': 1774868298.156184}
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX65130') HTTP/1.1" 204 0
2026-03-30 10:58:18 [auto1.de] INFO: Found listing with ID: WW07339
2026-03-30 10:58:18 [auto1.de] INFO: Found listing with ID: UH53806
2026-03-30 10:58:18 [auto1.de] INFO: Found listing with ID: HT08782
2026-03-30 10:58:18 [auto1.de] INFO: Found listing with ID: LJ58074
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58074%27 HTTP/1.1" 200 None
2026-03-30 10:58:18 [auto1.de] INFO: Scrape type for LJ58074: 2
2026-03-30 10:58:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cade1443-cecd-5baa-8fd2-740a130addcc with identifier: LJ58074
2026-03-30 10:58:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cade1443-cecd-5baa-8fd2-740a130addcc with scrape type 2
2026-03-30 10:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cade1443-cecd-5baa-8fd2-740a130addcc with scrape type 2
2026-03-30 10:58:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cade1443-cecd-5baa-8fd2-740a130addcc, identifier: LJ58074
2026-03-30 10:58:18 [auto1.de] INFO: Found listing with ID: EM69588
2026-03-30 10:58:18 [auto1.de] INFO: Found listing with ID: FY70837
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY70837%27 HTTP/1.1" 200 None
2026-03-30 10:58:18 [auto1.de] INFO: Scrape type for FY70837: 2
2026-03-30 10:58:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0481b56-dde9-549a-9e45-99aa4debc7e8 with identifier: FY70837
2026-03-30 10:58:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0481b56-dde9-549a-9e45-99aa4debc7e8 with scrape type 2
2026-03-30 10:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0481b56-dde9-549a-9e45-99aa4debc7e8 with scrape type 2
2026-03-30 10:58:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0481b56-dde9-549a-9e45-99aa4debc7e8, identifier: FY70837
2026-03-30 10:58:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cade1443-cecd-5baa-8fd2-740a130addcc with identifier: LJ58074
2026-03-30 10:58:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cade1443-cecd-5baa-8fd2-740a130addcc with identifier: LJ58074
2026-03-30 10:58:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cade1443-cecd-5baa-8fd2-740a130addcc with identifier: LJ58074 to the API
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:40:16Z',
 'fuel_type': 'petrol',
 'id': 'cade1443-cecd-5baa-8fd2-740a130addcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ58074',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 295018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-16',
 'seller_name': None,
 'title': 'BMW 1er 130i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58074%27 HTTP/1.1" 200 None
2026-03-30 10:58:18 [auto1.de] INFO: Saving data for LJ58074: {'auction_closing_time': 1774885216.0, 'created_time': 1773304656.76881, 'last_price_update_time': 1774868298.666094}
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ58074') HTTP/1.1" 204 0
2026-03-30 10:58:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0481b56-dde9-549a-9e45-99aa4debc7e8 with identifier: FY70837
2026-03-30 10:58:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0481b56-dde9-549a-9e45-99aa4debc7e8 with identifier: FY70837
2026-03-30 10:58:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0481b56-dde9-549a-9e45-99aa4debc7e8 with identifier: FY70837 to the API
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:08:05Z',
 'fuel_type': 'petrol',
 'id': 'e0481b56-dde9-549a-9e45-99aa4debc7e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY70837',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 62042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-28',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 Edition 2020 AMG Line',
 'transmission': 'automatic',
 'trim': 'Edition 2020 AMG Line',
 'year': 2021}
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY70837%27 HTTP/1.1" 200 None
2026-03-30 10:58:18 [auto1.de] INFO: Saving data for FY70837: {'auction_closing_time': 1774883285.0, 'created_time': 1774292712.867713, 'last_price_update_time': 1774868298.956934}
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY70837') HTTP/1.1" 204 0
2026-03-30 10:58:18 [auto1.de] INFO: Found listing with ID: LE65557
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE65557%27 HTTP/1.1" 200 None
2026-03-30 10:58:18 [auto1.de] INFO: Scrape type for LE65557: 2
2026-03-30 10:58:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c06712f-0cec-53ff-b445-3ddee5cc20c2 with identifier: LE65557
2026-03-30 10:58:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c06712f-0cec-53ff-b445-3ddee5cc20c2 with scrape type 2
2026-03-30 10:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c06712f-0cec-53ff-b445-3ddee5cc20c2 with scrape type 2
2026-03-30 10:58:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c06712f-0cec-53ff-b445-3ddee5cc20c2, identifier: LE65557
2026-03-30 10:58:19 [auto1.de] INFO: Found listing with ID: YL11317
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL11317%27 HTTP/1.1" 200 None
2026-03-30 10:58:19 [auto1.de] INFO: Scrape type for YL11317: 2
2026-03-30 10:58:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 287fb1b3-4d7a-5e7e-b033-e10b55591b61 with identifier: YL11317
2026-03-30 10:58:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 287fb1b3-4d7a-5e7e-b033-e10b55591b61 with scrape type 2
2026-03-30 10:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 287fb1b3-4d7a-5e7e-b033-e10b55591b61 with scrape type 2
2026-03-30 10:58:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 287fb1b3-4d7a-5e7e-b033-e10b55591b61, identifier: YL11317
2026-03-30 10:58:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c06712f-0cec-53ff-b445-3ddee5cc20c2 with identifier: LE65557
2026-03-30 10:58:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c06712f-0cec-53ff-b445-3ddee5cc20c2 with identifier: LE65557
2026-03-30 10:58:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c06712f-0cec-53ff-b445-3ddee5cc20c2 with identifier: LE65557 to the API
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:01:22Z',
 'fuel_type': 'petrol',
 'id': '4c06712f-0cec-53ff-b445-3ddee5cc20c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE65557',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Sedici',
 'odometer': 43376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-30',
 'seller_name': None,
 'title': 'Fiat Sedici 1.6 Pop 4x2',
 'transmission': 'manual',
 'trim': 'Pop 4x2',
 'year': 2012}
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE65557%27 HTTP/1.1" 200 None
2026-03-30 10:58:19 [auto1.de] INFO: Saving data for LE65557: {'auction_closing_time': 1774882882.0, 'created_time': 1773571557.020828, 'last_price_update_time': 1774868299.476535}
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE65557') HTTP/1.1" 204 0
2026-03-30 10:58:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 287fb1b3-4d7a-5e7e-b033-e10b55591b61 with identifier: YL11317
2026-03-30 10:58:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 287fb1b3-4d7a-5e7e-b033-e10b55591b61 with identifier: YL11317
2026-03-30 10:58:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 287fb1b3-4d7a-5e7e-b033-e10b55591b61 with identifier: YL11317 to the API
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:36:58Z',
 'fuel_type': 'petrol',
 'id': '287fb1b3-4d7a-5e7e-b033-e10b55591b61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL11317',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 229567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-28',
 'seller_name': None,
 'title': 'Audi A1 1.4 TFSI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2010}
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL11317%27 HTTP/1.1" 200 None
2026-03-30 10:58:19 [auto1.de] INFO: Saving data for YL11317: {'auction_closing_time': 1774885018.0, 'created_time': 1773427050.207461, 'last_price_update_time': 1774868299.77763}
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL11317') HTTP/1.1" 204 0
2026-03-30 10:58:19 [auto1.de] INFO: Found listing with ID: YY18465
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY18465%27 HTTP/1.1" 200 None
2026-03-30 10:58:19 [auto1.de] INFO: Scrape type for YY18465: 2
2026-03-30 10:58:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c77d5a41-4c87-5984-bbb7-fc7e6cccc93d with identifier: YY18465
2026-03-30 10:58:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c77d5a41-4c87-5984-bbb7-fc7e6cccc93d with scrape type 2
2026-03-30 10:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c77d5a41-4c87-5984-bbb7-fc7e6cccc93d with scrape type 2
2026-03-30 10:58:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c77d5a41-4c87-5984-bbb7-fc7e6cccc93d, identifier: YY18465
2026-03-30 10:58:19 [auto1.de] INFO: Found listing with ID: ZH40630
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH40630%27 HTTP/1.1" 200 None
2026-03-30 10:58:19 [auto1.de] INFO: Scrape type for ZH40630: 2
2026-03-30 10:58:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26bbd0b7-df5b-5d4f-9bf1-0c1b5572c0c0 with identifier: ZH40630
2026-03-30 10:58:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26bbd0b7-df5b-5d4f-9bf1-0c1b5572c0c0 with scrape type 2
2026-03-30 10:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26bbd0b7-df5b-5d4f-9bf1-0c1b5572c0c0 with scrape type 2
2026-03-30 10:58:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26bbd0b7-df5b-5d4f-9bf1-0c1b5572c0c0, identifier: ZH40630
2026-03-30 10:58:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c77d5a41-4c87-5984-bbb7-fc7e6cccc93d with identifier: YY18465
2026-03-30 10:58:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c77d5a41-4c87-5984-bbb7-fc7e6cccc93d with identifier: YY18465
2026-03-30 10:58:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c77d5a41-4c87-5984-bbb7-fc7e6cccc93d with identifier: YY18465 to the API
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-30T15:37:56Z',
 'fuel_type': 'petrol',
 'id': 'c77d5a41-4c87-5984-bbb7-fc7e6cccc93d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY18465',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 152037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-07-31',
 'seller_name': None,
 'title': 'Skoda Superb 2.8 V6 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2002}
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY18465%27 HTTP/1.1" 200 None
2026-03-30 10:58:20 [auto1.de] INFO: Saving data for YY18465: {'auction_closing_time': 1774885076.0, 'created_time': 1774637241.676485, 'last_price_update_time': 1774868300.318329}
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY18465') HTTP/1.1" 204 0
2026-03-30 10:58:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26bbd0b7-df5b-5d4f-9bf1-0c1b5572c0c0 with identifier: ZH40630
2026-03-30 10:58:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26bbd0b7-df5b-5d4f-9bf1-0c1b5572c0c0 with identifier: ZH40630
2026-03-30 10:58:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26bbd0b7-df5b-5d4f-9bf1-0c1b5572c0c0 with identifier: ZH40630 to the API
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:13:45Z',
 'fuel_type': 'petrol',
 'id': '26bbd0b7-df5b-5d4f-9bf1-0c1b5572c0c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH40630',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 118041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-02-06',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH40630%27 HTTP/1.1" 200 None
2026-03-30 10:58:20 [auto1.de] INFO: Saving data for ZH40630: {'auction_closing_time': 1774883625.0, 'created_time': 1774550868.470208, 'last_price_update_time': 1774868300.682133}
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH40630') HTTP/1.1" 204 0
2026-03-30 10:58:20 [auto1.de] INFO: Found listing with ID: VC28435
2026-03-30 10:58:20 [auto1.de] INFO: Found listing with ID: KP69989
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP69989%27 HTTP/1.1" 200 None
2026-03-30 10:58:20 [auto1.de] INFO: Scrape type for KP69989: 2
2026-03-30 10:58:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c666ffb-3ce2-5dbc-b807-029abfb5e8e3 with identifier: KP69989
2026-03-30 10:58:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c666ffb-3ce2-5dbc-b807-029abfb5e8e3 with scrape type 2
2026-03-30 10:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c666ffb-3ce2-5dbc-b807-029abfb5e8e3 with scrape type 2
2026-03-30 10:58:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c666ffb-3ce2-5dbc-b807-029abfb5e8e3, identifier: KP69989
2026-03-30 10:58:20 [auto1.de] INFO: Found listing with ID: RA38840
2026-03-30 10:58:20 [auto1.de] INFO: Found listing with ID: RR52693
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR52693%27 HTTP/1.1" 200 None
2026-03-30 10:58:20 [auto1.de] INFO: Scrape type for RR52693: 2
2026-03-30 10:58:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8df8c237-dc35-582b-98aa-1d30076b069f with identifier: RR52693
2026-03-30 10:58:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8df8c237-dc35-582b-98aa-1d30076b069f with scrape type 2
2026-03-30 10:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8df8c237-dc35-582b-98aa-1d30076b069f with scrape type 2
2026-03-30 10:58:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8df8c237-dc35-582b-98aa-1d30076b069f, identifier: RR52693
2026-03-30 10:58:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c666ffb-3ce2-5dbc-b807-029abfb5e8e3 with identifier: KP69989
2026-03-30 10:58:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c666ffb-3ce2-5dbc-b807-029abfb5e8e3 with identifier: KP69989
2026-03-30 10:58:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c666ffb-3ce2-5dbc-b807-029abfb5e8e3 with identifier: KP69989 to the API
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-30T15:47:45Z',
 'fuel_type': 'petrol',
 'id': '0c666ffb-3ce2-5dbc-b807-029abfb5e8e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP69989',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 81971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-03-31',
 'seller_name': None,
 'title': 'Renault Twingo 1.2',
 'transmission': 'automatic',
 'trim': '',
 'year': 1998}
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP69989%27 HTTP/1.1" 200 None
2026-03-30 10:58:21 [auto1.de] INFO: Saving data for KP69989: {'auction_closing_time': 1774885665.0, 'created_time': 1774378910.712866, 'last_price_update_time': 1774868301.21122}
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP69989') HTTP/1.1" 204 0
2026-03-30 10:58:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8df8c237-dc35-582b-98aa-1d30076b069f with identifier: RR52693
2026-03-30 10:58:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8df8c237-dc35-582b-98aa-1d30076b069f with identifier: RR52693
2026-03-30 10:58:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8df8c237-dc35-582b-98aa-1d30076b069f with identifier: RR52693 to the API
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:16:52Z',
 'fuel_type': 'petrol',
 'id': '8df8c237-dc35-582b-98aa-1d30076b069f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR52693',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 264293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-18',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2003}
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR52693%27 HTTP/1.1" 200 None
2026-03-30 10:58:21 [auto1.de] INFO: Saving data for RR52693: {'auction_closing_time': 1774883812.0, 'created_time': 1774550686.785911, 'last_price_update_time': 1774868301.52039}
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR52693') HTTP/1.1" 204 0
2026-03-30 10:58:21 [auto1.de] INFO: Found listing with ID: HJ76482
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ76482%27 HTTP/1.1" 200 None
2026-03-30 10:58:21 [auto1.de] INFO: Scrape type for HJ76482: 2
2026-03-30 10:58:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2eacd36-37c1-5b9f-a049-3f8ef88329ff with identifier: HJ76482
2026-03-30 10:58:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2eacd36-37c1-5b9f-a049-3f8ef88329ff with scrape type 2
2026-03-30 10:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2eacd36-37c1-5b9f-a049-3f8ef88329ff with scrape type 2
2026-03-30 10:58:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2eacd36-37c1-5b9f-a049-3f8ef88329ff, identifier: HJ76482
2026-03-30 10:58:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:58:21 [auto1.de] INFO: Found listing with ID: ES51146
2026-03-30 10:58:21 [auto1.de] INFO: Found listing with ID: NK75444
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK75444%27 HTTP/1.1" 200 None
2026-03-30 10:58:21 [auto1.de] INFO: Scrape type for NK75444: 2
2026-03-30 10:58:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ba55716-6ea1-5529-b3e3-456a4c66517f with identifier: NK75444
2026-03-30 10:58:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba55716-6ea1-5529-b3e3-456a4c66517f with scrape type 2
2026-03-30 10:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ba55716-6ea1-5529-b3e3-456a4c66517f with scrape type 2
2026-03-30 10:58:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ba55716-6ea1-5529-b3e3-456a4c66517f, identifier: NK75444
2026-03-30 10:58:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2eacd36-37c1-5b9f-a049-3f8ef88329ff with identifier: HJ76482
2026-03-30 10:58:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2eacd36-37c1-5b9f-a049-3f8ef88329ff with identifier: HJ76482
2026-03-30 10:58:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2eacd36-37c1-5b9f-a049-3f8ef88329ff with identifier: HJ76482 to the API
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:43:55Z',
 'fuel_type': 'petrol',
 'id': 'e2eacd36-37c1-5b9f-a049-3f8ef88329ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ76482',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 198563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-12-05',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2000}
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ76482%27 HTTP/1.1" 200 None
2026-03-30 10:58:22 [auto1.de] INFO: Saving data for HJ76482: {'auction_closing_time': 1774885435.0, 'created_time': 1773688187.07017, 'last_price_update_time': 1774868302.068261}
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ76482') HTTP/1.1" 204 0
2026-03-30 10:58:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ba55716-6ea1-5529-b3e3-456a4c66517f with identifier: NK75444
2026-03-30 10:58:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ba55716-6ea1-5529-b3e3-456a4c66517f with identifier: NK75444
2026-03-30 10:58:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ba55716-6ea1-5529-b3e3-456a4c66517f with identifier: NK75444 to the API
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:09:48Z',
 'fuel_type': 'diesel',
 'id': '4ba55716-6ea1-5529-b3e3-456a4c66517f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK75444',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 273190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-31',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2006}
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK75444%27 HTTP/1.1" 200 None
2026-03-30 10:58:22 [auto1.de] INFO: Saving data for NK75444: {'auction_closing_time': 1774883388.0, 'created_time': 1774638270.802446, 'last_price_update_time': 1774868302.349142}
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK75444') HTTP/1.1" 204 0
2026-03-30 10:58:22 [auto1.de] INFO: Found listing with ID: GT35568
2026-03-30 10:58:22 [auto1.de] INFO: Found listing with ID: TJ90592
2026-03-30 10:58:22 [auto1.de] INFO: Found listing with ID: PJ98033
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ98033%27 HTTP/1.1" 200 None
2026-03-30 10:58:22 [auto1.de] INFO: Scrape type for PJ98033: 2
2026-03-30 10:58:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc2378dc-495d-5342-93ef-4c9f70d3e4f5 with identifier: PJ98033
2026-03-30 10:58:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc2378dc-495d-5342-93ef-4c9f70d3e4f5 with scrape type 2
2026-03-30 10:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc2378dc-495d-5342-93ef-4c9f70d3e4f5 with scrape type 2
2026-03-30 10:58:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc2378dc-495d-5342-93ef-4c9f70d3e4f5, identifier: PJ98033
2026-03-30 10:58:22 [auto1.de] INFO: Found listing with ID: RC32924
2026-03-30 10:58:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc2378dc-495d-5342-93ef-4c9f70d3e4f5 with identifier: PJ98033
2026-03-30 10:58:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc2378dc-495d-5342-93ef-4c9f70d3e4f5 with identifier: PJ98033
2026-03-30 10:58:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc2378dc-495d-5342-93ef-4c9f70d3e4f5 with identifier: PJ98033 to the API
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:24:37Z',
 'fuel_type': 'petrol',
 'id': 'bc2378dc-495d-5342-93ef-4c9f70d3e4f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ98033',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 177203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-25',
 'seller_name': None,
 'title': 'Jaguar E-Pace P300 R-Dynamic HSE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE AWD',
 'year': 2018}
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ98033%27 HTTP/1.1" 200 None
2026-03-30 10:58:22 [auto1.de] INFO: Saving data for PJ98033: {'auction_closing_time': 1774884277.0, 'created_time': 1774551471.029718, 'last_price_update_time': 1774868302.799683}
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ98033') HTTP/1.1" 204 0
2026-03-30 10:58:22 [auto1.de] INFO: Found listing with ID: CV58900
2026-03-30 10:58:22 [auto1.de] INFO: Found listing with ID: RG53469
2026-03-30 10:58:22 [auto1.de] INFO: Found listing with ID: ZS29776
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS29776%27 HTTP/1.1" 200 None
2026-03-30 10:58:22 [auto1.de] INFO: Scrape type for ZS29776: 2
2026-03-30 10:58:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e82f3c59-c09d-54e9-9257-080d6ecf23c7 with identifier: ZS29776
2026-03-30 10:58:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e82f3c59-c09d-54e9-9257-080d6ecf23c7 with scrape type 2
2026-03-30 10:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e82f3c59-c09d-54e9-9257-080d6ecf23c7 with scrape type 2
2026-03-30 10:58:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e82f3c59-c09d-54e9-9257-080d6ecf23c7, identifier: ZS29776
2026-03-30 10:58:23 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 9544 | hits on page: 40
2026-03-30 10:58:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e82f3c59-c09d-54e9-9257-080d6ecf23c7 with identifier: ZS29776
2026-03-30 10:58:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e82f3c59-c09d-54e9-9257-080d6ecf23c7 with identifier: ZS29776
2026-03-30 10:58:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e82f3c59-c09d-54e9-9257-080d6ecf23c7 with identifier: ZS29776 to the API
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:17:56Z',
 'fuel_type': 'petrol',
 'id': 'e82f3c59-c09d-54e9-9257-080d6ecf23c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS29776',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 76860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-09-15',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS29776%27 HTTP/1.1" 200 None
2026-03-30 10:58:23 [auto1.de] INFO: Saving data for ZS29776: {'auction_closing_time': 1774883876.0, 'created_time': 1773741413.3073559, 'last_price_update_time': 1774868303.318299}
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS29776') HTTP/1.1" 204 0
2026-03-30 10:58:23 [auto1.de] INFO: Found listing with ID: AT97457
2026-03-30 10:58:23 [auto1.de] INFO: Found listing with ID: WY61426
2026-03-30 10:58:23 [auto1.de] INFO: Found listing with ID: DS41181
2026-03-30 10:58:23 [auto1.de] INFO: Found listing with ID: BV92050
2026-03-30 10:58:23 [auto1.de] INFO: Found listing with ID: ZA83090
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA83090%27 HTTP/1.1" 200 None
2026-03-30 10:58:23 [auto1.de] INFO: Scrape type for ZA83090: 2
2026-03-30 10:58:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1c7e94e-08c3-5514-9f35-38d9864e25cf with identifier: ZA83090
2026-03-30 10:58:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1c7e94e-08c3-5514-9f35-38d9864e25cf with scrape type 2
2026-03-30 10:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1c7e94e-08c3-5514-9f35-38d9864e25cf with scrape type 2
2026-03-30 10:58:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1c7e94e-08c3-5514-9f35-38d9864e25cf, identifier: ZA83090
2026-03-30 10:58:23 [auto1.de] INFO: Found listing with ID: HA10005
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10005%27 HTTP/1.1" 200 None
2026-03-30 10:58:23 [auto1.de] INFO: Scrape type for HA10005: 2
2026-03-30 10:58:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6261b8f0-3aab-5dd8-a6e8-e7dde4010f8d with identifier: HA10005
2026-03-30 10:58:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6261b8f0-3aab-5dd8-a6e8-e7dde4010f8d with scrape type 2
2026-03-30 10:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6261b8f0-3aab-5dd8-a6e8-e7dde4010f8d with scrape type 2
2026-03-30 10:58:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6261b8f0-3aab-5dd8-a6e8-e7dde4010f8d, identifier: HA10005
2026-03-30 10:58:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1c7e94e-08c3-5514-9f35-38d9864e25cf with identifier: ZA83090
2026-03-30 10:58:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1c7e94e-08c3-5514-9f35-38d9864e25cf with identifier: ZA83090
2026-03-30 10:58:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1c7e94e-08c3-5514-9f35-38d9864e25cf with identifier: ZA83090 to the API
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:19:37Z',
 'fuel_type': 'diesel',
 'id': 'e1c7e94e-08c3-5514-9f35-38d9864e25cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA83090',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 177886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-23',
 'seller_name': None,
 'title': 'Audi A4 50 TDI quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2019}
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA83090%27 HTTP/1.1" 200 None
2026-03-30 10:58:23 [auto1.de] INFO: Saving data for ZA83090: {'auction_closing_time': 1774883977.0, 'created_time': 1774550659.221894, 'last_price_update_time': 1774868303.829591}
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA83090') HTTP/1.1" 204 0
2026-03-30 10:58:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6261b8f0-3aab-5dd8-a6e8-e7dde4010f8d with identifier: HA10005
2026-03-30 10:58:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6261b8f0-3aab-5dd8-a6e8-e7dde4010f8d with identifier: HA10005
2026-03-30 10:58:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6261b8f0-3aab-5dd8-a6e8-e7dde4010f8d with identifier: HA10005 to the API
2026-03-30 10:58:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:32:09Z',
 'fuel_type': 'petrol',
 'id': '6261b8f0-3aab-5dd8-a6e8-e7dde4010f8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA10005',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 118258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-07',
 'seller_name': None,
 'title': 'Peugeot 307 1.6 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2003}
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10005%27 HTTP/1.1" 200 None
2026-03-30 10:58:24 [auto1.de] INFO: Saving data for HA10005: {'auction_closing_time': 1774884729.0, 'created_time': 1773305910.737394, 'last_price_update_time': 1774868304.120514}
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA10005') HTTP/1.1" 204 0
2026-03-30 10:58:24 [auto1.de] INFO: Found listing with ID: NX62884
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX62884%27 HTTP/1.1" 200 None
2026-03-30 10:58:24 [auto1.de] INFO: Scrape type for NX62884: 2
2026-03-30 10:58:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99027328-199d-57e2-9c07-22e90e160cfc with identifier: NX62884
2026-03-30 10:58:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99027328-199d-57e2-9c07-22e90e160cfc with scrape type 2
2026-03-30 10:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99027328-199d-57e2-9c07-22e90e160cfc with scrape type 2
2026-03-30 10:58:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99027328-199d-57e2-9c07-22e90e160cfc, identifier: NX62884
2026-03-30 10:58:24 [auto1.de] INFO: Found listing with ID: GM20688
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM20688%27 HTTP/1.1" 200 None
2026-03-30 10:58:24 [auto1.de] INFO: Scrape type for GM20688: 2
2026-03-30 10:58:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe96e208-c03b-5110-97d0-620641e91948 with identifier: GM20688
2026-03-30 10:58:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe96e208-c03b-5110-97d0-620641e91948 with scrape type 2
2026-03-30 10:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe96e208-c03b-5110-97d0-620641e91948 with scrape type 2
2026-03-30 10:58:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe96e208-c03b-5110-97d0-620641e91948, identifier: GM20688
2026-03-30 10:58:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99027328-199d-57e2-9c07-22e90e160cfc with identifier: NX62884
2026-03-30 10:58:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99027328-199d-57e2-9c07-22e90e160cfc with identifier: NX62884
2026-03-30 10:58:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99027328-199d-57e2-9c07-22e90e160cfc with identifier: NX62884 to the API
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:19:05Z',
 'fuel_type': 'petrol',
 'id': '99027328-199d-57e2-9c07-22e90e160cfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX62884',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 9733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-19',
 'seller_name': None,
 'title': 'Hyundai i30 1.0 TGDI Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2024}
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX62884%27 HTTP/1.1" 200 None
2026-03-30 10:58:24 [auto1.de] INFO: Saving data for NX62884: {'auction_closing_time': 1774883945.0, 'created_time': 1774379409.849261, 'last_price_update_time': 1774868304.638691}
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX62884') HTTP/1.1" 204 0
2026-03-30 10:58:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe96e208-c03b-5110-97d0-620641e91948 with identifier: GM20688
2026-03-30 10:58:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe96e208-c03b-5110-97d0-620641e91948 with identifier: GM20688
2026-03-30 10:58:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe96e208-c03b-5110-97d0-620641e91948 with identifier: GM20688 to the API
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:33Z',
 'fuel_type': 'diesel',
 'id': 'fe96e208-c03b-5110-97d0-620641e91948',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM20688',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 91967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-23',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Trendline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion',
 'year': 2019}
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM20688%27 HTTP/1.1" 200 None
2026-03-30 10:58:25 [auto1.de] INFO: Saving data for GM20688: {'auction_closing_time': 1774884213.0, 'created_time': 1774465941.412545, 'last_price_update_time': 1774868305.053389}
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM20688') HTTP/1.1" 204 0
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: UL88623
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: JJ76956
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ76956%27 HTTP/1.1" 200 None
2026-03-30 10:58:25 [auto1.de] INFO: Scrape type for JJ76956: 2
2026-03-30 10:58:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f6f51da-f8ba-5740-90d2-409199f2d9fb with identifier: JJ76956
2026-03-30 10:58:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f6f51da-f8ba-5740-90d2-409199f2d9fb with scrape type 2
2026-03-30 10:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f6f51da-f8ba-5740-90d2-409199f2d9fb with scrape type 2
2026-03-30 10:58:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f6f51da-f8ba-5740-90d2-409199f2d9fb, identifier: JJ76956
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: CG76921
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: CZ25681
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ25681%27 HTTP/1.1" 200 None
2026-03-30 10:58:25 [auto1.de] INFO: Scrape type for CZ25681: 2
2026-03-30 10:58:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75c6a4e1-64d4-5971-b744-0b4b926dc513 with identifier: CZ25681
2026-03-30 10:58:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75c6a4e1-64d4-5971-b744-0b4b926dc513 with scrape type 2
2026-03-30 10:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75c6a4e1-64d4-5971-b744-0b4b926dc513 with scrape type 2
2026-03-30 10:58:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75c6a4e1-64d4-5971-b744-0b4b926dc513, identifier: CZ25681
2026-03-30 10:58:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f6f51da-f8ba-5740-90d2-409199f2d9fb with identifier: JJ76956
2026-03-30 10:58:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f6f51da-f8ba-5740-90d2-409199f2d9fb with identifier: JJ76956
2026-03-30 10:58:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f6f51da-f8ba-5740-90d2-409199f2d9fb with identifier: JJ76956 to the API
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:53:59Z',
 'fuel_type': 'petrol',
 'id': '0f6f51da-f8ba-5740-90d2-409199f2d9fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ76956',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 153045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-25',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.4 Start',
 'transmission': 'manual',
 'trim': 'Start',
 'year': 2008}
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ76956%27 HTTP/1.1" 200 None
2026-03-30 10:58:25 [auto1.de] INFO: Saving data for JJ76956: {'auction_closing_time': 1774886039.0, 'created_time': 1773946531.616555, 'last_price_update_time': 1774868305.551106}
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ76956') HTTP/1.1" 204 0
2026-03-30 10:58:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75c6a4e1-64d4-5971-b744-0b4b926dc513 with identifier: CZ25681
2026-03-30 10:58:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75c6a4e1-64d4-5971-b744-0b4b926dc513 with identifier: CZ25681
2026-03-30 10:58:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75c6a4e1-64d4-5971-b744-0b4b926dc513 with identifier: CZ25681 to the API
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:53:30Z',
 'fuel_type': 'diesel',
 'id': '75c6a4e1-64d4-5971-b744-0b4b926dc513',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ25681',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 116472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ25681%27 HTTP/1.1" 200 None
2026-03-30 10:58:25 [auto1.de] INFO: Saving data for CZ25681: {'auction_closing_time': 1774886010.0, 'created_time': 1773946054.350922, 'last_price_update_time': 1774868305.857038}
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ25681') HTTP/1.1" 204 0
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: NW73502
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: BV67523
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: NW01649
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: ZX12399
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX12399%27 HTTP/1.1" 200 None
2026-03-30 10:58:25 [auto1.de] INFO: Scrape type for ZX12399: 2
2026-03-30 10:58:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcee13e3-2f6e-55e7-ba72-3de35cdc2b6a with identifier: ZX12399
2026-03-30 10:58:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcee13e3-2f6e-55e7-ba72-3de35cdc2b6a with scrape type 2
2026-03-30 10:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcee13e3-2f6e-55e7-ba72-3de35cdc2b6a with scrape type 2
2026-03-30 10:58:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcee13e3-2f6e-55e7-ba72-3de35cdc2b6a, identifier: ZX12399
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: VR35896
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: JT14161
2026-03-30 10:58:25 [auto1.de] INFO: Found listing with ID: GX28379
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX28379%27 HTTP/1.1" 200 None
2026-03-30 10:58:26 [auto1.de] INFO: Scrape type for GX28379: 2
2026-03-30 10:58:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f16c2869-a320-5d78-8ff0-a08e0efa122f with identifier: GX28379
2026-03-30 10:58:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f16c2869-a320-5d78-8ff0-a08e0efa122f with scrape type 2
2026-03-30 10:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f16c2869-a320-5d78-8ff0-a08e0efa122f with scrape type 2
2026-03-30 10:58:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f16c2869-a320-5d78-8ff0-a08e0efa122f, identifier: GX28379
2026-03-30 10:58:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcee13e3-2f6e-55e7-ba72-3de35cdc2b6a with identifier: ZX12399
2026-03-30 10:58:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcee13e3-2f6e-55e7-ba72-3de35cdc2b6a with identifier: ZX12399
2026-03-30 10:58:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcee13e3-2f6e-55e7-ba72-3de35cdc2b6a with identifier: ZX12399 to the API
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 103,
 'expiration_date': '2026-03-30T15:04:01Z',
 'fuel_type': 'petrol',
 'id': 'fcee13e3-2f6e-55e7-ba72-3de35cdc2b6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX12399',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 49296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-12-19',
 'seller_name': None,
 'title': 'Ford Puma 1.6 Futura2',
 'transmission': 'manual',
 'trim': 'Futura2',
 'year': 2001}
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX12399%27 HTTP/1.1" 200 None
2026-03-30 10:58:26 [auto1.de] INFO: Saving data for ZX12399: {'auction_closing_time': 1774883041.0, 'created_time': 1773428979.902194, 'last_price_update_time': 1774868306.384864}
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX12399') HTTP/1.1" 204 0
2026-03-30 10:58:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f16c2869-a320-5d78-8ff0-a08e0efa122f with identifier: GX28379
2026-03-30 10:58:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f16c2869-a320-5d78-8ff0-a08e0efa122f with identifier: GX28379
2026-03-30 10:58:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f16c2869-a320-5d78-8ff0-a08e0efa122f with identifier: GX28379 to the API
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:13:12Z',
 'fuel_type': 'petrol',
 'id': 'f16c2869-a320-5d78-8ff0-a08e0efa122f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX28379',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'MPV',
 'odometer': 336066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-12-26',
 'seller_name': None,
 'title': 'Mazda MPV 2.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2001}
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX28379%27 HTTP/1.1" 200 None
2026-03-30 10:58:26 [auto1.de] INFO: Saving data for GX28379: {'auction_closing_time': 1774883592.0, 'created_time': 1774034569.837588, 'last_price_update_time': 1774868306.762896}
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX28379') HTTP/1.1" 204 0
2026-03-30 10:58:26 [auto1.de] INFO: Found listing with ID: SN44411
2026-03-30 10:58:26 [auto1.de] INFO: Found listing with ID: BJ40023
2026-03-30 10:58:26 [auto1.de] INFO: Found listing with ID: HA10005
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10005%27 HTTP/1.1" 200 None
2026-03-30 10:58:26 [auto1.de] INFO: Scrape type for HA10005: 0
2026-03-30 10:58:26 [auto1.de] INFO: Found listing with ID: GM20688
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM20688%27 HTTP/1.1" 200 None
2026-03-30 10:58:26 [auto1.de] INFO: Scrape type for GM20688: 0
2026-03-30 10:58:26 [auto1.de] INFO: Found listing with ID: WF02803
2026-03-30 10:58:26 [auto1.de] INFO: Found listing with ID: LN95655
2026-03-30 10:58:26 [auto1.de] INFO: Found listing with ID: UH31359
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH31359%27 HTTP/1.1" 200 None
2026-03-30 10:58:26 [auto1.de] INFO: Scrape type for UH31359: 2
2026-03-30 10:58:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a5806fa-d8db-5374-8126-2f9923f37fc6 with identifier: UH31359
2026-03-30 10:58:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a5806fa-d8db-5374-8126-2f9923f37fc6 with scrape type 2
2026-03-30 10:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a5806fa-d8db-5374-8126-2f9923f37fc6 with scrape type 2
2026-03-30 10:58:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a5806fa-d8db-5374-8126-2f9923f37fc6, identifier: UH31359
2026-03-30 10:58:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a5806fa-d8db-5374-8126-2f9923f37fc6 with identifier: UH31359
2026-03-30 10:58:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a5806fa-d8db-5374-8126-2f9923f37fc6 with identifier: UH31359
2026-03-30 10:58:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a5806fa-d8db-5374-8126-2f9923f37fc6 with identifier: UH31359 to the API
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:37:51Z',
 'fuel_type': 'petrol',
 'id': '1a5806fa-d8db-5374-8126-2f9923f37fc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH31359',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 60739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-29',
 'seller_name': None,
 'title': 'Jaguar F-Pace 25t R-Sport AWD',
 'transmission': 'automatic',
 'trim': 'R-Sport AWD',
 'year': 2019}
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH31359%27 HTTP/1.1" 200 None
2026-03-30 10:58:27 [auto1.de] INFO: Saving data for UH31359: {'auction_closing_time': 1774885071.0, 'created_time': 1774780569.853448, 'last_price_update_time': 1774868307.20886}
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH31359') HTTP/1.1" 204 0
2026-03-30 10:58:27 [auto1.de] INFO: Found listing with ID: LG46226
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG46226%27 HTTP/1.1" 200 None
2026-03-30 10:58:27 [auto1.de] INFO: Scrape type for LG46226: 2
2026-03-30 10:58:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c37280a7-dab6-5bee-be3f-dd9a168eb6ba with identifier: LG46226
2026-03-30 10:58:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c37280a7-dab6-5bee-be3f-dd9a168eb6ba with scrape type 2
2026-03-30 10:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c37280a7-dab6-5bee-be3f-dd9a168eb6ba with scrape type 2
2026-03-30 10:58:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c37280a7-dab6-5bee-be3f-dd9a168eb6ba, identifier: LG46226
2026-03-30 10:58:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c37280a7-dab6-5bee-be3f-dd9a168eb6ba with identifier: LG46226
2026-03-30 10:58:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c37280a7-dab6-5bee-be3f-dd9a168eb6ba with identifier: LG46226
2026-03-30 10:58:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c37280a7-dab6-5bee-be3f-dd9a168eb6ba with identifier: LG46226 to the API
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:17:17Z',
 'fuel_type': 'diesel',
 'id': 'c37280a7-dab6-5bee-be3f-dd9a168eb6ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG46226',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 68715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-03',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2017}
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG46226%27 HTTP/1.1" 200 None
2026-03-30 10:58:27 [auto1.de] INFO: Saving data for LG46226: {'auction_closing_time': 1774883837.0, 'created_time': 1774031994.76186, 'last_price_update_time': 1774868307.621598}
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG46226') HTTP/1.1" 204 0
2026-03-30 10:58:27 [auto1.de] INFO: Found listing with ID: BE23086
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE23086%27 HTTP/1.1" 200 None
2026-03-30 10:58:27 [auto1.de] INFO: Scrape type for BE23086: 2
2026-03-30 10:58:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 490993ff-1382-5b73-a2b8-32496728408b with identifier: BE23086
2026-03-30 10:58:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490993ff-1382-5b73-a2b8-32496728408b with scrape type 2
2026-03-30 10:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 490993ff-1382-5b73-a2b8-32496728408b with scrape type 2
2026-03-30 10:58:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 490993ff-1382-5b73-a2b8-32496728408b, identifier: BE23086
2026-03-30 10:58:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 490993ff-1382-5b73-a2b8-32496728408b with identifier: BE23086
2026-03-30 10:58:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 490993ff-1382-5b73-a2b8-32496728408b with identifier: BE23086
2026-03-30 10:58:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 490993ff-1382-5b73-a2b8-32496728408b with identifier: BE23086 to the API
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:30:52Z',
 'fuel_type': 'diesel',
 'id': '490993ff-1382-5b73-a2b8-32496728408b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE23086',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 208686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-01',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2017}
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE23086%27 HTTP/1.1" 200 None
2026-03-30 10:58:28 [auto1.de] INFO: Saving data for BE23086: {'auction_closing_time': 1774884652.0, 'created_time': 1774780572.657639, 'last_price_update_time': 1774868308.000026}
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE23086') HTTP/1.1" 204 0
2026-03-30 10:58:28 [auto1.de] INFO: Found listing with ID: HP19661
2026-03-30 10:58:28 [auto1.de] INFO: Found listing with ID: FA69463
2026-03-30 10:58:28 [auto1.de] INFO: Found listing with ID: GN33586
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN33586%27 HTTP/1.1" 200 None
2026-03-30 10:58:28 [auto1.de] INFO: Scrape type for GN33586: 2
2026-03-30 10:58:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c5019e3-a1a7-5d7e-8d08-af133b5b7ae8 with identifier: GN33586
2026-03-30 10:58:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c5019e3-a1a7-5d7e-8d08-af133b5b7ae8 with scrape type 2
2026-03-30 10:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c5019e3-a1a7-5d7e-8d08-af133b5b7ae8 with scrape type 2
2026-03-30 10:58:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c5019e3-a1a7-5d7e-8d08-af133b5b7ae8, identifier: GN33586
2026-03-30 10:58:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c5019e3-a1a7-5d7e-8d08-af133b5b7ae8 with identifier: GN33586
2026-03-30 10:58:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c5019e3-a1a7-5d7e-8d08-af133b5b7ae8 with identifier: GN33586
2026-03-30 10:58:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c5019e3-a1a7-5d7e-8d08-af133b5b7ae8 with identifier: GN33586 to the API
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:57Z',
 'fuel_type': 'gas',
 'id': '3c5019e3-a1a7-5d7e-8d08-af133b5b7ae8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN33586',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 296960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-25',
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN33586%27 HTTP/1.1" 200 None
2026-03-30 10:58:28 [auto1.de] INFO: Saving data for GN33586: {'auction_closing_time': 1774883217.0, 'created_time': 1773383100.903011, 'last_price_update_time': 1774868308.415002}
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN33586') HTTP/1.1" 204 0
2026-03-30 10:58:28 [auto1.de] INFO: Found listing with ID: WG22836
2026-03-30 10:58:28 [auto1.de] INFO: Found listing with ID: HN88809
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN88809%27 HTTP/1.1" 200 None
2026-03-30 10:58:28 [auto1.de] INFO: Scrape type for HN88809: 2
2026-03-30 10:58:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28e5ff8c-3507-5cbe-b1ca-c45f51b40e24 with identifier: HN88809
2026-03-30 10:58:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28e5ff8c-3507-5cbe-b1ca-c45f51b40e24 with scrape type 2
2026-03-30 10:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28e5ff8c-3507-5cbe-b1ca-c45f51b40e24 with scrape type 2
2026-03-30 10:58:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28e5ff8c-3507-5cbe-b1ca-c45f51b40e24, identifier: HN88809
2026-03-30 10:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:58:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28e5ff8c-3507-5cbe-b1ca-c45f51b40e24 with identifier: HN88809
2026-03-30 10:58:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28e5ff8c-3507-5cbe-b1ca-c45f51b40e24 with identifier: HN88809
2026-03-30 10:58:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28e5ff8c-3507-5cbe-b1ca-c45f51b40e24 with identifier: HN88809 to the API
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:23:25Z',
 'fuel_type': 'petrol',
 'id': '28e5ff8c-3507-5cbe-b1ca-c45f51b40e24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN88809',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 181761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-23',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2005}
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN88809%27 HTTP/1.1" 200 None
2026-03-30 10:58:29 [auto1.de] INFO: Saving data for HN88809: {'auction_closing_time': 1774884205.0, 'created_time': 1773772726.470891, 'last_price_update_time': 1774868309.050213}
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN88809') HTTP/1.1" 204 0
2026-03-30 10:58:29 [auto1.de] INFO: Found listing with ID: NV36056
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV36056%27 HTTP/1.1" 200 None
2026-03-30 10:58:29 [auto1.de] INFO: Scrape type for NV36056: 2
2026-03-30 10:58:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e29c92b4-407f-5012-b4d4-a7f7d95fb220 with identifier: NV36056
2026-03-30 10:58:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e29c92b4-407f-5012-b4d4-a7f7d95fb220 with scrape type 2
2026-03-30 10:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e29c92b4-407f-5012-b4d4-a7f7d95fb220 with scrape type 2
2026-03-30 10:58:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e29c92b4-407f-5012-b4d4-a7f7d95fb220, identifier: NV36056
2026-03-30 10:58:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e29c92b4-407f-5012-b4d4-a7f7d95fb220 with identifier: NV36056
2026-03-30 10:58:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e29c92b4-407f-5012-b4d4-a7f7d95fb220 with identifier: NV36056
2026-03-30 10:58:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e29c92b4-407f-5012-b4d4-a7f7d95fb220 with identifier: NV36056 to the API
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:01:00Z',
 'fuel_type': 'diesel',
 'id': 'e29c92b4-407f-5012-b4d4-a7f7d95fb220',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV36056',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 397835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-20',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV36056%27 HTTP/1.1" 200 None
2026-03-30 10:58:29 [auto1.de] INFO: Saving data for NV36056: {'auction_closing_time': 1774882860.0, 'created_time': 1773227463.856825, 'last_price_update_time': 1774868309.473376}
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV36056') HTTP/1.1" 204 0
2026-03-30 10:58:29 [auto1.de] INFO: Found listing with ID: GF37615
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF37615%27 HTTP/1.1" 200 None
2026-03-30 10:58:29 [auto1.de] INFO: Scrape type for GF37615: 2
2026-03-30 10:58:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6191c1-46f5-5ec3-b0c6-0ec90c7fadf5 with identifier: GF37615
2026-03-30 10:58:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6191c1-46f5-5ec3-b0c6-0ec90c7fadf5 with scrape type 2
2026-03-30 10:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d6191c1-46f5-5ec3-b0c6-0ec90c7fadf5 with scrape type 2
2026-03-30 10:58:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d6191c1-46f5-5ec3-b0c6-0ec90c7fadf5, identifier: GF37615
2026-03-30 10:58:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d6191c1-46f5-5ec3-b0c6-0ec90c7fadf5 with identifier: GF37615
2026-03-30 10:58:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d6191c1-46f5-5ec3-b0c6-0ec90c7fadf5 with identifier: GF37615
2026-03-30 10:58:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d6191c1-46f5-5ec3-b0c6-0ec90c7fadf5 with identifier: GF37615 to the API
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:52:53Z',
 'fuel_type': 'petrol',
 'id': '8d6191c1-46f5-5ec3-b0c6-0ec90c7fadf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF37615',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 126115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-21',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF37615%27 HTTP/1.1" 200 None
2026-03-30 10:58:29 [auto1.de] INFO: Saving data for GF37615: {'auction_closing_time': 1774885973.0, 'created_time': 1773224150.645807, 'last_price_update_time': 1774868309.924801}
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF37615') HTTP/1.1" 204 0
2026-03-30 10:58:29 [auto1.de] INFO: Found listing with ID: VF27943
2026-03-30 10:58:29 [auto1.de] INFO: Found listing with ID: EK20296
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK20296%27 HTTP/1.1" 200 None
2026-03-30 10:58:29 [auto1.de] INFO: Scrape type for EK20296: 2
2026-03-30 10:58:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d01c62f-7421-5962-9d8a-b284bd9fb1b1 with identifier: EK20296
2026-03-30 10:58:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d01c62f-7421-5962-9d8a-b284bd9fb1b1 with scrape type 2
2026-03-30 10:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d01c62f-7421-5962-9d8a-b284bd9fb1b1 with scrape type 2
2026-03-30 10:58:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d01c62f-7421-5962-9d8a-b284bd9fb1b1, identifier: EK20296
2026-03-30 10:58:30 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 9544 | hits on page: 40
2026-03-30 10:58:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d01c62f-7421-5962-9d8a-b284bd9fb1b1 with identifier: EK20296
2026-03-30 10:58:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d01c62f-7421-5962-9d8a-b284bd9fb1b1 with identifier: EK20296
2026-03-30 10:58:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d01c62f-7421-5962-9d8a-b284bd9fb1b1 with identifier: EK20296 to the API
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:56:24Z',
 'fuel_type': 'petrol',
 'id': '9d01c62f-7421-5962-9d8a-b284bd9fb1b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK20296',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 132050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-07-25',
 'seller_name': None,
 'title': 'Peugeot 307 1.4 XR',
 'transmission': 'manual',
 'trim': 'XR',
 'year': 2002}
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK20296%27 HTTP/1.1" 200 None
2026-03-30 10:58:30 [auto1.de] INFO: Saving data for EK20296: {'auction_closing_time': 1774886184.0, 'created_time': 1774637780.509224, 'last_price_update_time': 1774868310.371545}
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK20296') HTTP/1.1" 204 0
2026-03-30 10:58:30 [auto1.de] INFO: Found listing with ID: MC98570
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC98570%27 HTTP/1.1" 200 None
2026-03-30 10:58:30 [auto1.de] INFO: Scrape type for MC98570: 2
2026-03-30 10:58:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebfd9360-84eb-5a41-83e5-cf0d5465d616 with identifier: MC98570
2026-03-30 10:58:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebfd9360-84eb-5a41-83e5-cf0d5465d616 with scrape type 2
2026-03-30 10:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebfd9360-84eb-5a41-83e5-cf0d5465d616 with scrape type 2
2026-03-30 10:58:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebfd9360-84eb-5a41-83e5-cf0d5465d616, identifier: MC98570
2026-03-30 10:58:30 [auto1.de] INFO: Found listing with ID: MZ37823
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ37823%27 HTTP/1.1" 200 None
2026-03-30 10:58:30 [auto1.de] INFO: Scrape type for MZ37823: 2
2026-03-30 10:58:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13002385-ccd3-55ab-b8a9-6b4548c571a4 with identifier: MZ37823
2026-03-30 10:58:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13002385-ccd3-55ab-b8a9-6b4548c571a4 with scrape type 2
2026-03-30 10:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13002385-ccd3-55ab-b8a9-6b4548c571a4 with scrape type 2
2026-03-30 10:58:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13002385-ccd3-55ab-b8a9-6b4548c571a4, identifier: MZ37823
2026-03-30 10:58:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebfd9360-84eb-5a41-83e5-cf0d5465d616 with identifier: MC98570
2026-03-30 10:58:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebfd9360-84eb-5a41-83e5-cf0d5465d616 with identifier: MC98570
2026-03-30 10:58:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebfd9360-84eb-5a41-83e5-cf0d5465d616 with identifier: MC98570 to the API
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:27:06Z',
 'fuel_type': 'petrol',
 'id': 'ebfd9360-84eb-5a41-83e5-cf0d5465d616',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC98570',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 230299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-02',
 'seller_name': None,
 'title': 'Citroen C4 1.6 VTR Plus',
 'transmission': 'automatic',
 'trim': 'VTR Plus',
 'year': 2006}
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC98570%27 HTTP/1.1" 200 None
2026-03-30 10:58:30 [auto1.de] INFO: Saving data for MC98570: {'auction_closing_time': 1774884426.0, 'created_time': 1773304522.806209, 'last_price_update_time': 1774868310.887235}
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC98570') HTTP/1.1" 204 0
2026-03-30 10:58:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13002385-ccd3-55ab-b8a9-6b4548c571a4 with identifier: MZ37823
2026-03-30 10:58:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13002385-ccd3-55ab-b8a9-6b4548c571a4 with identifier: MZ37823
2026-03-30 10:58:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13002385-ccd3-55ab-b8a9-6b4548c571a4 with identifier: MZ37823 to the API
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:36:45Z',
 'fuel_type': 'diesel',
 'id': '13002385-ccd3-55ab-b8a9-6b4548c571a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ37823',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 222436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-30',
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2017}
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ37823%27 HTTP/1.1" 200 None
2026-03-30 10:58:31 [auto1.de] INFO: Saving data for MZ37823: {'auction_closing_time': 1774885005.0, 'created_time': 1774780576.584183, 'last_price_update_time': 1774868311.757265}
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ37823') HTTP/1.1" 204 0
2026-03-30 10:58:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:31 [auto1.de] INFO: Found listing with ID: TU72063
2026-03-30 10:58:31 [auto1.de] INFO: Found listing with ID: AF05413
2026-03-30 10:58:31 [auto1.de] INFO: Found listing with ID: GC94975
2026-03-30 10:58:31 [auto1.de] INFO: Found listing with ID: JY14465
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY14465%27 HTTP/1.1" 200 None
2026-03-30 10:58:31 [auto1.de] INFO: Scrape type for JY14465: 2
2026-03-30 10:58:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c75c7759-bc23-51a4-a5dd-c80ee6d5b09b with identifier: JY14465
2026-03-30 10:58:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c75c7759-bc23-51a4-a5dd-c80ee6d5b09b with scrape type 2
2026-03-30 10:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c75c7759-bc23-51a4-a5dd-c80ee6d5b09b with scrape type 2
2026-03-30 10:58:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c75c7759-bc23-51a4-a5dd-c80ee6d5b09b, identifier: JY14465
2026-03-30 10:58:31 [auto1.de] INFO: Found listing with ID: KG90894
2026-03-30 10:58:31 [auto1.de] INFO: Found listing with ID: AA02702
2026-03-30 10:58:31 [auto1.de] INFO: Found listing with ID: WX41278
2026-03-30 10:58:31 [auto1.de] INFO: Found listing with ID: FF58085
2026-03-30 10:58:31 [auto1.de] INFO: Found listing with ID: RC66900
2026-03-30 10:58:31 [auto1.de] INFO: Found listing with ID: XV56284
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV56284%27 HTTP/1.1" 200 None
2026-03-30 10:58:31 [auto1.de] INFO: Scrape type for XV56284: 2
2026-03-30 10:58:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7864ee9e-f29c-5d81-928d-e5879f9aebbf with identifier: XV56284
2026-03-30 10:58:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7864ee9e-f29c-5d81-928d-e5879f9aebbf with scrape type 2
2026-03-30 10:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7864ee9e-f29c-5d81-928d-e5879f9aebbf with scrape type 2
2026-03-30 10:58:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7864ee9e-f29c-5d81-928d-e5879f9aebbf, identifier: XV56284
2026-03-30 10:58:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c75c7759-bc23-51a4-a5dd-c80ee6d5b09b with identifier: JY14465
2026-03-30 10:58:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c75c7759-bc23-51a4-a5dd-c80ee6d5b09b with identifier: JY14465
2026-03-30 10:58:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c75c7759-bc23-51a4-a5dd-c80ee6d5b09b with identifier: JY14465 to the API
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 213,
 'expiration_date': '2026-03-30T15:15:27Z',
 'fuel_type': 'hybrid',
 'id': 'c75c7759-bc23-51a4-a5dd-c80ee6d5b09b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY14465',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 61198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-29',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.5 VC-T e-POWER Tekna+ 4x4',
 'transmission': 'automatic',
 'trim': 'Tekna+ 4x4',
 'year': 2023}
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY14465%27 HTTP/1.1" 200 None
2026-03-30 10:58:32 [auto1.de] INFO: Saving data for JY14465: {'auction_closing_time': 1774883727.0, 'created_time': 1774780580.93976, 'last_price_update_time': 1774868312.280937}
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY14465') HTTP/1.1" 204 0
2026-03-30 10:58:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7864ee9e-f29c-5d81-928d-e5879f9aebbf with identifier: XV56284
2026-03-30 10:58:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7864ee9e-f29c-5d81-928d-e5879f9aebbf with identifier: XV56284
2026-03-30 10:58:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7864ee9e-f29c-5d81-928d-e5879f9aebbf with identifier: XV56284 to the API
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:07:28Z',
 'fuel_type': 'diesel',
 'id': '7864ee9e-f29c-5d81-928d-e5879f9aebbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV56284',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 166210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-31',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV56284%27 HTTP/1.1" 200 None
2026-03-30 10:58:32 [auto1.de] INFO: Saving data for XV56284: {'auction_closing_time': 1774883248.0, 'created_time': 1774550912.214317, 'last_price_update_time': 1774868312.697607}
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV56284') HTTP/1.1" 204 0
2026-03-30 10:58:32 [auto1.de] INFO: Found listing with ID: ZR75909
2026-03-30 10:58:32 [auto1.de] INFO: Found listing with ID: TT55225
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT55225%27 HTTP/1.1" 200 None
2026-03-30 10:58:32 [auto1.de] INFO: Scrape type for TT55225: 2
2026-03-30 10:58:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd5501a3-67a5-5eb0-a85a-2c82d3a3068f with identifier: TT55225
2026-03-30 10:58:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd5501a3-67a5-5eb0-a85a-2c82d3a3068f with scrape type 2
2026-03-30 10:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd5501a3-67a5-5eb0-a85a-2c82d3a3068f with scrape type 2
2026-03-30 10:58:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd5501a3-67a5-5eb0-a85a-2c82d3a3068f, identifier: TT55225
2026-03-30 10:58:32 [auto1.de] INFO: Found listing with ID: TR94323
2026-03-30 10:58:32 [auto1.de] INFO: Found listing with ID: EJ33834
2026-03-30 10:58:32 [auto1.de] INFO: Found listing with ID: KH07650
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH07650%27 HTTP/1.1" 200 None
2026-03-30 10:58:32 [auto1.de] INFO: Scrape type for KH07650: 2
2026-03-30 10:58:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cae4cab5-d35c-5c8f-90a5-c683dc29baf0 with identifier: KH07650
2026-03-30 10:58:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cae4cab5-d35c-5c8f-90a5-c683dc29baf0 with scrape type 2
2026-03-30 10:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cae4cab5-d35c-5c8f-90a5-c683dc29baf0 with scrape type 2
2026-03-30 10:58:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cae4cab5-d35c-5c8f-90a5-c683dc29baf0, identifier: KH07650
2026-03-30 10:58:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd5501a3-67a5-5eb0-a85a-2c82d3a3068f with identifier: TT55225
2026-03-30 10:58:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd5501a3-67a5-5eb0-a85a-2c82d3a3068f with identifier: TT55225
2026-03-30 10:58:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd5501a3-67a5-5eb0-a85a-2c82d3a3068f with identifier: TT55225 to the API
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:13:04Z',
 'fuel_type': 'diesel',
 'id': 'fd5501a3-67a5-5eb0-a85a-2c82d3a3068f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT55225',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 124506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-04',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 Pure',
 'transmission': 'automatic',
 'trim': 'Pure',
 'year': 2018}
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT55225%27 HTTP/1.1" 200 None
2026-03-30 10:58:33 [auto1.de] INFO: Saving data for TT55225: {'auction_closing_time': 1774883584.0, 'created_time': 1774780577.847994, 'last_price_update_time': 1774868313.249715}
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT55225') HTTP/1.1" 204 0
2026-03-30 10:58:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cae4cab5-d35c-5c8f-90a5-c683dc29baf0 with identifier: KH07650
2026-03-30 10:58:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cae4cab5-d35c-5c8f-90a5-c683dc29baf0 with identifier: KH07650
2026-03-30 10:58:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cae4cab5-d35c-5c8f-90a5-c683dc29baf0 with identifier: KH07650 to the API
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:57:55Z',
 'fuel_type': 'diesel',
 'id': 'cae4cab5-d35c-5c8f-90a5-c683dc29baf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH07650',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Talento',
 'odometer': 111208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-26',
 'seller_name': None,
 'title': 'Fiat Talento 1.6 TwinTurbo Diesel Ecojet L1H1 1,0t Family',
 'transmission': 'manual',
 'trim': 'L1H1 1,0t Family',
 'year': 2018}
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH07650%27 HTTP/1.1" 200 None
2026-03-30 10:58:33 [auto1.de] INFO: Saving data for KH07650: {'auction_closing_time': 1774886275.0, 'created_time': 1773571705.035339, 'last_price_update_time': 1774868313.533143}
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH07650') HTTP/1.1" 204 0
2026-03-30 10:58:33 [auto1.de] INFO: Found listing with ID: EX17549
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX17549%27 HTTP/1.1" 200 None
2026-03-30 10:58:33 [auto1.de] INFO: Scrape type for EX17549: 2
2026-03-30 10:58:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11e8fa88-7aeb-531d-bc62-d898ec4f4c0b with identifier: EX17549
2026-03-30 10:58:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e8fa88-7aeb-531d-bc62-d898ec4f4c0b with scrape type 2
2026-03-30 10:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11e8fa88-7aeb-531d-bc62-d898ec4f4c0b with scrape type 2
2026-03-30 10:58:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11e8fa88-7aeb-531d-bc62-d898ec4f4c0b, identifier: EX17549
2026-03-30 10:58:33 [auto1.de] INFO: Found listing with ID: FN39592
2026-03-30 10:58:33 [auto1.de] INFO: Found listing with ID: YV56430
2026-03-30 10:58:33 [auto1.de] INFO: Found listing with ID: VV83737
2026-03-30 10:58:33 [auto1.de] INFO: Found listing with ID: BS63746
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS63746%27 HTTP/1.1" 200 None
2026-03-30 10:58:33 [auto1.de] INFO: Scrape type for BS63746: 2
2026-03-30 10:58:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91a835ae-9bc4-56b9-a3ea-0daa0f2085e1 with identifier: BS63746
2026-03-30 10:58:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91a835ae-9bc4-56b9-a3ea-0daa0f2085e1 with scrape type 2
2026-03-30 10:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91a835ae-9bc4-56b9-a3ea-0daa0f2085e1 with scrape type 2
2026-03-30 10:58:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91a835ae-9bc4-56b9-a3ea-0daa0f2085e1, identifier: BS63746
2026-03-30 10:58:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11e8fa88-7aeb-531d-bc62-d898ec4f4c0b with identifier: EX17549
2026-03-30 10:58:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11e8fa88-7aeb-531d-bc62-d898ec4f4c0b with identifier: EX17549
2026-03-30 10:58:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11e8fa88-7aeb-531d-bc62-d898ec4f4c0b with identifier: EX17549 to the API
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:54:31Z',
 'fuel_type': 'petrol',
 'id': '11e8fa88-7aeb-531d-bc62-d898ec4f4c0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX17549',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 99190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-05',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 220 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX17549%27 HTTP/1.1" 200 None
2026-03-30 10:58:34 [auto1.de] INFO: Saving data for EX17549: {'auction_closing_time': 1774886071.0, 'created_time': 1773945955.646503, 'last_price_update_time': 1774868314.04456}
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX17549') HTTP/1.1" 204 0
2026-03-30 10:58:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91a835ae-9bc4-56b9-a3ea-0daa0f2085e1 with identifier: BS63746
2026-03-30 10:58:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91a835ae-9bc4-56b9-a3ea-0daa0f2085e1 with identifier: BS63746
2026-03-30 10:58:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91a835ae-9bc4-56b9-a3ea-0daa0f2085e1 with identifier: BS63746 to the API
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:48:02Z',
 'fuel_type': 'petrol',
 'id': '91a835ae-9bc4-56b9-a3ea-0daa0f2085e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS63746',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 63827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-13',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS63746%27 HTTP/1.1" 200 None
2026-03-30 10:58:34 [auto1.de] INFO: Saving data for BS63746: {'auction_closing_time': 1774885682.0, 'created_time': 1774780583.035773, 'last_price_update_time': 1774868314.317609}
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS63746') HTTP/1.1" 204 0
2026-03-30 10:58:34 [auto1.de] INFO: Found listing with ID: TE08681
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE08681%27 HTTP/1.1" 200 None
2026-03-30 10:58:34 [auto1.de] INFO: Scrape type for TE08681: 2
2026-03-30 10:58:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1502214c-2353-5432-8930-45f4678b64d5 with identifier: TE08681
2026-03-30 10:58:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1502214c-2353-5432-8930-45f4678b64d5 with scrape type 2
2026-03-30 10:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1502214c-2353-5432-8930-45f4678b64d5 with scrape type 2
2026-03-30 10:58:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1502214c-2353-5432-8930-45f4678b64d5, identifier: TE08681
2026-03-30 10:58:34 [auto1.de] INFO: Found listing with ID: BD67330
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD67330%27 HTTP/1.1" 200 None
2026-03-30 10:58:34 [auto1.de] INFO: Scrape type for BD67330: 2
2026-03-30 10:58:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5c2ecc5-3b83-5cc0-81b2-e28a62c3f144 with identifier: BD67330
2026-03-30 10:58:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5c2ecc5-3b83-5cc0-81b2-e28a62c3f144 with scrape type 2
2026-03-30 10:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5c2ecc5-3b83-5cc0-81b2-e28a62c3f144 with scrape type 2
2026-03-30 10:58:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5c2ecc5-3b83-5cc0-81b2-e28a62c3f144, identifier: BD67330
2026-03-30 10:58:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1502214c-2353-5432-8930-45f4678b64d5 with identifier: TE08681
2026-03-30 10:58:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1502214c-2353-5432-8930-45f4678b64d5 with identifier: TE08681
2026-03-30 10:58:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1502214c-2353-5432-8930-45f4678b64d5 with identifier: TE08681 to the API
2026-03-30 10:58:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:31:11Z',
 'fuel_type': 'petrol',
 'id': '1502214c-2353-5432-8930-45f4678b64d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE08681',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 145829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-30',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE08681%27 HTTP/1.1" 200 None
2026-03-30 10:58:35 [auto1.de] INFO: Saving data for TE08681: {'auction_closing_time': 1774884671.0, 'created_time': 1774780588.015343, 'last_price_update_time': 1774868315.392973}
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE08681') HTTP/1.1" 204 0
2026-03-30 10:58:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5c2ecc5-3b83-5cc0-81b2-e28a62c3f144 with identifier: BD67330
2026-03-30 10:58:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5c2ecc5-3b83-5cc0-81b2-e28a62c3f144 with identifier: BD67330
2026-03-30 10:58:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5c2ecc5-3b83-5cc0-81b2-e28a62c3f144 with identifier: BD67330 to the API
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:34:04Z',
 'fuel_type': 'petrol',
 'id': 'd5c2ecc5-3b83-5cc0-81b2-e28a62c3f144',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD67330',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 101608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-27',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.0 Turbo Super Q4',
 'transmission': 'automatic',
 'trim': 'Super Q4',
 'year': 2017}
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD67330%27 HTTP/1.1" 200 None
2026-03-30 10:58:35 [auto1.de] INFO: Saving data for BD67330: {'auction_closing_time': 1774884844.0, 'created_time': 1774550712.020694, 'last_price_update_time': 1774868315.82073}
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD67330') HTTP/1.1" 204 0
2026-03-30 10:58:35 [auto1.de] INFO: Found listing with ID: HB21625
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB21625%27 HTTP/1.1" 200 None
2026-03-30 10:58:35 [auto1.de] INFO: Scrape type for HB21625: 2
2026-03-30 10:58:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 240effed-d60a-5bd0-b5ae-6e300435bb4b with identifier: HB21625
2026-03-30 10:58:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 240effed-d60a-5bd0-b5ae-6e300435bb4b with scrape type 2
2026-03-30 10:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 240effed-d60a-5bd0-b5ae-6e300435bb4b with scrape type 2
2026-03-30 10:58:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 240effed-d60a-5bd0-b5ae-6e300435bb4b, identifier: HB21625
2026-03-30 10:58:35 [auto1.de] INFO: Found listing with ID: EC15325
2026-03-30 10:58:35 [auto1.de] INFO: Found listing with ID: JC71292
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC71292%27 HTTP/1.1" 200 None
2026-03-30 10:58:35 [auto1.de] INFO: Scrape type for JC71292: 2
2026-03-30 10:58:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 823f78c4-8278-5605-a962-1f96ff2255ba with identifier: JC71292
2026-03-30 10:58:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 823f78c4-8278-5605-a962-1f96ff2255ba with scrape type 2
2026-03-30 10:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 823f78c4-8278-5605-a962-1f96ff2255ba with scrape type 2
2026-03-30 10:58:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 823f78c4-8278-5605-a962-1f96ff2255ba, identifier: JC71292
2026-03-30 10:58:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 240effed-d60a-5bd0-b5ae-6e300435bb4b with identifier: HB21625
2026-03-30 10:58:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 240effed-d60a-5bd0-b5ae-6e300435bb4b with identifier: HB21625
2026-03-30 10:58:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 240effed-d60a-5bd0-b5ae-6e300435bb4b with identifier: HB21625 to the API
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:36:29Z',
 'fuel_type': 'petrol',
 'id': '240effed-d60a-5bd0-b5ae-6e300435bb4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB21625',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 55195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-30',
 'seller_name': None,
 'title': 'Kia XCeed 1.4 TGDI JBL Sound Edition',
 'transmission': 'automatic',
 'trim': 'JBL Sound Edition',
 'year': 2020}
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB21625%27 HTTP/1.1" 200 None
2026-03-30 10:58:36 [auto1.de] INFO: Saving data for HB21625: {'auction_closing_time': 1774884989.0, 'created_time': 1774780586.170729, 'last_price_update_time': 1774868316.389035}
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB21625') HTTP/1.1" 204 0
2026-03-30 10:58:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 823f78c4-8278-5605-a962-1f96ff2255ba with identifier: JC71292
2026-03-30 10:58:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 823f78c4-8278-5605-a962-1f96ff2255ba with identifier: JC71292
2026-03-30 10:58:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 823f78c4-8278-5605-a962-1f96ff2255ba with identifier: JC71292 to the API
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:06:31Z',
 'fuel_type': 'petrol',
 'id': '823f78c4-8278-5605-a962-1f96ff2255ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC71292',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 130325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-02',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Kompressor T Elegance',
 'transmission': 'manual',
 'trim': 'T Elegance',
 'year': 2007}
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC71292%27 HTTP/1.1" 200 None
2026-03-30 10:58:36 [auto1.de] INFO: Saving data for JC71292: {'auction_closing_time': 1774883191.0, 'created_time': 1773945557.783348, 'last_price_update_time': 1774868316.680205}
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC71292') HTTP/1.1" 204 0
2026-03-30 10:58:36 [auto1.de] INFO: Found listing with ID: YW33550
2026-03-30 10:58:36 [auto1.de] INFO: Found listing with ID: VE07121
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE07121%27 HTTP/1.1" 200 None
2026-03-30 10:58:36 [auto1.de] INFO: Scrape type for VE07121: 2
2026-03-30 10:58:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d51a362-f20f-5d31-af0d-5811cb785dd0 with identifier: VE07121
2026-03-30 10:58:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d51a362-f20f-5d31-af0d-5811cb785dd0 with scrape type 2
2026-03-30 10:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d51a362-f20f-5d31-af0d-5811cb785dd0 with scrape type 2
2026-03-30 10:58:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d51a362-f20f-5d31-af0d-5811cb785dd0, identifier: VE07121
2026-03-30 10:58:36 [auto1.de] INFO: Found listing with ID: XY86775
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY86775%27 HTTP/1.1" 200 None
2026-03-30 10:58:36 [auto1.de] INFO: Scrape type for XY86775: 2
2026-03-30 10:58:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e14b760-2a21-5f5f-8d0f-b546f844864e with identifier: XY86775
2026-03-30 10:58:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e14b760-2a21-5f5f-8d0f-b546f844864e with scrape type 2
2026-03-30 10:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e14b760-2a21-5f5f-8d0f-b546f844864e with scrape type 2
2026-03-30 10:58:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e14b760-2a21-5f5f-8d0f-b546f844864e, identifier: XY86775
2026-03-30 10:58:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d51a362-f20f-5d31-af0d-5811cb785dd0 with identifier: VE07121
2026-03-30 10:58:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d51a362-f20f-5d31-af0d-5811cb785dd0 with identifier: VE07121
2026-03-30 10:58:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d51a362-f20f-5d31-af0d-5811cb785dd0 with identifier: VE07121 to the API
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:45:16Z',
 'fuel_type': 'diesel',
 'id': '0d51a362-f20f-5d31-af0d-5811cb785dd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE07121',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 103309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-23',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2016}
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE07121%27 HTTP/1.1" 200 None
2026-03-30 10:58:37 [auto1.de] INFO: Saving data for VE07121: {'auction_closing_time': 1774885516.0, 'created_time': 1774780592.930006, 'last_price_update_time': 1774868317.20857}
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE07121') HTTP/1.1" 204 0
2026-03-30 10:58:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e14b760-2a21-5f5f-8d0f-b546f844864e with identifier: XY86775
2026-03-30 10:58:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e14b760-2a21-5f5f-8d0f-b546f844864e with identifier: XY86775
2026-03-30 10:58:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e14b760-2a21-5f5f-8d0f-b546f844864e with identifier: XY86775 to the API
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:23:04Z',
 'fuel_type': 'petrol',
 'id': '1e14b760-2a21-5f5f-8d0f-b546f844864e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY86775',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 225462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-04-30',
 'seller_name': None,
 'title': 'BMW 5er 525i',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY86775%27 HTTP/1.1" 200 None
2026-03-30 10:58:37 [auto1.de] INFO: Saving data for XY86775: {'auction_closing_time': 1774884184.0, 'created_time': 1773429710.596912, 'last_price_update_time': 1774868317.493751}
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY86775') HTTP/1.1" 204 0
2026-03-30 10:58:37 [auto1.de] INFO: Found listing with ID: RT89872
2026-03-30 10:58:37 [auto1.de] INFO: Found listing with ID: VN24673
2026-03-30 10:58:37 [auto1.de] INFO: Found listing with ID: RL83760
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83760%27 HTTP/1.1" 200 None
2026-03-30 10:58:37 [auto1.de] INFO: Scrape type for RL83760: 2
2026-03-30 10:58:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5db0cf00-68e7-5bde-95f2-74fb38274bcb with identifier: RL83760
2026-03-30 10:58:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5db0cf00-68e7-5bde-95f2-74fb38274bcb with scrape type 2
2026-03-30 10:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5db0cf00-68e7-5bde-95f2-74fb38274bcb with scrape type 2
2026-03-30 10:58:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5db0cf00-68e7-5bde-95f2-74fb38274bcb, identifier: RL83760
2026-03-30 10:58:37 [auto1.de] INFO: Found listing with ID: MR97164
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR97164%27 HTTP/1.1" 200 None
2026-03-30 10:58:37 [auto1.de] INFO: Scrape type for MR97164: 2
2026-03-30 10:58:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8802af05-9077-5cca-8256-e3941e52e775 with identifier: MR97164
2026-03-30 10:58:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8802af05-9077-5cca-8256-e3941e52e775 with scrape type 2
2026-03-30 10:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8802af05-9077-5cca-8256-e3941e52e775 with scrape type 2
2026-03-30 10:58:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8802af05-9077-5cca-8256-e3941e52e775, identifier: MR97164
2026-03-30 10:58:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5db0cf00-68e7-5bde-95f2-74fb38274bcb with identifier: RL83760
2026-03-30 10:58:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5db0cf00-68e7-5bde-95f2-74fb38274bcb with identifier: RL83760
2026-03-30 10:58:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5db0cf00-68e7-5bde-95f2-74fb38274bcb with identifier: RL83760 to the API
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:41:36Z',
 'fuel_type': 'petrol',
 'id': '5db0cf00-68e7-5bde-95f2-74fb38274bcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL83760',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Logo',
 'odometer': 81796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-03-21',
 'seller_name': None,
 'title': 'Honda Logo 1.3',
 'transmission': 'automatic',
 'trim': '',
 'year': 1999}
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83760%27 HTTP/1.1" 200 None
2026-03-30 10:58:38 [auto1.de] INFO: Saving data for RL83760: {'auction_closing_time': 1774885296.0, 'created_time': 1774550724.667173, 'last_price_update_time': 1774868318.037301}
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL83760') HTTP/1.1" 204 0
2026-03-30 10:58:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8802af05-9077-5cca-8256-e3941e52e775 with identifier: MR97164
2026-03-30 10:58:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8802af05-9077-5cca-8256-e3941e52e775 with identifier: MR97164
2026-03-30 10:58:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8802af05-9077-5cca-8256-e3941e52e775 with identifier: MR97164 to the API
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:55:37Z',
 'fuel_type': 'petrol',
 'id': '8802af05-9077-5cca-8256-e3941e52e775',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR97164',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 169812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-22',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2006}
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR97164%27 HTTP/1.1" 200 None
2026-03-30 10:58:38 [auto1.de] INFO: Saving data for MR97164: {'auction_closing_time': 1774886137.0, 'created_time': 1773775938.949593, 'last_price_update_time': 1774868318.30964}
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR97164') HTTP/1.1" 204 0
2026-03-30 10:58:38 [auto1.de] INFO: Found listing with ID: HH17921
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH17921%27 HTTP/1.1" 200 None
2026-03-30 10:58:38 [auto1.de] INFO: Scrape type for HH17921: 2
2026-03-30 10:58:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08c8065f-a223-56a0-9f34-35213e8da58c with identifier: HH17921
2026-03-30 10:58:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08c8065f-a223-56a0-9f34-35213e8da58c with scrape type 2
2026-03-30 10:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08c8065f-a223-56a0-9f34-35213e8da58c with scrape type 2
2026-03-30 10:58:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08c8065f-a223-56a0-9f34-35213e8da58c, identifier: HH17921
2026-03-30 10:58:38 [auto1.de] INFO: Found listing with ID: TL60563
2026-03-30 10:58:38 [auto1.de] INFO: Found listing with ID: GF90377
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF90377%27 HTTP/1.1" 200 None
2026-03-30 10:58:38 [auto1.de] INFO: Scrape type for GF90377: 2
2026-03-30 10:58:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 339ea701-9bb8-5e66-bff9-a5ece4b36499 with identifier: GF90377
2026-03-30 10:58:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 339ea701-9bb8-5e66-bff9-a5ece4b36499 with scrape type 2
2026-03-30 10:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 339ea701-9bb8-5e66-bff9-a5ece4b36499 with scrape type 2
2026-03-30 10:58:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 339ea701-9bb8-5e66-bff9-a5ece4b36499, identifier: GF90377
2026-03-30 10:58:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08c8065f-a223-56a0-9f34-35213e8da58c with identifier: HH17921
2026-03-30 10:58:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08c8065f-a223-56a0-9f34-35213e8da58c with identifier: HH17921
2026-03-30 10:58:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08c8065f-a223-56a0-9f34-35213e8da58c with identifier: HH17921 to the API
2026-03-30 10:58:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:01:30Z',
 'fuel_type': 'diesel',
 'id': '08c8065f-a223-56a0-9f34-35213e8da58c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH17921',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 59568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-25',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi Business Pack',
 'transmission': 'manual',
 'trim': 'Business Pack',
 'year': 2015}
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH17921%27 HTTP/1.1" 200 None
2026-03-30 10:58:39 [auto1.de] INFO: Saving data for HH17921: {'auction_closing_time': 1774882890.0, 'created_time': 1774550658.901572, 'last_price_update_time': 1774868319.400968}
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH17921') HTTP/1.1" 204 0
2026-03-30 10:58:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 339ea701-9bb8-5e66-bff9-a5ece4b36499 with identifier: GF90377
2026-03-30 10:58:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 339ea701-9bb8-5e66-bff9-a5ece4b36499 with identifier: GF90377
2026-03-30 10:58:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 339ea701-9bb8-5e66-bff9-a5ece4b36499 with identifier: GF90377 to the API
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:22:26Z',
 'fuel_type': 'petrol',
 'id': '339ea701-9bb8-5e66-bff9-a5ece4b36499',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF90377',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 215437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-27',
 'seller_name': None,
 'title': 'Honda Civic 1.4 Sport Unlimited',
 'transmission': 'manual',
 'trim': 'Sport Unlimited',
 'year': 2005}
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF90377%27 HTTP/1.1" 200 None
2026-03-30 10:58:39 [auto1.de] INFO: Saving data for GF90377: {'auction_closing_time': 1774884146.0, 'created_time': 1774550901.603305, 'last_price_update_time': 1774868319.780705}
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF90377') HTTP/1.1" 204 0
2026-03-30 10:58:39 [auto1.de] INFO: Found listing with ID: UY63030
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY63030%27 HTTP/1.1" 200 None
2026-03-30 10:58:39 [auto1.de] INFO: Scrape type for UY63030: 2
2026-03-30 10:58:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23558bdd-3615-50fa-896c-1827cc61a4dd with identifier: UY63030
2026-03-30 10:58:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23558bdd-3615-50fa-896c-1827cc61a4dd with scrape type 2
2026-03-30 10:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23558bdd-3615-50fa-896c-1827cc61a4dd with scrape type 2
2026-03-30 10:58:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23558bdd-3615-50fa-896c-1827cc61a4dd, identifier: UY63030
2026-03-30 10:58:39 [auto1.de] INFO: Found listing with ID: EX05236
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX05236%27 HTTP/1.1" 200 None
2026-03-30 10:58:39 [auto1.de] INFO: Scrape type for EX05236: 2
2026-03-30 10:58:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64f6ffe1-ec1e-550e-90d9-e92bf3d807f3 with identifier: EX05236
2026-03-30 10:58:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64f6ffe1-ec1e-550e-90d9-e92bf3d807f3 with scrape type 2
2026-03-30 10:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64f6ffe1-ec1e-550e-90d9-e92bf3d807f3 with scrape type 2
2026-03-30 10:58:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64f6ffe1-ec1e-550e-90d9-e92bf3d807f3, identifier: EX05236
2026-03-30 10:58:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:58:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23558bdd-3615-50fa-896c-1827cc61a4dd with identifier: UY63030
2026-03-30 10:58:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23558bdd-3615-50fa-896c-1827cc61a4dd with identifier: UY63030
2026-03-30 10:58:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23558bdd-3615-50fa-896c-1827cc61a4dd with identifier: UY63030 to the API
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:56:13Z',
 'fuel_type': 'diesel',
 'id': '23558bdd-3615-50fa-896c-1827cc61a4dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY63030',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 210950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-30',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY63030%27 HTTP/1.1" 200 None
2026-03-30 10:58:40 [auto1.de] INFO: Saving data for UY63030: {'auction_closing_time': 1774886173.0, 'created_time': 1773427828.857015, 'last_price_update_time': 1774868320.315131}
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY63030') HTTP/1.1" 204 0
2026-03-30 10:58:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64f6ffe1-ec1e-550e-90d9-e92bf3d807f3 with identifier: EX05236
2026-03-30 10:58:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64f6ffe1-ec1e-550e-90d9-e92bf3d807f3 with identifier: EX05236
2026-03-30 10:58:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64f6ffe1-ec1e-550e-90d9-e92bf3d807f3 with identifier: EX05236 to the API
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:06:50Z',
 'fuel_type': 'petrol',
 'id': '64f6ffe1-ec1e-550e-90d9-e92bf3d807f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX05236',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 233431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-07-11',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 320 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2000}
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX05236%27 HTTP/1.1" 200 None
2026-03-30 10:58:40 [auto1.de] INFO: Saving data for EX05236: {'auction_closing_time': 1774883210.0, 'created_time': 1774637243.437582, 'last_price_update_time': 1774868320.599925}
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX05236') HTTP/1.1" 204 0
2026-03-30 10:58:40 [auto1.de] INFO: Found listing with ID: ZY88037
2026-03-30 10:58:40 [auto1.de] INFO: Found listing with ID: NC19407
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC19407%27 HTTP/1.1" 200 None
2026-03-30 10:58:40 [auto1.de] INFO: Scrape type for NC19407: 2
2026-03-30 10:58:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eaa094c-fb8a-569f-b03b-98a5f3ed76ee with identifier: NC19407
2026-03-30 10:58:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eaa094c-fb8a-569f-b03b-98a5f3ed76ee with scrape type 2
2026-03-30 10:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2eaa094c-fb8a-569f-b03b-98a5f3ed76ee with scrape type 2
2026-03-30 10:58:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2eaa094c-fb8a-569f-b03b-98a5f3ed76ee, identifier: NC19407
2026-03-30 10:58:40 [auto1.de] INFO: Found listing with ID: FY44506
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY44506%27 HTTP/1.1" 200 None
2026-03-30 10:58:40 [auto1.de] INFO: Scrape type for FY44506: 2
2026-03-30 10:58:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e9226d1-ab29-5de1-88dc-137f9c5178a7 with identifier: FY44506
2026-03-30 10:58:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e9226d1-ab29-5de1-88dc-137f9c5178a7 with scrape type 2
2026-03-30 10:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e9226d1-ab29-5de1-88dc-137f9c5178a7 with scrape type 2
2026-03-30 10:58:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e9226d1-ab29-5de1-88dc-137f9c5178a7, identifier: FY44506
2026-03-30 10:58:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2eaa094c-fb8a-569f-b03b-98a5f3ed76ee with identifier: NC19407
2026-03-30 10:58:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2eaa094c-fb8a-569f-b03b-98a5f3ed76ee with identifier: NC19407
2026-03-30 10:58:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2eaa094c-fb8a-569f-b03b-98a5f3ed76ee with identifier: NC19407 to the API
2026-03-30 10:58:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:15:21Z',
 'fuel_type': 'gas',
 'id': '2eaa094c-fb8a-569f-b03b-98a5f3ed76ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC19407',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 283840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-22',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI EcoFuel Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC19407%27 HTTP/1.1" 200 None
2026-03-30 10:58:41 [auto1.de] INFO: Saving data for NC19407: {'auction_closing_time': 1774883721.0, 'created_time': 1773304267.35604, 'last_price_update_time': 1774868321.136741}
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC19407') HTTP/1.1" 204 0
2026-03-30 10:58:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e9226d1-ab29-5de1-88dc-137f9c5178a7 with identifier: FY44506
2026-03-30 10:58:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e9226d1-ab29-5de1-88dc-137f9c5178a7 with identifier: FY44506
2026-03-30 10:58:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e9226d1-ab29-5de1-88dc-137f9c5178a7 with identifier: FY44506 to the API
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:32:45Z',
 'fuel_type': 'diesel',
 'id': '3e9226d1-ab29-5de1-88dc-137f9c5178a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY44506',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-24',
 'seller_name': None,
 'title': 'Kia Sorento 2.5 CRDi VGT EX',
 'transmission': 'manual',
 'trim': 'VGT EX',
 'year': 2009}
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY44506%27 HTTP/1.1" 200 None
2026-03-30 10:58:41 [auto1.de] INFO: Saving data for FY44506: {'auction_closing_time': 1774884765.0, 'created_time': 1773775713.179534, 'last_price_update_time': 1774868321.402839}
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY44506') HTTP/1.1" 204 0
2026-03-30 10:58:41 [auto1.de] INFO: Found listing with ID: RR70760
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR70760%27 HTTP/1.1" 200 None
2026-03-30 10:58:41 [auto1.de] INFO: Scrape type for RR70760: 2
2026-03-30 10:58:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3aa40cf4-1b93-5bba-b866-f8bee9729b02 with identifier: RR70760
2026-03-30 10:58:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3aa40cf4-1b93-5bba-b866-f8bee9729b02 with scrape type 2
2026-03-30 10:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3aa40cf4-1b93-5bba-b866-f8bee9729b02 with scrape type 2
2026-03-30 10:58:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3aa40cf4-1b93-5bba-b866-f8bee9729b02, identifier: RR70760
2026-03-30 10:58:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3aa40cf4-1b93-5bba-b866-f8bee9729b02 with identifier: RR70760
2026-03-30 10:58:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3aa40cf4-1b93-5bba-b866-f8bee9729b02 with identifier: RR70760
2026-03-30 10:58:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3aa40cf4-1b93-5bba-b866-f8bee9729b02 with identifier: RR70760 to the API
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:16:32Z',
 'fuel_type': 'diesel',
 'id': '3aa40cf4-1b93-5bba-b866-f8bee9729b02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR70760',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 108941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': 'Citroen Jumpy 1.5 Blue-HDi Feel M',
 'transmission': 'manual',
 'trim': 'Feel M',
 'year': 2019}
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR70760%27 HTTP/1.1" 200 None
2026-03-30 10:58:41 [auto1.de] INFO: Saving data for RR70760: {'auction_closing_time': 1774883792.0, 'created_time': 1774780595.516774, 'last_price_update_time': 1774868321.796571}
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR70760') HTTP/1.1" 204 0
2026-03-30 10:58:41 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 9546 | hits on page: 40
2026-03-30 10:58:41 [auto1.de] INFO: Found listing with ID: DC02620
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC02620%27 HTTP/1.1" 200 None
2026-03-30 10:58:41 [auto1.de] INFO: Scrape type for DC02620: 2
2026-03-30 10:58:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b512a2db-f20e-5850-a9c3-dbdaead5c751 with identifier: DC02620
2026-03-30 10:58:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b512a2db-f20e-5850-a9c3-dbdaead5c751 with scrape type 2
2026-03-30 10:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b512a2db-f20e-5850-a9c3-dbdaead5c751 with scrape type 2
2026-03-30 10:58:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b512a2db-f20e-5850-a9c3-dbdaead5c751, identifier: DC02620
2026-03-30 10:58:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b512a2db-f20e-5850-a9c3-dbdaead5c751 with identifier: DC02620
2026-03-30 10:58:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b512a2db-f20e-5850-a9c3-dbdaead5c751 with identifier: DC02620
2026-03-30 10:58:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b512a2db-f20e-5850-a9c3-dbdaead5c751 with identifier: DC02620 to the API
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:41Z',
 'fuel_type': 'diesel',
 'id': 'b512a2db-f20e-5850-a9c3-dbdaead5c751',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC02620',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 260020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-09-18',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2003}
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC02620%27 HTTP/1.1" 200 None
2026-03-30 10:58:42 [auto1.de] INFO: Saving data for DC02620: {'auction_closing_time': 1774883861.0, 'created_time': 1773302030.958385, 'last_price_update_time': 1774868322.184057}
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC02620') HTTP/1.1" 204 0
2026-03-30 10:58:42 [auto1.de] INFO: Found listing with ID: FE29735
2026-03-30 10:58:42 [auto1.de] INFO: Found listing with ID: BS02635
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS02635%27 HTTP/1.1" 200 None
2026-03-30 10:58:42 [auto1.de] INFO: Scrape type for BS02635: 2
2026-03-30 10:58:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ed4827e-63ff-52fd-b656-73d08d805143 with identifier: BS02635
2026-03-30 10:58:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ed4827e-63ff-52fd-b656-73d08d805143 with scrape type 2
2026-03-30 10:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ed4827e-63ff-52fd-b656-73d08d805143 with scrape type 2
2026-03-30 10:58:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ed4827e-63ff-52fd-b656-73d08d805143, identifier: BS02635
2026-03-30 10:58:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:42 [auto1.de] INFO: Found listing with ID: LF08399
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF08399%27 HTTP/1.1" 200 None
2026-03-30 10:58:42 [auto1.de] INFO: Scrape type for LF08399: 2
2026-03-30 10:58:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55f9a8c7-5625-5997-9c23-9cf40f7497f3 with identifier: LF08399
2026-03-30 10:58:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55f9a8c7-5625-5997-9c23-9cf40f7497f3 with scrape type 2
2026-03-30 10:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55f9a8c7-5625-5997-9c23-9cf40f7497f3 with scrape type 2
2026-03-30 10:58:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55f9a8c7-5625-5997-9c23-9cf40f7497f3, identifier: LF08399
2026-03-30 10:58:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ed4827e-63ff-52fd-b656-73d08d805143 with identifier: BS02635
2026-03-30 10:58:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ed4827e-63ff-52fd-b656-73d08d805143 with identifier: BS02635
2026-03-30 10:58:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ed4827e-63ff-52fd-b656-73d08d805143 with identifier: BS02635 to the API
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:39:55Z',
 'fuel_type': 'petrol',
 'id': '4ed4827e-63ff-52fd-b656-73d08d805143',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS02635',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 49276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-12',
 'seller_name': None,
 'title': 'Hyundai i30 2.0 TGDI N Performance',
 'transmission': 'manual',
 'trim': 'N Performance',
 'year': 2020}
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS02635%27 HTTP/1.1" 200 None
2026-03-30 10:58:42 [auto1.de] INFO: Saving data for BS02635: {'auction_closing_time': 1774885195.0, 'created_time': 1774780595.148162, 'last_price_update_time': 1774868322.69031}
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS02635') HTTP/1.1" 204 0
2026-03-30 10:58:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55f9a8c7-5625-5997-9c23-9cf40f7497f3 with identifier: LF08399
2026-03-30 10:58:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55f9a8c7-5625-5997-9c23-9cf40f7497f3 with identifier: LF08399
2026-03-30 10:58:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55f9a8c7-5625-5997-9c23-9cf40f7497f3 with identifier: LF08399 to the API
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:38:51Z',
 'fuel_type': 'petrol',
 'id': '55f9a8c7-5625-5997-9c23-9cf40f7497f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF08399',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 171583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-08-31',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 FSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2004}
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF08399%27 HTTP/1.1" 200 None
2026-03-30 10:58:42 [auto1.de] INFO: Saving data for LF08399: {'auction_closing_time': 1774885131.0, 'created_time': 1773774404.035824, 'last_price_update_time': 1774868322.983568}
2026-03-30 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF08399') HTTP/1.1" 204 0
2026-03-30 10:58:43 [auto1.de] INFO: Found listing with ID: UB74163
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB74163%27 HTTP/1.1" 200 None
2026-03-30 10:58:43 [auto1.de] INFO: Scrape type for UB74163: 2
2026-03-30 10:58:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adbd38d5-fcba-5f7f-8d59-b82bd50f5962 with identifier: UB74163
2026-03-30 10:58:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adbd38d5-fcba-5f7f-8d59-b82bd50f5962 with scrape type 2
2026-03-30 10:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adbd38d5-fcba-5f7f-8d59-b82bd50f5962 with scrape type 2
2026-03-30 10:58:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adbd38d5-fcba-5f7f-8d59-b82bd50f5962, identifier: UB74163
2026-03-30 10:58:43 [auto1.de] INFO: Found listing with ID: XW84981
2026-03-30 10:58:43 [auto1.de] INFO: Found listing with ID: MT41300
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT41300%27 HTTP/1.1" 200 None
2026-03-30 10:58:43 [auto1.de] INFO: Scrape type for MT41300: 2
2026-03-30 10:58:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 339b07bc-89bb-579e-aba1-1a3a096a31e4 with identifier: MT41300
2026-03-30 10:58:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 339b07bc-89bb-579e-aba1-1a3a096a31e4 with scrape type 2
2026-03-30 10:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 339b07bc-89bb-579e-aba1-1a3a096a31e4 with scrape type 2
2026-03-30 10:58:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 339b07bc-89bb-579e-aba1-1a3a096a31e4, identifier: MT41300
2026-03-30 10:58:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adbd38d5-fcba-5f7f-8d59-b82bd50f5962 with identifier: UB74163
2026-03-30 10:58:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adbd38d5-fcba-5f7f-8d59-b82bd50f5962 with identifier: UB74163
2026-03-30 10:58:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adbd38d5-fcba-5f7f-8d59-b82bd50f5962 with identifier: UB74163 to the API
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:55:03Z',
 'fuel_type': 'diesel',
 'id': 'adbd38d5-fcba-5f7f-8d59-b82bd50f5962',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB74163',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 227020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-12',
 'seller_name': None,
 'title': 'Citroen Jumper 2.0 Blue-HDi 35 L2H2 Profi',
 'transmission': 'manual',
 'trim': '35 L2H2 Profi',
 'year': 2017}
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB74163%27 HTTP/1.1" 200 None
2026-03-30 10:58:43 [auto1.de] INFO: Saving data for UB74163: {'auction_closing_time': 1774886103.0, 'created_time': 1774553111.490565, 'last_price_update_time': 1774868323.528084}
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB74163') HTTP/1.1" 204 0
2026-03-30 10:58:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 339b07bc-89bb-579e-aba1-1a3a096a31e4 with identifier: MT41300
2026-03-30 10:58:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 339b07bc-89bb-579e-aba1-1a3a096a31e4 with identifier: MT41300
2026-03-30 10:58:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 339b07bc-89bb-579e-aba1-1a3a096a31e4 with identifier: MT41300 to the API
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:10:01Z',
 'fuel_type': 'diesel',
 'id': '339b07bc-89bb-579e-aba1-1a3a096a31e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT41300',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 178721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2017}
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT41300%27 HTTP/1.1" 200 None
2026-03-30 10:58:43 [auto1.de] INFO: Saving data for MT41300: {'auction_closing_time': 1774883401.0, 'created_time': 1774379565.332845, 'last_price_update_time': 1774868323.925636}
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT41300') HTTP/1.1" 204 0
2026-03-30 10:58:43 [auto1.de] INFO: Found listing with ID: TB77068
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77068%27 HTTP/1.1" 200 None
2026-03-30 10:58:43 [auto1.de] INFO: Scrape type for TB77068: 2
2026-03-30 10:58:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e261b936-f182-5ba8-8b0b-f8e71d10a127 with identifier: TB77068
2026-03-30 10:58:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e261b936-f182-5ba8-8b0b-f8e71d10a127 with scrape type 2
2026-03-30 10:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e261b936-f182-5ba8-8b0b-f8e71d10a127 with scrape type 2
2026-03-30 10:58:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e261b936-f182-5ba8-8b0b-f8e71d10a127, identifier: TB77068
2026-03-30 10:58:44 [auto1.de] INFO: Found listing with ID: HB92022
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB92022%27 HTTP/1.1" 200 None
2026-03-30 10:58:44 [auto1.de] INFO: Scrape type for HB92022: 2
2026-03-30 10:58:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43e22d51-3b41-5878-9a69-a68611452595 with identifier: HB92022
2026-03-30 10:58:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43e22d51-3b41-5878-9a69-a68611452595 with scrape type 2
2026-03-30 10:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43e22d51-3b41-5878-9a69-a68611452595 with scrape type 2
2026-03-30 10:58:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43e22d51-3b41-5878-9a69-a68611452595, identifier: HB92022
2026-03-30 10:58:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e261b936-f182-5ba8-8b0b-f8e71d10a127 with identifier: TB77068
2026-03-30 10:58:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e261b936-f182-5ba8-8b0b-f8e71d10a127 with identifier: TB77068
2026-03-30 10:58:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e261b936-f182-5ba8-8b0b-f8e71d10a127 with identifier: TB77068 to the API
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:04:08Z',
 'fuel_type': 'petrol',
 'id': 'e261b936-f182-5ba8-8b0b-f8e71d10a127',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB77068',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 71653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-08',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77068%27 HTTP/1.1" 200 None
2026-03-30 10:58:44 [auto1.de] INFO: Saving data for TB77068: {'auction_closing_time': 1774883048.0, 'created_time': 1773772832.755547, 'last_price_update_time': 1774868324.431676}
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB77068') HTTP/1.1" 204 0
2026-03-30 10:58:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43e22d51-3b41-5878-9a69-a68611452595 with identifier: HB92022
2026-03-30 10:58:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43e22d51-3b41-5878-9a69-a68611452595 with identifier: HB92022
2026-03-30 10:58:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43e22d51-3b41-5878-9a69-a68611452595 with identifier: HB92022 to the API
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:05:14Z',
 'fuel_type': 'petrol',
 'id': '43e22d51-3b41-5878-9a69-a68611452595',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB92022',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 64946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-12',
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Style 2WD',
 'transmission': 'manual',
 'trim': 'Style 2WD',
 'year': 2020}
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB92022%27 HTTP/1.1" 200 None
2026-03-30 10:58:44 [auto1.de] INFO: Saving data for HB92022: {'auction_closing_time': 1774883114.0, 'created_time': 1774780596.003102, 'last_price_update_time': 1774868324.766289}
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB92022') HTTP/1.1" 204 0
2026-03-30 10:58:44 [auto1.de] INFO: Found listing with ID: NB51359
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB51359%27 HTTP/1.1" 200 None
2026-03-30 10:58:44 [auto1.de] INFO: Scrape type for NB51359: 2
2026-03-30 10:58:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c with identifier: NB51359
2026-03-30 10:58:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c with scrape type 2
2026-03-30 10:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c with scrape type 2
2026-03-30 10:58:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c, identifier: NB51359
2026-03-30 10:58:44 [auto1.de] INFO: Found listing with ID: XE54390
2026-03-30 10:58:44 [auto1.de] INFO: Found listing with ID: WT31487
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT31487%27 HTTP/1.1" 200 None
2026-03-30 10:58:44 [auto1.de] INFO: Scrape type for WT31487: 2
2026-03-30 10:58:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5e03435-d636-5f99-91bf-c08e2680c685 with identifier: WT31487
2026-03-30 10:58:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5e03435-d636-5f99-91bf-c08e2680c685 with scrape type 2
2026-03-30 10:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5e03435-d636-5f99-91bf-c08e2680c685 with scrape type 2
2026-03-30 10:58:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5e03435-d636-5f99-91bf-c08e2680c685, identifier: WT31487
2026-03-30 10:58:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c with identifier: NB51359
2026-03-30 10:58:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c with identifier: NB51359
2026-03-30 10:58:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c with identifier: NB51359 to the API
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:16:27Z',
 'fuel_type': 'diesel',
 'id': '6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB51359',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC70',
 'odometer': 76956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-15',
 'seller_name': None,
 'title': 'Volvo XC70 2.0 D4 Momentum 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum 2WD',
 'year': 2014}
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB51359%27 HTTP/1.1" 200 None
2026-03-30 10:58:45 [auto1.de] INFO: Saving data for NB51359: {'auction_closing_time': 1774883787.0, 'created_time': 1774780590.512146, 'last_price_update_time': 1774868325.311438}
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB51359') HTTP/1.1" 204 0
2026-03-30 10:58:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5e03435-d636-5f99-91bf-c08e2680c685 with identifier: WT31487
2026-03-30 10:58:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5e03435-d636-5f99-91bf-c08e2680c685 with identifier: WT31487
2026-03-30 10:58:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5e03435-d636-5f99-91bf-c08e2680c685 with identifier: WT31487 to the API
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:26:32Z',
 'fuel_type': 'petrol',
 'id': 'a5e03435-d636-5f99-91bf-c08e2680c685',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT31487',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 93569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-29',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT31487%27 HTTP/1.1" 200 None
2026-03-30 10:58:45 [auto1.de] INFO: Saving data for WT31487: {'auction_closing_time': 1774884392.0, 'created_time': 1774463794.227068, 'last_price_update_time': 1774868325.604733}
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT31487') HTTP/1.1" 204 0
2026-03-30 10:58:45 [auto1.de] INFO: Found listing with ID: SP94156
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP94156%27 HTTP/1.1" 200 None
2026-03-30 10:58:45 [auto1.de] INFO: Scrape type for SP94156: 2
2026-03-30 10:58:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 213e48cf-6509-5b28-b77c-3f20cd675be9 with identifier: SP94156
2026-03-30 10:58:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 213e48cf-6509-5b28-b77c-3f20cd675be9 with scrape type 2
2026-03-30 10:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 213e48cf-6509-5b28-b77c-3f20cd675be9 with scrape type 2
2026-03-30 10:58:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 213e48cf-6509-5b28-b77c-3f20cd675be9, identifier: SP94156
2026-03-30 10:58:45 [auto1.de] INFO: Found listing with ID: US93398
2026-03-30 10:58:45 [auto1.de] INFO: Found listing with ID: WY12370
2026-03-30 10:58:45 [auto1.de] INFO: Found listing with ID: GT54138
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54138%27 HTTP/1.1" 200 None
2026-03-30 10:58:45 [auto1.de] INFO: Scrape type for GT54138: 2
2026-03-30 10:58:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c with identifier: GT54138
2026-03-30 10:58:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c with scrape type 2
2026-03-30 10:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c with scrape type 2
2026-03-30 10:58:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c, identifier: GT54138
2026-03-30 10:58:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 213e48cf-6509-5b28-b77c-3f20cd675be9 with identifier: SP94156
2026-03-30 10:58:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 213e48cf-6509-5b28-b77c-3f20cd675be9 with identifier: SP94156
2026-03-30 10:58:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 213e48cf-6509-5b28-b77c-3f20cd675be9 with identifier: SP94156 to the API
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:22:05Z',
 'fuel_type': 'diesel',
 'id': '213e48cf-6509-5b28-b77c-3f20cd675be9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP94156',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 277006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-06',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP94156%27 HTTP/1.1" 200 None
2026-03-30 10:58:46 [auto1.de] INFO: Saving data for SP94156: {'auction_closing_time': 1774884125.0, 'created_time': 1772540577.198826, 'last_price_update_time': 1774868326.104783}
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP94156') HTTP/1.1" 204 0
2026-03-30 10:58:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c with identifier: GT54138
2026-03-30 10:58:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c with identifier: GT54138
2026-03-30 10:58:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c with identifier: GT54138 to the API
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:29:08Z',
 'fuel_type': 'hybrid',
 'id': '62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT54138',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 115446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-13',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2021}
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54138%27 HTTP/1.1" 200 None
2026-03-30 10:58:46 [auto1.de] INFO: Saving data for GT54138: {'auction_closing_time': 1774884548.0, 'created_time': 1774780607.729723, 'last_price_update_time': 1774868326.466334}
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT54138') HTTP/1.1" 204 0
2026-03-30 10:58:46 [auto1.de] INFO: Found listing with ID: KJ70545
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ70545%27 HTTP/1.1" 200 None
2026-03-30 10:58:46 [auto1.de] INFO: Scrape type for KJ70545: 2
2026-03-30 10:58:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 300ea696-46c2-5488-ba9b-ab4c8e457fdc with identifier: KJ70545
2026-03-30 10:58:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 300ea696-46c2-5488-ba9b-ab4c8e457fdc with scrape type 2
2026-03-30 10:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 300ea696-46c2-5488-ba9b-ab4c8e457fdc with scrape type 2
2026-03-30 10:58:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 300ea696-46c2-5488-ba9b-ab4c8e457fdc, identifier: KJ70545
2026-03-30 10:58:46 [auto1.de] INFO: Found listing with ID: UJ19896
2026-03-30 10:58:46 [auto1.de] INFO: Found listing with ID: ZL28977
2026-03-30 10:58:46 [auto1.de] INFO: Found listing with ID: LN54864
2026-03-30 10:58:46 [auto1.de] INFO: Found listing with ID: GA07513
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA07513%27 HTTP/1.1" 200 None
2026-03-30 10:58:46 [auto1.de] INFO: Scrape type for GA07513: 2
2026-03-30 10:58:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9038a1c7-ef97-5a20-81cf-ca6fbe51d728 with identifier: GA07513
2026-03-30 10:58:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9038a1c7-ef97-5a20-81cf-ca6fbe51d728 with scrape type 2
2026-03-30 10:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9038a1c7-ef97-5a20-81cf-ca6fbe51d728 with scrape type 2
2026-03-30 10:58:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9038a1c7-ef97-5a20-81cf-ca6fbe51d728, identifier: GA07513
2026-03-30 10:58:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 300ea696-46c2-5488-ba9b-ab4c8e457fdc with identifier: KJ70545
2026-03-30 10:58:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 300ea696-46c2-5488-ba9b-ab4c8e457fdc with identifier: KJ70545
2026-03-30 10:58:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 300ea696-46c2-5488-ba9b-ab4c8e457fdc with identifier: KJ70545 to the API
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:10:02Z',
 'fuel_type': 'petrol',
 'id': '300ea696-46c2-5488-ba9b-ab4c8e457fdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ70545',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 110451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-28',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2014}
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ70545%27 HTTP/1.1" 200 None
2026-03-30 10:58:47 [auto1.de] INFO: Saving data for KJ70545: {'auction_closing_time': 1774883402.0, 'created_time': 1774550704.450878, 'last_price_update_time': 1774868327.024533}
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ70545') HTTP/1.1" 204 0
2026-03-30 10:58:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9038a1c7-ef97-5a20-81cf-ca6fbe51d728 with identifier: GA07513
2026-03-30 10:58:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9038a1c7-ef97-5a20-81cf-ca6fbe51d728 with identifier: GA07513
2026-03-30 10:58:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9038a1c7-ef97-5a20-81cf-ca6fbe51d728 with identifier: GA07513 to the API
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:28:23Z',
 'fuel_type': 'diesel',
 'id': '9038a1c7-ef97-5a20-81cf-ca6fbe51d728',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA07513',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 146033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-30',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA07513%27 HTTP/1.1" 200 None
2026-03-30 10:58:47 [auto1.de] INFO: Saving data for GA07513: {'auction_closing_time': 1774884503.0, 'created_time': 1774780588.340606, 'last_price_update_time': 1774868327.437275}
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA07513') HTTP/1.1" 204 0
2026-03-30 10:58:47 [auto1.de] INFO: Found listing with ID: NV52830
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV52830%27 HTTP/1.1" 200 None
2026-03-30 10:58:47 [auto1.de] INFO: Scrape type for NV52830: 2
2026-03-30 10:58:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f99cb84f-36b6-5c76-b12f-690073714431 with identifier: NV52830
2026-03-30 10:58:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f99cb84f-36b6-5c76-b12f-690073714431 with scrape type 2
2026-03-30 10:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f99cb84f-36b6-5c76-b12f-690073714431 with scrape type 2
2026-03-30 10:58:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f99cb84f-36b6-5c76-b12f-690073714431, identifier: NV52830
2026-03-30 10:58:47 [auto1.de] INFO: Found listing with ID: FE29735
2026-03-30 10:58:47 [auto1.de] INFO: Found listing with ID: BS02635
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS02635%27 HTTP/1.1" 200 None
2026-03-30 10:58:47 [auto1.de] INFO: Scrape type for BS02635: 0
2026-03-30 10:58:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f99cb84f-36b6-5c76-b12f-690073714431 with identifier: NV52830
2026-03-30 10:58:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f99cb84f-36b6-5c76-b12f-690073714431 with identifier: NV52830
2026-03-30 10:58:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f99cb84f-36b6-5c76-b12f-690073714431 with identifier: NV52830 to the API
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:53:00Z',
 'fuel_type': 'petrol',
 'id': 'f99cb84f-36b6-5c76-b12f-690073714431',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV52830',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 203578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-05',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 150 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2009}
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV52830%27 HTTP/1.1" 200 None
2026-03-30 10:58:47 [auto1.de] INFO: Saving data for NV52830: {'auction_closing_time': 1774885980.0, 'created_time': 1773399862.618445, 'last_price_update_time': 1774868327.900296}
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV52830') HTTP/1.1" 204 0
2026-03-30 10:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:58:47 [auto1.de] INFO: Found listing with ID: XW55257
2026-03-30 10:58:47 [auto1.de] INFO: Found listing with ID: WM05984
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM05984%27 HTTP/1.1" 200 None
2026-03-30 10:58:47 [auto1.de] INFO: Scrape type for WM05984: 2
2026-03-30 10:58:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8bb33f4-e126-5bee-ac3d-fd549d1af91f with identifier: WM05984
2026-03-30 10:58:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8bb33f4-e126-5bee-ac3d-fd549d1af91f with scrape type 2
2026-03-30 10:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8bb33f4-e126-5bee-ac3d-fd549d1af91f with scrape type 2
2026-03-30 10:58:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8bb33f4-e126-5bee-ac3d-fd549d1af91f, identifier: WM05984
2026-03-30 10:58:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8bb33f4-e126-5bee-ac3d-fd549d1af91f with identifier: WM05984
2026-03-30 10:58:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8bb33f4-e126-5bee-ac3d-fd549d1af91f with identifier: WM05984
2026-03-30 10:58:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8bb33f4-e126-5bee-ac3d-fd549d1af91f with identifier: WM05984 to the API
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:11:27Z',
 'fuel_type': 'petrol',
 'id': 'd8bb33f4-e126-5bee-ac3d-fd549d1af91f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM05984',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 216591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-18',
 'seller_name': None,
 'title': 'Honda Civic 1.8 VTEC Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM05984%27 HTTP/1.1" 200 None
2026-03-30 10:58:48 [auto1.de] INFO: Saving data for WM05984: {'auction_closing_time': 1774883487.0, 'created_time': 1773301583.713771, 'last_price_update_time': 1774868328.312703}
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM05984') HTTP/1.1" 204 0
2026-03-30 10:58:48 [auto1.de] INFO: Found listing with ID: TY76082
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY76082%27 HTTP/1.1" 200 None
2026-03-30 10:58:48 [auto1.de] INFO: Scrape type for TY76082: 2
2026-03-30 10:58:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11881326-7ff9-5747-a410-6e5a015b12c3 with identifier: TY76082
2026-03-30 10:58:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11881326-7ff9-5747-a410-6e5a015b12c3 with scrape type 2
2026-03-30 10:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11881326-7ff9-5747-a410-6e5a015b12c3 with scrape type 2
2026-03-30 10:58:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11881326-7ff9-5747-a410-6e5a015b12c3, identifier: TY76082
2026-03-30 10:58:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11881326-7ff9-5747-a410-6e5a015b12c3 with identifier: TY76082
2026-03-30 10:58:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11881326-7ff9-5747-a410-6e5a015b12c3 with identifier: TY76082
2026-03-30 10:58:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11881326-7ff9-5747-a410-6e5a015b12c3 with identifier: TY76082 to the API
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:36:50Z',
 'fuel_type': 'diesel',
 'id': '11881326-7ff9-5747-a410-6e5a015b12c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY76082',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 171448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-07',
 'seller_name': None,
 'title': 'Audi A4 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY76082%27 HTTP/1.1" 200 None
2026-03-30 10:58:48 [auto1.de] INFO: Saving data for TY76082: {'auction_closing_time': 1774885010.0, 'created_time': 1774465895.690799, 'last_price_update_time': 1774868328.723069}
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY76082') HTTP/1.1" 204 0
2026-03-30 10:58:48 [auto1.de] INFO: Found listing with ID: FG48186
2026-03-30 10:58:48 [auto1.de] INFO: Found listing with ID: VN17699
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN17699%27 HTTP/1.1" 200 None
2026-03-30 10:58:48 [auto1.de] INFO: Scrape type for VN17699: 2
2026-03-30 10:58:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4d33a1a-6f57-50be-9c43-d5c688b362f9 with identifier: VN17699
2026-03-30 10:58:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4d33a1a-6f57-50be-9c43-d5c688b362f9 with scrape type 2
2026-03-30 10:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4d33a1a-6f57-50be-9c43-d5c688b362f9 with scrape type 2
2026-03-30 10:58:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4d33a1a-6f57-50be-9c43-d5c688b362f9, identifier: VN17699
2026-03-30 10:58:48 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 9547 | hits on page: 40
2026-03-30 10:58:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4d33a1a-6f57-50be-9c43-d5c688b362f9 with identifier: VN17699
2026-03-30 10:58:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4d33a1a-6f57-50be-9c43-d5c688b362f9 with identifier: VN17699
2026-03-30 10:58:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4d33a1a-6f57-50be-9c43-d5c688b362f9 with identifier: VN17699 to the API
2026-03-30 10:58:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:56:50Z',
 'fuel_type': 'diesel',
 'id': 'e4d33a1a-6f57-50be-9c43-d5c688b362f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN17699',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 77687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-24',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueTEC Elegance',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Elegance',
 'year': 2016}
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN17699%27 HTTP/1.1" 200 None
2026-03-30 10:58:49 [auto1.de] INFO: Saving data for VN17699: {'auction_closing_time': 1774886210.0, 'created_time': 1773859203.772092, 'last_price_update_time': 1774868329.139581}
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN17699') HTTP/1.1" 204 0
2026-03-30 10:58:49 [auto1.de] INFO: Found listing with ID: EC36111
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36111%27 HTTP/1.1" 200 None
2026-03-30 10:58:49 [auto1.de] INFO: Scrape type for EC36111: 2
2026-03-30 10:58:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b04275d4-e3e9-5b86-85b9-d3df253cb748 with identifier: EC36111
2026-03-30 10:58:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b04275d4-e3e9-5b86-85b9-d3df253cb748 with scrape type 2
2026-03-30 10:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b04275d4-e3e9-5b86-85b9-d3df253cb748 with scrape type 2
2026-03-30 10:58:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b04275d4-e3e9-5b86-85b9-d3df253cb748, identifier: EC36111
2026-03-30 10:58:49 [auto1.de] INFO: Found listing with ID: WK49951
2026-03-30 10:58:49 [auto1.de] INFO: Found listing with ID: VX95412
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX95412%27 HTTP/1.1" 200 None
2026-03-30 10:58:49 [auto1.de] INFO: Scrape type for VX95412: 2
2026-03-30 10:58:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d043364-9e80-52b4-8239-f5b3f38a8d61 with identifier: VX95412
2026-03-30 10:58:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d043364-9e80-52b4-8239-f5b3f38a8d61 with scrape type 2
2026-03-30 10:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d043364-9e80-52b4-8239-f5b3f38a8d61 with scrape type 2
2026-03-30 10:58:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d043364-9e80-52b4-8239-f5b3f38a8d61, identifier: VX95412
2026-03-30 10:58:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b04275d4-e3e9-5b86-85b9-d3df253cb748 with identifier: EC36111
2026-03-30 10:58:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b04275d4-e3e9-5b86-85b9-d3df253cb748 with identifier: EC36111
2026-03-30 10:58:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b04275d4-e3e9-5b86-85b9-d3df253cb748 with identifier: EC36111 to the API
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:32:47Z',
 'fuel_type': 'petrol',
 'id': 'b04275d4-e3e9-5b86-85b9-d3df253cb748',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC36111',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 114184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-12',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 1.6 Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2006}
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36111%27 HTTP/1.1" 200 None
2026-03-30 10:58:49 [auto1.de] INFO: Saving data for EC36111: {'auction_closing_time': 1774884767.0, 'created_time': 1774637510.293763, 'last_price_update_time': 1774868329.685548}
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC36111') HTTP/1.1" 204 0
2026-03-30 10:58:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d043364-9e80-52b4-8239-f5b3f38a8d61 with identifier: VX95412
2026-03-30 10:58:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d043364-9e80-52b4-8239-f5b3f38a8d61 with identifier: VX95412
2026-03-30 10:58:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d043364-9e80-52b4-8239-f5b3f38a8d61 with identifier: VX95412 to the API
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:19:47Z',
 'fuel_type': 'diesel',
 'id': '0d043364-9e80-52b4-8239-f5b3f38a8d61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX95412',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 88817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L2',
 'transmission': 'manual',
 'trim': 'Allure L2',
 'year': 2021}
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX95412%27 HTTP/1.1" 200 None
2026-03-30 10:58:50 [auto1.de] INFO: Saving data for VX95412: {'auction_closing_time': 1774883987.0, 'created_time': 1773301153.584986, 'last_price_update_time': 1774868330.168954}
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX95412') HTTP/1.1" 204 0
2026-03-30 10:58:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:58:50 [auto1.de] INFO: Found listing with ID: WJ67809
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ67809%27 HTTP/1.1" 200 None
2026-03-30 10:58:50 [auto1.de] INFO: Scrape type for WJ67809: 2
2026-03-30 10:58:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edda5bae-10ff-5965-bc3a-9a9934a898d0 with identifier: WJ67809
2026-03-30 10:58:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edda5bae-10ff-5965-bc3a-9a9934a898d0 with scrape type 2
2026-03-30 10:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edda5bae-10ff-5965-bc3a-9a9934a898d0 with scrape type 2
2026-03-30 10:58:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edda5bae-10ff-5965-bc3a-9a9934a898d0, identifier: WJ67809
2026-03-30 10:58:50 [auto1.de] INFO: Found listing with ID: AE04688
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE04688%27 HTTP/1.1" 200 None
2026-03-30 10:58:50 [auto1.de] INFO: Scrape type for AE04688: 2
2026-03-30 10:58:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cd0abca-ab67-5885-acaa-04ee2974186f with identifier: AE04688
2026-03-30 10:58:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cd0abca-ab67-5885-acaa-04ee2974186f with scrape type 2
2026-03-30 10:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cd0abca-ab67-5885-acaa-04ee2974186f with scrape type 2
2026-03-30 10:58:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cd0abca-ab67-5885-acaa-04ee2974186f, identifier: AE04688
2026-03-30 10:58:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edda5bae-10ff-5965-bc3a-9a9934a898d0 with identifier: WJ67809
2026-03-30 10:58:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edda5bae-10ff-5965-bc3a-9a9934a898d0 with identifier: WJ67809
2026-03-30 10:58:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edda5bae-10ff-5965-bc3a-9a9934a898d0 with identifier: WJ67809 to the API
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 97,
 'expiration_date': '2026-03-30T15:15:06Z',
 'fuel_type': 'petrol',
 'id': 'edda5bae-10ff-5965-bc3a-9a9934a898d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ67809',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Accent',
 'odometer': 97531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-30',
 'seller_name': None,
 'title': 'Hyundai Accent 1.4 GL',
 'transmission': 'manual',
 'trim': 'GL',
 'year': 2007}
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ67809%27 HTTP/1.1" 200 None
2026-03-30 10:58:50 [auto1.de] INFO: Saving data for WJ67809: {'auction_closing_time': 1774883706.0, 'created_time': 1774550905.650726, 'last_price_update_time': 1774868330.681735}
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ67809') HTTP/1.1" 204 0
2026-03-30 10:58:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cd0abca-ab67-5885-acaa-04ee2974186f with identifier: AE04688
2026-03-30 10:58:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cd0abca-ab67-5885-acaa-04ee2974186f with identifier: AE04688
2026-03-30 10:58:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cd0abca-ab67-5885-acaa-04ee2974186f with identifier: AE04688 to the API
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:24:59Z',
 'fuel_type': 'petrol',
 'id': '0cd0abca-ab67-5885-acaa-04ee2974186f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE04688',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 87476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-29',
 'seller_name': None,
 'title': 'Honda Civic 1.0 VTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2017}
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE04688%27 HTTP/1.1" 200 None
2026-03-30 10:58:50 [auto1.de] INFO: Saving data for AE04688: {'auction_closing_time': 1774884299.0, 'created_time': 1773517648.634196, 'last_price_update_time': 1774868330.978354}
2026-03-30 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE04688') HTTP/1.1" 204 0
2026-03-30 10:58:51 [auto1.de] INFO: Found listing with ID: GB77683
2026-03-30 10:58:51 [auto1.de] INFO: Found listing with ID: WZ39505
2026-03-30 10:58:51 [auto1.de] INFO: Found listing with ID: YL47006
2026-03-30 10:58:51 [auto1.de] INFO: Found listing with ID: BT97276
2026-03-30 10:58:51 [auto1.de] INFO: Found listing with ID: UJ62660
2026-03-30 10:58:51 [auto1.de] INFO: Found listing with ID: UY36184
2026-03-30 10:58:51 [auto1.de] INFO: Found listing with ID: JK20630
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK20630%27 HTTP/1.1" 200 None
2026-03-30 10:58:51 [auto1.de] INFO: Scrape type for JK20630: 2
2026-03-30 10:58:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac534faf-be91-59c9-813a-d0b38ca4e99a with identifier: JK20630
2026-03-30 10:58:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac534faf-be91-59c9-813a-d0b38ca4e99a with scrape type 2
2026-03-30 10:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac534faf-be91-59c9-813a-d0b38ca4e99a with scrape type 2
2026-03-30 10:58:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac534faf-be91-59c9-813a-d0b38ca4e99a, identifier: JK20630
2026-03-30 10:58:51 [auto1.de] INFO: Found listing with ID: NP40069
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP40069%27 HTTP/1.1" 200 None
2026-03-30 10:58:51 [auto1.de] INFO: Scrape type for NP40069: 2
2026-03-30 10:58:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c91aa04-110b-5083-a79b-ccaa51ae72a4 with identifier: NP40069
2026-03-30 10:58:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c91aa04-110b-5083-a79b-ccaa51ae72a4 with scrape type 2
2026-03-30 10:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c91aa04-110b-5083-a79b-ccaa51ae72a4 with scrape type 2
2026-03-30 10:58:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c91aa04-110b-5083-a79b-ccaa51ae72a4, identifier: NP40069
2026-03-30 10:58:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac534faf-be91-59c9-813a-d0b38ca4e99a with identifier: JK20630
2026-03-30 10:58:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac534faf-be91-59c9-813a-d0b38ca4e99a with identifier: JK20630
2026-03-30 10:58:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac534faf-be91-59c9-813a-d0b38ca4e99a with identifier: JK20630 to the API
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:15:00Z',
 'fuel_type': 'petrol',
 'id': 'ac534faf-be91-59c9-813a-d0b38ca4e99a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK20630',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 87785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-17',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2019}
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK20630%27 HTTP/1.1" 200 None
2026-03-30 10:58:51 [auto1.de] INFO: Saving data for JK20630: {'auction_closing_time': 1774883700.0, 'created_time': 1774379501.062065, 'last_price_update_time': 1774868331.527125}
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK20630') HTTP/1.1" 204 0
2026-03-30 10:58:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c91aa04-110b-5083-a79b-ccaa51ae72a4 with identifier: NP40069
2026-03-30 10:58:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c91aa04-110b-5083-a79b-ccaa51ae72a4 with identifier: NP40069
2026-03-30 10:58:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c91aa04-110b-5083-a79b-ccaa51ae72a4 with identifier: NP40069 to the API
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:41:34Z',
 'fuel_type': 'petrol',
 'id': '6c91aa04-110b-5083-a79b-ccaa51ae72a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP40069',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC70',
 'odometer': 344180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-06-05',
 'seller_name': None,
 'title': 'Volvo XC70 2.4 T AWD Cross Country',
 'transmission': 'automatic',
 'trim': 'AWD Cross Country',
 'year': 2001}
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP40069%27 HTTP/1.1" 200 None
2026-03-30 10:58:51 [auto1.de] INFO: Saving data for NP40069: {'auction_closing_time': 1774885294.0, 'created_time': 1773861513.323761, 'last_price_update_time': 1774868331.844371}
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP40069') HTTP/1.1" 204 0
2026-03-30 10:58:51 [auto1.de] INFO: Found listing with ID: WE06039
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE06039%27 HTTP/1.1" 200 None
2026-03-30 10:58:51 [auto1.de] INFO: Scrape type for WE06039: 2
2026-03-30 10:58:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bc8e8ad-c754-5775-937f-15973877c749 with identifier: WE06039
2026-03-30 10:58:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bc8e8ad-c754-5775-937f-15973877c749 with scrape type 2
2026-03-30 10:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bc8e8ad-c754-5775-937f-15973877c749 with scrape type 2
2026-03-30 10:58:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bc8e8ad-c754-5775-937f-15973877c749, identifier: WE06039
2026-03-30 10:58:51 [auto1.de] INFO: Found listing with ID: HG95875
2026-03-30 10:58:51 [auto1.de] INFO: Found listing with ID: VW68690
2026-03-30 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW68690%27 HTTP/1.1" 200 None
2026-03-30 10:58:52 [auto1.de] INFO: Scrape type for VW68690: 2
2026-03-30 10:58:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0afdcaa-e7a8-5108-ba5f-1cd412738d42 with identifier: VW68690
2026-03-30 10:58:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0afdcaa-e7a8-5108-ba5f-1cd412738d42 with scrape type 2
2026-03-30 10:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0afdcaa-e7a8-5108-ba5f-1cd412738d42 with scrape type 2
2026-03-30 10:58:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0afdcaa-e7a8-5108-ba5f-1cd412738d42, identifier: VW68690
2026-03-30 10:58:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bc8e8ad-c754-5775-937f-15973877c749 with identifier: WE06039
2026-03-30 10:58:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bc8e8ad-c754-5775-937f-15973877c749 with identifier: WE06039
2026-03-30 10:58:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bc8e8ad-c754-5775-937f-15973877c749 with identifier: WE06039 to the API
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:59Z',
 'fuel_type': 'petrol',
 'id': '7bc8e8ad-c754-5775-937f-15973877c749',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE06039',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 2861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-22',
 'seller_name': None,
 'title': 'Hyundai i30 1.5 T-GDI Mild-Hybrid N Line',
 'transmission': 'automatic',
 'trim': 'N Line',
 'year': 2024}
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE06039%27 HTTP/1.1" 200 None
2026-03-30 10:58:52 [auto1.de] INFO: Saving data for WE06039: {'auction_closing_time': 1774885139.0, 'created_time': 1774118768.089242, 'last_price_update_time': 1774868332.381658}
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE06039') HTTP/1.1" 204 0
2026-03-30 10:58:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0afdcaa-e7a8-5108-ba5f-1cd412738d42 with identifier: VW68690
2026-03-30 10:58:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0afdcaa-e7a8-5108-ba5f-1cd412738d42 with identifier: VW68690
2026-03-30 10:58:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0afdcaa-e7a8-5108-ba5f-1cd412738d42 with identifier: VW68690 to the API
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:22:52Z',
 'fuel_type': 'petrol',
 'id': 'd0afdcaa-e7a8-5108-ba5f-1cd412738d42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW68690',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Linea',
 'odometer': 194308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-25',
 'seller_name': None,
 'title': 'Fiat Linea 1.4 Turbo Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2008}
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW68690%27 HTTP/1.1" 200 None
2026-03-30 10:58:52 [auto1.de] INFO: Saving data for VW68690: {'auction_closing_time': 1774884172.0, 'created_time': 1774550805.083777, 'last_price_update_time': 1774868332.76175}
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW68690') HTTP/1.1" 204 0
2026-03-30 10:58:52 [auto1.de] INFO: Found listing with ID: UR84816
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR84816%27 HTTP/1.1" 200 None
2026-03-30 10:58:52 [auto1.de] INFO: Scrape type for UR84816: 2
2026-03-30 10:58:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86eefe12-1b3e-59e1-91d8-5fc30edf9243 with identifier: UR84816
2026-03-30 10:58:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86eefe12-1b3e-59e1-91d8-5fc30edf9243 with scrape type 2
2026-03-30 10:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86eefe12-1b3e-59e1-91d8-5fc30edf9243 with scrape type 2
2026-03-30 10:58:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86eefe12-1b3e-59e1-91d8-5fc30edf9243, identifier: UR84816
2026-03-30 10:58:52 [auto1.de] INFO: Found listing with ID: NX61710
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX61710%27 HTTP/1.1" 200 None
2026-03-30 10:58:52 [auto1.de] INFO: Scrape type for NX61710: 2
2026-03-30 10:58:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d33f7a4-8524-5f2e-ae83-bc4fa3100e4f with identifier: NX61710
2026-03-30 10:58:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d33f7a4-8524-5f2e-ae83-bc4fa3100e4f with scrape type 2
2026-03-30 10:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d33f7a4-8524-5f2e-ae83-bc4fa3100e4f with scrape type 2
2026-03-30 10:58:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d33f7a4-8524-5f2e-ae83-bc4fa3100e4f, identifier: NX61710
2026-03-30 10:58:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86eefe12-1b3e-59e1-91d8-5fc30edf9243 with identifier: UR84816
2026-03-30 10:58:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86eefe12-1b3e-59e1-91d8-5fc30edf9243 with identifier: UR84816
2026-03-30 10:58:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86eefe12-1b3e-59e1-91d8-5fc30edf9243 with identifier: UR84816 to the API
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 174,
 'expiration_date': '2026-03-30T15:06:17Z',
 'fuel_type': 'diesel',
 'id': '86eefe12-1b3e-59e1-91d8-5fc30edf9243',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR84816',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 96158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-29',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 CDTI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2021}
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR84816%27 HTTP/1.1" 200 None
2026-03-30 10:58:53 [auto1.de] INFO: Saving data for UR84816: {'auction_closing_time': 1774883177.0, 'created_time': 1774550947.252458, 'last_price_update_time': 1774868333.317019}
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR84816') HTTP/1.1" 204 0
2026-03-30 10:58:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d33f7a4-8524-5f2e-ae83-bc4fa3100e4f with identifier: NX61710
2026-03-30 10:58:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d33f7a4-8524-5f2e-ae83-bc4fa3100e4f with identifier: NX61710
2026-03-30 10:58:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d33f7a4-8524-5f2e-ae83-bc4fa3100e4f with identifier: NX61710 to the API
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:49:27Z',
 'fuel_type': 'petrol',
 'id': '7d33f7a4-8524-5f2e-ae83-bc4fa3100e4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX61710',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 161487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-01',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX61710%27 HTTP/1.1" 200 None
2026-03-30 10:58:53 [auto1.de] INFO: Saving data for NX61710: {'auction_closing_time': 1774885767.0, 'created_time': 1773775381.682167, 'last_price_update_time': 1774868333.605754}
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX61710') HTTP/1.1" 204 0
2026-03-30 10:58:53 [auto1.de] INFO: Found listing with ID: UF70247
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF70247%27 HTTP/1.1" 200 None
2026-03-30 10:58:53 [auto1.de] INFO: Scrape type for UF70247: 2
2026-03-30 10:58:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3cd8fe5-6cd7-5631-88cd-0531e9045579 with identifier: UF70247
2026-03-30 10:58:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3cd8fe5-6cd7-5631-88cd-0531e9045579 with scrape type 2
2026-03-30 10:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3cd8fe5-6cd7-5631-88cd-0531e9045579 with scrape type 2
2026-03-30 10:58:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3cd8fe5-6cd7-5631-88cd-0531e9045579, identifier: UF70247
2026-03-30 10:58:53 [auto1.de] INFO: Found listing with ID: LG72403
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG72403%27 HTTP/1.1" 200 None
2026-03-30 10:58:53 [auto1.de] INFO: Scrape type for LG72403: 2
2026-03-30 10:58:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ebbff89-45aa-59b2-a188-c67ab80426dc with identifier: LG72403
2026-03-30 10:58:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ebbff89-45aa-59b2-a188-c67ab80426dc with scrape type 2
2026-03-30 10:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ebbff89-45aa-59b2-a188-c67ab80426dc with scrape type 2
2026-03-30 10:58:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ebbff89-45aa-59b2-a188-c67ab80426dc, identifier: LG72403
2026-03-30 10:58:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3cd8fe5-6cd7-5631-88cd-0531e9045579 with identifier: UF70247
2026-03-30 10:58:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3cd8fe5-6cd7-5631-88cd-0531e9045579 with identifier: UF70247
2026-03-30 10:58:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3cd8fe5-6cd7-5631-88cd-0531e9045579 with identifier: UF70247 to the API
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:52:48Z',
 'fuel_type': 'petrol',
 'id': 'b3cd8fe5-6cd7-5631-88cd-0531e9045579',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF70247',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 75807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-22',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF70247%27 HTTP/1.1" 200 None
2026-03-30 10:58:54 [auto1.de] INFO: Saving data for UF70247: {'auction_closing_time': 1774885968.0, 'created_time': 1773224305.26304, 'last_price_update_time': 1774868334.253977}
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF70247') HTTP/1.1" 204 0
2026-03-30 10:58:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ebbff89-45aa-59b2-a188-c67ab80426dc with identifier: LG72403
2026-03-30 10:58:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ebbff89-45aa-59b2-a188-c67ab80426dc with identifier: LG72403
2026-03-30 10:58:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ebbff89-45aa-59b2-a188-c67ab80426dc with identifier: LG72403 to the API
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:32:59Z',
 'fuel_type': 'diesel',
 'id': '3ebbff89-45aa-59b2-a188-c67ab80426dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG72403',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 178344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-21',
 'seller_name': None,
 'title': 'Fiat Scudo 2.0 JTDM Panorama Executive L2H1 165 Multijet',
 'transmission': 'manual',
 'trim': 'Panorama Executive L2H1 165 Multijet',
 'year': 2011}
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG72403%27 HTTP/1.1" 200 None
2026-03-30 10:58:54 [auto1.de] INFO: Saving data for LG72403: {'auction_closing_time': 1774884779.0, 'created_time': 1773557179.921375, 'last_price_update_time': 1774868334.557774}
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG72403') HTTP/1.1" 204 0
2026-03-30 10:58:54 [auto1.de] INFO: Found listing with ID: XA86799
2026-03-30 10:58:54 [auto1.de] INFO: Found listing with ID: SU99742
2026-03-30 10:58:54 [auto1.de] INFO: Found listing with ID: ZE87532
2026-03-30 10:58:54 [auto1.de] INFO: Found listing with ID: JY35599
2026-03-30 10:58:54 [auto1.de] INFO: Found listing with ID: PT45615
2026-03-30 10:58:54 [auto1.de] INFO: Found listing with ID: ZJ67042
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ67042%27 HTTP/1.1" 200 None
2026-03-30 10:58:54 [auto1.de] INFO: Scrape type for ZJ67042: 2
2026-03-30 10:58:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb7085cb-65c5-5546-9916-9d777e6eb8ec with identifier: ZJ67042
2026-03-30 10:58:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb7085cb-65c5-5546-9916-9d777e6eb8ec with scrape type 2
2026-03-30 10:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb7085cb-65c5-5546-9916-9d777e6eb8ec with scrape type 2
2026-03-30 10:58:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb7085cb-65c5-5546-9916-9d777e6eb8ec, identifier: ZJ67042
2026-03-30 10:58:54 [auto1.de] INFO: Found listing with ID: KX92622
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX92622%27 HTTP/1.1" 200 None
2026-03-30 10:58:54 [auto1.de] INFO: Scrape type for KX92622: 2
2026-03-30 10:58:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c53de3f-879e-5a59-b906-8373c29f0c16 with identifier: KX92622
2026-03-30 10:58:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c53de3f-879e-5a59-b906-8373c29f0c16 with scrape type 2
2026-03-30 10:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c53de3f-879e-5a59-b906-8373c29f0c16 with scrape type 2
2026-03-30 10:58:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c53de3f-879e-5a59-b906-8373c29f0c16, identifier: KX92622
2026-03-30 10:58:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb7085cb-65c5-5546-9916-9d777e6eb8ec with identifier: ZJ67042
2026-03-30 10:58:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb7085cb-65c5-5546-9916-9d777e6eb8ec with identifier: ZJ67042
2026-03-30 10:58:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb7085cb-65c5-5546-9916-9d777e6eb8ec with identifier: ZJ67042 to the API
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:18:07Z',
 'fuel_type': 'diesel',
 'id': 'bb7085cb-65c5-5546-9916-9d777e6eb8ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ67042',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 85679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-04',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ67042%27 HTTP/1.1" 200 None
2026-03-30 10:58:55 [auto1.de] INFO: Saving data for ZJ67042: {'auction_closing_time': 1774883887.0, 'created_time': 1774780602.178401, 'last_price_update_time': 1774868335.087768}
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ67042') HTTP/1.1" 204 0
2026-03-30 10:58:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c53de3f-879e-5a59-b906-8373c29f0c16 with identifier: KX92622
2026-03-30 10:58:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c53de3f-879e-5a59-b906-8373c29f0c16 with identifier: KX92622
2026-03-30 10:58:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c53de3f-879e-5a59-b906-8373c29f0c16 with identifier: KX92622 to the API
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:18:53Z',
 'fuel_type': 'petrol',
 'id': '3c53de3f-879e-5a59-b906-8373c29f0c16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX92622',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 78385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Ford Galaxy 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX92622%27 HTTP/1.1" 200 None
2026-03-30 10:58:55 [auto1.de] INFO: Saving data for KX92622: {'auction_closing_time': 1774883933.0, 'created_time': 1774550734.616378, 'last_price_update_time': 1774868335.481805}
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX92622') HTTP/1.1" 204 0
2026-03-30 10:58:55 [auto1.de] INFO: Found listing with ID: JA40486
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA40486%27 HTTP/1.1" 200 None
2026-03-30 10:58:55 [auto1.de] INFO: Scrape type for JA40486: 2
2026-03-30 10:58:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e0d4bcb-12b2-51ad-bd2b-67047066796f with identifier: JA40486
2026-03-30 10:58:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e0d4bcb-12b2-51ad-bd2b-67047066796f with scrape type 2
2026-03-30 10:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e0d4bcb-12b2-51ad-bd2b-67047066796f with scrape type 2
2026-03-30 10:58:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e0d4bcb-12b2-51ad-bd2b-67047066796f, identifier: JA40486
2026-03-30 10:58:55 [auto1.de] INFO: Found listing with ID: KY89472
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY89472%27 HTTP/1.1" 200 None
2026-03-30 10:58:55 [auto1.de] INFO: Scrape type for KY89472: 2
2026-03-30 10:58:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c40c78c9-93c2-53d1-949a-fee233885e5f with identifier: KY89472
2026-03-30 10:58:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c40c78c9-93c2-53d1-949a-fee233885e5f with scrape type 2
2026-03-30 10:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c40c78c9-93c2-53d1-949a-fee233885e5f with scrape type 2
2026-03-30 10:58:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c40c78c9-93c2-53d1-949a-fee233885e5f, identifier: KY89472
2026-03-30 10:58:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e0d4bcb-12b2-51ad-bd2b-67047066796f with identifier: JA40486
2026-03-30 10:58:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e0d4bcb-12b2-51ad-bd2b-67047066796f with identifier: JA40486
2026-03-30 10:58:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e0d4bcb-12b2-51ad-bd2b-67047066796f with identifier: JA40486 to the API
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:27:25Z',
 'fuel_type': 'petrol',
 'id': '8e0d4bcb-12b2-51ad-bd2b-67047066796f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA40486',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 177617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-06',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2009}
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA40486%27 HTTP/1.1" 200 None
2026-03-30 10:58:56 [auto1.de] INFO: Saving data for JA40486: {'auction_closing_time': 1774884445.0, 'created_time': 1774550666.52101, 'last_price_update_time': 1774868336.031599}
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA40486') HTTP/1.1" 204 0
2026-03-30 10:58:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c40c78c9-93c2-53d1-949a-fee233885e5f with identifier: KY89472
2026-03-30 10:58:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c40c78c9-93c2-53d1-949a-fee233885e5f with identifier: KY89472
2026-03-30 10:58:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c40c78c9-93c2-53d1-949a-fee233885e5f with identifier: KY89472 to the API
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:19:05Z',
 'fuel_type': 'petrol',
 'id': 'c40c78c9-93c2-53d1-949a-fee233885e5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY89472',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 140992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-26',
 'seller_name': None,
 'title': 'Audi A3 Sportback 30 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY89472%27 HTTP/1.1" 200 None
2026-03-30 10:58:56 [auto1.de] INFO: Saving data for KY89472: {'auction_closing_time': 1774883945.0, 'created_time': 1774552330.520192, 'last_price_update_time': 1774868336.332014}
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY89472') HTTP/1.1" 204 0
2026-03-30 10:58:56 [auto1.de] INFO: Found listing with ID: JY67859
2026-03-30 10:58:56 [auto1.de] INFO: Found listing with ID: SG28932
2026-03-30 10:58:56 [auto1.de] INFO: Found listing with ID: JL52757
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL52757%27 HTTP/1.1" 200 None
2026-03-30 10:58:56 [auto1.de] INFO: Scrape type for JL52757: 2
2026-03-30 10:58:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b074fabb-c123-55c7-895b-bd5e7b12f194 with identifier: JL52757
2026-03-30 10:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b074fabb-c123-55c7-895b-bd5e7b12f194 with scrape type 2
2026-03-30 10:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b074fabb-c123-55c7-895b-bd5e7b12f194 with scrape type 2
2026-03-30 10:58:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b074fabb-c123-55c7-895b-bd5e7b12f194, identifier: JL52757
2026-03-30 10:58:56 [auto1.de] INFO: Found listing with ID: WM17924
2026-03-30 10:58:56 [auto1.de] INFO: Found listing with ID: CL13866
2026-03-30 10:58:56 [auto1.de] INFO: Found listing with ID: SV54413
2026-03-30 10:58:56 [auto1.de] INFO: Found listing with ID: BY81957
2026-03-30 10:58:56 [auto1.de] INFO: Found listing with ID: NJ51378
2026-03-30 10:58:56 [auto1.de] INFO: Found listing with ID: KP55119
2026-03-30 10:58:56 [auto1.de] INFO: Found listing with ID: CF02627
2026-03-30 10:58:56 [auto1.de] INFO: Found listing with ID: NV13979
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13979%27 HTTP/1.1" 200 None
2026-03-30 10:58:56 [auto1.de] INFO: Scrape type for NV13979: 2
2026-03-30 10:58:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd4b47c4-d66e-5f74-96aa-7787461cb229 with identifier: NV13979
2026-03-30 10:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd4b47c4-d66e-5f74-96aa-7787461cb229 with scrape type 2
2026-03-30 10:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd4b47c4-d66e-5f74-96aa-7787461cb229 with scrape type 2
2026-03-30 10:58:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd4b47c4-d66e-5f74-96aa-7787461cb229, identifier: NV13979
2026-03-30 10:58:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b074fabb-c123-55c7-895b-bd5e7b12f194 with identifier: JL52757
2026-03-30 10:58:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b074fabb-c123-55c7-895b-bd5e7b12f194 with identifier: JL52757
2026-03-30 10:58:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b074fabb-c123-55c7-895b-bd5e7b12f194 with identifier: JL52757 to the API
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:38:05Z',
 'fuel_type': 'petrol',
 'id': 'b074fabb-c123-55c7-895b-bd5e7b12f194',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL52757',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '406',
 'odometer': 138347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-03-30',
 'seller_name': None,
 'title': 'Peugeot 406 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 1998}
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL52757%27 HTTP/1.1" 200 None
2026-03-30 10:58:56 [auto1.de] INFO: Saving data for JL52757: {'auction_closing_time': 1774885085.0, 'created_time': 1773917109.312762, 'last_price_update_time': 1774868336.859656}
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL52757') HTTP/1.1" 204 0
2026-03-30 10:58:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd4b47c4-d66e-5f74-96aa-7787461cb229 with identifier: NV13979
2026-03-30 10:58:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd4b47c4-d66e-5f74-96aa-7787461cb229 with identifier: NV13979
2026-03-30 10:58:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd4b47c4-d66e-5f74-96aa-7787461cb229 with identifier: NV13979 to the API
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:27:48Z',
 'fuel_type': 'petrol',
 'id': 'cd4b47c4-d66e-5f74-96aa-7787461cb229',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV13979',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 108118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-25',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Opel 2020 Start/Stop',
 'transmission': 'manual',
 'trim': '2020 Start/Stop',
 'year': 2020}
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13979%27 HTTP/1.1" 200 None
2026-03-30 10:58:57 [auto1.de] INFO: Saving data for NV13979: {'auction_closing_time': 1774884468.0, 'created_time': 1774002464.311014, 'last_price_update_time': 1774868337.247491}
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV13979') HTTP/1.1" 204 0
2026-03-30 10:58:57 [auto1.de] INFO: Found listing with ID: MG41395
2026-03-30 10:58:57 [auto1.de] INFO: Found listing with ID: ND21540
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND21540%27 HTTP/1.1" 200 None
2026-03-30 10:58:57 [auto1.de] INFO: Scrape type for ND21540: 2
2026-03-30 10:58:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 269b91c4-7d5e-5435-9f23-97176b02ee30 with identifier: ND21540
2026-03-30 10:58:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 269b91c4-7d5e-5435-9f23-97176b02ee30 with scrape type 2
2026-03-30 10:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 269b91c4-7d5e-5435-9f23-97176b02ee30 with scrape type 2
2026-03-30 10:58:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 269b91c4-7d5e-5435-9f23-97176b02ee30, identifier: ND21540
2026-03-30 10:58:57 [auto1.de] INFO: Found listing with ID: DM11182
2026-03-30 10:58:57 [auto1.de] INFO: Found listing with ID: EX39495
2026-03-30 10:58:57 [auto1.de] INFO: Found listing with ID: SR10535
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR10535%27 HTTP/1.1" 200 None
2026-03-30 10:58:57 [auto1.de] INFO: Scrape type for SR10535: 2
2026-03-30 10:58:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bcb943c-244d-5868-ab3d-b1618e2d7fac with identifier: SR10535
2026-03-30 10:58:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bcb943c-244d-5868-ab3d-b1618e2d7fac with scrape type 2
2026-03-30 10:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bcb943c-244d-5868-ab3d-b1618e2d7fac with scrape type 2
2026-03-30 10:58:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bcb943c-244d-5868-ab3d-b1618e2d7fac, identifier: SR10535
2026-03-30 10:58:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 269b91c4-7d5e-5435-9f23-97176b02ee30 with identifier: ND21540
2026-03-30 10:58:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 269b91c4-7d5e-5435-9f23-97176b02ee30 with identifier: ND21540
2026-03-30 10:58:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 269b91c4-7d5e-5435-9f23-97176b02ee30 with identifier: ND21540 to the API
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:05:22Z',
 'fuel_type': 'petrol',
 'id': '269b91c4-7d5e-5435-9f23-97176b02ee30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND21540',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 54799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI Performance BlueMotion',
 'year': 2018}
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND21540%27 HTTP/1.1" 200 None
2026-03-30 10:58:57 [auto1.de] INFO: Saving data for ND21540: {'auction_closing_time': 1774883122.0, 'created_time': 1774550698.89929, 'last_price_update_time': 1774868337.753461}
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND21540') HTTP/1.1" 204 0
2026-03-30 10:58:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bcb943c-244d-5868-ab3d-b1618e2d7fac with identifier: SR10535
2026-03-30 10:58:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bcb943c-244d-5868-ab3d-b1618e2d7fac with identifier: SR10535
2026-03-30 10:58:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bcb943c-244d-5868-ab3d-b1618e2d7fac with identifier: SR10535 to the API
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:48:08Z',
 'fuel_type': 'petrol',
 'id': '7bcb943c-244d-5868-ab3d-b1618e2d7fac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR10535',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 304472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR10535%27 HTTP/1.1" 200 None
2026-03-30 10:58:58 [auto1.de] INFO: Saving data for SR10535: {'auction_closing_time': 1774885688.0, 'created_time': 1774550677.46395, 'last_price_update_time': 1774868338.042275}
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR10535') HTTP/1.1" 204 0
2026-03-30 10:58:58 [auto1.de] INFO: Found listing with ID: DN18269
2026-03-30 10:58:58 [auto1.de] INFO: Found listing with ID: XG25622
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG25622%27 HTTP/1.1" 200 None
2026-03-30 10:58:58 [auto1.de] INFO: Scrape type for XG25622: 2
2026-03-30 10:58:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85c4481a-5599-53a9-b681-cfd3ebaeba54 with identifier: XG25622
2026-03-30 10:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85c4481a-5599-53a9-b681-cfd3ebaeba54 with scrape type 2
2026-03-30 10:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85c4481a-5599-53a9-b681-cfd3ebaeba54 with scrape type 2
2026-03-30 10:58:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85c4481a-5599-53a9-b681-cfd3ebaeba54, identifier: XG25622
2026-03-30 10:58:58 [auto1.de] INFO: Found listing with ID: LY60106
2026-03-30 10:58:58 [auto1.de] INFO: Found listing with ID: GR07934
2026-03-30 10:58:58 [auto1.de] INFO: Found listing with ID: GZ84157
2026-03-30 10:58:58 [auto1.de] INFO: Found listing with ID: CM86164
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM86164%27 HTTP/1.1" 200 None
2026-03-30 10:58:58 [auto1.de] INFO: Scrape type for CM86164: 2
2026-03-30 10:58:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 790041eb-c3bd-54f1-8fbf-02055ac2c84f with identifier: CM86164
2026-03-30 10:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 790041eb-c3bd-54f1-8fbf-02055ac2c84f with scrape type 2
2026-03-30 10:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 790041eb-c3bd-54f1-8fbf-02055ac2c84f with scrape type 2
2026-03-30 10:58:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 790041eb-c3bd-54f1-8fbf-02055ac2c84f, identifier: CM86164
2026-03-30 10:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:58:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85c4481a-5599-53a9-b681-cfd3ebaeba54 with identifier: XG25622
2026-03-30 10:58:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85c4481a-5599-53a9-b681-cfd3ebaeba54 with identifier: XG25622
2026-03-30 10:58:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85c4481a-5599-53a9-b681-cfd3ebaeba54 with identifier: XG25622 to the API
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:05:56Z',
 'fuel_type': 'hybrid',
 'id': '85c4481a-5599-53a9-b681-cfd3ebaeba54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG25622',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 1756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-05-07',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.5 Dualjet Hybrid Comfort 4x2',
 'transmission': 'automatic',
 'trim': 'Comfort 4x2',
 'year': 2025}
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG25622%27 HTTP/1.1" 200 None
2026-03-30 10:58:58 [auto1.de] INFO: Saving data for XG25622: {'auction_closing_time': 1774883156.0, 'created_time': 1774780600.128635, 'last_price_update_time': 1774868338.613375}
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG25622') HTTP/1.1" 204 0
2026-03-30 10:58:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 790041eb-c3bd-54f1-8fbf-02055ac2c84f with identifier: CM86164
2026-03-30 10:58:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 790041eb-c3bd-54f1-8fbf-02055ac2c84f with identifier: CM86164
2026-03-30 10:58:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 790041eb-c3bd-54f1-8fbf-02055ac2c84f with identifier: CM86164 to the API
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:36:00Z',
 'fuel_type': 'petrol',
 'id': '790041eb-c3bd-54f1-8fbf-02055ac2c84f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM86164',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 85249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-27',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 Motion Plus',
 'transmission': 'manual',
 'trim': 'Motion Plus',
 'year': 2008}
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM86164%27 HTTP/1.1" 200 None
2026-03-30 10:58:59 [auto1.de] INFO: Saving data for CM86164: {'auction_closing_time': 1774884960.0, 'created_time': 1774550681.882259, 'last_price_update_time': 1774868339.043599}
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM86164') HTTP/1.1" 204 0
2026-03-30 10:58:59 [auto1.de] INFO: Found listing with ID: WK49951
2026-03-30 10:58:59 [auto1.de] INFO: Found listing with ID: AD16750
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD16750%27 HTTP/1.1" 200 None
2026-03-30 10:58:59 [auto1.de] INFO: Scrape type for AD16750: 2
2026-03-30 10:58:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5635860-f6ad-5589-b8b2-01c1ee53888a with identifier: AD16750
2026-03-30 10:58:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5635860-f6ad-5589-b8b2-01c1ee53888a with scrape type 2
2026-03-30 10:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5635860-f6ad-5589-b8b2-01c1ee53888a with scrape type 2
2026-03-30 10:58:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5635860-f6ad-5589-b8b2-01c1ee53888a, identifier: AD16750
2026-03-30 10:58:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5635860-f6ad-5589-b8b2-01c1ee53888a with identifier: AD16750
2026-03-30 10:58:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5635860-f6ad-5589-b8b2-01c1ee53888a with identifier: AD16750
2026-03-30 10:58:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5635860-f6ad-5589-b8b2-01c1ee53888a with identifier: AD16750 to the API
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:01:10Z',
 'fuel_type': 'diesel',
 'id': 'b5635860-f6ad-5589-b8b2-01c1ee53888a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD16750',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 383887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-31',
 'seller_name': None,
 'title': 'BMW X3 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD16750%27 HTTP/1.1" 200 None
2026-03-30 10:58:59 [auto1.de] INFO: Saving data for AD16750: {'auction_closing_time': 1774882870.0, 'created_time': 1773686357.624209, 'last_price_update_time': 1774868339.436937}
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD16750') HTTP/1.1" 204 0
2026-03-30 10:58:59 [auto1.de] INFO: Found listing with ID: UF75132
2026-03-30 10:58:59 [auto1.de] INFO: Found listing with ID: JE79090
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79090%27 HTTP/1.1" 200 None
2026-03-30 10:58:59 [auto1.de] INFO: Scrape type for JE79090: 2
2026-03-30 10:58:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2550410a-2927-517a-815f-ebfeaf4472d7 with identifier: JE79090
2026-03-30 10:58:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2550410a-2927-517a-815f-ebfeaf4472d7 with scrape type 2
2026-03-30 10:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2550410a-2927-517a-815f-ebfeaf4472d7 with scrape type 2
2026-03-30 10:58:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2550410a-2927-517a-815f-ebfeaf4472d7, identifier: JE79090
2026-03-30 10:58:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2550410a-2927-517a-815f-ebfeaf4472d7 with identifier: JE79090
2026-03-30 10:58:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2550410a-2927-517a-815f-ebfeaf4472d7 with identifier: JE79090
2026-03-30 10:58:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2550410a-2927-517a-815f-ebfeaf4472d7 with identifier: JE79090 to the API
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:58:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:05:59Z',
 'fuel_type': 'petrol',
 'id': '2550410a-2927-517a-815f-ebfeaf4472d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE79090',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 43525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-04',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Impression',
 'transmission': 'manual',
 'trim': 'Impression',
 'year': 2015}
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79090%27 HTTP/1.1" 200 None
2026-03-30 10:58:59 [auto1.de] INFO: Saving data for JE79090: {'auction_closing_time': 1774883159.0, 'created_time': 1774550958.378453, 'last_price_update_time': 1774868339.87805}
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE79090') HTTP/1.1" 204 0
2026-03-30 10:58:59 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 9548 | hits on page: 40
2026-03-30 10:58:59 [auto1.de] INFO: Found listing with ID: FR75533
2026-03-30 10:58:59 [auto1.de] INFO: Found listing with ID: RK76188
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK76188%27 HTTP/1.1" 200 None
2026-03-30 10:58:59 [auto1.de] INFO: Scrape type for RK76188: 2
2026-03-30 10:58:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c4f8e85-5354-5a52-bfc3-2cb01536f0db with identifier: RK76188
2026-03-30 10:58:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c4f8e85-5354-5a52-bfc3-2cb01536f0db with scrape type 2
2026-03-30 10:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c4f8e85-5354-5a52-bfc3-2cb01536f0db with scrape type 2
2026-03-30 10:59:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c4f8e85-5354-5a52-bfc3-2cb01536f0db, identifier: RK76188
2026-03-30 10:59:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c4f8e85-5354-5a52-bfc3-2cb01536f0db with identifier: RK76188
2026-03-30 10:59:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c4f8e85-5354-5a52-bfc3-2cb01536f0db with identifier: RK76188
2026-03-30 10:59:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c4f8e85-5354-5a52-bfc3-2cb01536f0db with identifier: RK76188 to the API
2026-03-30 10:59:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:23:58Z',
 'fuel_type': 'diesel',
 'id': '3c4f8e85-5354-5a52-bfc3-2cb01536f0db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK76188',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 226034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-24',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 10:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK76188%27 HTTP/1.1" 200 None
2026-03-30 10:59:00 [auto1.de] INFO: Saving data for RK76188: {'auction_closing_time': 1774884238.0, 'created_time': 1773428916.426553, 'last_price_update_time': 1774868340.892378}
2026-03-30 10:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK76188') HTTP/1.1" 204 0
2026-03-30 10:59:00 [auto1.de] INFO: Found listing with ID: JG12226
2026-03-30 10:59:00 [auto1.de] INFO: Found listing with ID: MH98673
2026-03-30 10:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH98673%27 HTTP/1.1" 200 None
2026-03-30 10:59:00 [auto1.de] INFO: Scrape type for MH98673: 2
2026-03-30 10:59:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46331702-81ec-5126-aacd-b58fac8f37c1 with identifier: MH98673
2026-03-30 10:59:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46331702-81ec-5126-aacd-b58fac8f37c1 with scrape type 2
2026-03-30 10:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46331702-81ec-5126-aacd-b58fac8f37c1 with scrape type 2
2026-03-30 10:59:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46331702-81ec-5126-aacd-b58fac8f37c1, identifier: MH98673
2026-03-30 10:59:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:01 [auto1.de] INFO: Found listing with ID: EK64818
2026-03-30 10:59:01 [auto1.de] INFO: Found listing with ID: TU64777
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU64777%27 HTTP/1.1" 200 None
2026-03-30 10:59:01 [auto1.de] INFO: Scrape type for TU64777: 2
2026-03-30 10:59:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2958cc2-dc9f-540c-9e88-ab9b3db38262 with identifier: TU64777
2026-03-30 10:59:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2958cc2-dc9f-540c-9e88-ab9b3db38262 with scrape type 2
2026-03-30 10:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2958cc2-dc9f-540c-9e88-ab9b3db38262 with scrape type 2
2026-03-30 10:59:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2958cc2-dc9f-540c-9e88-ab9b3db38262, identifier: TU64777
2026-03-30 10:59:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46331702-81ec-5126-aacd-b58fac8f37c1 with identifier: MH98673
2026-03-30 10:59:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46331702-81ec-5126-aacd-b58fac8f37c1 with identifier: MH98673
2026-03-30 10:59:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46331702-81ec-5126-aacd-b58fac8f37c1 with identifier: MH98673 to the API
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:10Z',
 'fuel_type': 'diesel',
 'id': '46331702-81ec-5126-aacd-b58fac8f37c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH98673',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 221500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-09',
 'seller_name': None,
 'title': 'BMW X3 sDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH98673%27 HTTP/1.1" 200 None
2026-03-30 10:59:01 [auto1.de] INFO: Saving data for MH98673: {'auction_closing_time': 1774883350.0, 'created_time': 1774780613.474014, 'last_price_update_time': 1774868341.534773}
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH98673') HTTP/1.1" 204 0
2026-03-30 10:59:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2958cc2-dc9f-540c-9e88-ab9b3db38262 with identifier: TU64777
2026-03-30 10:59:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2958cc2-dc9f-540c-9e88-ab9b3db38262 with identifier: TU64777
2026-03-30 10:59:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2958cc2-dc9f-540c-9e88-ab9b3db38262 with identifier: TU64777 to the API
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:55:11Z',
 'fuel_type': 'diesel',
 'id': 'd2958cc2-dc9f-540c-9e88-ab9b3db38262',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU64777',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 135167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-12',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU64777%27 HTTP/1.1" 200 None
2026-03-30 10:59:01 [auto1.de] INFO: Saving data for TU64777: {'auction_closing_time': 1774886111.0, 'created_time': 1774379580.78464, 'last_price_update_time': 1774868341.844349}
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU64777') HTTP/1.1" 204 0
2026-03-30 10:59:01 [auto1.de] INFO: Found listing with ID: UV43425
2026-03-30 10:59:01 [auto1.de] INFO: Found listing with ID: LD99689
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD99689%27 HTTP/1.1" 200 None
2026-03-30 10:59:01 [auto1.de] INFO: Scrape type for LD99689: 2
2026-03-30 10:59:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3779838b-9f43-521d-bc3d-4bf4803594b5 with identifier: LD99689
2026-03-30 10:59:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3779838b-9f43-521d-bc3d-4bf4803594b5 with scrape type 2
2026-03-30 10:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3779838b-9f43-521d-bc3d-4bf4803594b5 with scrape type 2
2026-03-30 10:59:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3779838b-9f43-521d-bc3d-4bf4803594b5, identifier: LD99689
2026-03-30 10:59:01 [auto1.de] INFO: Found listing with ID: XY93824
2026-03-30 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY93824%27 HTTP/1.1" 200 None
2026-03-30 10:59:02 [auto1.de] INFO: Scrape type for XY93824: 2
2026-03-30 10:59:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd817a2e-a1d4-57d0-ab9f-9347faa4c859 with identifier: XY93824
2026-03-30 10:59:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd817a2e-a1d4-57d0-ab9f-9347faa4c859 with scrape type 2
2026-03-30 10:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd817a2e-a1d4-57d0-ab9f-9347faa4c859 with scrape type 2
2026-03-30 10:59:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd817a2e-a1d4-57d0-ab9f-9347faa4c859, identifier: XY93824
2026-03-30 10:59:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3779838b-9f43-521d-bc3d-4bf4803594b5 with identifier: LD99689
2026-03-30 10:59:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3779838b-9f43-521d-bc3d-4bf4803594b5 with identifier: LD99689
2026-03-30 10:59:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3779838b-9f43-521d-bc3d-4bf4803594b5 with identifier: LD99689 to the API
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:28:57Z',
 'fuel_type': 'petrol',
 'id': '3779838b-9f43-521d-bc3d-4bf4803594b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD99689',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Signum',
 'odometer': 162415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-27',
 'seller_name': None,
 'title': 'Opel Signum 1.8 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2006}
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD99689%27 HTTP/1.1" 200 None
2026-03-30 10:59:02 [auto1.de] INFO: Saving data for LD99689: {'auction_closing_time': 1774884537.0, 'created_time': 1773427007.012836, 'last_price_update_time': 1774868342.369507}
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD99689') HTTP/1.1" 204 0
2026-03-30 10:59:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd817a2e-a1d4-57d0-ab9f-9347faa4c859 with identifier: XY93824
2026-03-30 10:59:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd817a2e-a1d4-57d0-ab9f-9347faa4c859 with identifier: XY93824
2026-03-30 10:59:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd817a2e-a1d4-57d0-ab9f-9347faa4c859 with identifier: XY93824 to the API
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:56:58Z',
 'fuel_type': 'diesel',
 'id': 'bd817a2e-a1d4-57d0-ab9f-9347faa4c859',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY93824',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 132615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-04',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI kompakt Ambiente Edition',
 'transmission': 'automatic',
 'trim': 'kompakt Ambiente Edition',
 'year': 2010}
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY93824%27 HTTP/1.1" 200 None
2026-03-30 10:59:02 [auto1.de] INFO: Saving data for XY93824: {'auction_closing_time': 1774886218.0, 'created_time': 1774550895.370796, 'last_price_update_time': 1774868342.770878}
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY93824') HTTP/1.1" 204 0
2026-03-30 10:59:02 [auto1.de] INFO: Found listing with ID: JM98796
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM98796%27 HTTP/1.1" 200 None
2026-03-30 10:59:02 [auto1.de] INFO: Scrape type for JM98796: 2
2026-03-30 10:59:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cacc1a32-7d9a-5a9e-9cd3-f2e16990ca62 with identifier: JM98796
2026-03-30 10:59:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cacc1a32-7d9a-5a9e-9cd3-f2e16990ca62 with scrape type 2
2026-03-30 10:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cacc1a32-7d9a-5a9e-9cd3-f2e16990ca62 with scrape type 2
2026-03-30 10:59:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cacc1a32-7d9a-5a9e-9cd3-f2e16990ca62, identifier: JM98796
2026-03-30 10:59:02 [auto1.de] INFO: Found listing with ID: AT28488
2026-03-30 10:59:02 [auto1.de] INFO: Found listing with ID: YB70330
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB70330%27 HTTP/1.1" 200 None
2026-03-30 10:59:02 [auto1.de] INFO: Scrape type for YB70330: 2
2026-03-30 10:59:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aae4af9-eae4-5a6b-ab52-ef808ab8c3d6 with identifier: YB70330
2026-03-30 10:59:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aae4af9-eae4-5a6b-ab52-ef808ab8c3d6 with scrape type 2
2026-03-30 10:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aae4af9-eae4-5a6b-ab52-ef808ab8c3d6 with scrape type 2
2026-03-30 10:59:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9aae4af9-eae4-5a6b-ab52-ef808ab8c3d6, identifier: YB70330
2026-03-30 10:59:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cacc1a32-7d9a-5a9e-9cd3-f2e16990ca62 with identifier: JM98796
2026-03-30 10:59:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cacc1a32-7d9a-5a9e-9cd3-f2e16990ca62 with identifier: JM98796
2026-03-30 10:59:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cacc1a32-7d9a-5a9e-9cd3-f2e16990ca62 with identifier: JM98796 to the API
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:39:24Z',
 'fuel_type': 'petrol',
 'id': 'cacc1a32-7d9a-5a9e-9cd3-f2e16990ca62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM98796',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 180438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-23',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 170 NGT Taxi',
 'transmission': 'automatic',
 'trim': 'Taxi',
 'year': 2008}
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM98796%27 HTTP/1.1" 200 None
2026-03-30 10:59:03 [auto1.de] INFO: Saving data for JM98796: {'auction_closing_time': 1774885164.0, 'created_time': 1773571885.313575, 'last_price_update_time': 1774868343.310989}
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM98796') HTTP/1.1" 204 0
2026-03-30 10:59:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9aae4af9-eae4-5a6b-ab52-ef808ab8c3d6 with identifier: YB70330
2026-03-30 10:59:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9aae4af9-eae4-5a6b-ab52-ef808ab8c3d6 with identifier: YB70330
2026-03-30 10:59:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9aae4af9-eae4-5a6b-ab52-ef808ab8c3d6 with identifier: YB70330 to the API
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:13:42Z',
 'fuel_type': 'diesel',
 'id': '9aae4af9-eae4-5a6b-ab52-ef808ab8c3d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB70330',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 76342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-11',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB70330%27 HTTP/1.1" 200 None
2026-03-30 10:59:03 [auto1.de] INFO: Saving data for YB70330: {'auction_closing_time': 1774883622.0, 'created_time': 1773516443.020229, 'last_price_update_time': 1774868343.613869}
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB70330') HTTP/1.1" 204 0
2026-03-30 10:59:03 [auto1.de] INFO: Found listing with ID: VM39350
2026-03-30 10:59:03 [auto1.de] INFO: Found listing with ID: LZ98247
2026-03-30 10:59:03 [auto1.de] INFO: Found listing with ID: CZ09643
2026-03-30 10:59:03 [auto1.de] INFO: Found listing with ID: KU03533
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU03533%27 HTTP/1.1" 200 None
2026-03-30 10:59:03 [auto1.de] INFO: Scrape type for KU03533: 2
2026-03-30 10:59:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28c0cd65-ff3e-5d50-b06f-d68a254f3481 with identifier: KU03533
2026-03-30 10:59:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28c0cd65-ff3e-5d50-b06f-d68a254f3481 with scrape type 2
2026-03-30 10:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28c0cd65-ff3e-5d50-b06f-d68a254f3481 with scrape type 2
2026-03-30 10:59:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28c0cd65-ff3e-5d50-b06f-d68a254f3481, identifier: KU03533
2026-03-30 10:59:03 [auto1.de] INFO: Found listing with ID: YW90897
2026-03-30 10:59:03 [auto1.de] INFO: Found listing with ID: CJ04557
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ04557%27 HTTP/1.1" 200 None
2026-03-30 10:59:03 [auto1.de] INFO: Scrape type for CJ04557: 2
2026-03-30 10:59:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 401546a5-dcc2-5886-9f19-65097dc6df95 with identifier: CJ04557
2026-03-30 10:59:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 401546a5-dcc2-5886-9f19-65097dc6df95 with scrape type 2
2026-03-30 10:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 401546a5-dcc2-5886-9f19-65097dc6df95 with scrape type 2
2026-03-30 10:59:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 401546a5-dcc2-5886-9f19-65097dc6df95, identifier: CJ04557
2026-03-30 10:59:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28c0cd65-ff3e-5d50-b06f-d68a254f3481 with identifier: KU03533
2026-03-30 10:59:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28c0cd65-ff3e-5d50-b06f-d68a254f3481 with identifier: KU03533
2026-03-30 10:59:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28c0cd65-ff3e-5d50-b06f-d68a254f3481 with identifier: KU03533 to the API
2026-03-30 10:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-30T15:39:52Z',
 'fuel_type': 'diesel',
 'id': '28c0cd65-ff3e-5d50-b06f-d68a254f3481',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU03533',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 235223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-04',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Comfortline 4Motion',
 'transmission': 'automatic',
 'trim': 'Comfortline 4Motion',
 'year': 2021}
2026-03-30 10:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU03533%27 HTTP/1.1" 200 None
2026-03-30 10:59:04 [auto1.de] INFO: Saving data for KU03533: {'auction_closing_time': 1774885192.0, 'created_time': 1773429425.112844, 'last_price_update_time': 1774868344.127883}
2026-03-30 10:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU03533') HTTP/1.1" 204 0
2026-03-30 10:59:04 [scrapy.extensions.logstats] INFO: Crawled 780 pages (at 8 pages/min), scraped 1052 items (at 127 items/min)
2026-03-30 10:59:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 10:59:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 401546a5-dcc2-5886-9f19-65097dc6df95 with identifier: CJ04557
2026-03-30 10:59:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 401546a5-dcc2-5886-9f19-65097dc6df95 with identifier: CJ04557
2026-03-30 10:59:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 401546a5-dcc2-5886-9f19-65097dc6df95 with identifier: CJ04557 to the API
2026-03-30 10:59:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:41:32Z',
 'fuel_type': 'diesel',
 'id': '401546a5-dcc2-5886-9f19-65097dc6df95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ04557',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 273024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-30',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.9 TDI BlueMotion',
 'transmission': 'manual',
 'trim': 'BlueMotion',
 'year': 2007}
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ04557%27 HTTP/1.1" 200 None
2026-03-30 10:59:05 [auto1.de] INFO: Saving data for CJ04557: {'auction_closing_time': 1774885292.0, 'created_time': 1774638257.049201, 'last_price_update_time': 1774868345.391619}
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ04557') HTTP/1.1" 204 0
2026-03-30 10:59:05 [auto1.de] INFO: Found listing with ID: TB49409
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49409%27 HTTP/1.1" 200 None
2026-03-30 10:59:05 [auto1.de] INFO: Scrape type for TB49409: 2
2026-03-30 10:59:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 151649a1-64ec-577d-8c80-9c111bcb75bc with identifier: TB49409
2026-03-30 10:59:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 151649a1-64ec-577d-8c80-9c111bcb75bc with scrape type 2
2026-03-30 10:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 151649a1-64ec-577d-8c80-9c111bcb75bc with scrape type 2
2026-03-30 10:59:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 151649a1-64ec-577d-8c80-9c111bcb75bc, identifier: TB49409
2026-03-30 10:59:05 [auto1.de] INFO: Found listing with ID: UD27058
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD27058%27 HTTP/1.1" 200 None
2026-03-30 10:59:05 [auto1.de] INFO: Scrape type for UD27058: 2
2026-03-30 10:59:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af667184-c0c7-52b3-a9f9-3d31c374f588 with identifier: UD27058
2026-03-30 10:59:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af667184-c0c7-52b3-a9f9-3d31c374f588 with scrape type 2
2026-03-30 10:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af667184-c0c7-52b3-a9f9-3d31c374f588 with scrape type 2
2026-03-30 10:59:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af667184-c0c7-52b3-a9f9-3d31c374f588, identifier: UD27058
2026-03-30 10:59:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 151649a1-64ec-577d-8c80-9c111bcb75bc with identifier: TB49409
2026-03-30 10:59:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 151649a1-64ec-577d-8c80-9c111bcb75bc with identifier: TB49409
2026-03-30 10:59:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 151649a1-64ec-577d-8c80-9c111bcb75bc with identifier: TB49409 to the API
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:31:12Z',
 'fuel_type': 'petrol',
 'id': '151649a1-64ec-577d-8c80-9c111bcb75bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB49409',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 158895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-08-02',
 'seller_name': None,
 'title': 'Audi A6 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 2000}
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49409%27 HTTP/1.1" 200 None
2026-03-30 10:59:05 [auto1.de] INFO: Saving data for TB49409: {'auction_closing_time': 1774884672.0, 'created_time': 1774550710.341582, 'last_price_update_time': 1774868345.904638}
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB49409') HTTP/1.1" 204 0
2026-03-30 10:59:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af667184-c0c7-52b3-a9f9-3d31c374f588 with identifier: UD27058
2026-03-30 10:59:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af667184-c0c7-52b3-a9f9-3d31c374f588 with identifier: UD27058
2026-03-30 10:59:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af667184-c0c7-52b3-a9f9-3d31c374f588 with identifier: UD27058 to the API
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:51:06Z',
 'fuel_type': 'petrol',
 'id': 'af667184-c0c7-52b3-a9f9-3d31c374f588',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD27058',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 149804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-05',
 'seller_name': None,
 'title': 'Skoda Superb 1.8 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2013}
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD27058%27 HTTP/1.1" 200 None
2026-03-30 10:59:06 [auto1.de] INFO: Saving data for UD27058: {'auction_closing_time': 1774885866.0, 'created_time': 1773686331.940242, 'last_price_update_time': 1774868346.275901}
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD27058') HTTP/1.1" 204 0
2026-03-30 10:59:06 [auto1.de] INFO: Found listing with ID: NB42822
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB42822%27 HTTP/1.1" 200 None
2026-03-30 10:59:06 [auto1.de] INFO: Scrape type for NB42822: 2
2026-03-30 10:59:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bf69648-40a0-59f1-af18-d37e306788cd with identifier: NB42822
2026-03-30 10:59:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bf69648-40a0-59f1-af18-d37e306788cd with scrape type 2
2026-03-30 10:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bf69648-40a0-59f1-af18-d37e306788cd with scrape type 2
2026-03-30 10:59:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bf69648-40a0-59f1-af18-d37e306788cd, identifier: NB42822
2026-03-30 10:59:06 [auto1.de] INFO: Found listing with ID: VV98645
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98645%27 HTTP/1.1" 200 None
2026-03-30 10:59:06 [auto1.de] INFO: Scrape type for VV98645: 0
2026-03-30 10:59:06 [auto1.de] INFO: Found listing with ID: JG12226
2026-03-30 10:59:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bf69648-40a0-59f1-af18-d37e306788cd with identifier: NB42822
2026-03-30 10:59:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bf69648-40a0-59f1-af18-d37e306788cd with identifier: NB42822
2026-03-30 10:59:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bf69648-40a0-59f1-af18-d37e306788cd with identifier: NB42822 to the API
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:45:05Z',
 'fuel_type': 'diesel',
 'id': '1bf69648-40a0-59f1-af18-d37e306788cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB42822',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Carnival',
 'odometer': 334373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-13',
 'seller_name': None,
 'title': 'Kia Carnival 2.9 CRDi VGT EX Basis',
 'transmission': 'manual',
 'trim': 'VGT EX Basis',
 'year': 2009}
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB42822%27 HTTP/1.1" 200 None
2026-03-30 10:59:06 [auto1.de] INFO: Saving data for NB42822: {'auction_closing_time': 1774885505.0, 'created_time': 1774550802.765734, 'last_price_update_time': 1774868346.672515}
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB42822') HTTP/1.1" 204 0
2026-03-30 10:59:06 [auto1.de] INFO: Found listing with ID: LV79824
2026-03-30 10:59:06 [auto1.de] INFO: Found listing with ID: PM35820
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM35820%27 HTTP/1.1" 200 None
2026-03-30 10:59:06 [auto1.de] INFO: Scrape type for PM35820: 2
2026-03-30 10:59:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e697347-c876-5e32-9eaf-ba59ce799286 with identifier: PM35820
2026-03-30 10:59:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e697347-c876-5e32-9eaf-ba59ce799286 with scrape type 2
2026-03-30 10:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e697347-c876-5e32-9eaf-ba59ce799286 with scrape type 2
2026-03-30 10:59:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e697347-c876-5e32-9eaf-ba59ce799286, identifier: PM35820
2026-03-30 10:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e697347-c876-5e32-9eaf-ba59ce799286 with identifier: PM35820
2026-03-30 10:59:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e697347-c876-5e32-9eaf-ba59ce799286 with identifier: PM35820
2026-03-30 10:59:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e697347-c876-5e32-9eaf-ba59ce799286 with identifier: PM35820 to the API
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:42:26Z',
 'fuel_type': 'petrol',
 'id': '2e697347-c876-5e32-9eaf-ba59ce799286',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM35820',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 168037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-07-28',
 'seller_name': None,
 'title': 'Audi A3 1.8 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 1999}
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM35820%27 HTTP/1.1" 200 None
2026-03-30 10:59:07 [auto1.de] INFO: Saving data for PM35820: {'auction_closing_time': 1774885346.0, 'created_time': 1773131872.550017, 'last_price_update_time': 1774868347.068295}
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM35820') HTTP/1.1" 204 0
2026-03-30 10:59:07 [auto1.de] INFO: Found listing with ID: RE71424
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE71424%27 HTTP/1.1" 200 None
2026-03-30 10:59:07 [auto1.de] INFO: Scrape type for RE71424: 2
2026-03-30 10:59:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7897e21e-2c4d-50f4-9351-9413068ec250 with identifier: RE71424
2026-03-30 10:59:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7897e21e-2c4d-50f4-9351-9413068ec250 with scrape type 2
2026-03-30 10:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7897e21e-2c4d-50f4-9351-9413068ec250 with scrape type 2
2026-03-30 10:59:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7897e21e-2c4d-50f4-9351-9413068ec250, identifier: RE71424
2026-03-30 10:59:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7897e21e-2c4d-50f4-9351-9413068ec250 with identifier: RE71424
2026-03-30 10:59:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7897e21e-2c4d-50f4-9351-9413068ec250 with identifier: RE71424
2026-03-30 10:59:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7897e21e-2c4d-50f4-9351-9413068ec250 with identifier: RE71424 to the API
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:31:59Z',
 'fuel_type': 'petrol',
 'id': '7897e21e-2c4d-50f4-9351-9413068ec250',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE71424',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 182581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-01',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Team',
 'transmission': 'automatic',
 'trim': 'Team',
 'year': 2010}
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE71424%27 HTTP/1.1" 200 None
2026-03-30 10:59:07 [auto1.de] INFO: Saving data for RE71424: {'auction_closing_time': 1774884719.0, 'created_time': 1774034918.918706, 'last_price_update_time': 1774868347.469077}
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE71424') HTTP/1.1" 204 0
2026-03-30 10:59:07 [auto1.de] INFO: Found listing with ID: TZ64186
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ64186%27 HTTP/1.1" 200 None
2026-03-30 10:59:07 [auto1.de] INFO: Scrape type for TZ64186: 2
2026-03-30 10:59:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcdb418c-6e0d-50f3-8237-8df643b09a01 with identifier: TZ64186
2026-03-30 10:59:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcdb418c-6e0d-50f3-8237-8df643b09a01 with scrape type 2
2026-03-30 10:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcdb418c-6e0d-50f3-8237-8df643b09a01 with scrape type 2
2026-03-30 10:59:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcdb418c-6e0d-50f3-8237-8df643b09a01, identifier: TZ64186
2026-03-30 10:59:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcdb418c-6e0d-50f3-8237-8df643b09a01 with identifier: TZ64186
2026-03-30 10:59:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcdb418c-6e0d-50f3-8237-8df643b09a01 with identifier: TZ64186
2026-03-30 10:59:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcdb418c-6e0d-50f3-8237-8df643b09a01 with identifier: TZ64186 to the API
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:43:05Z',
 'fuel_type': 'diesel',
 'id': 'fcdb418c-6e0d-50f3-8237-8df643b09a01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ64186',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 183743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-07',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ64186%27 HTTP/1.1" 200 None
2026-03-30 10:59:07 [auto1.de] INFO: Saving data for TZ64186: {'auction_closing_time': 1774885385.0, 'created_time': 1774379158.155571, 'last_price_update_time': 1774868347.883905}
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ64186') HTTP/1.1" 204 0
2026-03-30 10:59:07 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 9549 | hits on page: 40
2026-03-30 10:59:07 [auto1.de] INFO: Found listing with ID: HE78253
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE78253%27 HTTP/1.1" 200 None
2026-03-30 10:59:07 [auto1.de] INFO: Scrape type for HE78253: 2
2026-03-30 10:59:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e35f40a6-8e9c-5ba0-908b-12af256a9ed0 with identifier: HE78253
2026-03-30 10:59:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e35f40a6-8e9c-5ba0-908b-12af256a9ed0 with scrape type 2
2026-03-30 10:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e35f40a6-8e9c-5ba0-908b-12af256a9ed0 with scrape type 2
2026-03-30 10:59:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e35f40a6-8e9c-5ba0-908b-12af256a9ed0, identifier: HE78253
2026-03-30 10:59:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e35f40a6-8e9c-5ba0-908b-12af256a9ed0 with identifier: HE78253
2026-03-30 10:59:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e35f40a6-8e9c-5ba0-908b-12af256a9ed0 with identifier: HE78253
2026-03-30 10:59:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e35f40a6-8e9c-5ba0-908b-12af256a9ed0 with identifier: HE78253 to the API
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:40:26Z',
 'fuel_type': 'petrol',
 'id': 'e35f40a6-8e9c-5ba0-908b-12af256a9ed0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE78253',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 137014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-12-31',
 'seller_name': None,
 'title': 'Skoda Fabia 2.0 Extra',
 'transmission': 'manual',
 'trim': 'Extra',
 'year': 2003}
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE78253%27 HTTP/1.1" 200 None
2026-03-30 10:59:08 [auto1.de] INFO: Saving data for HE78253: {'auction_closing_time': 1774885226.0, 'created_time': 1774550903.524119, 'last_price_update_time': 1774868348.310695}
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE78253') HTTP/1.1" 204 0
2026-03-30 10:59:08 [auto1.de] INFO: Found listing with ID: JA01983
2026-03-30 10:59:08 [auto1.de] INFO: Found listing with ID: UJ23150
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ23150%27 HTTP/1.1" 200 None
2026-03-30 10:59:08 [auto1.de] INFO: Scrape type for UJ23150: 2
2026-03-30 10:59:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbb50f2c-1443-59fb-b8d5-2da0e8a81b93 with identifier: UJ23150
2026-03-30 10:59:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbb50f2c-1443-59fb-b8d5-2da0e8a81b93 with scrape type 2
2026-03-30 10:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbb50f2c-1443-59fb-b8d5-2da0e8a81b93 with scrape type 2
2026-03-30 10:59:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbb50f2c-1443-59fb-b8d5-2da0e8a81b93, identifier: UJ23150
2026-03-30 10:59:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:08 [auto1.de] INFO: Found listing with ID: WC37981
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC37981%27 HTTP/1.1" 200 None
2026-03-30 10:59:08 [auto1.de] INFO: Scrape type for WC37981: 2
2026-03-30 10:59:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 337c3b48-1e0b-5d50-baa6-5bca177efb8d with identifier: WC37981
2026-03-30 10:59:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 337c3b48-1e0b-5d50-baa6-5bca177efb8d with scrape type 2
2026-03-30 10:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 337c3b48-1e0b-5d50-baa6-5bca177efb8d with scrape type 2
2026-03-30 10:59:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 337c3b48-1e0b-5d50-baa6-5bca177efb8d, identifier: WC37981
2026-03-30 10:59:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbb50f2c-1443-59fb-b8d5-2da0e8a81b93 with identifier: UJ23150
2026-03-30 10:59:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbb50f2c-1443-59fb-b8d5-2da0e8a81b93 with identifier: UJ23150
2026-03-30 10:59:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbb50f2c-1443-59fb-b8d5-2da0e8a81b93 with identifier: UJ23150 to the API
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:28:24Z',
 'fuel_type': 'petrol',
 'id': 'fbb50f2c-1443-59fb-b8d5-2da0e8a81b93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ23150',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 29946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-28',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 200 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ23150%27 HTTP/1.1" 200 None
2026-03-30 10:59:08 [auto1.de] INFO: Saving data for UJ23150: {'auction_closing_time': 1774884504.0, 'created_time': 1774780631.868296, 'last_price_update_time': 1774868348.933925}
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ23150') HTTP/1.1" 204 0
2026-03-30 10:59:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 337c3b48-1e0b-5d50-baa6-5bca177efb8d with identifier: WC37981
2026-03-30 10:59:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 337c3b48-1e0b-5d50-baa6-5bca177efb8d with identifier: WC37981
2026-03-30 10:59:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 337c3b48-1e0b-5d50-baa6-5bca177efb8d with identifier: WC37981 to the API
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:56:04Z',
 'fuel_type': 'diesel',
 'id': '337c3b48-1e0b-5d50-baa6-5bca177efb8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC37981',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 260590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-16',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2012}
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC37981%27 HTTP/1.1" 200 None
2026-03-30 10:59:09 [auto1.de] INFO: Saving data for WC37981: {'auction_closing_time': 1774886164.0, 'created_time': 1773571597.949573, 'last_price_update_time': 1774868349.344498}
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC37981') HTTP/1.1" 204 0
2026-03-30 10:59:09 [auto1.de] INFO: Found listing with ID: AH44309
2026-03-30 10:59:09 [auto1.de] INFO: Found listing with ID: YK45245
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK45245%27 HTTP/1.1" 200 None
2026-03-30 10:59:09 [auto1.de] INFO: Scrape type for YK45245: 2
2026-03-30 10:59:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f90e677a-2965-5862-8b51-7a0b52f336d1 with identifier: YK45245
2026-03-30 10:59:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f90e677a-2965-5862-8b51-7a0b52f336d1 with scrape type 2
2026-03-30 10:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f90e677a-2965-5862-8b51-7a0b52f336d1 with scrape type 2
2026-03-30 10:59:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f90e677a-2965-5862-8b51-7a0b52f336d1, identifier: YK45245
2026-03-30 10:59:09 [auto1.de] INFO: Found listing with ID: VU91193
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU91193%27 HTTP/1.1" 200 None
2026-03-30 10:59:09 [auto1.de] INFO: Scrape type for VU91193: 2
2026-03-30 10:59:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63224ded-4d7a-5829-bb28-142bd96caf78 with identifier: VU91193
2026-03-30 10:59:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63224ded-4d7a-5829-bb28-142bd96caf78 with scrape type 2
2026-03-30 10:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63224ded-4d7a-5829-bb28-142bd96caf78 with scrape type 2
2026-03-30 10:59:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63224ded-4d7a-5829-bb28-142bd96caf78, identifier: VU91193
2026-03-30 10:59:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f90e677a-2965-5862-8b51-7a0b52f336d1 with identifier: YK45245
2026-03-30 10:59:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f90e677a-2965-5862-8b51-7a0b52f336d1 with identifier: YK45245
2026-03-30 10:59:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f90e677a-2965-5862-8b51-7a0b52f336d1 with identifier: YK45245 to the API
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:59:59Z',
 'fuel_type': 'diesel',
 'id': 'f90e677a-2965-5862-8b51-7a0b52f336d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK45245',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 115098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-20',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Sd4 HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2015}
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK45245%27 HTTP/1.1" 200 None
2026-03-30 10:59:09 [auto1.de] INFO: Saving data for YK45245: {'auction_closing_time': 1774886399.0, 'created_time': 1774780631.348594, 'last_price_update_time': 1774868349.868201}
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK45245') HTTP/1.1" 204 0
2026-03-30 10:59:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63224ded-4d7a-5829-bb28-142bd96caf78 with identifier: VU91193
2026-03-30 10:59:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63224ded-4d7a-5829-bb28-142bd96caf78 with identifier: VU91193
2026-03-30 10:59:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63224ded-4d7a-5829-bb28-142bd96caf78 with identifier: VU91193 to the API
2026-03-30 10:59:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:11:19Z',
 'fuel_type': 'diesel',
 'id': '63224ded-4d7a-5829-bb28-142bd96caf78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU91193',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 215458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-07-10',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T Classic',
 'transmission': 'automatic',
 'trim': 'T Classic',
 'year': 2002}
2026-03-30 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU91193%27 HTTP/1.1" 200 None
2026-03-30 10:59:10 [auto1.de] INFO: Saving data for VU91193: {'auction_closing_time': 1774883479.0, 'created_time': 1773380917.728227, 'last_price_update_time': 1774868350.936659}
2026-03-30 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU91193') HTTP/1.1" 204 0
2026-03-30 10:59:10 [auto1.de] INFO: Found listing with ID: DB08314
2026-03-30 10:59:10 [auto1.de] INFO: Found listing with ID: PM99817
2026-03-30 10:59:10 [auto1.de] INFO: Found listing with ID: HS17931
2026-03-30 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS17931%27 HTTP/1.1" 200 None
2026-03-30 10:59:10 [auto1.de] INFO: Scrape type for HS17931: 2
2026-03-30 10:59:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 596af2bf-2067-5ea8-9de2-f04900fbe034 with identifier: HS17931
2026-03-30 10:59:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 596af2bf-2067-5ea8-9de2-f04900fbe034 with scrape type 2
2026-03-30 10:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 596af2bf-2067-5ea8-9de2-f04900fbe034 with scrape type 2
2026-03-30 10:59:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 596af2bf-2067-5ea8-9de2-f04900fbe034, identifier: HS17931
2026-03-30 10:59:11 [auto1.de] INFO: Found listing with ID: HA87343
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA87343%27 HTTP/1.1" 200 None
2026-03-30 10:59:11 [auto1.de] INFO: Scrape type for HA87343: 2
2026-03-30 10:59:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90099c28-5e98-5149-b0e6-bbd65e8daec1 with identifier: HA87343
2026-03-30 10:59:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90099c28-5e98-5149-b0e6-bbd65e8daec1 with scrape type 2
2026-03-30 10:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90099c28-5e98-5149-b0e6-bbd65e8daec1 with scrape type 2
2026-03-30 10:59:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90099c28-5e98-5149-b0e6-bbd65e8daec1, identifier: HA87343
2026-03-30 10:59:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 596af2bf-2067-5ea8-9de2-f04900fbe034 with identifier: HS17931
2026-03-30 10:59:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 596af2bf-2067-5ea8-9de2-f04900fbe034 with identifier: HS17931
2026-03-30 10:59:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 596af2bf-2067-5ea8-9de2-f04900fbe034 with identifier: HS17931 to the API
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:30:56Z',
 'fuel_type': 'petrol',
 'id': '596af2bf-2067-5ea8-9de2-f04900fbe034',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS17931',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 152281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-10-11',
 'seller_name': None,
 'title': 'Volvo V40 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 1998}
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS17931%27 HTTP/1.1" 200 None
2026-03-30 10:59:11 [auto1.de] INFO: Saving data for HS17931: {'auction_closing_time': 1774884656.0, 'created_time': 1773427388.07274, 'last_price_update_time': 1774868351.659198}
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS17931') HTTP/1.1" 204 0
2026-03-30 10:59:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90099c28-5e98-5149-b0e6-bbd65e8daec1 with identifier: HA87343
2026-03-30 10:59:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90099c28-5e98-5149-b0e6-bbd65e8daec1 with identifier: HA87343
2026-03-30 10:59:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90099c28-5e98-5149-b0e6-bbd65e8daec1 with identifier: HA87343 to the API
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:42:39Z',
 'fuel_type': 'petrol',
 'id': '90099c28-5e98-5149-b0e6-bbd65e8daec1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA87343',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 211061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-04',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2005}
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA87343%27 HTTP/1.1" 200 None
2026-03-30 10:59:11 [auto1.de] INFO: Saving data for HA87343: {'auction_closing_time': 1774885359.0, 'created_time': 1773429290.911001, 'last_price_update_time': 1774868351.957149}
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA87343') HTTP/1.1" 204 0
2026-03-30 10:59:11 [auto1.de] INFO: Found listing with ID: DP06637
2026-03-30 10:59:11 [auto1.de] INFO: Found listing with ID: NG65344
2026-03-30 10:59:11 [auto1.de] INFO: Found listing with ID: JC50514
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC50514%27 HTTP/1.1" 200 None
2026-03-30 10:59:11 [auto1.de] INFO: Scrape type for JC50514: 2
2026-03-30 10:59:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c537e97a-8e4e-5e8d-a796-e7d1620a3ef0 with identifier: JC50514
2026-03-30 10:59:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c537e97a-8e4e-5e8d-a796-e7d1620a3ef0 with scrape type 2
2026-03-30 10:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c537e97a-8e4e-5e8d-a796-e7d1620a3ef0 with scrape type 2
2026-03-30 10:59:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c537e97a-8e4e-5e8d-a796-e7d1620a3ef0, identifier: JC50514
2026-03-30 10:59:12 [auto1.de] INFO: Found listing with ID: TX49680
2026-03-30 10:59:12 [auto1.de] INFO: Found listing with ID: EE57065
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE57065%27 HTTP/1.1" 200 None
2026-03-30 10:59:12 [auto1.de] INFO: Scrape type for EE57065: 2
2026-03-30 10:59:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f841a43-da93-57a7-ac42-7157fc54b570 with identifier: EE57065
2026-03-30 10:59:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f841a43-da93-57a7-ac42-7157fc54b570 with scrape type 2
2026-03-30 10:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f841a43-da93-57a7-ac42-7157fc54b570 with scrape type 2
2026-03-30 10:59:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f841a43-da93-57a7-ac42-7157fc54b570, identifier: EE57065
2026-03-30 10:59:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c537e97a-8e4e-5e8d-a796-e7d1620a3ef0 with identifier: JC50514
2026-03-30 10:59:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c537e97a-8e4e-5e8d-a796-e7d1620a3ef0 with identifier: JC50514
2026-03-30 10:59:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c537e97a-8e4e-5e8d-a796-e7d1620a3ef0 with identifier: JC50514 to the API
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:01:10Z',
 'fuel_type': 'diesel',
 'id': 'c537e97a-8e4e-5e8d-a796-e7d1620a3ef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC50514',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 250747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC50514%27 HTTP/1.1" 200 None
2026-03-30 10:59:12 [auto1.de] INFO: Saving data for JC50514: {'auction_closing_time': 1774882870.0, 'created_time': 1773429327.007959, 'last_price_update_time': 1774868352.50021}
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC50514') HTTP/1.1" 204 0
2026-03-30 10:59:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f841a43-da93-57a7-ac42-7157fc54b570 with identifier: EE57065
2026-03-30 10:59:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f841a43-da93-57a7-ac42-7157fc54b570 with identifier: EE57065
2026-03-30 10:59:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f841a43-da93-57a7-ac42-7157fc54b570 with identifier: EE57065 to the API
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:26:41Z',
 'fuel_type': 'diesel',
 'id': '2f841a43-da93-57a7-ac42-7157fc54b570',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE57065',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 149669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-31',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L2 Tourneo Titanium',
 'transmission': 'automatic',
 'trim': '310 L2 Tourneo Titanium',
 'year': 2018}
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE57065%27 HTTP/1.1" 200 None
2026-03-30 10:59:12 [auto1.de] INFO: Saving data for EE57065: {'auction_closing_time': 1774884401.0, 'created_time': 1773658464.206997, 'last_price_update_time': 1774868352.957439}
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE57065') HTTP/1.1" 204 0
2026-03-30 10:59:12 [auto1.de] INFO: Found listing with ID: XT30705
2026-03-30 10:59:12 [auto1.de] INFO: Found listing with ID: AD00479
2026-03-30 10:59:12 [auto1.de] INFO: Found listing with ID: CL69426
2026-03-30 10:59:12 [auto1.de] INFO: Found listing with ID: TS98691
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98691%27 HTTP/1.1" 200 None
2026-03-30 10:59:12 [auto1.de] INFO: Scrape type for TS98691: 2
2026-03-30 10:59:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6786568e-a3c1-5e4f-a834-ecf2d943ba35 with identifier: TS98691
2026-03-30 10:59:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6786568e-a3c1-5e4f-a834-ecf2d943ba35 with scrape type 2
2026-03-30 10:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6786568e-a3c1-5e4f-a834-ecf2d943ba35 with scrape type 2
2026-03-30 10:59:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6786568e-a3c1-5e4f-a834-ecf2d943ba35, identifier: TS98691
2026-03-30 10:59:13 [auto1.de] INFO: Found listing with ID: BP97760
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97760%27 HTTP/1.1" 200 None
2026-03-30 10:59:13 [auto1.de] INFO: Scrape type for BP97760: 2
2026-03-30 10:59:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7a10aff-3210-5c74-937b-2cabc861e759 with identifier: BP97760
2026-03-30 10:59:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7a10aff-3210-5c74-937b-2cabc861e759 with scrape type 2
2026-03-30 10:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7a10aff-3210-5c74-937b-2cabc861e759 with scrape type 2
2026-03-30 10:59:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7a10aff-3210-5c74-937b-2cabc861e759, identifier: BP97760
2026-03-30 10:59:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6786568e-a3c1-5e4f-a834-ecf2d943ba35 with identifier: TS98691
2026-03-30 10:59:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6786568e-a3c1-5e4f-a834-ecf2d943ba35 with identifier: TS98691
2026-03-30 10:59:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6786568e-a3c1-5e4f-a834-ecf2d943ba35 with identifier: TS98691 to the API
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:30:22Z',
 'fuel_type': 'petrol',
 'id': '6786568e-a3c1-5e4f-a834-ecf2d943ba35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS98691',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 185952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-10',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.8 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98691%27 HTTP/1.1" 200 None
2026-03-30 10:59:13 [auto1.de] INFO: Saving data for TS98691: {'auction_closing_time': 1774884622.0, 'created_time': 1773945326.381923, 'last_price_update_time': 1774868353.51971}
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS98691') HTTP/1.1" 204 0
2026-03-30 10:59:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7a10aff-3210-5c74-937b-2cabc861e759 with identifier: BP97760
2026-03-30 10:59:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7a10aff-3210-5c74-937b-2cabc861e759 with identifier: BP97760
2026-03-30 10:59:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7a10aff-3210-5c74-937b-2cabc861e759 with identifier: BP97760 to the API
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:04:25Z',
 'fuel_type': 'diesel',
 'id': 'a7a10aff-3210-5c74-937b-2cabc861e759',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP97760',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 294106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-28',
 'seller_name': None,
 'title': 'Renault Twingo 1.5 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2011}
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97760%27 HTTP/1.1" 200 None
2026-03-30 10:59:13 [auto1.de] INFO: Saving data for BP97760: {'auction_closing_time': 1774883065.0, 'created_time': 1774550809.854508, 'last_price_update_time': 1774868353.819432}
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP97760') HTTP/1.1" 204 0
2026-03-30 10:59:13 [auto1.de] INFO: Found listing with ID: KH18492
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH18492%27 HTTP/1.1" 200 None
2026-03-30 10:59:13 [auto1.de] INFO: Scrape type for KH18492: 2
2026-03-30 10:59:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5674c1c2-3070-5f30-ace3-5d01ad393460 with identifier: KH18492
2026-03-30 10:59:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5674c1c2-3070-5f30-ace3-5d01ad393460 with scrape type 2
2026-03-30 10:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5674c1c2-3070-5f30-ace3-5d01ad393460 with scrape type 2
2026-03-30 10:59:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5674c1c2-3070-5f30-ace3-5d01ad393460, identifier: KH18492
2026-03-30 10:59:13 [auto1.de] INFO: Found listing with ID: MW79047
2026-03-30 10:59:13 [auto1.de] INFO: Found listing with ID: RP29277
2026-03-30 10:59:13 [auto1.de] INFO: Found listing with ID: HC04393
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04393%27 HTTP/1.1" 200 None
2026-03-30 10:59:13 [auto1.de] INFO: Scrape type for HC04393: 2
2026-03-30 10:59:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80c0b54b-da13-541f-a170-f6c4b67c479a with identifier: HC04393
2026-03-30 10:59:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80c0b54b-da13-541f-a170-f6c4b67c479a with scrape type 2
2026-03-30 10:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80c0b54b-da13-541f-a170-f6c4b67c479a with scrape type 2
2026-03-30 10:59:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80c0b54b-da13-541f-a170-f6c4b67c479a, identifier: HC04393
2026-03-30 10:59:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5674c1c2-3070-5f30-ace3-5d01ad393460 with identifier: KH18492
2026-03-30 10:59:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5674c1c2-3070-5f30-ace3-5d01ad393460 with identifier: KH18492
2026-03-30 10:59:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5674c1c2-3070-5f30-ace3-5d01ad393460 with identifier: KH18492 to the API
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:12:22Z',
 'fuel_type': 'petrol',
 'id': '5674c1c2-3070-5f30-ace3-5d01ad393460',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH18492',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 164486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-10',
 'seller_name': None,
 'title': "Kia cee'd 1.6 Mind",
 'transmission': 'manual',
 'trim': 'Mind',
 'year': 2010}
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH18492%27 HTTP/1.1" 200 None
2026-03-30 10:59:14 [auto1.de] INFO: Saving data for KH18492: {'auction_closing_time': 1774883542.0, 'created_time': 1773429218.619818, 'last_price_update_time': 1774868354.324555}
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH18492') HTTP/1.1" 204 0
2026-03-30 10:59:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80c0b54b-da13-541f-a170-f6c4b67c479a with identifier: HC04393
2026-03-30 10:59:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80c0b54b-da13-541f-a170-f6c4b67c479a with identifier: HC04393
2026-03-30 10:59:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80c0b54b-da13-541f-a170-f6c4b67c479a with identifier: HC04393 to the API
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:47:25Z',
 'fuel_type': 'petrol',
 'id': '80c0b54b-da13-541f-a170-f6c4b67c479a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC04393',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 237954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-05',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 Premium 2WD',
 'transmission': 'manual',
 'trim': 'Premium 2WD',
 'year': 2014}
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04393%27 HTTP/1.1" 200 None
2026-03-30 10:59:14 [auto1.de] INFO: Saving data for HC04393: {'auction_closing_time': 1774885645.0, 'created_time': 1773859031.182409, 'last_price_update_time': 1774868354.611234}
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC04393') HTTP/1.1" 204 0
2026-03-30 10:59:14 [auto1.de] INFO: Found listing with ID: WJ52801
2026-03-30 10:59:14 [auto1.de] INFO: Found listing with ID: TC78124
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC78124%27 HTTP/1.1" 200 None
2026-03-30 10:59:14 [auto1.de] INFO: Scrape type for TC78124: 2
2026-03-30 10:59:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5954ae8a-a709-55bb-8426-8a6fae9d3171 with identifier: TC78124
2026-03-30 10:59:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5954ae8a-a709-55bb-8426-8a6fae9d3171 with scrape type 2
2026-03-30 10:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5954ae8a-a709-55bb-8426-8a6fae9d3171 with scrape type 2
2026-03-30 10:59:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5954ae8a-a709-55bb-8426-8a6fae9d3171, identifier: TC78124
2026-03-30 10:59:14 [auto1.de] INFO: Found listing with ID: ZV78302
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV78302%27 HTTP/1.1" 200 None
2026-03-30 10:59:14 [auto1.de] INFO: Scrape type for ZV78302: 2
2026-03-30 10:59:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf3098e4-d57f-54a3-a3da-be138a881f52 with identifier: ZV78302
2026-03-30 10:59:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf3098e4-d57f-54a3-a3da-be138a881f52 with scrape type 2
2026-03-30 10:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf3098e4-d57f-54a3-a3da-be138a881f52 with scrape type 2
2026-03-30 10:59:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf3098e4-d57f-54a3-a3da-be138a881f52, identifier: ZV78302
2026-03-30 10:59:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5954ae8a-a709-55bb-8426-8a6fae9d3171 with identifier: TC78124
2026-03-30 10:59:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5954ae8a-a709-55bb-8426-8a6fae9d3171 with identifier: TC78124
2026-03-30 10:59:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5954ae8a-a709-55bb-8426-8a6fae9d3171 with identifier: TC78124 to the API
2026-03-30 10:59:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:03:29Z',
 'fuel_type': 'petrol',
 'id': '5954ae8a-a709-55bb-8426-8a6fae9d3171',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC78124',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 101154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-11',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2018}
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC78124%27 HTTP/1.1" 200 None
2026-03-30 10:59:15 [auto1.de] INFO: Saving data for TC78124: {'auction_closing_time': 1774883009.0, 'created_time': 1773946068.821789, 'last_price_update_time': 1774868355.160352}
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TC78124') HTTP/1.1" 204 0
2026-03-30 10:59:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf3098e4-d57f-54a3-a3da-be138a881f52 with identifier: ZV78302
2026-03-30 10:59:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf3098e4-d57f-54a3-a3da-be138a881f52 with identifier: ZV78302
2026-03-30 10:59:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf3098e4-d57f-54a3-a3da-be138a881f52 with identifier: ZV78302 to the API
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:21Z',
 'fuel_type': 'diesel',
 'id': 'bf3098e4-d57f-54a3-a3da-be138a881f52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV78302',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 83264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV78302%27 HTTP/1.1" 200 None
2026-03-30 10:59:15 [auto1.de] INFO: Saving data for ZV78302: {'auction_closing_time': 1774886061.0, 'created_time': 1774780636.544166, 'last_price_update_time': 1774868355.566347}
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV78302') HTTP/1.1" 204 0
2026-03-30 10:59:15 [auto1.de] INFO: Found listing with ID: PY29315
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY29315%27 HTTP/1.1" 200 None
2026-03-30 10:59:15 [auto1.de] INFO: Scrape type for PY29315: 2
2026-03-30 10:59:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17d0d5a3-fc6b-5290-8ebc-c0603953a1a7 with identifier: PY29315
2026-03-30 10:59:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17d0d5a3-fc6b-5290-8ebc-c0603953a1a7 with scrape type 2
2026-03-30 10:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17d0d5a3-fc6b-5290-8ebc-c0603953a1a7 with scrape type 2
2026-03-30 10:59:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17d0d5a3-fc6b-5290-8ebc-c0603953a1a7, identifier: PY29315
2026-03-30 10:59:15 [auto1.de] INFO: Found listing with ID: VX94865
2026-03-30 10:59:15 [auto1.de] INFO: Found listing with ID: CZ47065
2026-03-30 10:59:15 [auto1.de] INFO: Found listing with ID: ES20413
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES20413%27 HTTP/1.1" 200 None
2026-03-30 10:59:15 [auto1.de] INFO: Scrape type for ES20413: 2
2026-03-30 10:59:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90a3d64c-8dde-5b5b-8f48-d234598f6c82 with identifier: ES20413
2026-03-30 10:59:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90a3d64c-8dde-5b5b-8f48-d234598f6c82 with scrape type 2
2026-03-30 10:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90a3d64c-8dde-5b5b-8f48-d234598f6c82 with scrape type 2
2026-03-30 10:59:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90a3d64c-8dde-5b5b-8f48-d234598f6c82, identifier: ES20413
2026-03-30 10:59:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17d0d5a3-fc6b-5290-8ebc-c0603953a1a7 with identifier: PY29315
2026-03-30 10:59:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17d0d5a3-fc6b-5290-8ebc-c0603953a1a7 with identifier: PY29315
2026-03-30 10:59:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17d0d5a3-fc6b-5290-8ebc-c0603953a1a7 with identifier: PY29315 to the API
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:25:05Z',
 'fuel_type': 'petrol',
 'id': '17d0d5a3-fc6b-5290-8ebc-c0603953a1a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY29315',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 148738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-15',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Eco',
 'transmission': 'manual',
 'trim': 'Eco',
 'year': 2009}
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY29315%27 HTTP/1.1" 200 None
2026-03-30 10:59:16 [auto1.de] INFO: Saving data for PY29315: {'auction_closing_time': 1774884305.0, 'created_time': 1773775603.012367, 'last_price_update_time': 1774868356.122896}
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY29315') HTTP/1.1" 204 0
2026-03-30 10:59:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90a3d64c-8dde-5b5b-8f48-d234598f6c82 with identifier: ES20413
2026-03-30 10:59:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90a3d64c-8dde-5b5b-8f48-d234598f6c82 with identifier: ES20413
2026-03-30 10:59:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90a3d64c-8dde-5b5b-8f48-d234598f6c82 with identifier: ES20413 to the API
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:34:37Z',
 'fuel_type': 'petrol',
 'id': '90a3d64c-8dde-5b5b-8f48-d234598f6c82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES20413',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Bravo',
 'odometer': 169294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-21',
 'seller_name': None,
 'title': 'Fiat Bravo 1.4 Turbo T JET Dynamic',
 'transmission': 'manual',
 'trim': 'T JET Dynamic',
 'year': 2008}
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES20413%27 HTTP/1.1" 200 None
2026-03-30 10:59:16 [auto1.de] INFO: Saving data for ES20413: {'auction_closing_time': 1774884877.0, 'created_time': 1773860272.902876, 'last_price_update_time': 1774868356.414253}
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES20413') HTTP/1.1" 204 0
2026-03-30 10:59:16 [auto1.de] INFO: Found listing with ID: WW76911
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW76911%27 HTTP/1.1" 200 None
2026-03-30 10:59:16 [auto1.de] INFO: Scrape type for WW76911: 2
2026-03-30 10:59:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3d603a4-4f42-52c8-9e1a-71af0b203059 with identifier: WW76911
2026-03-30 10:59:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3d603a4-4f42-52c8-9e1a-71af0b203059 with scrape type 2
2026-03-30 10:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3d603a4-4f42-52c8-9e1a-71af0b203059 with scrape type 2
2026-03-30 10:59:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3d603a4-4f42-52c8-9e1a-71af0b203059, identifier: WW76911
2026-03-30 10:59:16 [auto1.de] INFO: Found listing with ID: XE08723
2026-03-30 10:59:16 [auto1.de] INFO: Found listing with ID: LZ63004
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ63004%27 HTTP/1.1" 200 None
2026-03-30 10:59:16 [auto1.de] INFO: Scrape type for LZ63004: 2
2026-03-30 10:59:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b289fac-4b2a-5678-855e-aa76a65072e9 with identifier: LZ63004
2026-03-30 10:59:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b289fac-4b2a-5678-855e-aa76a65072e9 with scrape type 2
2026-03-30 10:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b289fac-4b2a-5678-855e-aa76a65072e9 with scrape type 2
2026-03-30 10:59:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b289fac-4b2a-5678-855e-aa76a65072e9, identifier: LZ63004
2026-03-30 10:59:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3d603a4-4f42-52c8-9e1a-71af0b203059 with identifier: WW76911
2026-03-30 10:59:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3d603a4-4f42-52c8-9e1a-71af0b203059 with identifier: WW76911
2026-03-30 10:59:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3d603a4-4f42-52c8-9e1a-71af0b203059 with identifier: WW76911 to the API
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:11:51Z',
 'fuel_type': 'petrol',
 'id': 'f3d603a4-4f42-52c8-9e1a-71af0b203059',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW76911',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 23531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-18',
 'seller_name': None,
 'title': 'Skoda Fabia 1.5 TSI ACT Monte Carlo',
 'transmission': 'automatic',
 'trim': 'Monte Carlo',
 'year': 2023}
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW76911%27 HTTP/1.1" 200 None
2026-03-30 10:59:16 [auto1.de] INFO: Saving data for WW76911: {'auction_closing_time': 1774883511.0, 'created_time': 1774780646.863743, 'last_price_update_time': 1774868356.976401}
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW76911') HTTP/1.1" 204 0
2026-03-30 10:59:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b289fac-4b2a-5678-855e-aa76a65072e9 with identifier: LZ63004
2026-03-30 10:59:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b289fac-4b2a-5678-855e-aa76a65072e9 with identifier: LZ63004
2026-03-30 10:59:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b289fac-4b2a-5678-855e-aa76a65072e9 with identifier: LZ63004 to the API
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:18:10Z',
 'fuel_type': 'petrol',
 'id': '5b289fac-4b2a-5678-855e-aa76a65072e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ63004',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 120294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-02-28',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2003}
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ63004%27 HTTP/1.1" 200 None
2026-03-30 10:59:17 [auto1.de] INFO: Saving data for LZ63004: {'auction_closing_time': 1774883890.0, 'created_time': 1774638259.469958, 'last_price_update_time': 1774868357.296783}
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ63004') HTTP/1.1" 204 0
2026-03-30 10:59:17 [auto1.de] INFO: Found listing with ID: EE66446
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE66446%27 HTTP/1.1" 200 None
2026-03-30 10:59:17 [auto1.de] INFO: Scrape type for EE66446: 2
2026-03-30 10:59:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81c4a184-0523-5ff0-8b65-156c28e994b7 with identifier: EE66446
2026-03-30 10:59:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81c4a184-0523-5ff0-8b65-156c28e994b7 with scrape type 2
2026-03-30 10:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81c4a184-0523-5ff0-8b65-156c28e994b7 with scrape type 2
2026-03-30 10:59:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81c4a184-0523-5ff0-8b65-156c28e994b7, identifier: EE66446
2026-03-30 10:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:17 [auto1.de] INFO: Found listing with ID: AU50389
2026-03-30 10:59:17 [auto1.de] INFO: Found listing with ID: VT21239
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT21239%27 HTTP/1.1" 200 None
2026-03-30 10:59:17 [auto1.de] INFO: Scrape type for VT21239: 2
2026-03-30 10:59:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04b8cb32-6b71-5de2-a373-3f2258b156c7 with identifier: VT21239
2026-03-30 10:59:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04b8cb32-6b71-5de2-a373-3f2258b156c7 with scrape type 2
2026-03-30 10:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04b8cb32-6b71-5de2-a373-3f2258b156c7 with scrape type 2
2026-03-30 10:59:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04b8cb32-6b71-5de2-a373-3f2258b156c7, identifier: VT21239
2026-03-30 10:59:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81c4a184-0523-5ff0-8b65-156c28e994b7 with identifier: EE66446
2026-03-30 10:59:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81c4a184-0523-5ff0-8b65-156c28e994b7 with identifier: EE66446
2026-03-30 10:59:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81c4a184-0523-5ff0-8b65-156c28e994b7 with identifier: EE66446 to the API
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:47:34Z',
 'fuel_type': 'petrol',
 'id': '81c4a184-0523-5ff0-8b65-156c28e994b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE66446',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 209407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-14',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 Avantage',
 'transmission': 'manual',
 'trim': 'Avantage',
 'year': 2007}
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE66446%27 HTTP/1.1" 200 None
2026-03-30 10:59:17 [auto1.de] INFO: Saving data for EE66446: {'auction_closing_time': 1774885654.0, 'created_time': 1774638548.325725, 'last_price_update_time': 1774868357.835498}
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE66446') HTTP/1.1" 204 0
2026-03-30 10:59:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04b8cb32-6b71-5de2-a373-3f2258b156c7 with identifier: VT21239
2026-03-30 10:59:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04b8cb32-6b71-5de2-a373-3f2258b156c7 with identifier: VT21239
2026-03-30 10:59:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04b8cb32-6b71-5de2-a373-3f2258b156c7 with identifier: VT21239 to the API
2026-03-30 10:59:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:43:21Z',
 'fuel_type': 'diesel',
 'id': '04b8cb32-6b71-5de2-a373-3f2258b156c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT21239',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 113355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-11',
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TDI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2020}
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT21239%27 HTTP/1.1" 200 None
2026-03-30 10:59:18 [auto1.de] INFO: Saving data for VT21239: {'auction_closing_time': 1774885401.0, 'created_time': 1774780636.954412, 'last_price_update_time': 1774868358.112244}
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT21239') HTTP/1.1" 204 0
2026-03-30 10:59:18 [auto1.de] INFO: Found listing with ID: SR43778
2026-03-30 10:59:18 [auto1.de] INFO: Found listing with ID: GV67741
2026-03-30 10:59:18 [auto1.de] INFO: Found listing with ID: VY63466
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY63466%27 HTTP/1.1" 200 None
2026-03-30 10:59:18 [auto1.de] INFO: Scrape type for VY63466: 2
2026-03-30 10:59:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 970d396a-0953-5390-b82a-2bd774787613 with identifier: VY63466
2026-03-30 10:59:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 970d396a-0953-5390-b82a-2bd774787613 with scrape type 2
2026-03-30 10:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 970d396a-0953-5390-b82a-2bd774787613 with scrape type 2
2026-03-30 10:59:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 970d396a-0953-5390-b82a-2bd774787613, identifier: VY63466
2026-03-30 10:59:18 [auto1.de] INFO: Found listing with ID: ME62571
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME62571%27 HTTP/1.1" 200 None
2026-03-30 10:59:18 [auto1.de] INFO: Scrape type for ME62571: 2
2026-03-30 10:59:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e83560a-2b84-5cb5-8a75-7a127e49fd88 with identifier: ME62571
2026-03-30 10:59:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e83560a-2b84-5cb5-8a75-7a127e49fd88 with scrape type 2
2026-03-30 10:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e83560a-2b84-5cb5-8a75-7a127e49fd88 with scrape type 2
2026-03-30 10:59:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e83560a-2b84-5cb5-8a75-7a127e49fd88, identifier: ME62571
2026-03-30 10:59:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 970d396a-0953-5390-b82a-2bd774787613 with identifier: VY63466
2026-03-30 10:59:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 970d396a-0953-5390-b82a-2bd774787613 with identifier: VY63466
2026-03-30 10:59:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 970d396a-0953-5390-b82a-2bd774787613 with identifier: VY63466 to the API
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:52:29Z',
 'fuel_type': 'diesel',
 'id': '970d396a-0953-5390-b82a-2bd774787613',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY63466',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Voyager',
 'odometer': 186974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-12',
 'seller_name': None,
 'title': 'Lancia Voyager 2.8 JTDM Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2012}
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY63466%27 HTTP/1.1" 200 None
2026-03-30 10:59:18 [auto1.de] INFO: Saving data for VY63466: {'auction_closing_time': 1774885949.0, 'created_time': 1774637407.81463, 'last_price_update_time': 1774868358.627344}
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY63466') HTTP/1.1" 204 0
2026-03-30 10:59:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e83560a-2b84-5cb5-8a75-7a127e49fd88 with identifier: ME62571
2026-03-30 10:59:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e83560a-2b84-5cb5-8a75-7a127e49fd88 with identifier: ME62571
2026-03-30 10:59:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e83560a-2b84-5cb5-8a75-7a127e49fd88 with identifier: ME62571 to the API
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:07:23Z',
 'fuel_type': 'petrol',
 'id': '5e83560a-2b84-5cb5-8a75-7a127e49fd88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME62571',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Bora',
 'odometer': 265740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-08',
 'seller_name': None,
 'title': 'Volkswagen Bora 1.6 Pacific',
 'transmission': 'manual',
 'trim': 'Pacific',
 'year': 2004}
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME62571%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Saving data for ME62571: {'auction_closing_time': 1774883243.0, 'created_time': 1773830420.519557, 'last_price_update_time': 1774868359.082998}
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME62571') HTTP/1.1" 204 0
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: PF70516
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: MB34428
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB34428%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for MB34428: 2
2026-03-30 10:59:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caaefc81-fec0-58b7-96a3-46d73fabf7a7 with identifier: MB34428
2026-03-30 10:59:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caaefc81-fec0-58b7-96a3-46d73fabf7a7 with scrape type 2
2026-03-30 10:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caaefc81-fec0-58b7-96a3-46d73fabf7a7 with scrape type 2
2026-03-30 10:59:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caaefc81-fec0-58b7-96a3-46d73fabf7a7, identifier: MB34428
2026-03-30 10:59:19 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 9549 | hits on page: 40
2026-03-30 10:59:19 [auto1.de] INFO: Found listing with ID: NV69214
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV69214%27 HTTP/1.1" 200 None
2026-03-30 10:59:19 [auto1.de] INFO: Scrape type for NV69214: 2
2026-03-30 10:59:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acd34e51-4672-5868-afd1-7fe7c0d3ad8d with identifier: NV69214
2026-03-30 10:59:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acd34e51-4672-5868-afd1-7fe7c0d3ad8d with scrape type 2
2026-03-30 10:59:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acd34e51-4672-5868-afd1-7fe7c0d3ad8d with scrape type 2
2026-03-30 10:59:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acd34e51-4672-5868-afd1-7fe7c0d3ad8d, identifier: NV69214
2026-03-30 10:59:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caaefc81-fec0-58b7-96a3-46d73fabf7a7 with identifier: MB34428
2026-03-30 10:59:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caaefc81-fec0-58b7-96a3-46d73fabf7a7 with identifier: MB34428
2026-03-30 10:59:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caaefc81-fec0-58b7-96a3-46d73fabf7a7 with identifier: MB34428 to the API
2026-03-30 10:59:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:30:49Z',
 'fuel_type': 'petrol',
 'id': 'caaefc81-fec0-58b7-96a3-46d73fabf7a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB34428',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 210558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-03',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2007}
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB34428%27 HTTP/1.1" 200 None
2026-03-30 10:59:20 [auto1.de] INFO: Saving data for MB34428: {'auction_closing_time': 1774884649.0, 'created_time': 1774638373.716023, 'last_price_update_time': 1774868360.445085}
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB34428') HTTP/1.1" 204 0
2026-03-30 10:59:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acd34e51-4672-5868-afd1-7fe7c0d3ad8d with identifier: NV69214
2026-03-30 10:59:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acd34e51-4672-5868-afd1-7fe7c0d3ad8d with identifier: NV69214
2026-03-30 10:59:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acd34e51-4672-5868-afd1-7fe7c0d3ad8d with identifier: NV69214 to the API
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:53:54Z',
 'fuel_type': 'diesel',
 'id': 'acd34e51-4672-5868-afd1-7fe7c0d3ad8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV69214',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 97504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-24',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Sound BlueMotion',
 'transmission': 'manual',
 'trim': 'Sound BlueMotion',
 'year': 2017}
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV69214%27 HTTP/1.1" 200 None
2026-03-30 10:59:20 [auto1.de] INFO: Saving data for NV69214: {'auction_closing_time': 1774886034.0, 'created_time': 1774550905.353575, 'last_price_update_time': 1774868360.787162}
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV69214') HTTP/1.1" 204 0
2026-03-30 10:59:20 [auto1.de] INFO: Found listing with ID: YY88868
2026-03-30 10:59:20 [auto1.de] INFO: Found listing with ID: WL17880
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17880%27 HTTP/1.1" 200 None
2026-03-30 10:59:20 [auto1.de] INFO: Scrape type for WL17880: 2
2026-03-30 10:59:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14606920-0247-56f0-902e-8e89226fbc2f with identifier: WL17880
2026-03-30 10:59:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14606920-0247-56f0-902e-8e89226fbc2f with scrape type 2
2026-03-30 10:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14606920-0247-56f0-902e-8e89226fbc2f with scrape type 2
2026-03-30 10:59:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14606920-0247-56f0-902e-8e89226fbc2f, identifier: WL17880
2026-03-30 10:59:20 [auto1.de] INFO: Found listing with ID: WX30683
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30683%27 HTTP/1.1" 200 None
2026-03-30 10:59:20 [auto1.de] INFO: Scrape type for WX30683: 2
2026-03-30 10:59:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dd3594d-8dcb-5df6-ac70-629f031812ac with identifier: WX30683
2026-03-30 10:59:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dd3594d-8dcb-5df6-ac70-629f031812ac with scrape type 2
2026-03-30 10:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dd3594d-8dcb-5df6-ac70-629f031812ac with scrape type 2
2026-03-30 10:59:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6dd3594d-8dcb-5df6-ac70-629f031812ac, identifier: WX30683
2026-03-30 10:59:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: KJ28184
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: KF75867
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: UT98357
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: HY43469
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: JA01983
2026-03-30 10:59:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14606920-0247-56f0-902e-8e89226fbc2f with identifier: WL17880
2026-03-30 10:59:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14606920-0247-56f0-902e-8e89226fbc2f with identifier: WL17880
2026-03-30 10:59:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14606920-0247-56f0-902e-8e89226fbc2f with identifier: WL17880 to the API
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:14:19Z',
 'fuel_type': 'diesel',
 'id': '14606920-0247-56f0-902e-8e89226fbc2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL17880',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 67492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-01',
 'seller_name': None,
 'title': 'Audi Q5 3.0 V6 TDI quattro Ambiente',
 'transmission': 'automatic',
 'trim': 'quattro Ambiente',
 'year': 2015}
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17880%27 HTTP/1.1" 200 None
2026-03-30 10:59:21 [auto1.de] INFO: Saving data for WL17880: {'auction_closing_time': 1774883659.0, 'created_time': 1774780646.442904, 'last_price_update_time': 1774868361.380609}
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL17880') HTTP/1.1" 204 0
2026-03-30 10:59:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6dd3594d-8dcb-5df6-ac70-629f031812ac with identifier: WX30683
2026-03-30 10:59:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6dd3594d-8dcb-5df6-ac70-629f031812ac with identifier: WX30683
2026-03-30 10:59:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6dd3594d-8dcb-5df6-ac70-629f031812ac with identifier: WX30683 to the API
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:35:59Z',
 'fuel_type': 'petrol',
 'id': '6dd3594d-8dcb-5df6-ac70-629f031812ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX30683',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 164169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-05',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.1 Inform',
 'transmission': 'manual',
 'trim': 'Inform',
 'year': 2009}
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30683%27 HTTP/1.1" 200 None
2026-03-30 10:59:21 [auto1.de] INFO: Saving data for WX30683: {'auction_closing_time': 1774884959.0, 'created_time': 1773861194.648874, 'last_price_update_time': 1774868361.803153}
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX30683') HTTP/1.1" 204 0
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: PA05830
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA05830%27 HTTP/1.1" 200 None
2026-03-30 10:59:21 [auto1.de] INFO: Scrape type for PA05830: 2
2026-03-30 10:59:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f55467da-7e9d-5f4d-bca4-7d1a3f70c7b7 with identifier: PA05830
2026-03-30 10:59:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f55467da-7e9d-5f4d-bca4-7d1a3f70c7b7 with scrape type 2
2026-03-30 10:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f55467da-7e9d-5f4d-bca4-7d1a3f70c7b7 with scrape type 2
2026-03-30 10:59:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f55467da-7e9d-5f4d-bca4-7d1a3f70c7b7, identifier: PA05830
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: YK03536
2026-03-30 10:59:21 [auto1.de] INFO: Found listing with ID: HZ13557
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13557%27 HTTP/1.1" 200 None
2026-03-30 10:59:21 [auto1.de] INFO: Scrape type for HZ13557: 2
2026-03-30 10:59:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with identifier: HZ13557
2026-03-30 10:59:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with scrape type 2
2026-03-30 10:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with scrape type 2
2026-03-30 10:59:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef, identifier: HZ13557
2026-03-30 10:59:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f55467da-7e9d-5f4d-bca4-7d1a3f70c7b7 with identifier: PA05830
2026-03-30 10:59:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f55467da-7e9d-5f4d-bca4-7d1a3f70c7b7 with identifier: PA05830
2026-03-30 10:59:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f55467da-7e9d-5f4d-bca4-7d1a3f70c7b7 with identifier: PA05830 to the API
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:53:30Z',
 'fuel_type': 'diesel',
 'id': 'f55467da-7e9d-5f4d-bca4-7d1a3f70c7b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA05830',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 58232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1987-03-24',
 'seller_name': None,
 'title': 'Ford Transit 2.5 Diesel Bus FT 100',
 'transmission': 'manual',
 'trim': 'Bus FT 100',
 'year': 1987}
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA05830%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Saving data for PA05830: {'auction_closing_time': 1774886010.0, 'created_time': 1773224377.691535, 'last_price_update_time': 1774868362.314475}
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA05830') HTTP/1.1" 204 0
2026-03-30 10:59:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with identifier: HZ13557
2026-03-30 10:59:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with identifier: HZ13557
2026-03-30 10:59:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with identifier: HZ13557 to the API
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:42:38Z',
 'fuel_type': 'petrol',
 'id': '8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ13557',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fusion',
 'odometer': 145730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-30',
 'seller_name': None,
 'title': 'Ford Fusion 1.6 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2003}
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13557%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Saving data for HZ13557: {'auction_closing_time': 1774885358.0, 'created_time': 1774033521.558895, 'last_price_update_time': 1774868362.646965}
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ13557') HTTP/1.1" 204 0
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: NY52199
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY52199%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for NY52199: 2
2026-03-30 10:59:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6a23ac0-277f-541d-a641-0d8b78e6919d with identifier: NY52199
2026-03-30 10:59:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6a23ac0-277f-541d-a641-0d8b78e6919d with scrape type 2
2026-03-30 10:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6a23ac0-277f-541d-a641-0d8b78e6919d with scrape type 2
2026-03-30 10:59:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6a23ac0-277f-541d-a641-0d8b78e6919d, identifier: NY52199
2026-03-30 10:59:22 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU13190%27 HTTP/1.1" 200 None
2026-03-30 10:59:22 [auto1.de] INFO: Scrape type for TU13190: 2
2026-03-30 10:59:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c99888af-5bc1-58de-adc6-23888f945e77 with identifier: TU13190
2026-03-30 10:59:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99888af-5bc1-58de-adc6-23888f945e77 with scrape type 2
2026-03-30 10:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c99888af-5bc1-58de-adc6-23888f945e77 with scrape type 2
2026-03-30 10:59:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c99888af-5bc1-58de-adc6-23888f945e77, identifier: TU13190
2026-03-30 10:59:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6a23ac0-277f-541d-a641-0d8b78e6919d with identifier: NY52199
2026-03-30 10:59:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6a23ac0-277f-541d-a641-0d8b78e6919d with identifier: NY52199
2026-03-30 10:59:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6a23ac0-277f-541d-a641-0d8b78e6919d with identifier: NY52199 to the API
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 398,
 'expiration_date': '2026-03-30T15:37:02Z',
 'fuel_type': 'hybrid',
 'id': 'b6a23ac0-277f-541d-a641-0d8b78e6919d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY52199',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 54058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-06',
 'seller_name': None,
 'title': 'Volvo V60 2.0 T6 Recharge Plug-in Hybrid Core AWD',
 'transmission': 'automatic',
 'trim': 'Core AWD',
 'year': 2022}
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY52199%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Saving data for NY52199: {'auction_closing_time': 1774885022.0, 'created_time': 1774780647.202119, 'last_price_update_time': 1774868363.200207}
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY52199') HTTP/1.1" 204 0
2026-03-30 10:59:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c99888af-5bc1-58de-adc6-23888f945e77 with identifier: TU13190
2026-03-30 10:59:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c99888af-5bc1-58de-adc6-23888f945e77 with identifier: TU13190
2026-03-30 10:59:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c99888af-5bc1-58de-adc6-23888f945e77 with identifier: TU13190 to the API
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:26:53Z',
 'fuel_type': 'diesel',
 'id': 'c99888af-5bc1-58de-adc6-23888f945e77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU13190',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 313956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-12',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU13190%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Saving data for TU13190: {'auction_closing_time': 1774884413.0, 'created_time': 1773861494.215117, 'last_price_update_time': 1774868363.488136}
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU13190') HTTP/1.1" 204 0
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: CL67465
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL67465%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for CL67465: 2
2026-03-30 10:59:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eab8616e-3474-52fb-8bc3-7b99ec85f75f with identifier: CL67465
2026-03-30 10:59:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eab8616e-3474-52fb-8bc3-7b99ec85f75f with scrape type 2
2026-03-30 10:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eab8616e-3474-52fb-8bc3-7b99ec85f75f with scrape type 2
2026-03-30 10:59:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eab8616e-3474-52fb-8bc3-7b99ec85f75f, identifier: CL67465
2026-03-30 10:59:23 [auto1.de] INFO: Found listing with ID: CP72119
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP72119%27 HTTP/1.1" 200 None
2026-03-30 10:59:23 [auto1.de] INFO: Scrape type for CP72119: 2
2026-03-30 10:59:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e8b7c2-fc2b-5fbe-bbc2-98bf7e8e39a1 with identifier: CP72119
2026-03-30 10:59:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e8b7c2-fc2b-5fbe-bbc2-98bf7e8e39a1 with scrape type 2
2026-03-30 10:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96e8b7c2-fc2b-5fbe-bbc2-98bf7e8e39a1 with scrape type 2
2026-03-30 10:59:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96e8b7c2-fc2b-5fbe-bbc2-98bf7e8e39a1, identifier: CP72119
2026-03-30 10:59:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eab8616e-3474-52fb-8bc3-7b99ec85f75f with identifier: CL67465
2026-03-30 10:59:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eab8616e-3474-52fb-8bc3-7b99ec85f75f with identifier: CL67465
2026-03-30 10:59:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eab8616e-3474-52fb-8bc3-7b99ec85f75f with identifier: CL67465 to the API
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:00:57Z',
 'fuel_type': 'petrol',
 'id': 'eab8616e-3474-52fb-8bc3-7b99ec85f75f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL67465',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 146871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-05',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-30 10:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL67465%27 HTTP/1.1" 200 None
2026-03-30 10:59:24 [auto1.de] INFO: Saving data for CL67465: {'auction_closing_time': 1774882857.0, 'created_time': 1773831744.413293, 'last_price_update_time': 1774868364.080546}
2026-03-30 10:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL67465') HTTP/1.1" 204 0
2026-03-30 10:59:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96e8b7c2-fc2b-5fbe-bbc2-98bf7e8e39a1 with identifier: CP72119
2026-03-30 10:59:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96e8b7c2-fc2b-5fbe-bbc2-98bf7e8e39a1 with identifier: CP72119
2026-03-30 10:59:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96e8b7c2-fc2b-5fbe-bbc2-98bf7e8e39a1 with identifier: CP72119 to the API
2026-03-30 10:59:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:46:16Z',
 'fuel_type': 'petrol',
 'id': '96e8b7c2-fc2b-5fbe-bbc2-98bf7e8e39a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP72119',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '306',
 'odometer': 183488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1995-05-28',
 'seller_name': None,
 'title': 'Peugeot 306 1.4 Atoll',
 'transmission': 'manual',
 'trim': 'Atoll',
 'year': 1995}
2026-03-30 10:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP72119%27 HTTP/1.1" 200 None
2026-03-30 10:59:24 [auto1.de] INFO: Saving data for CP72119: {'auction_closing_time': 1774885576.0, 'created_time': 1774550688.591962, 'last_price_update_time': 1774868364.894245}
2026-03-30 10:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP72119') HTTP/1.1" 204 0
2026-03-30 10:59:24 [auto1.de] INFO: Found listing with ID: AX54291
2026-03-30 10:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX54291%27 HTTP/1.1" 200 None
2026-03-30 10:59:24 [auto1.de] INFO: Scrape type for AX54291: 2
2026-03-30 10:59:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a3f139e-dac2-5210-b581-c38326ebb97c with identifier: AX54291
2026-03-30 10:59:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a3f139e-dac2-5210-b581-c38326ebb97c with scrape type 2
2026-03-30 10:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a3f139e-dac2-5210-b581-c38326ebb97c with scrape type 2
2026-03-30 10:59:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a3f139e-dac2-5210-b581-c38326ebb97c, identifier: AX54291
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: VG12821
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: NW56335
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: EL19889
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: EJ19003
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: XC49831
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC49831%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for XC49831: 2
2026-03-30 10:59:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e022cecc-533f-554b-8306-a5bb992ae25c with identifier: XC49831
2026-03-30 10:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e022cecc-533f-554b-8306-a5bb992ae25c with scrape type 2
2026-03-30 10:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e022cecc-533f-554b-8306-a5bb992ae25c with scrape type 2
2026-03-30 10:59:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e022cecc-533f-554b-8306-a5bb992ae25c, identifier: XC49831
2026-03-30 10:59:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a3f139e-dac2-5210-b581-c38326ebb97c with identifier: AX54291
2026-03-30 10:59:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a3f139e-dac2-5210-b581-c38326ebb97c with identifier: AX54291
2026-03-30 10:59:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a3f139e-dac2-5210-b581-c38326ebb97c with identifier: AX54291 to the API
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:41:15Z',
 'fuel_type': 'petrol',
 'id': '0a3f139e-dac2-5210-b581-c38326ebb97c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX54291',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 153857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-22',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX54291%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Saving data for AX54291: {'auction_closing_time': 1774885275.0, 'created_time': 1773831226.303824, 'last_price_update_time': 1774868365.399651}
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX54291') HTTP/1.1" 204 0
2026-03-30 10:59:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e022cecc-533f-554b-8306-a5bb992ae25c with identifier: XC49831
2026-03-30 10:59:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e022cecc-533f-554b-8306-a5bb992ae25c with identifier: XC49831
2026-03-30 10:59:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e022cecc-533f-554b-8306-a5bb992ae25c with identifier: XC49831 to the API
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:47:12Z',
 'fuel_type': 'diesel',
 'id': 'e022cecc-533f-554b-8306-a5bb992ae25c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC49831',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 293580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2005}
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC49831%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Saving data for XC49831: {'auction_closing_time': 1774885632.0, 'created_time': 1774550883.934181, 'last_price_update_time': 1774868365.779807}
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC49831') HTTP/1.1" 204 0
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: EU26057
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: KN25796
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN25796%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for KN25796: 2
2026-03-30 10:59:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75f975dc-8b44-52be-b16b-bffcc2e9fdc1 with identifier: KN25796
2026-03-30 10:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75f975dc-8b44-52be-b16b-bffcc2e9fdc1 with scrape type 2
2026-03-30 10:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75f975dc-8b44-52be-b16b-bffcc2e9fdc1 with scrape type 2
2026-03-30 10:59:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75f975dc-8b44-52be-b16b-bffcc2e9fdc1, identifier: KN25796
2026-03-30 10:59:25 [auto1.de] INFO: Found listing with ID: JG80760
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG80760%27 HTTP/1.1" 200 None
2026-03-30 10:59:25 [auto1.de] INFO: Scrape type for JG80760: 2
2026-03-30 10:59:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8336b0ea-3ef9-5e89-9a74-e288e7fafc65 with identifier: JG80760
2026-03-30 10:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8336b0ea-3ef9-5e89-9a74-e288e7fafc65 with scrape type 2
2026-03-30 10:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8336b0ea-3ef9-5e89-9a74-e288e7fafc65 with scrape type 2
2026-03-30 10:59:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8336b0ea-3ef9-5e89-9a74-e288e7fafc65, identifier: JG80760
2026-03-30 10:59:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75f975dc-8b44-52be-b16b-bffcc2e9fdc1 with identifier: KN25796
2026-03-30 10:59:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75f975dc-8b44-52be-b16b-bffcc2e9fdc1 with identifier: KN25796
2026-03-30 10:59:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75f975dc-8b44-52be-b16b-bffcc2e9fdc1 with identifier: KN25796 to the API
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:23:27Z',
 'fuel_type': 'diesel',
 'id': '75f975dc-8b44-52be-b16b-bffcc2e9fdc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN25796',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 241999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-12',
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2007}
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN25796%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Saving data for KN25796: {'auction_closing_time': 1774884207.0, 'created_time': 1774550867.726706, 'last_price_update_time': 1774868366.272899}
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN25796') HTTP/1.1" 204 0
2026-03-30 10:59:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8336b0ea-3ef9-5e89-9a74-e288e7fafc65 with identifier: JG80760
2026-03-30 10:59:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8336b0ea-3ef9-5e89-9a74-e288e7fafc65 with identifier: JG80760
2026-03-30 10:59:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8336b0ea-3ef9-5e89-9a74-e288e7fafc65 with identifier: JG80760 to the API
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:44:38Z',
 'fuel_type': 'diesel',
 'id': '8336b0ea-3ef9-5e89-9a74-e288e7fafc65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG80760',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 85631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-08',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG80760%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Saving data for JG80760: {'auction_closing_time': 1774885478.0, 'created_time': 1774379238.735053, 'last_price_update_time': 1774868366.562788}
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG80760') HTTP/1.1" 204 0
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: NN77195
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN77195%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for NN77195: 2
2026-03-30 10:59:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 342ab0f5-bd41-505f-9b2f-77f47ddea43a with identifier: NN77195
2026-03-30 10:59:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 342ab0f5-bd41-505f-9b2f-77f47ddea43a with scrape type 2
2026-03-30 10:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 342ab0f5-bd41-505f-9b2f-77f47ddea43a with scrape type 2
2026-03-30 10:59:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 342ab0f5-bd41-505f-9b2f-77f47ddea43a, identifier: NN77195
2026-03-30 10:59:26 [auto1.de] INFO: Found listing with ID: TV16338
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV16338%27 HTTP/1.1" 200 None
2026-03-30 10:59:26 [auto1.de] INFO: Scrape type for TV16338: 2
2026-03-30 10:59:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 967f72b3-8576-5d55-bc0d-2495a5fb191a with identifier: TV16338
2026-03-30 10:59:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 967f72b3-8576-5d55-bc0d-2495a5fb191a with scrape type 2
2026-03-30 10:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 967f72b3-8576-5d55-bc0d-2495a5fb191a with scrape type 2
2026-03-30 10:59:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 967f72b3-8576-5d55-bc0d-2495a5fb191a, identifier: TV16338
2026-03-30 10:59:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 342ab0f5-bd41-505f-9b2f-77f47ddea43a with identifier: NN77195
2026-03-30 10:59:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 342ab0f5-bd41-505f-9b2f-77f47ddea43a with identifier: NN77195
2026-03-30 10:59:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 342ab0f5-bd41-505f-9b2f-77f47ddea43a with identifier: NN77195 to the API
2026-03-30 10:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:22:32Z',
 'fuel_type': 'petrol',
 'id': '342ab0f5-bd41-505f-9b2f-77f47ddea43a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN77195',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 106138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-25',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN77195%27 HTTP/1.1" 200 None
2026-03-30 10:59:27 [auto1.de] INFO: Saving data for NN77195: {'auction_closing_time': 1774884152.0, 'created_time': 1774463754.171343, 'last_price_update_time': 1774868367.151564}
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN77195') HTTP/1.1" 204 0
2026-03-30 10:59:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 967f72b3-8576-5d55-bc0d-2495a5fb191a with identifier: TV16338
2026-03-30 10:59:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 967f72b3-8576-5d55-bc0d-2495a5fb191a with identifier: TV16338
2026-03-30 10:59:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 967f72b3-8576-5d55-bc0d-2495a5fb191a with identifier: TV16338 to the API
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:47:52Z',
 'fuel_type': 'petrol',
 'id': '967f72b3-8576-5d55-bc0d-2495a5fb191a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV16338',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'Legacy',
 'odometer': 162852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-08-30',
 'seller_name': None,
 'title': 'Subaru Legacy 2.0 Hubertus Airbag',
 'transmission': 'manual',
 'trim': 'Hubertus Airbag',
 'year': 1998}
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV16338%27 HTTP/1.1" 200 None
2026-03-30 10:59:27 [auto1.de] INFO: Saving data for TV16338: {'auction_closing_time': 1774885672.0, 'created_time': 1774378771.284447, 'last_price_update_time': 1774868367.479534}
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV16338') HTTP/1.1" 204 0
2026-03-30 10:59:27 [auto1.de] INFO: Found listing with ID: RZ45087
2026-03-30 10:59:27 [auto1.de] INFO: Found listing with ID: HW35113
2026-03-30 10:59:27 [auto1.de] INFO: Found listing with ID: TP80753
2026-03-30 10:59:27 [auto1.de] INFO: Found listing with ID: NF53472
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF53472%27 HTTP/1.1" 200 None
2026-03-30 10:59:27 [auto1.de] INFO: Scrape type for NF53472: 2
2026-03-30 10:59:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c81dd0c0-a2d5-5f20-9ba2-19fffe4dd2e8 with identifier: NF53472
2026-03-30 10:59:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c81dd0c0-a2d5-5f20-9ba2-19fffe4dd2e8 with scrape type 2
2026-03-30 10:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c81dd0c0-a2d5-5f20-9ba2-19fffe4dd2e8 with scrape type 2
2026-03-30 10:59:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c81dd0c0-a2d5-5f20-9ba2-19fffe4dd2e8, identifier: NF53472
2026-03-30 10:59:27 [auto1.de] INFO: Found listing with ID: AS89586
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS89586%27 HTTP/1.1" 200 None
2026-03-30 10:59:27 [auto1.de] INFO: Scrape type for AS89586: 2
2026-03-30 10:59:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9c0c0d8-8b83-5be1-a127-570767a92bb0 with identifier: AS89586
2026-03-30 10:59:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9c0c0d8-8b83-5be1-a127-570767a92bb0 with scrape type 2
2026-03-30 10:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9c0c0d8-8b83-5be1-a127-570767a92bb0 with scrape type 2
2026-03-30 10:59:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9c0c0d8-8b83-5be1-a127-570767a92bb0, identifier: AS89586
2026-03-30 10:59:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c81dd0c0-a2d5-5f20-9ba2-19fffe4dd2e8 with identifier: NF53472
2026-03-30 10:59:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c81dd0c0-a2d5-5f20-9ba2-19fffe4dd2e8 with identifier: NF53472
2026-03-30 10:59:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c81dd0c0-a2d5-5f20-9ba2-19fffe4dd2e8 with identifier: NF53472 to the API
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:58:42Z',
 'fuel_type': 'diesel',
 'id': 'c81dd0c0-a2d5-5f20-9ba2-19fffe4dd2e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF53472',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 228749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-15',
 'seller_name': None,
 'title': 'Ford S-Max 2.2 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2014}
2026-03-30 10:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF53472%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Saving data for NF53472: {'auction_closing_time': 1774886322.0, 'created_time': 1773517696.600579, 'last_price_update_time': 1774868368.006843}
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF53472') HTTP/1.1" 204 0
2026-03-30 10:59:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9c0c0d8-8b83-5be1-a127-570767a92bb0 with identifier: AS89586
2026-03-30 10:59:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9c0c0d8-8b83-5be1-a127-570767a92bb0 with identifier: AS89586
2026-03-30 10:59:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9c0c0d8-8b83-5be1-a127-570767a92bb0 with identifier: AS89586 to the API
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:17:08Z',
 'fuel_type': 'petrol',
 'id': 'f9c0c0d8-8b83-5be1-a127-570767a92bb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS89586',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 197175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-31',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.8 SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2007}
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS89586%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Saving data for AS89586: {'auction_closing_time': 1774883828.0, 'created_time': 1773688513.098673, 'last_price_update_time': 1774868368.297605}
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS89586') HTTP/1.1" 204 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: WB48893
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: HC78210
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: XL04777
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: ZB59540
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59540%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for ZB59540: 2
2026-03-30 10:59:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa1de6b0-58c9-57d7-9cb2-1068800d4ab2 with identifier: ZB59540
2026-03-30 10:59:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa1de6b0-58c9-57d7-9cb2-1068800d4ab2 with scrape type 2
2026-03-30 10:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa1de6b0-58c9-57d7-9cb2-1068800d4ab2 with scrape type 2
2026-03-30 10:59:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa1de6b0-58c9-57d7-9cb2-1068800d4ab2, identifier: ZB59540
2026-03-30 10:59:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa1de6b0-58c9-57d7-9cb2-1068800d4ab2 with identifier: ZB59540
2026-03-30 10:59:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa1de6b0-58c9-57d7-9cb2-1068800d4ab2 with identifier: ZB59540
2026-03-30 10:59:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa1de6b0-58c9-57d7-9cb2-1068800d4ab2 with identifier: ZB59540 to the API
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:58:48Z',
 'fuel_type': 'petrol',
 'id': 'aa1de6b0-58c9-57d7-9cb2-1068800d4ab2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB59540',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 88106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-28',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2016}
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59540%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Saving data for ZB59540: {'auction_closing_time': 1774886328.0, 'created_time': 1773775806.362419, 'last_price_update_time': 1774868368.683536}
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB59540') HTTP/1.1" 204 0
2026-03-30 10:59:28 [auto1.de] INFO: Found listing with ID: EZ65040
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ65040%27 HTTP/1.1" 200 None
2026-03-30 10:59:28 [auto1.de] INFO: Scrape type for EZ65040: 2
2026-03-30 10:59:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b041abaa-e91e-5fe2-ba8b-c8602a23071d with identifier: EZ65040
2026-03-30 10:59:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b041abaa-e91e-5fe2-ba8b-c8602a23071d with scrape type 2
2026-03-30 10:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b041abaa-e91e-5fe2-ba8b-c8602a23071d with scrape type 2
2026-03-30 10:59:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b041abaa-e91e-5fe2-ba8b-c8602a23071d, identifier: EZ65040
2026-03-30 10:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b041abaa-e91e-5fe2-ba8b-c8602a23071d with identifier: EZ65040
2026-03-30 10:59:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b041abaa-e91e-5fe2-ba8b-c8602a23071d with identifier: EZ65040
2026-03-30 10:59:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b041abaa-e91e-5fe2-ba8b-c8602a23071d with identifier: EZ65040 to the API
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:36Z',
 'fuel_type': 'petrol',
 'id': 'b041abaa-e91e-5fe2-ba8b-c8602a23071d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ65040',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 51710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-05',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.5 TSI ACT Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2019}
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ65040%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Saving data for EZ65040: {'auction_closing_time': 1774886256.0, 'created_time': 1773775856.706354, 'last_price_update_time': 1774868369.194054}
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ65040') HTTP/1.1" 204 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: KR07785
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR07785%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for KR07785: 2
2026-03-30 10:59:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b03f4cdd-367a-5493-8bda-ce6b24d12ff4 with identifier: KR07785
2026-03-30 10:59:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03f4cdd-367a-5493-8bda-ce6b24d12ff4 with scrape type 2
2026-03-30 10:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b03f4cdd-367a-5493-8bda-ce6b24d12ff4 with scrape type 2
2026-03-30 10:59:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b03f4cdd-367a-5493-8bda-ce6b24d12ff4, identifier: KR07785
2026-03-30 10:59:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b03f4cdd-367a-5493-8bda-ce6b24d12ff4 with identifier: KR07785
2026-03-30 10:59:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b03f4cdd-367a-5493-8bda-ce6b24d12ff4 with identifier: KR07785
2026-03-30 10:59:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b03f4cdd-367a-5493-8bda-ce6b24d12ff4 with identifier: KR07785 to the API
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-30T15:28:36Z',
 'fuel_type': 'petrol',
 'id': 'b03f4cdd-367a-5493-8bda-ce6b24d12ff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR07785',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 56973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-17',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Zama',
 'transmission': 'automatic',
 'trim': 'Zama',
 'year': 2021}
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR07785%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Saving data for KR07785: {'auction_closing_time': 1774884516.0, 'created_time': 1774379578.767395, 'last_price_update_time': 1774868369.581273}
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR07785') HTTP/1.1" 204 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: CW58984
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW58984%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for CW58984: 2
2026-03-30 10:59:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d37d51a0-adf9-5ab4-be3d-9b59ff563204 with identifier: CW58984
2026-03-30 10:59:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d37d51a0-adf9-5ab4-be3d-9b59ff563204 with scrape type 2
2026-03-30 10:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d37d51a0-adf9-5ab4-be3d-9b59ff563204 with scrape type 2
2026-03-30 10:59:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d37d51a0-adf9-5ab4-be3d-9b59ff563204, identifier: CW58984
2026-03-30 10:59:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d37d51a0-adf9-5ab4-be3d-9b59ff563204 with identifier: CW58984
2026-03-30 10:59:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d37d51a0-adf9-5ab4-be3d-9b59ff563204 with identifier: CW58984
2026-03-30 10:59:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d37d51a0-adf9-5ab4-be3d-9b59ff563204 with identifier: CW58984 to the API
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:23:49Z',
 'fuel_type': 'petrol',
 'id': 'd37d51a0-adf9-5ab4-be3d-9b59ff563204',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW58984',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 206719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-28',
 'seller_name': None,
 'title': 'Ford Focus 1.8 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2007}
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW58984%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Saving data for CW58984: {'auction_closing_time': 1774884229.0, 'created_time': 1773861654.207414, 'last_price_update_time': 1774868369.960477}
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW58984') HTTP/1.1" 204 0
2026-03-30 10:59:29 [auto1.de] INFO: Found listing with ID: ZF51547
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF51547%27 HTTP/1.1" 200 None
2026-03-30 10:59:29 [auto1.de] INFO: Scrape type for ZF51547: 2
2026-03-30 10:59:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65d2cf42-3356-5394-b36e-6b2cebfde13a with identifier: ZF51547
2026-03-30 10:59:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65d2cf42-3356-5394-b36e-6b2cebfde13a with scrape type 2
2026-03-30 10:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65d2cf42-3356-5394-b36e-6b2cebfde13a with scrape type 2
2026-03-30 10:59:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65d2cf42-3356-5394-b36e-6b2cebfde13a, identifier: ZF51547
2026-03-30 10:59:30 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 9552 | hits on page: 40
2026-03-30 10:59:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65d2cf42-3356-5394-b36e-6b2cebfde13a with identifier: ZF51547
2026-03-30 10:59:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65d2cf42-3356-5394-b36e-6b2cebfde13a with identifier: ZF51547
2026-03-30 10:59:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65d2cf42-3356-5394-b36e-6b2cebfde13a with identifier: ZF51547 to the API
2026-03-30 10:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:58:49Z',
 'fuel_type': 'petrol',
 'id': '65d2cf42-3356-5394-b36e-6b2cebfde13a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF51547',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 155053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-27',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2012}
2026-03-30 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF51547%27 HTTP/1.1" 200 None
2026-03-30 10:59:30 [auto1.de] INFO: Saving data for ZF51547: {'auction_closing_time': 1774886329.0, 'created_time': 1773571706.098878, 'last_price_update_time': 1774868370.395256}
2026-03-30 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF51547') HTTP/1.1" 204 0
2026-03-30 10:59:30 [auto1.de] INFO: Found listing with ID: LE60252
2026-03-30 10:59:30 [auto1.de] INFO: Found listing with ID: BL18853
2026-03-30 10:59:30 [auto1.de] INFO: Found listing with ID: GX07003
2026-03-30 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX07003%27 HTTP/1.1" 200 None
2026-03-30 10:59:30 [auto1.de] INFO: Scrape type for GX07003: 2
2026-03-30 10:59:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72ea1f31-66a0-5c9d-8df0-8821b8983893 with identifier: GX07003
2026-03-30 10:59:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72ea1f31-66a0-5c9d-8df0-8821b8983893 with scrape type 2
2026-03-30 10:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72ea1f31-66a0-5c9d-8df0-8821b8983893 with scrape type 2
2026-03-30 10:59:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72ea1f31-66a0-5c9d-8df0-8821b8983893, identifier: GX07003
2026-03-30 10:59:30 [auto1.de] INFO: Found listing with ID: PJ99813
2026-03-30 10:59:30 [auto1.de] INFO: Found listing with ID: WP80129
2026-03-30 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP80129%27 HTTP/1.1" 200 None
2026-03-30 10:59:30 [auto1.de] INFO: Scrape type for WP80129: 2
2026-03-30 10:59:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7ae5b31-c19d-5234-9d07-76449a71f39a with identifier: WP80129
2026-03-30 10:59:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7ae5b31-c19d-5234-9d07-76449a71f39a with scrape type 2
2026-03-30 10:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7ae5b31-c19d-5234-9d07-76449a71f39a with scrape type 2
2026-03-30 10:59:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7ae5b31-c19d-5234-9d07-76449a71f39a, identifier: WP80129
2026-03-30 10:59:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72ea1f31-66a0-5c9d-8df0-8821b8983893 with identifier: GX07003
2026-03-30 10:59:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72ea1f31-66a0-5c9d-8df0-8821b8983893 with identifier: GX07003
2026-03-30 10:59:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72ea1f31-66a0-5c9d-8df0-8821b8983893 with identifier: GX07003 to the API
2026-03-30 10:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:32:49Z',
 'fuel_type': 'petrol',
 'id': '72ea1f31-66a0-5c9d-8df0-8821b8983893',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX07003',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 176510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-29',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.1 ClearTec EDITION',
 'transmission': 'manual',
 'trim': 'ClearTec EDITION',
 'year': 2012}
2026-03-30 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX07003%27 HTTP/1.1" 200 None
2026-03-30 10:59:30 [auto1.de] INFO: Saving data for GX07003: {'auction_closing_time': 1774884769.0, 'created_time': 1773689242.900957, 'last_price_update_time': 1774868370.920737}
2026-03-30 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX07003') HTTP/1.1" 204 0
2026-03-30 10:59:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7ae5b31-c19d-5234-9d07-76449a71f39a with identifier: WP80129
2026-03-30 10:59:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7ae5b31-c19d-5234-9d07-76449a71f39a with identifier: WP80129
2026-03-30 10:59:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7ae5b31-c19d-5234-9d07-76449a71f39a with identifier: WP80129 to the API
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:03:21Z',
 'fuel_type': 'diesel',
 'id': 'e7ae5b31-c19d-5234-9d07-76449a71f39a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP80129',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 105222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-28',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 320 L2 Limited',
 'transmission': 'automatic',
 'trim': '320 L2 Limited',
 'year': 2020}
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP80129%27 HTTP/1.1" 200 None
2026-03-30 10:59:31 [auto1.de] INFO: Saving data for WP80129: {'auction_closing_time': 1774883001.0, 'created_time': 1774780656.141935, 'last_price_update_time': 1774868371.61571}
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP80129') HTTP/1.1" 204 0
2026-03-30 10:59:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:31 [auto1.de] INFO: Found listing with ID: DW68241
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68241%27 HTTP/1.1" 200 None
2026-03-30 10:59:31 [auto1.de] INFO: Scrape type for DW68241: 2
2026-03-30 10:59:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48f86626-7dff-5675-8fe1-5ef959ea57bf with identifier: DW68241
2026-03-30 10:59:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48f86626-7dff-5675-8fe1-5ef959ea57bf with scrape type 2
2026-03-30 10:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48f86626-7dff-5675-8fe1-5ef959ea57bf with scrape type 2
2026-03-30 10:59:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48f86626-7dff-5675-8fe1-5ef959ea57bf, identifier: DW68241
2026-03-30 10:59:32 [auto1.de] INFO: Found listing with ID: TJ95012
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ95012%27 HTTP/1.1" 200 None
2026-03-30 10:59:32 [auto1.de] INFO: Scrape type for TJ95012: 2
2026-03-30 10:59:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52f82dd4-9620-581d-be9c-066eeddbe951 with identifier: TJ95012
2026-03-30 10:59:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52f82dd4-9620-581d-be9c-066eeddbe951 with scrape type 2
2026-03-30 10:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52f82dd4-9620-581d-be9c-066eeddbe951 with scrape type 2
2026-03-30 10:59:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52f82dd4-9620-581d-be9c-066eeddbe951, identifier: TJ95012
2026-03-30 10:59:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48f86626-7dff-5675-8fe1-5ef959ea57bf with identifier: DW68241
2026-03-30 10:59:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48f86626-7dff-5675-8fe1-5ef959ea57bf with identifier: DW68241
2026-03-30 10:59:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48f86626-7dff-5675-8fe1-5ef959ea57bf with identifier: DW68241 to the API
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:04:12Z',
 'fuel_type': 'diesel',
 'id': '48f86626-7dff-5675-8fe1-5ef959ea57bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW68241',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 104068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68241%27 HTTP/1.1" 200 None
2026-03-30 10:59:32 [auto1.de] INFO: Saving data for DW68241: {'auction_closing_time': 1774883052.0, 'created_time': 1773945820.431146, 'last_price_update_time': 1774868372.399668}
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW68241') HTTP/1.1" 204 0
2026-03-30 10:59:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52f82dd4-9620-581d-be9c-066eeddbe951 with identifier: TJ95012
2026-03-30 10:59:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52f82dd4-9620-581d-be9c-066eeddbe951 with identifier: TJ95012
2026-03-30 10:59:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52f82dd4-9620-581d-be9c-066eeddbe951 with identifier: TJ95012 to the API
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-30T15:20:12Z',
 'fuel_type': 'petrol',
 'id': '52f82dd4-9620-581d-be9c-066eeddbe951',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ95012',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 26244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seller_name': None,
 'title': 'Suzuki Swift 1.4 BoosterJet Mild-Hybrid Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2022}
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ95012%27 HTTP/1.1" 200 None
2026-03-30 10:59:33 [auto1.de] INFO: Saving data for TJ95012: {'auction_closing_time': 1774884012.0, 'created_time': 1773774797.258653, 'last_price_update_time': 1774868373.450974}
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ95012') HTTP/1.1" 204 0
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: AE08285
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE08285%27 HTTP/1.1" 200 None
2026-03-30 10:59:33 [auto1.de] INFO: Scrape type for AE08285: 2
2026-03-30 10:59:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7c14c3b-8267-5312-b677-a9d9818e347c with identifier: AE08285
2026-03-30 10:59:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7c14c3b-8267-5312-b677-a9d9818e347c with scrape type 2
2026-03-30 10:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7c14c3b-8267-5312-b677-a9d9818e347c with scrape type 2
2026-03-30 10:59:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7c14c3b-8267-5312-b677-a9d9818e347c, identifier: AE08285
2026-03-30 10:59:33 [auto1.de] INFO: Found listing with ID: BB55573
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB55573%27 HTTP/1.1" 200 None
2026-03-30 10:59:33 [auto1.de] INFO: Scrape type for BB55573: 2
2026-03-30 10:59:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6f7aa36-3cd0-5722-9b37-932c90170c80 with identifier: BB55573
2026-03-30 10:59:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6f7aa36-3cd0-5722-9b37-932c90170c80 with scrape type 2
2026-03-30 10:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6f7aa36-3cd0-5722-9b37-932c90170c80 with scrape type 2
2026-03-30 10:59:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6f7aa36-3cd0-5722-9b37-932c90170c80, identifier: BB55573
2026-03-30 10:59:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7c14c3b-8267-5312-b677-a9d9818e347c with identifier: AE08285
2026-03-30 10:59:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7c14c3b-8267-5312-b677-a9d9818e347c with identifier: AE08285
2026-03-30 10:59:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7c14c3b-8267-5312-b677-a9d9818e347c with identifier: AE08285 to the API
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:07:07Z',
 'fuel_type': 'diesel',
 'id': 'b7c14c3b-8267-5312-b677-a9d9818e347c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE08285',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 115717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-22',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE08285%27 HTTP/1.1" 200 None
2026-03-30 10:59:34 [auto1.de] INFO: Saving data for AE08285: {'auction_closing_time': 1774883227.0, 'created_time': 1774780658.246627, 'last_price_update_time': 1774868374.031273}
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE08285') HTTP/1.1" 204 0
2026-03-30 10:59:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6f7aa36-3cd0-5722-9b37-932c90170c80 with identifier: BB55573
2026-03-30 10:59:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6f7aa36-3cd0-5722-9b37-932c90170c80 with identifier: BB55573
2026-03-30 10:59:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6f7aa36-3cd0-5722-9b37-932c90170c80 with identifier: BB55573 to the API
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:29:31Z',
 'fuel_type': 'petrol',
 'id': 'a6f7aa36-3cd0-5722-9b37-932c90170c80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB55573',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 97774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-04-07',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition Bild',
 'transmission': 'manual',
 'trim': 'Edition Bild',
 'year': 2003}
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB55573%27 HTTP/1.1" 200 None
2026-03-30 10:59:34 [auto1.de] INFO: Saving data for BB55573: {'auction_closing_time': 1774884571.0, 'created_time': 1774638488.273313, 'last_price_update_time': 1774868374.31823}
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB55573') HTTP/1.1" 204 0
2026-03-30 10:59:34 [auto1.de] INFO: Found listing with ID: BV75755
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV75755%27 HTTP/1.1" 200 None
2026-03-30 10:59:34 [auto1.de] INFO: Scrape type for BV75755: 2
2026-03-30 10:59:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 473b039e-ca9c-5f93-aff5-b26ef85df55d with identifier: BV75755
2026-03-30 10:59:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 473b039e-ca9c-5f93-aff5-b26ef85df55d with scrape type 2
2026-03-30 10:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 473b039e-ca9c-5f93-aff5-b26ef85df55d with scrape type 2
2026-03-30 10:59:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 473b039e-ca9c-5f93-aff5-b26ef85df55d, identifier: BV75755
2026-03-30 10:59:34 [auto1.de] INFO: Found listing with ID: AE82588
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE82588%27 HTTP/1.1" 200 None
2026-03-30 10:59:34 [auto1.de] INFO: Scrape type for AE82588: 2
2026-03-30 10:59:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 274e51c0-e226-5fd8-a9f1-bd65eed8f0da with identifier: AE82588
2026-03-30 10:59:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 274e51c0-e226-5fd8-a9f1-bd65eed8f0da with scrape type 2
2026-03-30 10:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 274e51c0-e226-5fd8-a9f1-bd65eed8f0da with scrape type 2
2026-03-30 10:59:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 274e51c0-e226-5fd8-a9f1-bd65eed8f0da, identifier: AE82588
2026-03-30 10:59:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 473b039e-ca9c-5f93-aff5-b26ef85df55d with identifier: BV75755
2026-03-30 10:59:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 473b039e-ca9c-5f93-aff5-b26ef85df55d with identifier: BV75755
2026-03-30 10:59:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 473b039e-ca9c-5f93-aff5-b26ef85df55d with identifier: BV75755 to the API
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:24:21Z',
 'fuel_type': 'petrol',
 'id': '473b039e-ca9c-5f93-aff5-b26ef85df55d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV75755',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '407',
 'odometer': 148695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-12-13',
 'seller_name': None,
 'title': 'Peugeot 407 3.0 V6 Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2005}
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV75755%27 HTTP/1.1" 200 None
2026-03-30 10:59:34 [auto1.de] INFO: Saving data for BV75755: {'auction_closing_time': 1774884261.0, 'created_time': 1774638353.858507, 'last_price_update_time': 1774868374.867363}
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV75755') HTTP/1.1" 204 0
2026-03-30 10:59:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 274e51c0-e226-5fd8-a9f1-bd65eed8f0da with identifier: AE82588
2026-03-30 10:59:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 274e51c0-e226-5fd8-a9f1-bd65eed8f0da with identifier: AE82588
2026-03-30 10:59:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 274e51c0-e226-5fd8-a9f1-bd65eed8f0da with identifier: AE82588 to the API
2026-03-30 10:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:05:46Z',
 'fuel_type': 'petrol',
 'id': '274e51c0-e226-5fd8-a9f1-bd65eed8f0da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE82588',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 98156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-08-11',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE82588%27 HTTP/1.1" 200 None
2026-03-30 10:59:35 [auto1.de] INFO: Saving data for AE82588: {'auction_closing_time': 1774883146.0, 'created_time': 1774637404.296086, 'last_price_update_time': 1774868375.194127}
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE82588') HTTP/1.1" 204 0
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: XE49281
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: SY67219
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: WE35343
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE35343%27 HTTP/1.1" 200 None
2026-03-30 10:59:35 [auto1.de] INFO: Scrape type for WE35343: 2
2026-03-30 10:59:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c19ece-d008-5e77-80ae-9ab4fc3f4d77 with identifier: WE35343
2026-03-30 10:59:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c19ece-d008-5e77-80ae-9ab4fc3f4d77 with scrape type 2
2026-03-30 10:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c19ece-d008-5e77-80ae-9ab4fc3f4d77 with scrape type 2
2026-03-30 10:59:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36c19ece-d008-5e77-80ae-9ab4fc3f4d77, identifier: WE35343
2026-03-30 10:59:35 [auto1.de] INFO: Found listing with ID: UA53606
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA53606%27 HTTP/1.1" 200 None
2026-03-30 10:59:35 [auto1.de] INFO: Scrape type for UA53606: 2
2026-03-30 10:59:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66c6f3a8-2a8a-5706-bd72-62f033ee70e5 with identifier: UA53606
2026-03-30 10:59:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66c6f3a8-2a8a-5706-bd72-62f033ee70e5 with scrape type 2
2026-03-30 10:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66c6f3a8-2a8a-5706-bd72-62f033ee70e5 with scrape type 2
2026-03-30 10:59:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66c6f3a8-2a8a-5706-bd72-62f033ee70e5, identifier: UA53606
2026-03-30 10:59:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36c19ece-d008-5e77-80ae-9ab4fc3f4d77 with identifier: WE35343
2026-03-30 10:59:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36c19ece-d008-5e77-80ae-9ab4fc3f4d77 with identifier: WE35343
2026-03-30 10:59:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36c19ece-d008-5e77-80ae-9ab4fc3f4d77 with identifier: WE35343 to the API
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:56:45Z',
 'fuel_type': 'petrol',
 'id': '36c19ece-d008-5e77-80ae-9ab4fc3f4d77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE35343',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 158945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-10',
 'seller_name': None,
 'title': "Kia cee'd 1.4 Dream Team",
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2015}
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE35343%27 HTTP/1.1" 200 None
2026-03-30 10:59:35 [auto1.de] INFO: Saving data for WE35343: {'auction_closing_time': 1774886205.0, 'created_time': 1773520203.948166, 'last_price_update_time': 1774868375.794558}
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE35343') HTTP/1.1" 204 0
2026-03-30 10:59:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66c6f3a8-2a8a-5706-bd72-62f033ee70e5 with identifier: UA53606
2026-03-30 10:59:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66c6f3a8-2a8a-5706-bd72-62f033ee70e5 with identifier: UA53606
2026-03-30 10:59:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66c6f3a8-2a8a-5706-bd72-62f033ee70e5 with identifier: UA53606 to the API
2026-03-30 10:59:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:11:26Z',
 'fuel_type': 'petrol',
 'id': '66c6f3a8-2a8a-5706-bd72-62f033ee70e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA53606',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 151766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-21',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 Aktionsmodell',
 'transmission': 'manual',
 'trim': 'Aktionsmodell',
 'year': 2016}
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA53606%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Saving data for UA53606: {'auction_closing_time': 1774883486.0, 'created_time': 1773516447.717427, 'last_price_update_time': 1774868376.927655}
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA53606') HTTP/1.1" 204 0
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: NL19475
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: WJ46196
2026-03-30 10:59:36 [auto1.de] INFO: Found listing with ID: GZ46196
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ46196%27 HTTP/1.1" 200 None
2026-03-30 10:59:36 [auto1.de] INFO: Scrape type for GZ46196: 2
2026-03-30 10:59:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04129cd5-49d2-5fc8-9463-32075e556860 with identifier: GZ46196
2026-03-30 10:59:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04129cd5-49d2-5fc8-9463-32075e556860 with scrape type 2
2026-03-30 10:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04129cd5-49d2-5fc8-9463-32075e556860 with scrape type 2
2026-03-30 10:59:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04129cd5-49d2-5fc8-9463-32075e556860, identifier: GZ46196
2026-03-30 10:59:37 [auto1.de] INFO: Found listing with ID: LS75303
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS75303%27 HTTP/1.1" 200 None
2026-03-30 10:59:37 [auto1.de] INFO: Scrape type for LS75303: 2
2026-03-30 10:59:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0167c4ab-657c-536f-ba81-31148907790c with identifier: LS75303
2026-03-30 10:59:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0167c4ab-657c-536f-ba81-31148907790c with scrape type 2
2026-03-30 10:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0167c4ab-657c-536f-ba81-31148907790c with scrape type 2
2026-03-30 10:59:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0167c4ab-657c-536f-ba81-31148907790c, identifier: LS75303
2026-03-30 10:59:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04129cd5-49d2-5fc8-9463-32075e556860 with identifier: GZ46196
2026-03-30 10:59:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04129cd5-49d2-5fc8-9463-32075e556860 with identifier: GZ46196
2026-03-30 10:59:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04129cd5-49d2-5fc8-9463-32075e556860 with identifier: GZ46196 to the API
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:02:21Z',
 'fuel_type': 'petrol',
 'id': '04129cd5-49d2-5fc8-9463-32075e556860',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ46196',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Matiz',
 'odometer': 180480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-30',
 'seller_name': None,
 'title': 'Chevrolet Matiz 1.0 SE',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2007}
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ46196%27 HTTP/1.1" 200 None
2026-03-30 10:59:37 [auto1.de] INFO: Saving data for GZ46196: {'auction_closing_time': 1774882941.0, 'created_time': 1774550685.23626, 'last_price_update_time': 1774868377.435175}
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ46196') HTTP/1.1" 204 0
2026-03-30 10:59:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0167c4ab-657c-536f-ba81-31148907790c with identifier: LS75303
2026-03-30 10:59:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0167c4ab-657c-536f-ba81-31148907790c with identifier: LS75303
2026-03-30 10:59:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0167c4ab-657c-536f-ba81-31148907790c with identifier: LS75303 to the API
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:14:05Z',
 'fuel_type': 'diesel',
 'id': '0167c4ab-657c-536f-ba81-31148907790c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS75303',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 445909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-10-14',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.9 TDI Special',
 'transmission': 'automatic',
 'trim': 'Special',
 'year': 2002}
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS75303%27 HTTP/1.1" 200 None
2026-03-30 10:59:37 [auto1.de] INFO: Saving data for LS75303: {'auction_closing_time': 1774883645.0, 'created_time': 1774637269.847014, 'last_price_update_time': 1774868377.801699}
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS75303') HTTP/1.1" 204 0
2026-03-30 10:59:37 [auto1.de] INFO: Found listing with ID: UW13006
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13006%27 HTTP/1.1" 200 None
2026-03-30 10:59:37 [auto1.de] INFO: Scrape type for UW13006: 2
2026-03-30 10:59:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d467e812-dd3f-5a56-9fc2-ac0a9fb79c94 with identifier: UW13006
2026-03-30 10:59:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d467e812-dd3f-5a56-9fc2-ac0a9fb79c94 with scrape type 2
2026-03-30 10:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d467e812-dd3f-5a56-9fc2-ac0a9fb79c94 with scrape type 2
2026-03-30 10:59:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d467e812-dd3f-5a56-9fc2-ac0a9fb79c94, identifier: UW13006
2026-03-30 10:59:37 [auto1.de] INFO: Found listing with ID: VH02312
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH02312%27 HTTP/1.1" 200 None
2026-03-30 10:59:37 [auto1.de] INFO: Scrape type for VH02312: 2
2026-03-30 10:59:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0bbaef4-b322-5953-bfd2-76324f7a278f with identifier: VH02312
2026-03-30 10:59:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0bbaef4-b322-5953-bfd2-76324f7a278f with scrape type 2
2026-03-30 10:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0bbaef4-b322-5953-bfd2-76324f7a278f with scrape type 2
2026-03-30 10:59:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0bbaef4-b322-5953-bfd2-76324f7a278f, identifier: VH02312
2026-03-30 10:59:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d467e812-dd3f-5a56-9fc2-ac0a9fb79c94 with identifier: UW13006
2026-03-30 10:59:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d467e812-dd3f-5a56-9fc2-ac0a9fb79c94 with identifier: UW13006
2026-03-30 10:59:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d467e812-dd3f-5a56-9fc2-ac0a9fb79c94 with identifier: UW13006 to the API
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:24:58Z',
 'fuel_type': 'petrol',
 'id': 'd467e812-dd3f-5a56-9fc2-ac0a9fb79c94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW13006',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 81596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-01',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13006%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Saving data for UW13006: {'auction_closing_time': 1774884298.0, 'created_time': 1774551850.515072, 'last_price_update_time': 1774868378.349317}
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW13006') HTTP/1.1" 204 0
2026-03-30 10:59:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0bbaef4-b322-5953-bfd2-76324f7a278f with identifier: VH02312
2026-03-30 10:59:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0bbaef4-b322-5953-bfd2-76324f7a278f with identifier: VH02312
2026-03-30 10:59:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0bbaef4-b322-5953-bfd2-76324f7a278f with identifier: VH02312 to the API
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:34:22Z',
 'fuel_type': 'petrol',
 'id': 'a0bbaef4-b322-5953-bfd2-76324f7a278f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH02312',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 134086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-05',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2003}
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH02312%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Saving data for VH02312: {'auction_closing_time': 1774884862.0, 'created_time': 1774550927.225985, 'last_price_update_time': 1774868378.645883}
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH02312') HTTP/1.1" 204 0
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: AT70381
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: VN12200
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN12200%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Scrape type for VN12200: 2
2026-03-30 10:59:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5363727-5ce7-5159-b539-b567415ec1e9 with identifier: VN12200
2026-03-30 10:59:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5363727-5ce7-5159-b539-b567415ec1e9 with scrape type 2
2026-03-30 10:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5363727-5ce7-5159-b539-b567415ec1e9 with scrape type 2
2026-03-30 10:59:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5363727-5ce7-5159-b539-b567415ec1e9, identifier: VN12200
2026-03-30 10:59:38 [auto1.de] INFO: Found listing with ID: PN52671
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN52671%27 HTTP/1.1" 200 None
2026-03-30 10:59:38 [auto1.de] INFO: Scrape type for PN52671: 2
2026-03-30 10:59:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6f647f6-c20d-56de-9091-66d14b9b1f4a with identifier: PN52671
2026-03-30 10:59:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6f647f6-c20d-56de-9091-66d14b9b1f4a with scrape type 2
2026-03-30 10:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6f647f6-c20d-56de-9091-66d14b9b1f4a with scrape type 2
2026-03-30 10:59:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6f647f6-c20d-56de-9091-66d14b9b1f4a, identifier: PN52671
2026-03-30 10:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5363727-5ce7-5159-b539-b567415ec1e9 with identifier: VN12200
2026-03-30 10:59:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5363727-5ce7-5159-b539-b567415ec1e9 with identifier: VN12200
2026-03-30 10:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5363727-5ce7-5159-b539-b567415ec1e9 with identifier: VN12200 to the API
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:03:50Z',
 'fuel_type': 'diesel',
 'id': 'b5363727-5ce7-5159-b539-b567415ec1e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN12200',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 290606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 320 CDI 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2008}
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN12200%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Saving data for VN12200: {'auction_closing_time': 1774883030.0, 'created_time': 1774035031.644207, 'last_price_update_time': 1774868379.207}
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN12200') HTTP/1.1" 204 0
2026-03-30 10:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6f647f6-c20d-56de-9091-66d14b9b1f4a with identifier: PN52671
2026-03-30 10:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6f647f6-c20d-56de-9091-66d14b9b1f4a with identifier: PN52671
2026-03-30 10:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6f647f6-c20d-56de-9091-66d14b9b1f4a with identifier: PN52671 to the API
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:10:04Z',
 'fuel_type': 'diesel',
 'id': 'a6f647f6-c20d-56de-9091-66d14b9b1f4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN52671',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '407',
 'odometer': 246750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-26',
 'seller_name': None,
 'title': 'Peugeot 407 2.0 HDi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN52671%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Saving data for PN52671: {'auction_closing_time': 1774883404.0, 'created_time': 1773383452.275822, 'last_price_update_time': 1774868379.51371}
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN52671') HTTP/1.1" 204 0
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: HE00957
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: MS26334
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: ST83220
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST83220%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for ST83220: 2
2026-03-30 10:59:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c69efc6-b574-5e0e-a059-24a1546697ce with identifier: ST83220
2026-03-30 10:59:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c69efc6-b574-5e0e-a059-24a1546697ce with scrape type 2
2026-03-30 10:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c69efc6-b574-5e0e-a059-24a1546697ce with scrape type 2
2026-03-30 10:59:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c69efc6-b574-5e0e-a059-24a1546697ce, identifier: ST83220
2026-03-30 10:59:39 [auto1.de] INFO: Found listing with ID: NN25217
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN25217%27 HTTP/1.1" 200 None
2026-03-30 10:59:39 [auto1.de] INFO: Scrape type for NN25217: 2
2026-03-30 10:59:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58c5d78f-62f9-50c1-91fd-0120b1569370 with identifier: NN25217
2026-03-30 10:59:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58c5d78f-62f9-50c1-91fd-0120b1569370 with scrape type 2
2026-03-30 10:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58c5d78f-62f9-50c1-91fd-0120b1569370 with scrape type 2
2026-03-30 10:59:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58c5d78f-62f9-50c1-91fd-0120b1569370, identifier: NN25217
2026-03-30 10:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c69efc6-b574-5e0e-a059-24a1546697ce with identifier: ST83220
2026-03-30 10:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c69efc6-b574-5e0e-a059-24a1546697ce with identifier: ST83220
2026-03-30 10:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c69efc6-b574-5e0e-a059-24a1546697ce with identifier: ST83220 to the API
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:31Z',
 'fuel_type': 'diesel',
 'id': '0c69efc6-b574-5e0e-a059-24a1546697ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST83220',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Kombi',
 'odometer': 208857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-11',
 'seller_name': None,
 'title': 'Volkswagen T6 Kombi 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST83220%27 HTTP/1.1" 200 None
2026-03-30 10:59:40 [auto1.de] INFO: Saving data for ST83220: {'auction_closing_time': 1774884511.0, 'created_time': 1774550688.906531, 'last_price_update_time': 1774868380.033994}
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST83220') HTTP/1.1" 204 0
2026-03-30 10:59:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58c5d78f-62f9-50c1-91fd-0120b1569370 with identifier: NN25217
2026-03-30 10:59:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58c5d78f-62f9-50c1-91fd-0120b1569370 with identifier: NN25217
2026-03-30 10:59:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58c5d78f-62f9-50c1-91fd-0120b1569370 with identifier: NN25217 to the API
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:14:47Z',
 'fuel_type': 'petrol',
 'id': '58c5d78f-62f9-50c1-91fd-0120b1569370',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN25217',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 85584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-01-26',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2003}
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN25217%27 HTTP/1.1" 200 None
2026-03-30 10:59:40 [auto1.de] INFO: Saving data for NN25217: {'auction_closing_time': 1774883687.0, 'created_time': 1773775810.730187, 'last_price_update_time': 1774868380.319616}
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN25217') HTTP/1.1" 204 0
2026-03-30 10:59:40 [auto1.de] INFO: Found listing with ID: PJ99813
2026-03-30 10:59:40 [auto1.de] INFO: Found listing with ID: WP80129
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP80129%27 HTTP/1.1" 200 None
2026-03-30 10:59:40 [auto1.de] INFO: Scrape type for WP80129: 0
2026-03-30 10:59:40 [auto1.de] INFO: Found listing with ID: TJ95012
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ95012%27 HTTP/1.1" 200 None
2026-03-30 10:59:40 [auto1.de] INFO: Scrape type for TJ95012: 0
2026-03-30 10:59:40 [auto1.de] INFO: Found listing with ID: SR95486
2026-03-30 10:59:40 [auto1.de] INFO: Found listing with ID: NL19683
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19683%27 HTTP/1.1" 200 None
2026-03-30 10:59:40 [auto1.de] INFO: Scrape type for NL19683: 2
2026-03-30 10:59:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48a3ce89-5d9f-589f-bd48-5c676fe374d0 with identifier: NL19683
2026-03-30 10:59:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48a3ce89-5d9f-589f-bd48-5c676fe374d0 with scrape type 2
2026-03-30 10:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48a3ce89-5d9f-589f-bd48-5c676fe374d0 with scrape type 2
2026-03-30 10:59:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48a3ce89-5d9f-589f-bd48-5c676fe374d0, identifier: NL19683
2026-03-30 10:59:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48a3ce89-5d9f-589f-bd48-5c676fe374d0 with identifier: NL19683
2026-03-30 10:59:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48a3ce89-5d9f-589f-bd48-5c676fe374d0 with identifier: NL19683
2026-03-30 10:59:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48a3ce89-5d9f-589f-bd48-5c676fe374d0 with identifier: NL19683 to the API
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:41:07Z',
 'fuel_type': 'petrol',
 'id': '48a3ce89-5d9f-589f-bd48-5c676fe374d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL19683',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 77828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-20',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2017}
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19683%27 HTTP/1.1" 200 None
2026-03-30 10:59:40 [auto1.de] INFO: Saving data for NL19683: {'auction_closing_time': 1774885267.0, 'created_time': 1774292329.063223, 'last_price_update_time': 1774868380.755631}
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL19683') HTTP/1.1" 204 0
2026-03-30 10:59:40 [auto1.de] INFO: Found listing with ID: SV33608
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV33608%27 HTTP/1.1" 200 None
2026-03-30 10:59:40 [auto1.de] INFO: Scrape type for SV33608: 2
2026-03-30 10:59:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cb16e13-d4dd-5d15-b1a7-1e80ab2173c4 with identifier: SV33608
2026-03-30 10:59:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cb16e13-d4dd-5d15-b1a7-1e80ab2173c4 with scrape type 2
2026-03-30 10:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cb16e13-d4dd-5d15-b1a7-1e80ab2173c4 with scrape type 2
2026-03-30 10:59:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cb16e13-d4dd-5d15-b1a7-1e80ab2173c4, identifier: SV33608
2026-03-30 10:59:40 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 9553 | hits on page: 40
2026-03-30 10:59:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cb16e13-d4dd-5d15-b1a7-1e80ab2173c4 with identifier: SV33608
2026-03-30 10:59:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cb16e13-d4dd-5d15-b1a7-1e80ab2173c4 with identifier: SV33608
2026-03-30 10:59:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cb16e13-d4dd-5d15-b1a7-1e80ab2173c4 with identifier: SV33608 to the API
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:07:03Z',
 'fuel_type': 'petrol',
 'id': '0cb16e13-d4dd-5d15-b1a7-1e80ab2173c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV33608',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 83402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-23',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 400 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV33608%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Saving data for SV33608: {'auction_closing_time': 1774883223.0, 'created_time': 1774379460.989364, 'last_price_update_time': 1774868381.236674}
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV33608') HTTP/1.1" 204 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: JW05859
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW05859%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for JW05859: 2
2026-03-30 10:59:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b426d51-ccf0-5edf-a255-1ddf6bfcb698 with identifier: JW05859
2026-03-30 10:59:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b426d51-ccf0-5edf-a255-1ddf6bfcb698 with scrape type 2
2026-03-30 10:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b426d51-ccf0-5edf-a255-1ddf6bfcb698 with scrape type 2
2026-03-30 10:59:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b426d51-ccf0-5edf-a255-1ddf6bfcb698, identifier: JW05859
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU61192%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for ZU61192: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: KS19016
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: SH98568
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: UB19219
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19219%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for UB19219: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: UT35325
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT35325%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for UT35325: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: FU56159
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: VE03726
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: JC07133
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC07133%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for JC07133: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: NG98905
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG98905%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for NG98905: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: SJ83553
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: GL55365
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: JR52924
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR52924%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for JR52924: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: MU38011
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU38011%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for MU38011: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: GM39396
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: KM60144
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM60144%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for KM60144: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: YU84960
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: KP76789
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP76789%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for KP76789: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: WJ57335
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: KM84276
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM84276%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for KM84276: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: HK49782
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: JT65336
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: UM76387
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM76387%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for UM76387: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: BR88683
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: PY66131
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: AL04579
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: WX96485
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX96485%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for WX96485: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: NH10753
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: CA14151
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: BY37084
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY37084%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for BY37084: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: EF04397
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: UA30528
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA30528%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for UA30528: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: PP86111
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: GC63965
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63965%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for GC63965: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: AF40281
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF40281%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for AF40281: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: AU99703
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: UJ07162
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: YV92261
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV92261%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for YV92261: 0
2026-03-30 10:59:41 [auto1.de] INFO: Found listing with ID: YG24433
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG24433%27 HTTP/1.1" 200 None
2026-03-30 10:59:41 [auto1.de] INFO: Scrape type for YG24433: 0
2026-03-30 10:59:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b426d51-ccf0-5edf-a255-1ddf6bfcb698 with identifier: JW05859
2026-03-30 10:59:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b426d51-ccf0-5edf-a255-1ddf6bfcb698 with identifier: JW05859
2026-03-30 10:59:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b426d51-ccf0-5edf-a255-1ddf6bfcb698 with identifier: JW05859 to the API
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:12:43Z',
 'fuel_type': 'petrol',
 'id': '0b426d51-ccf0-5edf-a255-1ddf6bfcb698',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW05859',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 84139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-07',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.5 TSI ACT Monte Carlo',
 'transmission': 'automatic',
 'trim': 'Monte Carlo',
 'year': 2021}
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW05859%27 HTTP/1.1" 200 None
2026-03-30 10:59:42 [auto1.de] INFO: Saving data for JW05859: {'auction_closing_time': 1774883563.0, 'created_time': 1773227652.654152, 'last_price_update_time': 1774868382.030449}
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW05859') HTTP/1.1" 204 0
2026-03-30 10:59:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:42 [auto1.de] INFO: Found listing with ID: WL45010
2026-03-30 10:59:42 [auto1.de] INFO: Found listing with ID: YG26489
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG26489%27 HTTP/1.1" 200 None
2026-03-30 10:59:42 [auto1.de] INFO: Scrape type for YG26489: 2
2026-03-30 10:59:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 106ce988-c22e-5bac-b92a-9279771cc858 with identifier: YG26489
2026-03-30 10:59:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 106ce988-c22e-5bac-b92a-9279771cc858 with scrape type 2
2026-03-30 10:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 106ce988-c22e-5bac-b92a-9279771cc858 with scrape type 2
2026-03-30 10:59:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 106ce988-c22e-5bac-b92a-9279771cc858, identifier: YG26489
2026-03-30 10:59:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 106ce988-c22e-5bac-b92a-9279771cc858 with identifier: YG26489
2026-03-30 10:59:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 106ce988-c22e-5bac-b92a-9279771cc858 with identifier: YG26489
2026-03-30 10:59:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 106ce988-c22e-5bac-b92a-9279771cc858 with identifier: YG26489 to the API
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 374,
 'expiration_date': '2026-03-30T15:56:45Z',
 'fuel_type': 'petrol',
 'id': '106ce988-c22e-5bac-b92a-9279771cc858',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG26489',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 24747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-28',
 'seller_name': None,
 'title': 'BMW 2er M240i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2023}
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG26489%27 HTTP/1.1" 200 None
2026-03-30 10:59:42 [auto1.de] INFO: Saving data for YG26489: {'auction_closing_time': 1774886205.0, 'created_time': 1774379362.484869, 'last_price_update_time': 1774868382.536815}
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YG26489') HTTP/1.1" 204 0
2026-03-30 10:59:42 [auto1.de] INFO: Found listing with ID: VJ55974
2026-03-30 10:59:42 [auto1.de] INFO: Found listing with ID: YP11119
2026-03-30 10:59:42 [auto1.de] INFO: Found listing with ID: GE22934
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE22934%27 HTTP/1.1" 200 None
2026-03-30 10:59:42 [auto1.de] INFO: Scrape type for GE22934: 2
2026-03-30 10:59:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47f8be1c-e36a-594b-a77d-d3cba666b44b with identifier: GE22934
2026-03-30 10:59:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47f8be1c-e36a-594b-a77d-d3cba666b44b with scrape type 2
2026-03-30 10:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47f8be1c-e36a-594b-a77d-d3cba666b44b with scrape type 2
2026-03-30 10:59:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47f8be1c-e36a-594b-a77d-d3cba666b44b, identifier: GE22934
2026-03-30 10:59:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47f8be1c-e36a-594b-a77d-d3cba666b44b with identifier: GE22934
2026-03-30 10:59:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47f8be1c-e36a-594b-a77d-d3cba666b44b with identifier: GE22934
2026-03-30 10:59:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47f8be1c-e36a-594b-a77d-d3cba666b44b with identifier: GE22934 to the API
2026-03-30 10:59:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:09:21Z',
 'fuel_type': 'diesel',
 'id': '47f8be1c-e36a-594b-a77d-d3cba666b44b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE22934',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 141266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-28',
 'seller_name': None,
 'title': 'BMW X6 xDrive 40d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE22934%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Saving data for GE22934: {'auction_closing_time': 1774883361.0, 'created_time': 1773381191.616447, 'last_price_update_time': 1774868383.948494}
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE22934') HTTP/1.1" 204 0
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: MC32966
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: FB20654
2026-03-30 10:59:43 [auto1.de] INFO: Found listing with ID: GM09493
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM09493%27 HTTP/1.1" 200 None
2026-03-30 10:59:43 [auto1.de] INFO: Scrape type for GM09493: 2
2026-03-30 10:59:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 945a5e16-5224-54fb-b19b-ae707151d7b3 with identifier: GM09493
2026-03-30 10:59:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 945a5e16-5224-54fb-b19b-ae707151d7b3 with scrape type 2
2026-03-30 10:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 945a5e16-5224-54fb-b19b-ae707151d7b3 with scrape type 2
2026-03-30 10:59:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 945a5e16-5224-54fb-b19b-ae707151d7b3, identifier: GM09493
2026-03-30 10:59:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 945a5e16-5224-54fb-b19b-ae707151d7b3 with identifier: GM09493
2026-03-30 10:59:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 945a5e16-5224-54fb-b19b-ae707151d7b3 with identifier: GM09493
2026-03-30 10:59:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 945a5e16-5224-54fb-b19b-ae707151d7b3 with identifier: GM09493 to the API
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:09:20Z',
 'fuel_type': 'petrol',
 'id': '945a5e16-5224-54fb-b19b-ae707151d7b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM09493',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 24199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seller_name': None,
 'title': 'MINI Countryman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM09493%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Saving data for GM09493: {'auction_closing_time': 1774883360.0, 'created_time': 1774379384.953606, 'last_price_update_time': 1774868384.325228}
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM09493') HTTP/1.1" 204 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: UZ05424
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ05424%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for UZ05424: 2
2026-03-30 10:59:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce477fc1-fd47-5740-90a4-229aaee97690 with identifier: UZ05424
2026-03-30 10:59:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce477fc1-fd47-5740-90a4-229aaee97690 with scrape type 2
2026-03-30 10:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce477fc1-fd47-5740-90a4-229aaee97690 with scrape type 2
2026-03-30 10:59:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce477fc1-fd47-5740-90a4-229aaee97690, identifier: UZ05424
2026-03-30 10:59:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce477fc1-fd47-5740-90a4-229aaee97690 with identifier: UZ05424
2026-03-30 10:59:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce477fc1-fd47-5740-90a4-229aaee97690 with identifier: UZ05424
2026-03-30 10:59:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce477fc1-fd47-5740-90a4-229aaee97690 with identifier: UZ05424 to the API
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:22:37Z',
 'fuel_type': 'diesel',
 'id': 'ce477fc1-fd47-5740-90a4-229aaee97690',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ05424',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 67882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ05424%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Saving data for UZ05424: {'auction_closing_time': 1774884157.0, 'created_time': 1774465813.967316, 'last_price_update_time': 1774868384.728452}
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ05424') HTTP/1.1" 204 0
2026-03-30 10:59:44 [auto1.de] INFO: Found listing with ID: AY40999
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY40999%27 HTTP/1.1" 200 None
2026-03-30 10:59:44 [auto1.de] INFO: Scrape type for AY40999: 2
2026-03-30 10:59:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 495f2792-7a8e-5428-ba58-531800124e3b with identifier: AY40999
2026-03-30 10:59:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 495f2792-7a8e-5428-ba58-531800124e3b with scrape type 2
2026-03-30 10:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 495f2792-7a8e-5428-ba58-531800124e3b with scrape type 2
2026-03-30 10:59:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 495f2792-7a8e-5428-ba58-531800124e3b, identifier: AY40999
2026-03-30 10:59:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 495f2792-7a8e-5428-ba58-531800124e3b with identifier: AY40999
2026-03-30 10:59:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 495f2792-7a8e-5428-ba58-531800124e3b with identifier: AY40999
2026-03-30 10:59:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 495f2792-7a8e-5428-ba58-531800124e3b with identifier: AY40999 to the API
2026-03-30 10:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:00:56Z',
 'fuel_type': 'diesel',
 'id': '495f2792-7a8e-5428-ba58-531800124e3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY40999',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 144829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2017}
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY40999%27 HTTP/1.1" 200 None
2026-03-30 10:59:45 [auto1.de] INFO: Saving data for AY40999: {'auction_closing_time': 1774882856.0, 'created_time': 1774379443.213474, 'last_price_update_time': 1774868385.144469}
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY40999') HTTP/1.1" 204 0
2026-03-30 10:59:45 [auto1.de] INFO: Found listing with ID: FA50226
2026-03-30 10:59:45 [auto1.de] INFO: Found listing with ID: SY89352
2026-03-30 10:59:45 [auto1.de] INFO: Found listing with ID: YE79096
2026-03-30 10:59:45 [auto1.de] INFO: Found listing with ID: XG44569
2026-03-30 10:59:45 [auto1.de] INFO: Found listing with ID: XZ28453
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ28453%27 HTTP/1.1" 200 None
2026-03-30 10:59:45 [auto1.de] INFO: Scrape type for XZ28453: 2
2026-03-30 10:59:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7cd7cd0-aaac-5d43-9852-8ae13effb70e with identifier: XZ28453
2026-03-30 10:59:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7cd7cd0-aaac-5d43-9852-8ae13effb70e with scrape type 2
2026-03-30 10:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7cd7cd0-aaac-5d43-9852-8ae13effb70e with scrape type 2
2026-03-30 10:59:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7cd7cd0-aaac-5d43-9852-8ae13effb70e, identifier: XZ28453
2026-03-30 10:59:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7cd7cd0-aaac-5d43-9852-8ae13effb70e with identifier: XZ28453
2026-03-30 10:59:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7cd7cd0-aaac-5d43-9852-8ae13effb70e with identifier: XZ28453
2026-03-30 10:59:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7cd7cd0-aaac-5d43-9852-8ae13effb70e with identifier: XZ28453 to the API
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:32:14Z',
 'fuel_type': 'diesel',
 'id': 'd7cd7cd0-aaac-5d43-9852-8ae13effb70e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ28453',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 134581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-08',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Multivan Generation Six 4Motion',
 'transmission': 'automatic',
 'trim': 'Multivan Generation Six 4Motion',
 'year': 2017}
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ28453%27 HTTP/1.1" 200 None
2026-03-30 10:59:45 [auto1.de] INFO: Saving data for XZ28453: {'auction_closing_time': 1774884734.0, 'created_time': 1774379056.744329, 'last_price_update_time': 1774868385.913498}
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ28453') HTTP/1.1" 204 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: EE17704
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: TU83885
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU83885%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for TU83885: 2
2026-03-30 10:59:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 494a889c-62bf-57d5-8125-d0ac8bc1ed9e with identifier: TU83885
2026-03-30 10:59:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 494a889c-62bf-57d5-8125-d0ac8bc1ed9e with scrape type 2
2026-03-30 10:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 494a889c-62bf-57d5-8125-d0ac8bc1ed9e with scrape type 2
2026-03-30 10:59:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 494a889c-62bf-57d5-8125-d0ac8bc1ed9e, identifier: TU83885
2026-03-30 10:59:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 494a889c-62bf-57d5-8125-d0ac8bc1ed9e with identifier: TU83885
2026-03-30 10:59:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 494a889c-62bf-57d5-8125-d0ac8bc1ed9e with identifier: TU83885
2026-03-30 10:59:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 494a889c-62bf-57d5-8125-d0ac8bc1ed9e with identifier: TU83885 to the API
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:49:57Z',
 'fuel_type': 'petrol',
 'id': '494a889c-62bf-57d5-8125-d0ac8bc1ed9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU83885',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 228422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-06',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TSI Comfortline lang',
 'transmission': 'automatic',
 'trim': 'Comfortline lang',
 'year': 2018}
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU83885%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Saving data for TU83885: {'auction_closing_time': 1774885797.0, 'created_time': 1773380838.095643, 'last_price_update_time': 1774868386.40294}
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU83885') HTTP/1.1" 204 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: ZU14307
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU14307%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for ZU14307: 2
2026-03-30 10:59:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e9e5cd9-d6fe-5ade-98ba-3e5ddbff171b with identifier: ZU14307
2026-03-30 10:59:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e9e5cd9-d6fe-5ade-98ba-3e5ddbff171b with scrape type 2
2026-03-30 10:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e9e5cd9-d6fe-5ade-98ba-3e5ddbff171b with scrape type 2
2026-03-30 10:59:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e9e5cd9-d6fe-5ade-98ba-3e5ddbff171b, identifier: ZU14307
2026-03-30 10:59:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e9e5cd9-d6fe-5ade-98ba-3e5ddbff171b with identifier: ZU14307
2026-03-30 10:59:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e9e5cd9-d6fe-5ade-98ba-3e5ddbff171b with identifier: ZU14307
2026-03-30 10:59:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e9e5cd9-d6fe-5ade-98ba-3e5ddbff171b with identifier: ZU14307 to the API
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:49Z',
 'fuel_type': 'diesel',
 'id': '3e9e5cd9-d6fe-5ade-98ba-3e5ddbff171b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU14307',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 81461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-03',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU14307%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Saving data for ZU14307: {'auction_closing_time': 1774884229.0, 'created_time': 1773831103.484913, 'last_price_update_time': 1774868386.829809}
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU14307') HTTP/1.1" 204 0
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: WT63610
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: GD86800
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: MT90206
2026-03-30 10:59:46 [auto1.de] INFO: Found listing with ID: EH26353
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH26353%27 HTTP/1.1" 200 None
2026-03-30 10:59:46 [auto1.de] INFO: Scrape type for EH26353: 2
2026-03-30 10:59:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19a0eafb-7f20-599e-9ee4-63552a59b5a5 with identifier: EH26353
2026-03-30 10:59:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19a0eafb-7f20-599e-9ee4-63552a59b5a5 with scrape type 2
2026-03-30 10:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19a0eafb-7f20-599e-9ee4-63552a59b5a5 with scrape type 2
2026-03-30 10:59:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19a0eafb-7f20-599e-9ee4-63552a59b5a5, identifier: EH26353
2026-03-30 10:59:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19a0eafb-7f20-599e-9ee4-63552a59b5a5 with identifier: EH26353
2026-03-30 10:59:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19a0eafb-7f20-599e-9ee4-63552a59b5a5 with identifier: EH26353
2026-03-30 10:59:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19a0eafb-7f20-599e-9ee4-63552a59b5a5 with identifier: EH26353 to the API
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:51:43Z',
 'fuel_type': 'petrol',
 'id': '19a0eafb-7f20-599e-9ee4-63552a59b5a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH26353',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 32387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-24',
 'seller_name': None,
 'title': 'Audi A3 Limousine 35 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH26353%27 HTTP/1.1" 200 None
2026-03-30 10:59:47 [auto1.de] INFO: Saving data for EH26353: {'auction_closing_time': 1774885903.0, 'created_time': 1773380586.550223, 'last_price_update_time': 1774868387.251879}
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH26353') HTTP/1.1" 204 0
2026-03-30 10:59:47 [auto1.de] INFO: Found listing with ID: TU83793
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU83793%27 HTTP/1.1" 200 None
2026-03-30 10:59:47 [auto1.de] INFO: Scrape type for TU83793: 2
2026-03-30 10:59:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 281514de-9464-560f-9eff-f973e58c2390 with identifier: TU83793
2026-03-30 10:59:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 281514de-9464-560f-9eff-f973e58c2390 with scrape type 2
2026-03-30 10:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 281514de-9464-560f-9eff-f973e58c2390 with scrape type 2
2026-03-30 10:59:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 281514de-9464-560f-9eff-f973e58c2390, identifier: TU83793
2026-03-30 10:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 281514de-9464-560f-9eff-f973e58c2390 with identifier: TU83793
2026-03-30 10:59:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 281514de-9464-560f-9eff-f973e58c2390 with identifier: TU83793
2026-03-30 10:59:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 281514de-9464-560f-9eff-f973e58c2390 with identifier: TU83793 to the API
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:00:55Z',
 'fuel_type': 'diesel',
 'id': '281514de-9464-560f-9eff-f973e58c2390',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU83793',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 188594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-27',
 'seller_name': None,
 'title': 'BMW 6er 640d Gran Coupé xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU83793%27 HTTP/1.1" 200 None
2026-03-30 10:59:47 [auto1.de] INFO: Saving data for TU83793: {'auction_closing_time': 1774882855.0, 'created_time': 1774034893.524327, 'last_price_update_time': 1774868387.695368}
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU83793') HTTP/1.1" 204 0
2026-03-30 10:59:47 [auto1.de] INFO: Found listing with ID: FL70928
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL70928%27 HTTP/1.1" 200 None
2026-03-30 10:59:47 [auto1.de] INFO: Scrape type for FL70928: 2
2026-03-30 10:59:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d9f80fc-e69c-57f8-a3cb-01d28456e344 with identifier: FL70928
2026-03-30 10:59:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d9f80fc-e69c-57f8-a3cb-01d28456e344 with scrape type 2
2026-03-30 10:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d9f80fc-e69c-57f8-a3cb-01d28456e344 with scrape type 2
2026-03-30 10:59:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d9f80fc-e69c-57f8-a3cb-01d28456e344, identifier: FL70928
2026-03-30 10:59:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d9f80fc-e69c-57f8-a3cb-01d28456e344 with identifier: FL70928
2026-03-30 10:59:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d9f80fc-e69c-57f8-a3cb-01d28456e344 with identifier: FL70928
2026-03-30 10:59:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d9f80fc-e69c-57f8-a3cb-01d28456e344 with identifier: FL70928 to the API
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 10:59:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 10:59:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-30T15:28:23Z',
 'fuel_type': 'diesel',
 'id': '8d9f80fc-e69c-57f8-a3cb-01d28456e344',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL70928',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Defender',
 'odometer': 104410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-08',
 'seller_name': None,
 'title': 'Land Rover Defender D240 110 SE',
 'transmission': 'automatic',
 'trim': '110 SE',
 'year': 2020}
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL70928%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Saving data for FL70928: {'auction_closing_time': 1774884503.0, 'created_time': 1774550382.532324, 'last_price_update_time': 1774868388.079923}
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL70928') HTTP/1.1" 204 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: PY62114
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY62114%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for PY62114: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU61192%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for ZU61192: 0
2026-03-30 10:59:48 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 9554 | hits on page: 40
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: YG24433
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG24433%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for YG24433: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: RK19274
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK19274%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for RK19274: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: XP45109
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP45109%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for XP45109: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: UB06797
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB06797%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for UB06797: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: BM44177
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM44177%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for BM44177: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: TK71200
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: EZ46252
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: AK88220
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK88220%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for AK88220: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: DN40523
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: XJ45397
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: UP49415
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP49415%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for UP49415: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: TZ55203
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ55203%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for TZ55203: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: XW83383
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW83383%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for XW83383: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: NR32079
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: ST09245
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST09245%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for ST09245: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: DN59974
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN59974%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for DN59974: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: TM91896
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM91896%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for TM91896: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: TH47484
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH47484%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for TH47484: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: PD79431
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: GZ01520
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: TK97766
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK97766%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for TK97766: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: RS30445
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: VN22748
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: BK28670
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: AK90767
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: TB02108
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: YC23372
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: GB27698
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: LN26385
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN26385%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for LN26385: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: WA11944
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: VA77092
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: SR72775
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR72775%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for SR72775: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: JZ29670
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ29670%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for JZ29670: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: LW90225
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: LJ23138
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ23138%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for LJ23138: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: ZA27483
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ47534%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for VZ47534: 0
2026-03-30 10:59:48 [auto1.de] INFO: Found listing with ID: HY14352
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY14352%27 HTTP/1.1" 200 None
2026-03-30 10:59:48 [auto1.de] INFO: Scrape type for HY14352: 0
2026-03-30 10:59:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:49 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 9554 | hits on page: 40
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: XM73112
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: JD41613
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD41613%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for JD41613: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA70059%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for EA70059: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: VY06306
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY06306%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for VY06306: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: RP66782
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: RW76455
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: RC29911
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: VL48750
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: CZ70893
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ70893%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for CZ70893: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: HC32133
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC32133%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for HC32133: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: WC25701
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: RS41901
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: YC02535
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: CW57830
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: XB95476
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB95476%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for XB95476: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: HK91051
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK91051%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for HK91051: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: TW01944
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: RN71628
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN71628%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for RN71628: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: UV60068
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV60068%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for UV60068: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: YW93482
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW93482%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for YW93482: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: CJ85818
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ85818%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for CJ85818: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: KF64937
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: CM64848
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM64848%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for CM64848: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: MW29670
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW29670%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for MW29670: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: RC86966
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86966%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for RC86966: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: XW48128
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: KL19595
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: WS77403
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY40136%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for TY40136: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: YV77496
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: SP96872
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96872%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for SP96872: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: BG00548
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG00548%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for BG00548: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: FN44778
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN44778%27 HTTP/1.1" 200 None
2026-03-30 10:59:49 [auto1.de] INFO: Scrape type for FN44778: 0
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-30 10:59:49 [auto1.de] INFO: Found listing with ID: CG08693
2026-03-30 10:59:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:50 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 9555 | hits on page: 40
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: CG08693
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD51854%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for MD51854: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE88330%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for ZE88330: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: LG10256
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ47162%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for EZ47162: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: XY85959
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY85959%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for XY85959: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: YB72786
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB72786%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for YB72786: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: YL95361
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX80950%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for TX80950: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: RM28884
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28884%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for RM28884: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ79239%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for WJ79239: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80734%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for FD80734: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: HA68744
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA68744%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for HA68744: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV13799%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for PV13799: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT54414%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for NT54414: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: RY86630
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: CU91826
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE98096%27 HTTP/1.1" 200 None
2026-03-30 10:59:50 [auto1.de] INFO: Scrape type for RE98096: 0
2026-03-30 10:59:50 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR00588%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for JR00588: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: YY17846
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU42318%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for RU42318: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ91725%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for BZ91725: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK06472%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for CK06472: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: AS80209
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS80209%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for AS80209: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: NB79280
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: AP67523
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP67523%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for AP67523: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: TF22102
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ86823%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for SJ86823: 0
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-30 10:59:51 [auto1.de] INFO: Found listing with ID: JL43427
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL43427%27 HTTP/1.1" 200 None
2026-03-30 10:59:51 [auto1.de] INFO: Scrape type for JL43427: 0
2026-03-30 10:59:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:52 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 9555 | hits on page: 40
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: LF77567
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: DX27890
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX27890%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for DX27890: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: VJ93938
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN60754%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for AN60754: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: JF12446
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: NH81971
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: PU44230
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: MA20018
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: SU19428
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: UW74525
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: CP06642
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: EH70293
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH70293%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for EH70293: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: NR97756
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR97756%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for NR97756: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: YX40073
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: LC05735
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: VH46900
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: AW14620
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: ZN75041
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: JX06129
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX06129%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for JX06129: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: XV57552
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV57552%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for XV57552: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: UW93361
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: YY00897
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: DE21080
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: ZP65093
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: JN49232
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: WX35600
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX35600%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for WX35600: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82983%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for MH82983: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF56561%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for DF56561: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: WV35399
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV35399%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for WV35399: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: ZT07846
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: MM39918
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM39918%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for MM39918: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: AF95202
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF95202%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for AF95202: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: YJ88627
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ88627%27 HTTP/1.1" 200 None
2026-03-30 10:59:52 [auto1.de] INFO: Scrape type for YJ88627: 0
2026-03-30 10:59:52 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-30 10:59:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:53 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 9555 | hits on page: 40
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: XV17111
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV17111%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for XV17111: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01319%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for DV01319: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW76820%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for EW76820: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK52723%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for JK52723: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: GJ78269
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR38931%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for GR38931: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS91363%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for FS91363: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: AZ86702
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ86702%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for AZ86702: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39968%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for ZR39968: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: EU39655
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: RV72867
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: XT69734
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: PL85371
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL85371%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for PL85371: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: TZ11746
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: XF01324
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: UP89204
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL35659%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for SL35659: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17165%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for GJ17165: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: ZK08136
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF37611%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for VF37611: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU15284%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for ZU15284: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: VH01397
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH01397%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for VH01397: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: VG22194
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR30493%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for UR30493: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: FD54213
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD54213%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for FD54213: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: JY95314
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY95314%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for JY95314: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: JT90882
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: ZR98160
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR98160%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for ZR98160: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM33807%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for AM33807: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: MG97845
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG97845%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for MG97845: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: UM62946
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM62946%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for UM62946: 0
2026-03-30 10:59:53 [auto1.de] INFO: Found listing with ID: EN76399
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN76399%27 HTTP/1.1" 200 None
2026-03-30 10:59:53 [auto1.de] INFO: Scrape type for EN76399: 0
2026-03-30 10:59:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:54 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 9555 | hits on page: 40
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL40632%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for CL40632: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: YZ27957
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: GA63896
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: TW27373
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW27373%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for TW27373: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: PR12496
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR12496%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for PR12496: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY00065%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for PY00065: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ75916%27 HTTP/1.1" 200 None
2026-03-30 10:59:54 [auto1.de] INFO: Scrape type for HZ75916: 0
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-30 10:59:54 [auto1.de] INFO: Found listing with ID: DD41075
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD41075%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for DD41075: 0
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL75204%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for VL75204: 0
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: XR19518
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY40414%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for JY40414: 0
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG80613%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for KG80613: 0
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81159%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for RB81159: 0
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: FE98948
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM43405%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for KM43405: 0
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: UK22592
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: JM01437
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM01437%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for JM01437: 0
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF03838%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for YF03838: 0
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL60178%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for CL60178: 0
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: AH10770
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH10770%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for AH10770: 0
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: PW13353
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE40777%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for GE40777: 0
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: JG07802
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: TA43023
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA43023%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for TA43023: 0
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: RC29433
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: LP47085
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP47085%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for LP47085: 0
2026-03-30 10:59:55 [auto1.de] INFO: Found listing with ID: VD46825
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD46825%27 HTTP/1.1" 200 None
2026-03-30 10:59:55 [auto1.de] INFO: Scrape type for VD46825: 0
2026-03-30 10:59:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:56 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 9555 | hits on page: 40
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: YE68062
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: MP83511
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP83511%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for MP83511: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: FV18032
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: AK95286
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK95286%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for AK95286: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG50197%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for JG50197: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH92207%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for XH92207: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: JA02220
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: AX71998
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX71998%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for AX71998: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN72943%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for MN72943: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH87632%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for PH87632: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47334%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for NT47334: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK51297%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for DK51297: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: AV07522
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV07522%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for AV07522: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA25327%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for ZA25327: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: YE47766
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE47766%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for YE47766: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: AY52280
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: ST92465
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST92465%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for ST92465: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: EY37424
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: MT94431
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: ZF33601
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF33601%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for ZF33601: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: BP69387
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69387%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for BP69387: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: PF83814
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF83814%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for PF83814: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: PS96844
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: DH90644
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: UX35771
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX35771%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for UX35771: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: LC73868
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC73868%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for LC73868: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: JX17903
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: YE89715
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE89715%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for YE89715: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: NX25429
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: FB30616
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: PZ87651
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ87651%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for PZ87651: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: WR49956
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR49956%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for WR49956: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: EU48519
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU48519%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for EU48519: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: EM09444
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: HS59554
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS59554%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for HS59554: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: VU90894
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU90894%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for VU90894: 0
2026-03-30 10:59:56 [auto1.de] INFO: Found listing with ID: AL66084
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL66084%27 HTTP/1.1" 200 None
2026-03-30 10:59:56 [auto1.de] INFO: Scrape type for AL66084: 0
2026-03-30 10:59:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:57 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 9555 | hits on page: 40
2026-03-30 10:59:57 [auto1.de] INFO: Found listing with ID: WF31027
2026-03-30 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31027%27 HTTP/1.1" 200 None
2026-03-30 10:59:57 [auto1.de] INFO: Scrape type for WF31027: 0
2026-03-30 10:59:57 [auto1.de] INFO: Found listing with ID: KJ73179
2026-03-30 10:59:57 [auto1.de] INFO: Found listing with ID: VM07579
2026-03-30 10:59:57 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-30 10:59:57 [auto1.de] INFO: Found listing with ID: UZ89172
2026-03-30 10:59:57 [auto1.de] INFO: Found listing with ID: EF06925
2026-03-30 10:59:57 [auto1.de] INFO: Found listing with ID: KR46332
2026-03-30 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR46332%27 HTTP/1.1" 200 None
2026-03-30 10:59:57 [auto1.de] INFO: Scrape type for KR46332: 0
2026-03-30 10:59:57 [auto1.de] INFO: Found listing with ID: UE56505
2026-03-30 10:59:57 [auto1.de] INFO: Found listing with ID: YS85982
2026-03-30 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85982%27 HTTP/1.1" 200 None
2026-03-30 10:59:57 [auto1.de] INFO: Scrape type for YS85982: 0
2026-03-30 10:59:57 [auto1.de] INFO: Found listing with ID: KC50337
2026-03-30 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC50337%27 HTTP/1.1" 200 None
2026-03-30 10:59:57 [auto1.de] INFO: Scrape type for KC50337: 0
2026-03-30 10:59:57 [auto1.de] INFO: Found listing with ID: TR93945
2026-03-30 10:59:57 [auto1.de] INFO: Found listing with ID: EP14807
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP14807%27 HTTP/1.1" 200 None
2026-03-30 10:59:58 [auto1.de] INFO: Scrape type for EP14807: 0
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: XG49869
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG49869%27 HTTP/1.1" 200 None
2026-03-30 10:59:58 [auto1.de] INFO: Scrape type for XG49869: 0
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: ZW53829
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW53829%27 HTTP/1.1" 200 None
2026-03-30 10:59:58 [auto1.de] INFO: Scrape type for ZW53829: 0
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: UF10359
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: CE58616
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE58616%27 HTTP/1.1" 200 None
2026-03-30 10:59:58 [auto1.de] INFO: Scrape type for CE58616: 0
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: KS98119
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS98119%27 HTTP/1.1" 200 None
2026-03-30 10:59:58 [auto1.de] INFO: Scrape type for KS98119: 0
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: HW05295
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW05295%27 HTTP/1.1" 200 None
2026-03-30 10:59:58 [auto1.de] INFO: Scrape type for HW05295: 0
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: BN60503
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: BG41279
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: DK12229
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK12229%27 HTTP/1.1" 200 None
2026-03-30 10:59:58 [auto1.de] INFO: Scrape type for DK12229: 0
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: ND89828
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: YB47390
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB47390%27 HTTP/1.1" 200 None
2026-03-30 10:59:58 [auto1.de] INFO: Scrape type for YB47390: 0
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: VX00455
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX00455%27 HTTP/1.1" 200 None
2026-03-30 10:59:58 [auto1.de] INFO: Scrape type for VX00455: 0
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: VW07399
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW07399%27 HTTP/1.1" 200 None
2026-03-30 10:59:58 [auto1.de] INFO: Scrape type for VW07399: 0
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: SZ67140
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ67140%27 HTTP/1.1" 200 None
2026-03-30 10:59:58 [auto1.de] INFO: Scrape type for SZ67140: 0
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: CK62820
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: HT40242
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT40242%27 HTTP/1.1" 200 None
2026-03-30 10:59:58 [auto1.de] INFO: Scrape type for HT40242: 0
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: FC82221
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: MF60875
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: KT60854
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: AC96507
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC96507%27 HTTP/1.1" 200 None
2026-03-30 10:59:58 [auto1.de] INFO: Scrape type for AC96507: 0
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: YS65782
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS65782%27 HTTP/1.1" 200 None
2026-03-30 10:59:58 [auto1.de] INFO: Scrape type for YS65782: 0
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: MG42603
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: FK12887
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: ZU40023
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU40023%27 HTTP/1.1" 200 None
2026-03-30 10:59:58 [auto1.de] INFO: Scrape type for ZU40023: 0
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: CH93645
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE55813%27 HTTP/1.1" 200 None
2026-03-30 10:59:58 [auto1.de] INFO: Scrape type for PE55813: 0
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: JP33538
2026-03-30 10:59:58 [auto1.de] INFO: Found listing with ID: YT05280
2026-03-30 10:59:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 10:59:59 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 9556 | hits on page: 40
2026-03-30 10:59:59 [auto1.de] INFO: Found listing with ID: YT05280
2026-03-30 10:59:59 [auto1.de] INFO: Found listing with ID: RF07068
2026-03-30 10:59:59 [auto1.de] INFO: Found listing with ID: MU49508
2026-03-30 10:59:59 [auto1.de] INFO: Found listing with ID: KD86114
2026-03-30 10:59:59 [auto1.de] INFO: Found listing with ID: AY96814
2026-03-30 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY96814%27 HTTP/1.1" 200 None
2026-03-30 10:59:59 [auto1.de] INFO: Scrape type for AY96814: 0
2026-03-30 10:59:59 [auto1.de] INFO: Found listing with ID: EF75873
2026-03-30 10:59:59 [auto1.de] INFO: Found listing with ID: HZ55109
2026-03-30 10:59:59 [auto1.de] INFO: Found listing with ID: UR98067
2026-03-30 10:59:59 [auto1.de] INFO: Found listing with ID: PT29857
2026-03-30 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT29857%27 HTTP/1.1" 200 None
2026-03-30 10:59:59 [auto1.de] INFO: Scrape type for PT29857: 0
2026-03-30 10:59:59 [auto1.de] INFO: Found listing with ID: CX74060
2026-03-30 10:59:59 [auto1.de] INFO: Found listing with ID: LA18154
2026-03-30 10:59:59 [auto1.de] INFO: Found listing with ID: WA25791
2026-03-30 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA25791%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for WA25791: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: LN99770
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN99770%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for LN99770: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: NK17990
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK17990%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for NK17990: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: CY43451
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY43451%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for CY43451: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: ZX96561
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX96561%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for ZX96561: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: LX79709
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX79709%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for LX79709: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: KC50640
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC50640%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for KC50640: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: VR60747
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR60747%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for VR60747: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: SZ06147
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ06147%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for SZ06147: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: CW95568
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: NV70278
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV70278%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for NV70278: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: ZL59344
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL59344%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for ZL59344: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: GD26044
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: EE96817
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: NH06338
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: DS59005
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59005%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for DS59005: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: MF86039
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: JV48558
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV48558%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for JV48558: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: SJ64604
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: LH54346
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH54346%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for LH54346: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: DT57257
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: VT63649
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: JX79740
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: FR69109
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: BS19118
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: JX21647
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX21647%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for JX21647: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: VU30885
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU30885%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for VU30885: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: MM90627
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM90627%27 HTTP/1.1" 200 None
2026-03-30 11:00:00 [auto1.de] INFO: Scrape type for MM90627: 0
2026-03-30 11:00:00 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-30 11:00:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:01 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 9556 | hits on page: 40
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: SL92984
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: GH39731
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: JG03809
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG03809%27 HTTP/1.1" 200 None
2026-03-30 11:00:01 [auto1.de] INFO: Scrape type for JG03809: 0
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: NV30450
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: SN42334
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: ZW50012
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: YV85598
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV85598%27 HTTP/1.1" 200 None
2026-03-30 11:00:01 [auto1.de] INFO: Scrape type for YV85598: 0
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: LE50284
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE50284%27 HTTP/1.1" 200 None
2026-03-30 11:00:01 [auto1.de] INFO: Scrape type for LE50284: 0
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: AB49133
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: FN52751
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN52751%27 HTTP/1.1" 200 None
2026-03-30 11:00:01 [auto1.de] INFO: Scrape type for FN52751: 0
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: KB67170
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: SC23766
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC23766%27 HTTP/1.1" 200 None
2026-03-30 11:00:01 [auto1.de] INFO: Scrape type for SC23766: 0
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: CL73395
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL73395%27 HTTP/1.1" 200 None
2026-03-30 11:00:01 [auto1.de] INFO: Scrape type for CL73395: 0
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: ZU96971
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU96971%27 HTTP/1.1" 200 None
2026-03-30 11:00:01 [auto1.de] INFO: Scrape type for ZU96971: 0
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: KF93262
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: BP80209
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: FR18143
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: FP56300
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP56300%27 HTTP/1.1" 200 None
2026-03-30 11:00:01 [auto1.de] INFO: Scrape type for FP56300: 0
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: WF13702
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: DU56840
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU56840%27 HTTP/1.1" 200 None
2026-03-30 11:00:01 [auto1.de] INFO: Scrape type for DU56840: 0
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: HJ42862
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ42862%27 HTTP/1.1" 200 None
2026-03-30 11:00:01 [auto1.de] INFO: Scrape type for HJ42862: 0
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: HH06006
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: LU46217
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: NC63257
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC63257%27 HTTP/1.1" 200 None
2026-03-30 11:00:01 [auto1.de] INFO: Scrape type for NC63257: 0
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: HA49497
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA49497%27 HTTP/1.1" 200 None
2026-03-30 11:00:01 [auto1.de] INFO: Scrape type for HA49497: 0
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: GN25688
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN25688%27 HTTP/1.1" 200 None
2026-03-30 11:00:01 [auto1.de] INFO: Scrape type for GN25688: 0
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: DC32299
2026-03-30 11:00:01 [auto1.de] INFO: Found listing with ID: SD24294
2026-03-30 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD24294%27 HTTP/1.1" 200 None
2026-03-30 11:00:02 [auto1.de] INFO: Scrape type for SD24294: 0
2026-03-30 11:00:02 [auto1.de] INFO: Found listing with ID: JY97697
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY97697%27 HTTP/1.1" 200 None
2026-03-30 11:00:02 [auto1.de] INFO: Scrape type for JY97697: 0
2026-03-30 11:00:02 [auto1.de] INFO: Found listing with ID: ZM10504
2026-03-30 11:00:02 [auto1.de] INFO: Found listing with ID: NA60022
2026-03-30 11:00:02 [auto1.de] INFO: Found listing with ID: CH24864
2026-03-30 11:00:02 [auto1.de] INFO: Found listing with ID: GX79735
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX79735%27 HTTP/1.1" 200 None
2026-03-30 11:00:02 [auto1.de] INFO: Scrape type for GX79735: 0
2026-03-30 11:00:02 [auto1.de] INFO: Found listing with ID: ZY33636
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY33636%27 HTTP/1.1" 200 None
2026-03-30 11:00:02 [auto1.de] INFO: Scrape type for ZY33636: 0
2026-03-30 11:00:02 [auto1.de] INFO: Found listing with ID: HJ92241
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ92241%27 HTTP/1.1" 200 None
2026-03-30 11:00:02 [auto1.de] INFO: Scrape type for HJ92241: 0
2026-03-30 11:00:02 [auto1.de] INFO: Found listing with ID: FL18278
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL18278%27 HTTP/1.1" 200 None
2026-03-30 11:00:02 [auto1.de] INFO: Scrape type for FL18278: 0
2026-03-30 11:00:02 [auto1.de] INFO: Found listing with ID: TE81012
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE81012%27 HTTP/1.1" 200 None
2026-03-30 11:00:02 [auto1.de] INFO: Scrape type for TE81012: 0
2026-03-30 11:00:02 [auto1.de] INFO: Found listing with ID: CG37224
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37224%27 HTTP/1.1" 200 None
2026-03-30 11:00:02 [auto1.de] INFO: Scrape type for CG37224: 0
2026-03-30 11:00:02 [auto1.de] INFO: Found listing with ID: BE55111
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE55111%27 HTTP/1.1" 200 None
2026-03-30 11:00:02 [auto1.de] INFO: Scrape type for BE55111: 0
2026-03-30 11:00:02 [auto1.de] INFO: Found listing with ID: VN71215
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN71215%27 HTTP/1.1" 200 None
2026-03-30 11:00:02 [auto1.de] INFO: Scrape type for VN71215: 0
2026-03-30 11:00:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:03 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 9556 | hits on page: 40
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: LV65947
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV65947%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for LV65947: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: FY57331
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57331%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for FY57331: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: GS42870
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS42870%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for GS42870: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: MT54263
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT54263%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for MT54263: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: AK26500
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: ZZ49081
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ49081%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for ZZ49081: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: JL32962
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY35476%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for GY35476: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: UN88738
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: TV18525
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: GB49809
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB49809%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for GB49809: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: LT85175
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT85175%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for LT85175: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: ZL07582
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: MU81714
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: PW12377
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: RD52099
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: LX33649
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX33649%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for LX33649: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: CX30934
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: KT37105
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: NT69326
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT69326%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for NT69326: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: MP45750
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP45750%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for MP45750: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: BS14329
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14329%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for BS14329: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: HW62804
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW62804%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for HW62804: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: BS91998
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS91998%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for BS91998: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: WW27591
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27591%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for WW27591: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: SS07399
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: ZM46839
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM46839%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for ZM46839: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: PL16151
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL16151%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for PL16151: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: GT44390
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT44390%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for GT44390: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: NK02034
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK02034%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for NK02034: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: RR54011
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: PN39432
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN39432%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for PN39432: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: XB31619
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB31619%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for XB31619: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: YA55481
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA55481%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for YA55481: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: KP96972
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX41654%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for GX41654: 0
2026-03-30 11:00:03 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW18163%27 HTTP/1.1" 200 None
2026-03-30 11:00:03 [auto1.de] INFO: Scrape type for LW18163: 0
2026-03-30 11:00:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:03 [scrapy.extensions.logstats] INFO: Crawled 795 pages (at 15 pages/min), scraped 1137 items (at 85 items/min)
2026-03-30 11:00:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:04 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 9556 | hits on page: 40
2026-03-30 11:00:04 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-30 11:00:04 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-30 11:00:04 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-30 11:00:04 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-30 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP30050%27 HTTP/1.1" 200 None
2026-03-30 11:00:04 [auto1.de] INFO: Scrape type for EP30050: 0
2026-03-30 11:00:04 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-30 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ56711%27 HTTP/1.1" 200 None
2026-03-30 11:00:04 [auto1.de] INFO: Scrape type for DJ56711: 0
2026-03-30 11:00:04 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-30 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG96584%27 HTTP/1.1" 200 None
2026-03-30 11:00:04 [auto1.de] INFO: Scrape type for TG96584: 0
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC23376%27 HTTP/1.1" 200 None
2026-03-30 11:00:05 [auto1.de] INFO: Scrape type for RC23376: 0
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: BM86036
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM86036%27 HTTP/1.1" 200 None
2026-03-30 11:00:05 [auto1.de] INFO: Scrape type for BM86036: 0
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP45840%27 HTTP/1.1" 200 None
2026-03-30 11:00:05 [auto1.de] INFO: Scrape type for BP45840: 0
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA63852%27 HTTP/1.1" 200 None
2026-03-30 11:00:05 [auto1.de] INFO: Scrape type for FA63852: 0
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL79995%27 HTTP/1.1" 200 None
2026-03-30 11:00:05 [auto1.de] INFO: Scrape type for FL79995: 0
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35466%27 HTTP/1.1" 200 None
2026-03-30 11:00:05 [auto1.de] INFO: Scrape type for RD35466: 0
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM92730%27 HTTP/1.1" 200 None
2026-03-30 11:00:05 [auto1.de] INFO: Scrape type for PM92730: 0
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS01373%27 HTTP/1.1" 200 None
2026-03-30 11:00:05 [auto1.de] INFO: Scrape type for TS01373: 0
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK60410%27 HTTP/1.1" 200 None
2026-03-30 11:00:05 [auto1.de] INFO: Scrape type for SK60410: 0
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH64312%27 HTTP/1.1" 200 None
2026-03-30 11:00:05 [auto1.de] INFO: Scrape type for FH64312: 0
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST88871%27 HTTP/1.1" 200 None
2026-03-30 11:00:05 [auto1.de] INFO: Scrape type for ST88871: 0
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH96137%27 HTTP/1.1" 200 None
2026-03-30 11:00:05 [auto1.de] INFO: Scrape type for KH96137: 0
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX41895%27 HTTP/1.1" 200 None
2026-03-30 11:00:05 [auto1.de] INFO: Scrape type for VX41895: 0
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV12841%27 HTTP/1.1" 200 None
2026-03-30 11:00:05 [auto1.de] INFO: Scrape type for GV12841: 0
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE37865%27 HTTP/1.1" 200 None
2026-03-30 11:00:05 [auto1.de] INFO: Scrape type for BE37865: 0
2026-03-30 11:00:05 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN51683%27 HTTP/1.1" 200 None
2026-03-30 11:00:05 [auto1.de] INFO: Scrape type for HN51683: 0
2026-03-30 11:00:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:06 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 9556 | hits on page: 40
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML63417%27 HTTP/1.1" 200 None
2026-03-30 11:00:06 [auto1.de] INFO: Scrape type for ML63417: 0
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP71706%27 HTTP/1.1" 200 None
2026-03-30 11:00:06 [auto1.de] INFO: Scrape type for FP71706: 0
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU02977%27 HTTP/1.1" 200 None
2026-03-30 11:00:06 [auto1.de] INFO: Scrape type for RU02977: 0
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW26653%27 HTTP/1.1" 200 None
2026-03-30 11:00:06 [auto1.de] INFO: Scrape type for RW26653: 0
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ23740%27 HTTP/1.1" 200 None
2026-03-30 11:00:06 [auto1.de] INFO: Scrape type for AZ23740: 0
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY72717%27 HTTP/1.1" 200 None
2026-03-30 11:00:06 [auto1.de] INFO: Scrape type for ZY72717: 0
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN42254%27 HTTP/1.1" 200 None
2026-03-30 11:00:06 [auto1.de] INFO: Scrape type for MN42254: 0
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF81751%27 HTTP/1.1" 200 None
2026-03-30 11:00:06 [auto1.de] INFO: Scrape type for GF81751: 0
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS01911%27 HTTP/1.1" 200 None
2026-03-30 11:00:06 [auto1.de] INFO: Scrape type for GS01911: 0
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04147%27 HTTP/1.1" 200 None
2026-03-30 11:00:06 [auto1.de] INFO: Scrape type for UV04147: 0
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN93492%27 HTTP/1.1" 200 None
2026-03-30 11:00:06 [auto1.de] INFO: Scrape type for JN93492: 0
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08614%27 HTTP/1.1" 200 None
2026-03-30 11:00:06 [auto1.de] INFO: Scrape type for AJ08614: 0
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH31418%27 HTTP/1.1" 200 None
2026-03-30 11:00:06 [auto1.de] INFO: Scrape type for KH31418: 0
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: UY73943
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ86247%27 HTTP/1.1" 200 None
2026-03-30 11:00:06 [auto1.de] INFO: Scrape type for KJ86247: 0
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF22062%27 HTTP/1.1" 200 None
2026-03-30 11:00:06 [auto1.de] INFO: Scrape type for AF22062: 0
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS27718%27 HTTP/1.1" 200 None
2026-03-30 11:00:06 [auto1.de] INFO: Scrape type for XS27718: 0
2026-03-30 11:00:06 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-30 11:00:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:07 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 9556 | hits on page: 40
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH59067%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for FH59067: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ30839%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for YJ30839: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD68188%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for BD68188: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU87810%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for VU87810: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU83359%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for MU83359: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: FA27220
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA27220%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for FA27220: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81106%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for YS81106: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN35762%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for HN35762: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD63054%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for TD63054: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS51511%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for WS51511: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: NR54362
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR54362%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for NR54362: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU72162%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for PU72162: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA55761%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for BA55761: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48993%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for WP48993: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU40538%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for BU40538: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS95970%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for LS95970: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ26621%27 HTTP/1.1" 200 None
2026-03-30 11:00:07 [auto1.de] INFO: Scrape type for GJ26621: 0
2026-03-30 11:00:07 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-30 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT21278%27 HTTP/1.1" 200 None
2026-03-30 11:00:08 [auto1.de] INFO: Scrape type for KT21278: 0
2026-03-30 11:00:08 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-30 11:00:08 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-30 11:00:08 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-30 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ75608%27 HTTP/1.1" 200 None
2026-03-30 11:00:08 [auto1.de] INFO: Scrape type for ZZ75608: 0
2026-03-30 11:00:08 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-30 11:00:08 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-30 11:00:08 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-30 11:00:08 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-30 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86421%27 HTTP/1.1" 200 None
2026-03-30 11:00:08 [auto1.de] INFO: Scrape type for PC86421: 0
2026-03-30 11:00:08 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-30 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB76223%27 HTTP/1.1" 200 None
2026-03-30 11:00:08 [auto1.de] INFO: Scrape type for NB76223: 0
2026-03-30 11:00:08 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-30 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT11127%27 HTTP/1.1" 200 None
2026-03-30 11:00:08 [auto1.de] INFO: Scrape type for WT11127: 0
2026-03-30 11:00:08 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-30 11:00:08 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-30 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42521%27 HTTP/1.1" 200 None
2026-03-30 11:00:08 [auto1.de] INFO: Scrape type for BZ42521: 0
2026-03-30 11:00:08 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-30 11:00:08 [auto1.de] INFO: Found listing with ID: UV10868
2026-03-30 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV10868%27 HTTP/1.1" 200 None
2026-03-30 11:00:08 [auto1.de] INFO: Scrape type for UV10868: 0
2026-03-30 11:00:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:09 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 9556 | hits on page: 40
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY81856%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for NY81856: 0
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55546%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for SY55546: 0
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ74816%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for ZZ74816: 0
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA10723%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for PA10723: 0
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP43844%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for RP43844: 0
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD55328%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for YD55328: 0
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT27249%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for UT27249: 0
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG27498%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for WG27498: 0
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: JV22464
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: GY48177
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ71304%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for ZZ71304: 0
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC14398%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for JC14398: 0
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC88789%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for HC88789: 0
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS56228%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for LS56228: 0
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN76006%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for LN76006: 0
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM14062%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for JM14062: 0
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU86908%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for CU86908: 0
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE36621%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for ZE36621: 0
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-30 11:00:09 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA96746%27 HTTP/1.1" 200 None
2026-03-30 11:00:09 [auto1.de] INFO: Scrape type for SA96746: 0
2026-03-30 11:00:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:11 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 9556 | hits on page: 40
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB27474%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for HB27474: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ79355%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for HJ79355: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ86499%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for BZ86499: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ46710%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for XZ46710: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG31023%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for EG31023: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ72675%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for NZ72675: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB93098%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for WB93098: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR69964%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for XR69964: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27175%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for PE27175: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY45109%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for EY45109: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL70058%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for KL70058: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN86054%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for TN86054: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ26330%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for LZ26330: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ80434%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for DJ80434: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS56497%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for CS56497: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ01082%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for ZZ01082: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB97674%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for ZB97674: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB83489%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for MB83489: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD26953%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for TD26953: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM98978%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for TM98978: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV51967%27 HTTP/1.1" 200 None
2026-03-30 11:00:11 [auto1.de] INFO: Scrape type for DV51967: 0
2026-03-30 11:00:11 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-30 11:00:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:12 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 9556 | hits on page: 40
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98993%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for HA98993: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: BS44912
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS44912%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for BS44912: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC85459%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for AC85459: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN23533%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for BN23533: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU76337%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for NU76337: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82708%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for SA82708: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT50939%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for XT50939: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC67993%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for PC67993: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS38799%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for GS38799: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA25299%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for JA25299: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85650%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for FN85650: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC13254%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for ZC13254: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW51915%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for WW51915: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU54451%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for CU54451: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: ZM17001
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV09122%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for FV09122: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA80165%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for SA80165: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU29030%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for RU29030: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD36706%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for HD36706: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY49734%27 HTTP/1.1" 200 None
2026-03-30 11:00:12 [auto1.de] INFO: Scrape type for XY49734: 0
2026-03-30 11:00:12 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-30 11:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:13 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 9556 | hits on page: 40
2026-03-30 11:00:13 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-30 11:00:13 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-30 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN32284%27 HTTP/1.1" 200 None
2026-03-30 11:00:13 [auto1.de] INFO: Scrape type for NN32284: 0
2026-03-30 11:00:13 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-30 11:00:13 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-30 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU43264%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for RU43264: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD01626%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for LD01626: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP54704%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for CP54704: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF70690%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for VF70690: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33078%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for MM33078: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG21922%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for FG21922: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB35967%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for JB35967: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE90361%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for SE90361: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS56665%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for ZS56665: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF89653%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for CF89653: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV72489%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for EV72489: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM40569%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for YM40569: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB04317%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for WB04317: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET31330%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for ET31330: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ63454%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for SJ63454: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC50586%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for RC50586: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD78025%27 HTTP/1.1" 200 None
2026-03-30 11:00:14 [auto1.de] INFO: Scrape type for LD78025: 0
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-30 11:00:14 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-30 11:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:15 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 9556 | hits on page: 40
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR19685%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for AR19685: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD83134%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for HD83134: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN44804%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for ZN44804: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG28413%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for NG28413: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP19687%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for SP19687: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68298%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for JV68298: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP33481%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for BP33481: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM73266%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for JM73266: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB09285%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for LB09285: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME09470%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for ME09470: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM50859%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for CM50859: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW45885%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for WW45885: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26352%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for AW26352: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM40239%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for RM40239: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG36618%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for GG36618: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: JL88490
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL88490%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for JL88490: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV31897%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for NV31897: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU23510%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for BU23510: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE53759%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for RE53759: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH48180%27 HTTP/1.1" 200 None
2026-03-30 11:00:15 [auto1.de] INFO: Scrape type for PH48180: 0
2026-03-30 11:00:15 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW42745%27 HTTP/1.1" 200 None
2026-03-30 11:00:16 [auto1.de] INFO: Scrape type for VW42745: 0
2026-03-30 11:00:16 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-30 11:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:17 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 9556 | hits on page: 40
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89563%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for ZT89563: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ99770%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for YJ99770: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW77910%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for PW77910: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE93454%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for TE93454: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH45720%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for FH45720: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU00921%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for PU00921: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR37276%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for MR37276: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY72197%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for UY72197: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10648%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for VY10648: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF26414%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for BF26414: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF07638%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for HF07638: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH88741%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for PH88741: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91836%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for FY91836: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK44645%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for VK44645: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP46416%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for VP46416: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ47669%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for RJ47669: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF53394%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for CF53394: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: KV36004
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW15848%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for TW15848: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV55154%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for MV55154: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ38880%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for WZ38880: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ73559%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for CZ73559: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41165%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for DV41165: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31373%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for GA31373: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK64805%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for AK64805: 0
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-30 11:00:17 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP44160%27 HTTP/1.1" 200 None
2026-03-30 11:00:17 [auto1.de] INFO: Scrape type for EP44160: 0
2026-03-30 11:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:27 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 9557 | hits on page: 40
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP44160%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for EP44160: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC98855%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for JC98855: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC06569%27 HTTP/1.1" 200 None
2026-03-30 11:00:27 [auto1.de] INFO: Scrape type for TC06569: 0
2026-03-30 11:00:27 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP44310%27 HTTP/1.1" 200 None
2026-03-30 11:00:28 [auto1.de] INFO: Scrape type for LP44310: 0
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97465%27 HTTP/1.1" 200 None
2026-03-30 11:00:28 [auto1.de] INFO: Scrape type for BP97465: 0
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: TH33543
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH33543%27 HTTP/1.1" 200 None
2026-03-30 11:00:28 [auto1.de] INFO: Scrape type for TH33543: 0
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: TD06456
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL90320%27 HTTP/1.1" 200 None
2026-03-30 11:00:28 [auto1.de] INFO: Scrape type for CL90320: 0
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS65332%27 HTTP/1.1" 200 None
2026-03-30 11:00:28 [auto1.de] INFO: Scrape type for LS65332: 0
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND38532%27 HTTP/1.1" 200 None
2026-03-30 11:00:28 [auto1.de] INFO: Scrape type for ND38532: 0
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: US43373
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US43373%27 HTTP/1.1" 200 None
2026-03-30 11:00:28 [auto1.de] INFO: Scrape type for US43373: 0
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL79897%27 HTTP/1.1" 200 None
2026-03-30 11:00:28 [auto1.de] INFO: Scrape type for PL79897: 0
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW65541%27 HTTP/1.1" 200 None
2026-03-30 11:00:28 [auto1.de] INFO: Scrape type for PW65541: 0
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98956%27 HTTP/1.1" 200 None
2026-03-30 11:00:28 [auto1.de] INFO: Scrape type for VV98956: 0
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP82440%27 HTTP/1.1" 200 None
2026-03-30 11:00:28 [auto1.de] INFO: Scrape type for XP82440: 0
2026-03-30 11:00:28 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS48399%27 HTTP/1.1" 200 None
2026-03-30 11:00:28 [auto1.de] INFO: Scrape type for CS48399: 0
2026-03-30 11:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:29 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 9557 | hits on page: 40
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY33546%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for HY33546: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF77212%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for PF77212: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ29098%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for BJ29098: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ92700%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for WZ92700: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM08350%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for FM08350: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN28121%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for NN28121: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD93722%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for FD93722: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA80529%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for PA80529: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU03053%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for ZU03053: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG69866%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for WG69866: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35105%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for RD35105: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA65327%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for BA65327: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX14499%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for SX14499: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW52920%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for GW52920: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV21910%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for ZV21910: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ72681%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for SJ72681: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS48100%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for KS48100: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA56984%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for TA56984: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC04825%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for ZC04825: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS17953%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for CS17953: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH53134%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for BH53134: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ38627%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for VJ38627: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK71622%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.de] INFO: Scrape type for WK71622: 0
2026-03-30 11:00:29 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-30 11:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:30 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 9557 | hits on page: 40
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE48308%27 HTTP/1.1" 200 None
2026-03-30 11:00:30 [auto1.de] INFO: Scrape type for ZE48308: 0
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP46424%27 HTTP/1.1" 200 None
2026-03-30 11:00:30 [auto1.de] INFO: Scrape type for XP46424: 0
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61703%27 HTTP/1.1" 200 None
2026-03-30 11:00:30 [auto1.de] INFO: Scrape type for KZ61703: 0
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY49191%27 HTTP/1.1" 200 None
2026-03-30 11:00:30 [auto1.de] INFO: Scrape type for TY49191: 0
2026-03-30 11:00:30 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY55773%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for BY55773: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH96912%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for UH96912: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV25811%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for HV25811: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH00039%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for UH00039: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY92722%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for MY92722: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA28860%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for GA28860: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF22787%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for RF22787: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG25993%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for HG25993: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF45337%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for UF45337: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH35819%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for JH35819: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM43288%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for HM43288: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR95726%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for PR95726: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB66833%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for LB66833: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ12111%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for BZ12111: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG70959%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for MG70959: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF28924%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for ZF28924: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ14237%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for DJ14237: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN88860%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.de] INFO: Scrape type for LN88860: 0
2026-03-30 11:00:31 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-30 11:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:32 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 9557 | hits on page: 40
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV58982%27 HTTP/1.1" 200 None
2026-03-30 11:00:32 [auto1.de] INFO: Scrape type for EV58982: 0
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN01043%27 HTTP/1.1" 200 None
2026-03-30 11:00:32 [auto1.de] INFO: Scrape type for VN01043: 0
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: PC60624
2026-03-30 11:00:32 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN56757%27 HTTP/1.1" 200 None
2026-03-30 11:00:32 [auto1.de] INFO: Scrape type for PN56757: 0
2026-03-30 11:00:33 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ54145%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [auto1.de] INFO: Scrape type for PJ54145: 0
2026-03-30 11:00:33 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21217%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [auto1.de] INFO: Scrape type for NY21217: 0
2026-03-30 11:00:33 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH75769%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [auto1.de] INFO: Scrape type for CH75769: 0
2026-03-30 11:00:33 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-30 11:00:33 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-30 11:00:33 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-30 11:00:33 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV61779%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [auto1.de] INFO: Scrape type for ZV61779: 0
2026-03-30 11:00:33 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-30 11:00:33 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH48904%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [auto1.de] INFO: Scrape type for BH48904: 0
2026-03-30 11:00:33 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-30 11:00:33 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM02183%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [auto1.de] INFO: Scrape type for YM02183: 0
2026-03-30 11:00:33 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-30 11:00:33 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-30 11:00:33 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ67975%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [auto1.de] INFO: Scrape type for TZ67975: 2
2026-03-30 11:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f149faa4-5cb3-5739-acd3-02b9fc6747d1 with identifier: TZ67975
2026-03-30 11:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f149faa4-5cb3-5739-acd3-02b9fc6747d1 with scrape type 2
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f149faa4-5cb3-5739-acd3-02b9fc6747d1 with scrape type 2
2026-03-30 11:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f149faa4-5cb3-5739-acd3-02b9fc6747d1, identifier: TZ67975
2026-03-30 11:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f149faa4-5cb3-5739-acd3-02b9fc6747d1 with identifier: TZ67975
2026-03-30 11:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f149faa4-5cb3-5739-acd3-02b9fc6747d1 with identifier: TZ67975
2026-03-30 11:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f149faa4-5cb3-5739-acd3-02b9fc6747d1 with identifier: TZ67975 to the API
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:20:51Z',
 'fuel_type': 'petrol',
 'id': 'f149faa4-5cb3-5739-acd3-02b9fc6747d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ67975',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 138621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-11',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2009}
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ67975%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [auto1.de] INFO: Saving data for TZ67975: {'auction_closing_time': 1774884051.0, 'created_time': 1774596938.054236, 'last_price_update_time': 1774868433.937058}
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ67975') HTTP/1.1" 204 0
2026-03-30 11:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE20511%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.de] INFO: Scrape type for AE20511: 0
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV15803%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.de] INFO: Scrape type for WV15803: 0
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF14640%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.de] INFO: Scrape type for PF14640: 0
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM75653%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.de] INFO: Scrape type for HM75653: 0
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF94308%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.de] INFO: Scrape type for DF94308: 0
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT28876%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.de] INFO: Scrape type for NT28876: 0
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE00996%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.de] INFO: Scrape type for EE00996: 0
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS83332%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.de] INFO: Scrape type for PS83332: 0
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS00408%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.de] INFO: Scrape type for FS00408: 0
2026-03-30 11:00:34 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT83472%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.de] INFO: Scrape type for TT83472: 0
2026-03-30 11:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:35 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 9557 | hits on page: 40
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE65713%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for WE65713: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX50338%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for CX50338: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM36828%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for HM36828: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR04951%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for AR04951: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD48040%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for RD48040: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD05825%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for CD05825: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM10671%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for UM10671: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN75673%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for LN75673: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV89856%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for JV89856: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX08405%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for GX08405: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL21282%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for BL21282: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU47138%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for VU47138: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD41373%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for HD41373: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT07597%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for GT07597: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY79904%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for MY79904: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU58060%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for KU58060: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH55749%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for SH55749: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ40865%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for AZ40865: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG62181%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for SG62181: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC03765%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for BC03765: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41921%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for SP41921: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB35938%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for AB35938: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD57805%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.de] INFO: Scrape type for TD57805: 0
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-30 11:00:35 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-30 11:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:37 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 9557 | hits on page: 40
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB58662%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for XB58662: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR74432%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for YR74432: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG66874%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for SG66874: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT34315%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for BT34315: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ05672%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for CZ05672: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL77544%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for DL77544: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL44411%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for SL44411: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK53036%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for BK53036: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU90865%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for CU90865: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF43434%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for CF43434: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB26744%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for GB26744: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE47693%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for BE47693: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL23560%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for TL23560: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH74255%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for KH74255: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU04580%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for NU04580: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA82816%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for KA82816: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ25719%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for VZ25719: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT22988%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for UT22988: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ97003%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.de] INFO: Scrape type for BJ97003: 0
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-30 11:00:37 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-30 11:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:38 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 9557 | hits on page: 40
2026-03-30 11:00:38 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-30 11:00:38 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP76245%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [auto1.de] INFO: Scrape type for LP76245: 0
2026-03-30 11:00:38 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-30 11:00:38 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33750%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [auto1.de] INFO: Scrape type for EC33750: 0
2026-03-30 11:00:38 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH70992%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [auto1.de] INFO: Scrape type for MH70992: 0
2026-03-30 11:00:38 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP14042%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [auto1.de] INFO: Scrape type for WP14042: 0
2026-03-30 11:00:38 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN44091%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [auto1.de] INFO: Scrape type for HN44091: 0
2026-03-30 11:00:38 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB27737%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [auto1.de] INFO: Scrape type for AB27737: 0
2026-03-30 11:00:38 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB91647%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [auto1.de] INFO: Scrape type for AB91647: 0
2026-03-30 11:00:38 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-30 11:00:38 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC28332%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [auto1.de] INFO: Scrape type for JC28332: 0
2026-03-30 11:00:38 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-30 11:00:38 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-30 11:00:38 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM57840%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [auto1.de] INFO: Scrape type for HM57840: 0
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF52928%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [auto1.de] INFO: Scrape type for MF52928: 0
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM15816%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [auto1.de] INFO: Scrape type for AM15816: 0
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE15667%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [auto1.de] INFO: Scrape type for YE15667: 2
2026-03-30 11:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f90855a8-5853-5d95-a239-7d83c663eda1 with identifier: YE15667
2026-03-30 11:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f90855a8-5853-5d95-a239-7d83c663eda1 with scrape type 2
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f90855a8-5853-5d95-a239-7d83c663eda1 with scrape type 2
2026-03-30 11:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f90855a8-5853-5d95-a239-7d83c663eda1, identifier: YE15667
2026-03-30 11:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f90855a8-5853-5d95-a239-7d83c663eda1 with identifier: YE15667
2026-03-30 11:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f90855a8-5853-5d95-a239-7d83c663eda1 with identifier: YE15667
2026-03-30 11:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f90855a8-5853-5d95-a239-7d83c663eda1 with identifier: YE15667 to the API
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:56:39Z',
 'fuel_type': 'diesel',
 'id': 'f90855a8-5853-5d95-a239-7d83c663eda1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE15667',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 142718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-02',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2015}
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE15667%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [auto1.de] INFO: Saving data for YE15667: {'auction_closing_time': 1774886199.0, 'created_time': 1774596944.495969, 'last_price_update_time': 1774868439.552359}
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE15667') HTTP/1.1" 204 0
2026-03-30 11:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX08023%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [auto1.de] INFO: Scrape type for AX08023: 0
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH75951%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [auto1.de] INFO: Scrape type for VH75951: 0
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV16003%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [auto1.de] INFO: Scrape type for NV16003: 0
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ81913%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [auto1.de] INFO: Scrape type for XZ81913: 0
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP35673%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [auto1.de] INFO: Scrape type for ZP35673: 0
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ76409%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [auto1.de] INFO: Scrape type for EZ76409: 0
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ97529%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [auto1.de] INFO: Scrape type for NZ97529: 0
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE98094%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [auto1.de] INFO: Scrape type for DE98094: 0
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47676%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [auto1.de] INFO: Scrape type for EJ47676: 0
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC90935%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [auto1.de] INFO: Scrape type for SC90935: 0
2026-03-30 11:00:39 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-30 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:40 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 9557 | hits on page: 40
2026-03-30 11:00:40 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-30 11:00:40 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE90376%27 HTTP/1.1" 200 None
2026-03-30 11:00:40 [auto1.de] INFO: Scrape type for ZE90376: 0
2026-03-30 11:00:40 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-30 11:00:40 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-30 11:00:40 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR56411%27 HTTP/1.1" 200 None
2026-03-30 11:00:40 [auto1.de] INFO: Scrape type for PR56411: 0
2026-03-30 11:00:40 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK09609%27 HTTP/1.1" 200 None
2026-03-30 11:00:40 [auto1.de] INFO: Scrape type for NK09609: 0
2026-03-30 11:00:40 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-30 11:00:40 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-30 11:00:40 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-30 11:00:40 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-30 11:00:40 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL75790%27 HTTP/1.1" 200 None
2026-03-30 11:00:40 [auto1.de] INFO: Scrape type for UL75790: 0
2026-03-30 11:00:40 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-30 11:00:40 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-30 11:00:40 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC97863%27 HTTP/1.1" 200 None
2026-03-30 11:00:40 [auto1.de] INFO: Scrape type for FC97863: 0
2026-03-30 11:00:40 [auto1.de] INFO: Found listing with ID: US49854
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US49854%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [auto1.de] INFO: Scrape type for US49854: 0
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE14691%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [auto1.de] INFO: Scrape type for BE14691: 0
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR34714%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [auto1.de] INFO: Scrape type for MR34714: 0
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE15038%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [auto1.de] INFO: Scrape type for CE15038: 0
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG49246%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [auto1.de] INFO: Scrape type for RG49246: 0
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64041%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [auto1.de] INFO: Scrape type for SJ64041: 0
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR49989%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [auto1.de] INFO: Scrape type for LR49989: 0
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: VU33733
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET94101%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [auto1.de] INFO: Scrape type for ET94101: 0
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91998%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [auto1.de] INFO: Scrape type for XT91998: 0
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95738%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [auto1.de] INFO: Scrape type for DL95738: 0
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-30 11:00:41 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39068%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [auto1.de] INFO: Scrape type for BP39068: 0
2026-03-30 11:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:42 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 9557 | hits on page: 40
2026-03-30 11:00:42 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ97715%27 HTTP/1.1" 200 None
2026-03-30 11:00:42 [auto1.de] INFO: Scrape type for SZ97715: 0
2026-03-30 11:00:42 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46959%27 HTTP/1.1" 200 None
2026-03-30 11:00:42 [auto1.de] INFO: Scrape type for WA46959: 0
2026-03-30 11:00:42 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ34801%27 HTTP/1.1" 200 None
2026-03-30 11:00:42 [auto1.de] INFO: Scrape type for BJ34801: 0
2026-03-30 11:00:42 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV03143%27 HTTP/1.1" 200 None
2026-03-30 11:00:42 [auto1.de] INFO: Scrape type for YV03143: 0
2026-03-30 11:00:42 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-30 11:00:42 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57746%27 HTTP/1.1" 200 None
2026-03-30 11:00:42 [auto1.de] INFO: Scrape type for VJ57746: 0
2026-03-30 11:00:42 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-30 11:00:42 [auto1.de] INFO: Found listing with ID: TU08005
2026-03-30 11:00:42 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-30 11:00:42 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-30 11:00:42 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG37163%27 HTTP/1.1" 200 None
2026-03-30 11:00:42 [auto1.de] INFO: Scrape type for BG37163: 0
2026-03-30 11:00:42 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ42176%27 HTTP/1.1" 200 None
2026-03-30 11:00:42 [auto1.de] INFO: Scrape type for AZ42176: 0
2026-03-30 11:00:42 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK66887%27 HTTP/1.1" 200 None
2026-03-30 11:00:42 [auto1.de] INFO: Scrape type for MK66887: 2
2026-03-30 11:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f87ca8d-80ba-5bb0-b143-7df81e953605 with identifier: MK66887
2026-03-30 11:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f87ca8d-80ba-5bb0-b143-7df81e953605 with scrape type 2
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f87ca8d-80ba-5bb0-b143-7df81e953605 with scrape type 2
2026-03-30 11:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f87ca8d-80ba-5bb0-b143-7df81e953605, identifier: MK66887
2026-03-30 11:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f87ca8d-80ba-5bb0-b143-7df81e953605 with identifier: MK66887
2026-03-30 11:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f87ca8d-80ba-5bb0-b143-7df81e953605 with identifier: MK66887
2026-03-30 11:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f87ca8d-80ba-5bb0-b143-7df81e953605 with identifier: MK66887 to the API
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:20:59Z',
 'fuel_type': 'diesel',
 'id': '8f87ca8d-80ba-5bb0-b143-7df81e953605',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK66887',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 90326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-13',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L2 Tourneo Titanium',
 'transmission': 'manual',
 'trim': '310 L2 Tourneo Titanium',
 'year': 2019}
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK66887%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.de] INFO: Saving data for MK66887: {'auction_closing_time': 1774884059.0, 'created_time': 1774350168.445839, 'last_price_update_time': 1774868443.122818}
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK66887') HTTP/1.1" 204 0
2026-03-30 11:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61695%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.de] INFO: Scrape type for VH61695: 0
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD51611%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.de] INFO: Scrape type for BD51611: 0
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ89642%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.de] INFO: Scrape type for NZ89642: 0
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK98725%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.de] INFO: Scrape type for YK98725: 0
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM79272%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.de] INFO: Scrape type for JM79272: 0
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96010%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.de] INFO: Scrape type for KF96010: 0
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP83297%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.de] INFO: Scrape type for PP83297: 0
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA99950%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.de] INFO: Scrape type for UA99950: 0
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT53198%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.de] INFO: Scrape type for VT53198: 0
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL92267%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.de] INFO: Scrape type for EL92267: 0
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN95479%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.de] INFO: Scrape type for JN95479: 0
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12981%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.de] INFO: Scrape type for RK12981: 0
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES37621%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.de] INFO: Scrape type for ES37621: 0
2026-03-30 11:00:43 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-30 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:51 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 9557 | hits on page: 40
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC77687%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for HC77687: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV67492%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for FV67492: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC64340%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for VC64340: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT94754%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for DT94754: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX63688%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for TX63688: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR65343%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for MR65343: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: PW12132
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB36710%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for DB36710: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK50070%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for HK50070: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14525%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for SU14525: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD56647%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for CD56647: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP48554%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for KP48554: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY74749%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for AY74749: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ83769%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for JJ83769: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD32112%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for SD32112: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM07006%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for DM07006: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ99970%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for RZ99970: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU35390%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for AU35390: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA74334%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for EA74334: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR96195%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for HR96195: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH59538%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.de] INFO: Scrape type for YH59538: 0
2026-03-30 11:00:51 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-30 11:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:03 [scrapy.extensions.logstats] INFO: Crawled 814 pages (at 19 pages/min), scraped 1140 items (at 3 items/min)
2026-03-30 11:01:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:02:03 [scrapy.extensions.logstats] INFO: Crawled 814 pages (at 0 pages/min), scraped 1140 items (at 0 items/min)
2026-03-30 11:02:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:03:01 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.027(s), this was the 1st time calling it.
2026-03-30 11:03:01 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.129531427666642 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:03:03 [scrapy.extensions.logstats] INFO: Crawled 814 pages (at 0 pages/min), scraped 1140 items (at 0 items/min)
2026-03-30 11:03:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:04:03 [scrapy.extensions.logstats] INFO: Crawled 814 pages (at 0 pages/min), scraped 1140 items (at 0 items/min)
2026-03-30 11:04:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:15 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 9568 | hits on page: 40
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM07006%27 HTTP/1.1" 200 None
2026-03-30 11:04:15 [auto1.de] INFO: Scrape type for DM07006: 0
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ99970%27 HTTP/1.1" 200 None
2026-03-30 11:04:15 [auto1.de] INFO: Scrape type for RZ99970: 0
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU35390%27 HTTP/1.1" 200 None
2026-03-30 11:04:15 [auto1.de] INFO: Scrape type for AU35390: 0
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA74334%27 HTTP/1.1" 200 None
2026-03-30 11:04:15 [auto1.de] INFO: Scrape type for EA74334: 0
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR96195%27 HTTP/1.1" 200 None
2026-03-30 11:04:15 [auto1.de] INFO: Scrape type for HR96195: 0
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH59538%27 HTTP/1.1" 200 None
2026-03-30 11:04:15 [auto1.de] INFO: Scrape type for YH59538: 0
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH10355%27 HTTP/1.1" 200 None
2026-03-30 11:04:15 [auto1.de] INFO: Scrape type for VH10355: 0
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA54991%27 HTTP/1.1" 200 None
2026-03-30 11:04:15 [auto1.de] INFO: Scrape type for RA54991: 0
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED74506%27 HTTP/1.1" 200 None
2026-03-30 11:04:15 [auto1.de] INFO: Scrape type for ED74506: 0
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ60689%27 HTTP/1.1" 200 None
2026-03-30 11:04:15 [auto1.de] INFO: Scrape type for MJ60689: 0
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP29257%27 HTTP/1.1" 200 None
2026-03-30 11:04:15 [auto1.de] INFO: Scrape type for DP29257: 0
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ12211%27 HTTP/1.1" 200 None
2026-03-30 11:04:15 [auto1.de] INFO: Scrape type for UJ12211: 0
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP37775%27 HTTP/1.1" 200 None
2026-03-30 11:04:15 [auto1.de] INFO: Scrape type for NP37775: 0
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG80154%27 HTTP/1.1" 200 None
2026-03-30 11:04:15 [auto1.de] INFO: Scrape type for NG80154: 0
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-30 11:04:15 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64599%27 HTTP/1.1" 200 None
2026-03-30 11:04:15 [auto1.de] INFO: Scrape type for PN64599: 0
2026-03-30 11:04:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:26 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 9568 | hits on page: 40
2026-03-30 11:04:26 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-30 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY44920%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for CY44920: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14264%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for UR14264: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC69838%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for AC69838: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64336%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for FT64336: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE16712%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for VE16712: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35367%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for JG35367: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM07569%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for JM07569: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU30537%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for GU30537: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98494%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for UR98494: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ52823%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for XJ52823: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: RU25678
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC57472%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for CC57472: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13521%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for YY13521: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU00695%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for BU00695: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER31380%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for ER31380: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH30720%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for GH30720: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94642%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for CJ94642: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF16745%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for WF16745: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP86837%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for ZP86837: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL07964%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for TL07964: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR15436%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for SR15436: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW57264%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for SW57264: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC84662%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for UC84662: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF45808%27 HTTP/1.1" 200 None
2026-03-30 11:04:27 [auto1.de] INFO: Scrape type for DF45808: 0
2026-03-30 11:04:27 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-30 11:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:28 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 9569 | hits on page: 40
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT91695%27 HTTP/1.1" 200 None
2026-03-30 11:04:28 [auto1.de] INFO: Scrape type for FT91695: 0
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH27110%27 HTTP/1.1" 200 None
2026-03-30 11:04:28 [auto1.de] INFO: Scrape type for PH27110: 0
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ58710%27 HTTP/1.1" 200 None
2026-03-30 11:04:28 [auto1.de] INFO: Scrape type for LZ58710: 0
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46432%27 HTTP/1.1" 200 None
2026-03-30 11:04:28 [auto1.de] INFO: Scrape type for VV46432: 0
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ26339%27 HTTP/1.1" 200 None
2026-03-30 11:04:28 [auto1.de] INFO: Scrape type for SJ26339: 0
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM44288%27 HTTP/1.1" 200 None
2026-03-30 11:04:28 [auto1.de] INFO: Scrape type for RM44288: 0
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN99491%27 HTTP/1.1" 200 None
2026-03-30 11:04:28 [auto1.de] INFO: Scrape type for SN99491: 0
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39576%27 HTTP/1.1" 200 None
2026-03-30 11:04:28 [auto1.de] INFO: Scrape type for EG39576: 0
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK97473%27 HTTP/1.1" 200 None
2026-03-30 11:04:28 [auto1.de] INFO: Scrape type for WK97473: 0
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG38985%27 HTTP/1.1" 200 None
2026-03-30 11:04:28 [auto1.de] INFO: Scrape type for VG38985: 0
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: KV78740
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL12267%27 HTTP/1.1" 200 None
2026-03-30 11:04:28 [auto1.de] INFO: Scrape type for FL12267: 0
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY92753%27 HTTP/1.1" 200 None
2026-03-30 11:04:28 [auto1.de] INFO: Scrape type for PY92753: 0
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ52630%27 HTTP/1.1" 200 None
2026-03-30 11:04:28 [auto1.de] INFO: Scrape type for RZ52630: 0
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-30 11:04:28 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ04369%27 HTTP/1.1" 200 None
2026-03-30 11:04:28 [auto1.de] INFO: Scrape type for LJ04369: 2
2026-03-30 11:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13ad8c3c-a8f7-5798-ab47-98d8cc46a6cd with identifier: LJ04369
2026-03-30 11:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13ad8c3c-a8f7-5798-ab47-98d8cc46a6cd with scrape type 2
2026-03-30 11:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13ad8c3c-a8f7-5798-ab47-98d8cc46a6cd with scrape type 2
2026-03-30 11:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13ad8c3c-a8f7-5798-ab47-98d8cc46a6cd, identifier: LJ04369
2026-03-30 11:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13ad8c3c-a8f7-5798-ab47-98d8cc46a6cd with identifier: LJ04369
2026-03-30 11:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13ad8c3c-a8f7-5798-ab47-98d8cc46a6cd with identifier: LJ04369
2026-03-30 11:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13ad8c3c-a8f7-5798-ab47-98d8cc46a6cd with identifier: LJ04369 to the API
2026-03-30 11:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:08:46Z',
 'fuel_type': 'diesel',
 'id': '13ad8c3c-a8f7-5798-ab47-98d8cc46a6cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ04369',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 240597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-25',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Kombi EcoProfi',
 'transmission': 'manual',
 'trim': 'Kombi EcoProfi',
 'year': 2014}
2026-03-30 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ04369%27 HTTP/1.1" 200 None
2026-03-30 11:04:29 [auto1.de] INFO: Saving data for LJ04369: {'auction_closing_time': 1774883326.0, 'created_time': 1772729279.460841, 'last_price_update_time': 1774868669.581061}
2026-03-30 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ04369') HTTP/1.1" 204 0
2026-03-30 11:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:29 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-30 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD72223%27 HTTP/1.1" 200 None
2026-03-30 11:04:29 [auto1.de] INFO: Scrape type for SD72223: 0
2026-03-30 11:04:29 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-30 11:04:29 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-30 11:04:29 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-30 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU53159%27 HTTP/1.1" 200 None
2026-03-30 11:04:29 [auto1.de] INFO: Scrape type for FU53159: 0
2026-03-30 11:04:29 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-30 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX37368%27 HTTP/1.1" 200 None
2026-03-30 11:04:29 [auto1.de] INFO: Scrape type for JX37368: 0
2026-03-30 11:04:29 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-30 11:04:29 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-30 11:04:29 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-30 11:04:29 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-30 11:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:30 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 9569 | hits on page: 40
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW76497%27 HTTP/1.1" 200 None
2026-03-30 11:04:30 [auto1.de] INFO: Scrape type for DW76497: 0
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP91741%27 HTTP/1.1" 200 None
2026-03-30 11:04:30 [auto1.de] INFO: Scrape type for YP91741: 0
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF63833%27 HTTP/1.1" 200 None
2026-03-30 11:04:30 [auto1.de] INFO: Scrape type for DF63833: 0
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP81340%27 HTTP/1.1" 200 None
2026-03-30 11:04:30 [auto1.de] INFO: Scrape type for BP81340: 0
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU39624%27 HTTP/1.1" 200 None
2026-03-30 11:04:30 [auto1.de] INFO: Scrape type for FU39624: 0
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA37640%27 HTTP/1.1" 200 None
2026-03-30 11:04:30 [auto1.de] INFO: Scrape type for PA37640: 0
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW83321%27 HTTP/1.1" 200 None
2026-03-30 11:04:30 [auto1.de] INFO: Scrape type for SW83321: 0
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM22494%27 HTTP/1.1" 200 None
2026-03-30 11:04:30 [auto1.de] INFO: Scrape type for EM22494: 0
2026-03-30 11:04:30 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-30 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD59606%27 HTTP/1.1" 200 None
2026-03-30 11:04:31 [auto1.de] INFO: Scrape type for UD59606: 0
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV18053%27 HTTP/1.1" 200 None
2026-03-30 11:04:31 [auto1.de] INFO: Scrape type for MV18053: 0
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU50288%27 HTTP/1.1" 200 None
2026-03-30 11:04:31 [auto1.de] INFO: Scrape type for MU50288: 0
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA22944%27 HTTP/1.1" 200 None
2026-03-30 11:04:31 [auto1.de] INFO: Scrape type for KA22944: 0
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27918%27 HTTP/1.1" 200 None
2026-03-30 11:04:31 [auto1.de] INFO: Scrape type for AP27918: 0
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV27021%27 HTTP/1.1" 200 None
2026-03-30 11:04:31 [auto1.de] INFO: Scrape type for PV27021: 0
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ35619%27 HTTP/1.1" 200 None
2026-03-30 11:04:31 [auto1.de] INFO: Scrape type for EZ35619: 0
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB67029%27 HTTP/1.1" 200 None
2026-03-30 11:04:31 [auto1.de] INFO: Scrape type for HB67029: 0
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM08795%27 HTTP/1.1" 200 None
2026-03-30 11:04:31 [auto1.de] INFO: Scrape type for GM08795: 0
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK38056%27 HTTP/1.1" 200 None
2026-03-30 11:04:31 [auto1.de] INFO: Scrape type for PK38056: 0
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR95574%27 HTTP/1.1" 200 None
2026-03-30 11:04:31 [auto1.de] INFO: Scrape type for LR95574: 0
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-30 11:04:31 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-30 11:04:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:39 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 9570 | hits on page: 40
2026-03-30 11:04:39 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-30 11:04:39 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-30 11:04:39 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ25875%27 HTTP/1.1" 200 None
2026-03-30 11:04:39 [auto1.de] INFO: Scrape type for NZ25875: 0
2026-03-30 11:04:39 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU93919%27 HTTP/1.1" 200 None
2026-03-30 11:04:39 [auto1.de] INFO: Scrape type for YU93919: 0
2026-03-30 11:04:39 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR11157%27 HTTP/1.1" 200 None
2026-03-30 11:04:39 [auto1.de] INFO: Scrape type for YR11157: 0
2026-03-30 11:04:39 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-30 11:04:39 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB39806%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for XB39806: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG85121%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for LG85121: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE25882%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for TE25882: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR74805%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for LR74805: 2
2026-03-30 11:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d14e9819-60ba-5540-9ddb-f0b81d50936c with identifier: LR74805
2026-03-30 11:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d14e9819-60ba-5540-9ddb-f0b81d50936c with scrape type 2
2026-03-30 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d14e9819-60ba-5540-9ddb-f0b81d50936c with scrape type 2
2026-03-30 11:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d14e9819-60ba-5540-9ddb-f0b81d50936c, identifier: LR74805
2026-03-30 11:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d14e9819-60ba-5540-9ddb-f0b81d50936c with identifier: LR74805
2026-03-30 11:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d14e9819-60ba-5540-9ddb-f0b81d50936c with identifier: LR74805
2026-03-30 11:04:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d14e9819-60ba-5540-9ddb-f0b81d50936c with identifier: LR74805 to the API
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 188,
 'expiration_date': '2026-03-30T15:41:42Z',
 'fuel_type': 'hybrid',
 'id': 'd14e9819-60ba-5540-9ddb-f0b81d50936c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR74805',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 7099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-27',
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 2.4 Plug-in Hybrid 4WD',
 'transmission': 'automatic',
 'trim': '4WD',
 'year': 2022}
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR74805%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Saving data for LR74805: {'auction_closing_time': 1774885302.0, 'created_time': 1774350483.716935, 'last_price_update_time': 1774868680.444291}
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR74805') HTTP/1.1" 204 0
2026-03-30 11:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX03618%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for MX03618: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC30039%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for DC30039: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP20467%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for MP20467: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS29851%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for JS29851: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63954%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for UK63954: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM82441%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for VM82441: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF62011%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for CF62011: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC92334%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for KC92334: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF80406%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for WF80406: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK07510%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for FK07510: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV15826%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.de] INFO: Scrape type for SV15826: 0
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-30 11:04:40 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-30 11:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:50 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 9573 | hits on page: 40
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST87748%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for ST87748: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY26571%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for EY26571: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN30435%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for LN30435: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP86079%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for WP86079: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE57105%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for VE57105: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL97595%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for DL97595: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC99000%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for CC99000: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB25361%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for UB25361: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN63570%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for TN63570: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH53485%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for FH53485: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB12842%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for CB12842: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX08843%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for PX08843: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG93766%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for UG93766: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB33429%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for JB33429: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL34551%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for AL34551: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95499%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for DL95499: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK59033%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for CK59033: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT42363%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for DT42363: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96921%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for GE96921: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW75116%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for JW75116: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW78199%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for DW78199: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN96808%27 HTTP/1.1" 200 None
2026-03-30 11:04:50 [auto1.de] INFO: Scrape type for UN96808: 0
2026-03-30 11:04:50 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-30 11:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:52 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 9573 | hits on page: 40
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM95893%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for DM95893: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS73501%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for JS73501: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16553%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for GE16553: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE41778%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for DE41778: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB33155%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for GB33155: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA42451%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for MA42451: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP97012%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for SP97012: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU85949%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for AU85949: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: UB34830
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL90308%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for EL90308: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK31305%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for VK31305: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH56246%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for CH56246: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR96643%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for MR96643: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV57112%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for KV57112: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC04938%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for GC04938: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR08367%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for ZR08367: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ71458%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for WJ71458: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX77194%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for SX77194: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ35475%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for XZ35475: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS76015%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for CS76015: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH40808%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for UH40808: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU52502%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.de] INFO: Scrape type for XU52502: 0
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-30 11:04:52 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-30 11:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:55 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 9573 | hits on page: 40
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ51408%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [auto1.de] INFO: Scrape type for YJ51408: 0
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: XN70423
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX27277%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [auto1.de] INFO: Scrape type for EX27277: 0
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX50427%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [auto1.de] INFO: Scrape type for VX50427: 0
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25868%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [auto1.de] INFO: Scrape type for UA25868: 0
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ60723%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [auto1.de] INFO: Scrape type for MZ60723: 0
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19657%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [auto1.de] INFO: Scrape type for GB19657: 0
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: JJ39643
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ39643%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [auto1.de] INFO: Scrape type for JJ39643: 0
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL38868%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [auto1.de] INFO: Scrape type for KL38868: 0
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB12349%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [auto1.de] INFO: Scrape type for WB12349: 0
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ31953%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [auto1.de] INFO: Scrape type for BJ31953: 0
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09023%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [auto1.de] INFO: Scrape type for DB09023: 0
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF93652%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [auto1.de] INFO: Scrape type for DF93652: 0
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-30 11:04:55 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL76772%27 HTTP/1.1" 200 None
2026-03-30 11:04:55 [auto1.de] INFO: Scrape type for TL76772: 0
2026-03-30 11:04:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:56 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 9573 | hits on page: 40
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: EC81606
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC81606%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.de] INFO: Scrape type for EC81606: 0
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN73895%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.de] INFO: Scrape type for ZN73895: 0
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91844%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.de] INFO: Scrape type for MW91844: 0
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA89012%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.de] INFO: Scrape type for WA89012: 0
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX63179%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.de] INFO: Scrape type for XX63179: 0
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY47852%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.de] INFO: Scrape type for HY47852: 0
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA54301%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.de] INFO: Scrape type for VA54301: 0
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09271%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.de] INFO: Scrape type for SM09271: 0
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX42832%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.de] INFO: Scrape type for DX42832: 0
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY34106%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.de] INFO: Scrape type for SY34106: 0
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND90067%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.de] INFO: Scrape type for ND90067: 0
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72953%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.de] INFO: Scrape type for CK72953: 0
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF56816%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.de] INFO: Scrape type for MF56816: 0
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY46067%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.de] INFO: Scrape type for PY46067: 0
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB03477%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.de] INFO: Scrape type for WB03477: 0
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM55237%27 HTTP/1.1" 200 None
2026-03-30 11:04:56 [auto1.de] INFO: Scrape type for YM55237: 0
2026-03-30 11:04:56 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY23917%27 HTTP/1.1" 200 None
2026-03-30 11:04:57 [auto1.de] INFO: Scrape type for GY23917: 0
2026-03-30 11:04:57 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC43616%27 HTTP/1.1" 200 None
2026-03-30 11:04:57 [auto1.de] INFO: Scrape type for NC43616: 0
2026-03-30 11:04:57 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58590%27 HTTP/1.1" 200 None
2026-03-30 11:04:57 [auto1.de] INFO: Scrape type for SG58590: 2
2026-03-30 11:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edcce00f-bd6f-5ef0-a0e2-fada08e566da with identifier: SG58590
2026-03-30 11:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edcce00f-bd6f-5ef0-a0e2-fada08e566da with scrape type 2
2026-03-30 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edcce00f-bd6f-5ef0-a0e2-fada08e566da with scrape type 2
2026-03-30 11:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edcce00f-bd6f-5ef0-a0e2-fada08e566da, identifier: SG58590
2026-03-30 11:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edcce00f-bd6f-5ef0-a0e2-fada08e566da with identifier: SG58590
2026-03-30 11:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edcce00f-bd6f-5ef0-a0e2-fada08e566da with identifier: SG58590
2026-03-30 11:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edcce00f-bd6f-5ef0-a0e2-fada08e566da with identifier: SG58590 to the API
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:25:51Z',
 'fuel_type': 'petrol',
 'id': 'edcce00f-bd6f-5ef0-a0e2-fada08e566da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG58590',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 122982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-30',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Edition Dynamique',
 'transmission': 'manual',
 'trim': 'Edition Dynamique',
 'year': 2008}
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58590%27 HTTP/1.1" 200 None
2026-03-30 11:04:57 [auto1.de] INFO: Saving data for SG58590: {'auction_closing_time': 1774884351.0, 'created_time': 1774596942.975142, 'last_price_update_time': 1774868697.705412}
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG58590') HTTP/1.1" 204 0
2026-03-30 11:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:57 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-30 11:04:57 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-30 11:04:57 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL36228%27 HTTP/1.1" 200 None
2026-03-30 11:04:57 [auto1.de] INFO: Scrape type for NL36228: 0
2026-03-30 11:04:57 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-30 11:04:57 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09769%27 HTTP/1.1" 200 None
2026-03-30 11:04:57 [auto1.de] INFO: Scrape type for SM09769: 0
2026-03-30 11:04:57 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-30 11:04:57 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11985%27 HTTP/1.1" 200 None
2026-03-30 11:04:57 [auto1.de] INFO: Scrape type for SA11985: 0
2026-03-30 11:04:57 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-30 11:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:58 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 9573 | hits on page: 40
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA44966%27 HTTP/1.1" 200 None
2026-03-30 11:04:58 [auto1.de] INFO: Scrape type for RA44966: 0
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23717%27 HTTP/1.1" 200 None
2026-03-30 11:04:58 [auto1.de] INFO: Scrape type for NU23717: 0
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML64265%27 HTTP/1.1" 200 None
2026-03-30 11:04:58 [auto1.de] INFO: Scrape type for ML64265: 0
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB95489%27 HTTP/1.1" 200 None
2026-03-30 11:04:58 [auto1.de] INFO: Scrape type for HB95489: 0
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU18943%27 HTTP/1.1" 200 None
2026-03-30 11:04:58 [auto1.de] INFO: Scrape type for ZU18943: 0
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT79554%27 HTTP/1.1" 200 None
2026-03-30 11:04:58 [auto1.de] INFO: Scrape type for RT79554: 0
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ68009%27 HTTP/1.1" 200 None
2026-03-30 11:04:58 [auto1.de] INFO: Scrape type for JJ68009: 0
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR61198%27 HTTP/1.1" 200 None
2026-03-30 11:04:58 [auto1.de] INFO: Scrape type for CR61198: 0
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-30 11:04:58 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP61360%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [auto1.de] INFO: Scrape type for ZP61360: 0
2026-03-30 11:04:59 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-30 11:04:59 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-30 11:04:59 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ04747%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [auto1.de] INFO: Scrape type for UZ04747: 0
2026-03-30 11:04:59 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB41592%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [auto1.de] INFO: Scrape type for PB41592: 2
2026-03-30 11:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ed57afd-3f01-5e0a-9fda-06fb012db77c with identifier: PB41592
2026-03-30 11:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ed57afd-3f01-5e0a-9fda-06fb012db77c with scrape type 2
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ed57afd-3f01-5e0a-9fda-06fb012db77c with scrape type 2
2026-03-30 11:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ed57afd-3f01-5e0a-9fda-06fb012db77c, identifier: PB41592
2026-03-30 11:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ed57afd-3f01-5e0a-9fda-06fb012db77c with identifier: PB41592
2026-03-30 11:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ed57afd-3f01-5e0a-9fda-06fb012db77c with identifier: PB41592
2026-03-30 11:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ed57afd-3f01-5e0a-9fda-06fb012db77c with identifier: PB41592 to the API
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 360,
 'expiration_date': '2026-03-30T15:43:56Z',
 'fuel_type': 'electro',
 'id': '4ed57afd-3f01-5e0a-9fda-06fb012db77c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB41592',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'e-tron',
 'odometer': 26701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-22',
 'seller_name': None,
 'title': 'Audi e-tron 55 quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB41592%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [auto1.de] INFO: Saving data for PB41592: {'auction_closing_time': 1774885436.0, 'created_time': 1772726678.702162, 'last_price_update_time': 1774868699.433655}
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB41592') HTTP/1.1" 204 0
2026-03-30 11:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:59 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-30 11:04:59 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH96711%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [auto1.de] INFO: Scrape type for EH96711: 0
2026-03-30 11:04:59 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV47355%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [auto1.de] INFO: Scrape type for TV47355: 0
2026-03-30 11:04:59 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL56937%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [auto1.de] INFO: Scrape type for XL56937: 2
2026-03-30 11:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edc9cb10-babd-5e17-97f1-7965df10c168 with identifier: XL56937
2026-03-30 11:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edc9cb10-babd-5e17-97f1-7965df10c168 with scrape type 2
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edc9cb10-babd-5e17-97f1-7965df10c168 with scrape type 2
2026-03-30 11:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edc9cb10-babd-5e17-97f1-7965df10c168, identifier: XL56937
2026-03-30 11:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edc9cb10-babd-5e17-97f1-7965df10c168 with identifier: XL56937
2026-03-30 11:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edc9cb10-babd-5e17-97f1-7965df10c168 with identifier: XL56937
2026-03-30 11:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edc9cb10-babd-5e17-97f1-7965df10c168 with identifier: XL56937 to the API
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:31:43Z',
 'fuel_type': 'petrol',
 'id': 'edc9cb10-babd-5e17-97f1-7965df10c168',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL56937',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 59367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-17',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 TGDI GT",
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2023}
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL56937%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [auto1.de] INFO: Saving data for XL56937: {'auction_closing_time': 1774884703.0, 'created_time': 1773946537.606522, 'last_price_update_time': 1774868699.946229}
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL56937') HTTP/1.1" 204 0
2026-03-30 11:04:59 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-30 11:04:59 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-30 11:04:59 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE62797%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for DE62797: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN55276%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.de] INFO: Scrape type for BN55276: 0
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-30 11:05:00 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-30 11:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:01 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 9573 | hits on page: 40
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT51313%27 HTTP/1.1" 200 None
2026-03-30 11:05:01 [auto1.de] INFO: Scrape type for JT51313: 0
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG61616%27 HTTP/1.1" 200 None
2026-03-30 11:05:01 [auto1.de] INFO: Scrape type for DG61616: 0
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN15165%27 HTTP/1.1" 200 None
2026-03-30 11:05:01 [auto1.de] INFO: Scrape type for AN15165: 0
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF88064%27 HTTP/1.1" 200 None
2026-03-30 11:05:01 [auto1.de] INFO: Scrape type for NF88064: 0
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63876%27 HTTP/1.1" 200 None
2026-03-30 11:05:01 [auto1.de] INFO: Scrape type for DZ63876: 0
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE65204%27 HTTP/1.1" 200 None
2026-03-30 11:05:01 [auto1.de] INFO: Scrape type for VE65204: 0
2026-03-30 11:05:01 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV66840%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for JV66840: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: PV33295
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV33295%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for PV33295: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW15579%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for VW15579: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH20468%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for MH20468: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69075%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for BP69075: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH45132%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for BH45132: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN58244%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for JN58244: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY45921%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for CY45921: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE28536%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for ZE28536: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX04518%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for XX04518: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93561%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for GM93561: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ09412%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for SJ09412: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: SV25975
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV25975%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for SV25975: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR39544%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for AR39544: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ84971%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for SJ84971: 0
2026-03-30 11:05:02 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW32541%27 HTTP/1.1" 200 None
2026-03-30 11:05:02 [auto1.de] INFO: Scrape type for RW32541: 2
2026-03-30 11:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f159673-0961-518e-a8e2-302646b757f2 with identifier: RW32541
2026-03-30 11:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f159673-0961-518e-a8e2-302646b757f2 with scrape type 2
2026-03-30 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f159673-0961-518e-a8e2-302646b757f2 with scrape type 2
2026-03-30 11:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f159673-0961-518e-a8e2-302646b757f2, identifier: RW32541
2026-03-30 11:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f159673-0961-518e-a8e2-302646b757f2 with identifier: RW32541
2026-03-30 11:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f159673-0961-518e-a8e2-302646b757f2 with identifier: RW32541
2026-03-30 11:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f159673-0961-518e-a8e2-302646b757f2 with identifier: RW32541 to the API
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-30T15:05:44Z',
 'fuel_type': 'petrol',
 'id': '2f159673-0961-518e-a8e2-302646b757f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW32541',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 37269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seller_name': None,
 'title': 'Fiat 500 1.2 DolceVita',
 'transmission': 'manual',
 'trim': 'DolceVita',
 'year': 2019}
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW32541%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Saving data for RW32541: {'auction_closing_time': 1774883144.0, 'created_time': 1773228667.10731, 'last_price_update_time': 1774868703.342997}
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW32541') HTTP/1.1" 204 0
2026-03-30 11:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN62296%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for BN62296: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL31529%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.de] INFO: Scrape type for VL31529: 0
2026-03-30 11:05:03 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-30 11:05:03 [scrapy.extensions.logstats] INFO: Crawled 825 pages (at 11 pages/min), scraped 1146 items (at 6 items/min)
2026-03-30 11:05:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:04 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 9572 | hits on page: 40
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT13241%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for LT13241: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV47802%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for VV47802: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH04834%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for YH04834: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK32817%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for RK32817: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH90150%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for UH90150: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD88757%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for UD88757: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP43917%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for JP43917: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH72749%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for YH72749: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE92828%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.de] INFO: Scrape type for KE92828: 0
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-30 11:05:04 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD81240%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.de] INFO: Scrape type for AD81240: 0
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS96658%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.de] INFO: Scrape type for AS96658: 0
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST98775%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.de] INFO: Scrape type for ST98775: 0
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ25721%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.de] INFO: Scrape type for MJ25721: 0
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT65416%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.de] INFO: Scrape type for KT65416: 0
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF96715%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.de] INFO: Scrape type for DF96715: 0
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY05464%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.de] INFO: Scrape type for JY05464: 0
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-30 11:05:05 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-30 11:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:06 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 9572 | hits on page: 40
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24751%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for KX24751: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE68185%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for AE68185: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC67226%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for XC67226: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05119%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for YT05119: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09118%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for CZ09118: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: AW88722
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD16900%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for WD16900: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX85367%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for SX85367: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD99191%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for BD99191: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL28048%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for SL28048: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA61541%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for MA61541: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU85370%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for FU85370: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC91159%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for HC91159: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW37787%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for EW37787: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ26190%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for DZ26190: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU48886%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for ZU48886: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP42616%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for PP42616: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM51665%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for RM51665: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU38066%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for XU38066: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL15014%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for LL15014: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW82569%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for WW82569: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ32773%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for WZ32773: 0
2026-03-30 11:05:06 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN83173%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.de] INFO: Scrape type for BN83173: 0
2026-03-30 11:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:10 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 9572 | hits on page: 40
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR33012%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for GR33012: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03365%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for MH03365: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM60777%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for AM60777: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR44160%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for ZR44160: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP99988%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for GP99988: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR92554%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for ZR92554: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK52286%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for UK52286: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD42848%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for XD42848: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA96638%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for FA96638: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR52886%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for XR52886: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ39955%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for MZ39955: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE07006%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for TE07006: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE62159%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for FE62159: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC12469%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for MC12469: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB37654%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for TB37654: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK01329%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for ZK01329: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS30943%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for SS30943: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH02243%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for RH02243: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB15265%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for BB15265: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY95504%27 HTTP/1.1" 200 None
2026-03-30 11:05:10 [auto1.de] INFO: Scrape type for DY95504: 0
2026-03-30 11:05:10 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-30 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH96915%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for PH96915: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM07898%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for EM07898: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP05122%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for EP05122: 0
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-30 11:05:11 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT52370%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.de] INFO: Scrape type for YT52370: 0
2026-03-30 11:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:12 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 9572 | hits on page: 40
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR50591%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for KR50591: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13721%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for CD13721: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02810%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for WF02810: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL84937%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for TL84937: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24274%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for PG24274: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ88633%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for HJ88633: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75597%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for NY75597: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU59921%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for GU59921: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: PP10507
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP10507%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for PP10507: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD15904%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for SD15904: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG81908%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for BG81908: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ75374%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for GJ75374: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME06173%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for ME06173: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV97888%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for EV97888: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04622%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for HH04622: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL64975%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for PL64975: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF36424%27 HTTP/1.1" 200 None
2026-03-30 11:05:12 [auto1.de] INFO: Scrape type for JF36424: 0
2026-03-30 11:05:12 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-30 11:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:13 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 9573 | hits on page: 40
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG10671%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for BG10671: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN46464%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for AN46464: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY58366%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for ZY58366: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT75774%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for UT75774: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP37567%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for HP37567: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN41414%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for AN41414: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR25980%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for YR25980: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD69180%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for CD69180: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT34656%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for LT34656: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX90434%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for VX90434: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM42204%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for MM42204: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL25204%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for LL25204: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE08080%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for AE08080: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT23493%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for YT23493: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB50562%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for UB50562: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW12135%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for WW12135: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD30169%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for HD30169: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE84104%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for DE84104: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR24647%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for BR24647: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ86962%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for WZ86962: 0
2026-03-30 11:05:13 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF47074%27 HTTP/1.1" 200 None
2026-03-30 11:05:13 [auto1.de] INFO: Scrape type for EF47074: 0
2026-03-30 11:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:18 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 9573 | hits on page: 40
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD55722%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for MD55722: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF73158%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for FF73158: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY67323%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for DY67323: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ66077%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for NJ66077: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK09737%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for UK09737: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV13612%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for AV13612: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT21792%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for MT21792: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD30774%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for ZD30774: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY04572%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for FY04572: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY21775%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for JY21775: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG90770%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for NG90770: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL69348%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for DL69348: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK40199%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for RK40199: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX23620%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for NX23620: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU56450%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for XU56450: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT35414%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for BT35414: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC73225%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for BC73225: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77480%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for YA77480: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL62100%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for HL62100: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP87789%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for DP87789: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ94385%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for BJ94385: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN83370%27 HTTP/1.1" 200 None
2026-03-30 11:05:18 [auto1.de] INFO: Scrape type for EN83370: 0
2026-03-30 11:05:18 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-30 11:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:26 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 9575 | hits on page: 40
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN83370%27 HTTP/1.1" 200 None
2026-03-30 11:05:26 [auto1.de] INFO: Scrape type for EN83370: 0
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA59196%27 HTTP/1.1" 200 None
2026-03-30 11:05:26 [auto1.de] INFO: Scrape type for SA59196: 0
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH38821%27 HTTP/1.1" 200 None
2026-03-30 11:05:26 [auto1.de] INFO: Scrape type for AH38821: 0
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ27429%27 HTTP/1.1" 200 None
2026-03-30 11:05:26 [auto1.de] INFO: Scrape type for WZ27429: 0
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF83541%27 HTTP/1.1" 200 None
2026-03-30 11:05:26 [auto1.de] INFO: Scrape type for YF83541: 0
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC36419%27 HTTP/1.1" 200 None
2026-03-30 11:05:26 [auto1.de] INFO: Scrape type for MC36419: 0
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK25487%27 HTTP/1.1" 200 None
2026-03-30 11:05:26 [auto1.de] INFO: Scrape type for BK25487: 0
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13854%27 HTTP/1.1" 200 None
2026-03-30 11:05:26 [auto1.de] INFO: Scrape type for EA13854: 0
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67551%27 HTTP/1.1" 200 None
2026-03-30 11:05:26 [auto1.de] INFO: Scrape type for MH67551: 0
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA94096%27 HTTP/1.1" 200 None
2026-03-30 11:05:26 [auto1.de] INFO: Scrape type for SA94096: 0
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF98082%27 HTTP/1.1" 200 None
2026-03-30 11:05:26 [auto1.de] INFO: Scrape type for KF98082: 0
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK49064%27 HTTP/1.1" 200 None
2026-03-30 11:05:26 [auto1.de] INFO: Scrape type for BK49064: 0
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE33973%27 HTTP/1.1" 200 None
2026-03-30 11:05:26 [auto1.de] INFO: Scrape type for HE33973: 0
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA65377%27 HTTP/1.1" 200 None
2026-03-30 11:05:26 [auto1.de] INFO: Scrape type for HA65377: 0
2026-03-30 11:05:26 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-30 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR72060%27 HTTP/1.1" 200 None
2026-03-30 11:05:27 [auto1.de] INFO: Scrape type for AR72060: 0
2026-03-30 11:05:27 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-30 11:05:27 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-30 11:05:27 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-30 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG36952%27 HTTP/1.1" 200 None
2026-03-30 11:05:27 [auto1.de] INFO: Scrape type for BG36952: 0
2026-03-30 11:05:27 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-30 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR06088%27 HTTP/1.1" 200 None
2026-03-30 11:05:27 [auto1.de] INFO: Scrape type for XR06088: 0
2026-03-30 11:05:27 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-30 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK78247%27 HTTP/1.1" 200 None
2026-03-30 11:05:27 [auto1.de] INFO: Scrape type for WK78247: 0
2026-03-30 11:05:27 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-30 11:05:27 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-30 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY74387%27 HTTP/1.1" 200 None
2026-03-30 11:05:27 [auto1.de] INFO: Scrape type for RY74387: 0
2026-03-30 11:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:39 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 9579 | hits on page: 40
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR06088%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.de] INFO: Scrape type for XR06088: 0
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK78247%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.de] INFO: Scrape type for WK78247: 0
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY74387%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.de] INFO: Scrape type for RY74387: 0
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB80689%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.de] INFO: Scrape type for NB80689: 0
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37659%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.de] INFO: Scrape type for CG37659: 0
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05399%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.de] INFO: Scrape type for LU05399: 0
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM12960%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.de] INFO: Scrape type for ZM12960: 0
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH13691%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.de] INFO: Scrape type for NH13691: 0
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG81975%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.de] INFO: Scrape type for MG81975: 0
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-30 11:05:39 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU88385%27 HTTP/1.1" 200 None
2026-03-30 11:05:39 [auto1.de] INFO: Scrape type for HU88385: 2
2026-03-30 11:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a2f53a0-5a13-5302-9d04-02e01fe32665 with identifier: HU88385
2026-03-30 11:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a2f53a0-5a13-5302-9d04-02e01fe32665 with scrape type 2
2026-03-30 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a2f53a0-5a13-5302-9d04-02e01fe32665 with scrape type 2
2026-03-30 11:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a2f53a0-5a13-5302-9d04-02e01fe32665, identifier: HU88385
2026-03-30 11:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a2f53a0-5a13-5302-9d04-02e01fe32665 with identifier: HU88385
2026-03-30 11:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a2f53a0-5a13-5302-9d04-02e01fe32665 with identifier: HU88385
2026-03-30 11:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a2f53a0-5a13-5302-9d04-02e01fe32665 with identifier: HU88385 to the API
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:20:46Z',
 'fuel_type': 'diesel',
 'id': '9a2f53a0-5a13-5302-9d04-02e01fe32665',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU88385',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 352212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 250 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2011}
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU88385%27 HTTP/1.1" 200 None
2026-03-30 11:05:40 [auto1.de] INFO: Saving data for HU88385: {'auction_closing_time': 1774884046.0, 'created_time': 1773945927.372912, 'last_price_update_time': 1774868740.85318}
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU88385') HTTP/1.1" 204 0
2026-03-30 11:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:40 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-30 11:05:40 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-30 11:05:40 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV10728%27 HTTP/1.1" 200 None
2026-03-30 11:05:40 [auto1.de] INFO: Scrape type for BV10728: 0
2026-03-30 11:05:40 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-30 11:05:40 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-30 11:05:40 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX49915%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [auto1.de] INFO: Scrape type for HX49915: 2
2026-03-30 11:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28acd615-2ad7-5dde-aed3-cc4989013e84 with identifier: HX49915
2026-03-30 11:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28acd615-2ad7-5dde-aed3-cc4989013e84 with scrape type 2
2026-03-30 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28acd615-2ad7-5dde-aed3-cc4989013e84 with scrape type 2
2026-03-30 11:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28acd615-2ad7-5dde-aed3-cc4989013e84, identifier: HX49915
2026-03-30 11:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28acd615-2ad7-5dde-aed3-cc4989013e84 with identifier: HX49915
2026-03-30 11:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28acd615-2ad7-5dde-aed3-cc4989013e84 with identifier: HX49915
2026-03-30 11:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28acd615-2ad7-5dde-aed3-cc4989013e84 with identifier: HX49915 to the API
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:34:17Z',
 'fuel_type': 'petrol',
 'id': '28acd615-2ad7-5dde-aed3-cc4989013e84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX49915',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 47182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-13',
 'seller_name': None,
 'title': 'Kia XCeed 1.6 TGDI Black Xdition',
 'transmission': 'automatic',
 'trim': 'Black Xdition',
 'year': 2022}
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX49915%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [auto1.de] INFO: Saving data for HX49915: {'auction_closing_time': 1774884857.0, 'created_time': 1773382553.038197, 'last_price_update_time': 1774868741.43672}
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX49915') HTTP/1.1" 204 0
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70837%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [auto1.de] INFO: Scrape type for DM70837: 0
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE50897%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [auto1.de] INFO: Scrape type for KE50897: 0
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM64478%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [auto1.de] INFO: Scrape type for AM64478: 0
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL07705%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [auto1.de] INFO: Scrape type for BL07705: 0
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92660%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [auto1.de] INFO: Scrape type for TX92660: 0
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF85526%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [auto1.de] INFO: Scrape type for CF85526: 0
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP72323%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [auto1.de] INFO: Scrape type for RP72323: 0
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX91022%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [auto1.de] INFO: Scrape type for GX91022: 0
2026-03-30 11:05:41 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19270%27 HTTP/1.1" 200 None
2026-03-30 11:05:41 [auto1.de] INFO: Scrape type for YJ19270: 0
2026-03-30 11:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:48 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 9579 | hits on page: 40
2026-03-30 11:05:48 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL76472%27 HTTP/1.1" 200 None
2026-03-30 11:05:48 [auto1.de] INFO: Scrape type for YL76472: 0
2026-03-30 11:05:48 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL79607%27 HTTP/1.1" 200 None
2026-03-30 11:05:48 [auto1.de] INFO: Scrape type for KL79607: 0
2026-03-30 11:05:48 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-30 11:05:48 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88982%27 HTTP/1.1" 200 None
2026-03-30 11:05:48 [auto1.de] INFO: Scrape type for HG88982: 0
2026-03-30 11:05:48 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-30 11:05:48 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA56207%27 HTTP/1.1" 200 None
2026-03-30 11:05:48 [auto1.de] INFO: Scrape type for UA56207: 0
2026-03-30 11:05:48 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-30 11:05:48 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-30 11:05:48 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-30 11:05:48 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-30 11:05:48 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL54594%27 HTTP/1.1" 200 None
2026-03-30 11:05:48 [auto1.de] INFO: Scrape type for DL54594: 0
2026-03-30 11:05:48 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-30 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED43113%27 HTTP/1.1" 200 None
2026-03-30 11:05:49 [auto1.de] INFO: Scrape type for ED43113: 0
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW09320%27 HTTP/1.1" 200 None
2026-03-30 11:05:49 [auto1.de] INFO: Scrape type for BW09320: 0
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP13980%27 HTTP/1.1" 200 None
2026-03-30 11:05:49 [auto1.de] INFO: Scrape type for EP13980: 0
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP19513%27 HTTP/1.1" 200 None
2026-03-30 11:05:49 [auto1.de] INFO: Scrape type for GP19513: 0
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE37083%27 HTTP/1.1" 200 None
2026-03-30 11:05:49 [auto1.de] INFO: Scrape type for DE37083: 0
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB96558%27 HTTP/1.1" 200 None
2026-03-30 11:05:49 [auto1.de] INFO: Scrape type for VB96558: 0
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34308%27 HTTP/1.1" 200 None
2026-03-30 11:05:49 [auto1.de] INFO: Scrape type for DG34308: 0
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW98982%27 HTTP/1.1" 200 None
2026-03-30 11:05:49 [auto1.de] INFO: Scrape type for UW98982: 0
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM13407%27 HTTP/1.1" 200 None
2026-03-30 11:05:49 [auto1.de] INFO: Scrape type for SM13407: 0
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-30 11:05:49 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-30 11:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:52 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 9579 | hits on page: 40
2026-03-30 11:05:52 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71348%27 HTTP/1.1" 200 None
2026-03-30 11:05:52 [auto1.de] INFO: Scrape type for KZ71348: 0
2026-03-30 11:05:52 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-30 11:05:52 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-30 11:05:52 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-30 11:05:52 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP54397%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for GP54397: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE22331%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for DE22331: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: US78573
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US78573%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for US78573: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ96543%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for XZ96543: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93445%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for NL93445: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13409%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for TR13409: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA38480%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for CA38480: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS55646%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for ZS55646: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK62428%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for VK62428: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD70157%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for MD70157: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT32036%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for UT32036: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM14327%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for XM14327: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF88550%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for UF88550: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH20562%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for KH20562: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND67175%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for ND67175: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ90967%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for JJ90967: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG01299%27 HTTP/1.1" 200 None
2026-03-30 11:05:53 [auto1.de] INFO: Scrape type for FG01299: 0
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: XN62659
2026-03-30 11:05:53 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-30 11:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:54 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 9579 | hits on page: 40
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD50788%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for XD50788: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30438%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for WX30438: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED91782%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for ED91782: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE71372%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for FE71372: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51493%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for SS51493: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN05925%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for ZN05925: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ29192%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for JJ29192: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56526%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for KU56526: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ04828%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for HJ04828: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: WD73510
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD73510%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for WD73510: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH25486%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for PH25486: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX13584%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for WX13584: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35846%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for PB35846: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY60596%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for HY60596: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY00431%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for EY00431: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ14311%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for RZ14311: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS55163%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for YS55163: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM76815%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for BM76815: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK68330%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for MK68330: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB08106%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for HB08106: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70862%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [auto1.de] INFO: Scrape type for DM70862: 0
2026-03-30 11:05:54 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-30 11:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:03 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 9581 | hits on page: 40
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70862%27 HTTP/1.1" 200 None
2026-03-30 11:06:03 [auto1.de] INFO: Scrape type for DM70862: 0
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU40216%27 HTTP/1.1" 200 None
2026-03-30 11:06:03 [auto1.de] INFO: Scrape type for ZU40216: 0
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE61397%27 HTTP/1.1" 200 None
2026-03-30 11:06:03 [auto1.de] INFO: Scrape type for VE61397: 0
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23896%27 HTTP/1.1" 200 None
2026-03-30 11:06:03 [auto1.de] INFO: Scrape type for JD23896: 0
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW97412%27 HTTP/1.1" 200 None
2026-03-30 11:06:03 [auto1.de] INFO: Scrape type for GW97412: 0
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA54240%27 HTTP/1.1" 200 None
2026-03-30 11:06:03 [auto1.de] INFO: Scrape type for CA54240: 0
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV08426%27 HTTP/1.1" 200 None
2026-03-30 11:06:03 [auto1.de] INFO: Scrape type for UV08426: 0
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS28030%27 HTTP/1.1" 200 None
2026-03-30 11:06:03 [auto1.de] INFO: Scrape type for SS28030: 0
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU97666%27 HTTP/1.1" 200 None
2026-03-30 11:06:03 [auto1.de] INFO: Scrape type for VU97666: 0
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-30 11:06:03 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN40502%27 HTTP/1.1" 200 None
2026-03-30 11:06:03 [auto1.de] INFO: Scrape type for ZN40502: 2
2026-03-30 11:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5a357f5-4c18-50f0-82c9-55ba71e1afe7 with identifier: ZN40502
2026-03-30 11:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5a357f5-4c18-50f0-82c9-55ba71e1afe7 with scrape type 2
2026-03-30 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5a357f5-4c18-50f0-82c9-55ba71e1afe7 with scrape type 2
2026-03-30 11:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5a357f5-4c18-50f0-82c9-55ba71e1afe7, identifier: ZN40502
2026-03-30 11:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5a357f5-4c18-50f0-82c9-55ba71e1afe7 with identifier: ZN40502
2026-03-30 11:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5a357f5-4c18-50f0-82c9-55ba71e1afe7 with identifier: ZN40502
2026-03-30 11:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5a357f5-4c18-50f0-82c9-55ba71e1afe7 with identifier: ZN40502 to the API
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:35:19Z',
 'fuel_type': 'petrol',
 'id': 'f5a357f5-4c18-50f0-82c9-55ba71e1afe7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN40502',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 149528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-07',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2015}
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN40502%27 HTTP/1.1" 200 None
2026-03-30 11:06:03 [auto1.de] INFO: Saving data for ZN40502: {'auction_closing_time': 1774884919.0, 'created_time': 1773646560.606247, 'last_price_update_time': 1774868763.969462}
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN40502') HTTP/1.1" 204 0
2026-03-30 11:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU43350%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for ZU43350: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD78060%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for VD78060: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV10952%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for WV10952: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW04069%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for RW04069: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51107%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for SS51107: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ43768%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for ZZ43768: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS04042%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for CS04042: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH89031%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for FH89031: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG21382%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for YG21382: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ78717%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for AJ78717: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU03537%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for YU03537: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK43120%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for ZK43120: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC19815%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for SC19815: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ77655%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for DJ77655: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE48122%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for JE48122: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW69749%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for LW69749: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG35961%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for DG35961: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF31444%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for BF31444: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU51889%27 HTTP/1.1" 200 None
2026-03-30 11:06:04 [auto1.de] INFO: Scrape type for EU51889: 0
2026-03-30 11:06:04 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-30 11:06:04 [scrapy.extensions.logstats] INFO: Crawled 837 pages (at 12 pages/min), scraped 1149 items (at 3 items/min)
2026-03-30 11:06:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:10 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 9581 | hits on page: 40
2026-03-30 11:06:10 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-30 11:06:10 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-30 11:06:10 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD83034%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for SD83034: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG76856%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for EG76856: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: US02373
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR94699%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for DR94699: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY84491%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for SY84491: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT65842%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for CT65842: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63692%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for TP63692: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA01752%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for TA01752: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: EK13927
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK13927%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for EK13927: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH07682%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for GH07682: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR38354%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for CR38354: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB32004%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for WB32004: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28097%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for WC28097: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97428%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for YY97428: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM80186%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for EM80186: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09685%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for DB09685: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT11802%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for HT11802: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11611%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for SY11611: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE16717%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for NE16717: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX36326%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for HX36326: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW76685%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for ZW76685: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT22955%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for ZT22955: 0
2026-03-30 11:06:11 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML35786%27 HTTP/1.1" 200 None
2026-03-30 11:06:11 [auto1.de] INFO: Scrape type for ML35786: 0
2026-03-30 11:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:47 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 9587 | hits on page: 40
2026-03-30 11:06:47 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE16717%27 HTTP/1.1" 200 None
2026-03-30 11:06:47 [auto1.de] INFO: Scrape type for NE16717: 0
2026-03-30 11:06:47 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX36326%27 HTTP/1.1" 200 None
2026-03-30 11:06:47 [auto1.de] INFO: Scrape type for HX36326: 0
2026-03-30 11:06:47 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-30 11:06:47 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW76685%27 HTTP/1.1" 200 None
2026-03-30 11:06:47 [auto1.de] INFO: Scrape type for ZW76685: 0
2026-03-30 11:06:47 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT22955%27 HTTP/1.1" 200 None
2026-03-30 11:06:47 [auto1.de] INFO: Scrape type for ZT22955: 0
2026-03-30 11:06:47 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML35786%27 HTTP/1.1" 200 None
2026-03-30 11:06:47 [auto1.de] INFO: Scrape type for ML35786: 0
2026-03-30 11:06:47 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-30 11:06:47 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-30 11:06:47 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC06699%27 HTTP/1.1" 200 None
2026-03-30 11:06:47 [auto1.de] INFO: Scrape type for BC06699: 0
2026-03-30 11:06:47 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG74367%27 HTTP/1.1" 200 None
2026-03-30 11:06:47 [auto1.de] INFO: Scrape type for YG74367: 0
2026-03-30 11:06:47 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX62437%27 HTTP/1.1" 200 None
2026-03-30 11:06:47 [auto1.de] INFO: Scrape type for BX62437: 0
2026-03-30 11:06:47 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX92411%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for XX92411: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW39351%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for TW39351: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06555%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for VN06555: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48051%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for MY48051: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA07160%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for EA07160: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14298%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for UC14298: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78048%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for FJ78048: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02201%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for FZ02201: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ76178%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for DJ76178: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN41224%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for NN41224: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: US46384
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42354%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for BZ42354: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB03726%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for JB03726: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL79145%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for EL79145: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59883%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for UA59883: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU11267%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for PU11267: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM22108%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for AM22108: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU95957%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.de] INFO: Scrape type for FU95957: 0
2026-03-30 11:06:48 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-30 11:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:07:03 [scrapy.extensions.logstats] INFO: Crawled 839 pages (at 2 pages/min), scraped 1149 items (at 0 items/min)
2026-03-30 11:07:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:07:26 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 9592 | hits on page: 40
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM22108%27 HTTP/1.1" 200 None
2026-03-30 11:07:26 [auto1.de] INFO: Scrape type for AM22108: 0
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU95957%27 HTTP/1.1" 200 None
2026-03-30 11:07:26 [auto1.de] INFO: Scrape type for FU95957: 0
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG88480%27 HTTP/1.1" 200 None
2026-03-30 11:07:26 [auto1.de] INFO: Scrape type for AG88480: 0
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV40802%27 HTTP/1.1" 200 None
2026-03-30 11:07:26 [auto1.de] INFO: Scrape type for AV40802: 0
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU33293%27 HTTP/1.1" 200 None
2026-03-30 11:07:26 [auto1.de] INFO: Scrape type for EU33293: 0
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY72609%27 HTTP/1.1" 200 None
2026-03-30 11:07:26 [auto1.de] INFO: Scrape type for DY72609: 0
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB14997%27 HTTP/1.1" 200 None
2026-03-30 11:07:26 [auto1.de] INFO: Scrape type for BB14997: 0
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF39586%27 HTTP/1.1" 200 None
2026-03-30 11:07:26 [auto1.de] INFO: Scrape type for FF39586: 0
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG61391%27 HTTP/1.1" 200 None
2026-03-30 11:07:26 [auto1.de] INFO: Scrape type for RG61391: 0
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA15787%27 HTTP/1.1" 200 None
2026-03-30 11:07:26 [auto1.de] INFO: Scrape type for XA15787: 0
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG58500%27 HTTP/1.1" 200 None
2026-03-30 11:07:26 [auto1.de] INFO: Scrape type for XG58500: 0
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: US51436
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG49368%27 HTTP/1.1" 200 None
2026-03-30 11:07:26 [auto1.de] INFO: Scrape type for PG49368: 0
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA77354%27 HTTP/1.1" 200 None
2026-03-30 11:07:26 [auto1.de] INFO: Scrape type for PA77354: 0
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT59305%27 HTTP/1.1" 200 None
2026-03-30 11:07:26 [auto1.de] INFO: Scrape type for UT59305: 0
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47615%27 HTTP/1.1" 200 None
2026-03-30 11:07:26 [auto1.de] INFO: Scrape type for EJ47615: 0
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM67977%27 HTTP/1.1" 200 None
2026-03-30 11:07:26 [auto1.de] INFO: Scrape type for KM67977: 0
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-30 11:07:26 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-30 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB02361%27 HTTP/1.1" 200 None
2026-03-30 11:07:27 [auto1.de] INFO: Scrape type for YB02361: 0
2026-03-30 11:07:27 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-30 11:07:27 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-30 11:07:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:03 [scrapy.extensions.logstats] INFO: Crawled 840 pages (at 1 pages/min), scraped 1149 items (at 0 items/min)
2026-03-30 11:08:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:32 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 9600 | hits on page: 40
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM67977%27 HTTP/1.1" 200 None
2026-03-30 11:08:32 [auto1.de] INFO: Scrape type for KM67977: 0
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB02361%27 HTTP/1.1" 200 None
2026-03-30 11:08:32 [auto1.de] INFO: Scrape type for YB02361: 0
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG96137%27 HTTP/1.1" 200 None
2026-03-30 11:08:32 [auto1.de] INFO: Scrape type for PG96137: 0
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL13857%27 HTTP/1.1" 200 None
2026-03-30 11:08:32 [auto1.de] INFO: Scrape type for XL13857: 0
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ39363%27 HTTP/1.1" 200 None
2026-03-30 11:08:32 [auto1.de] INFO: Scrape type for TJ39363: 0
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN86617%27 HTTP/1.1" 200 None
2026-03-30 11:08:32 [auto1.de] INFO: Scrape type for PN86617: 0
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG32866%27 HTTP/1.1" 200 None
2026-03-30 11:08:32 [auto1.de] INFO: Scrape type for MG32866: 0
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45710%27 HTTP/1.1" 200 None
2026-03-30 11:08:32 [auto1.de] INFO: Scrape type for NY45710: 0
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA43321%27 HTTP/1.1" 200 None
2026-03-30 11:08:32 [auto1.de] INFO: Scrape type for BA43321: 0
2026-03-30 11:08:32 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-30 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX49945%27 HTTP/1.1" 200 None
2026-03-30 11:08:33 [auto1.de] INFO: Scrape type for RX49945: 0
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-30 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK83629%27 HTTP/1.1" 200 None
2026-03-30 11:08:33 [auto1.de] INFO: Scrape type for BK83629: 0
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-30 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW06930%27 HTTP/1.1" 200 None
2026-03-30 11:08:33 [auto1.de] INFO: Scrape type for EW06930: 0
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-30 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH67751%27 HTTP/1.1" 200 None
2026-03-30 11:08:33 [auto1.de] INFO: Scrape type for LH67751: 0
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-30 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS61714%27 HTTP/1.1" 200 None
2026-03-30 11:08:33 [auto1.de] INFO: Scrape type for TS61714: 0
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: FJ40863
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-30 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27909%27 HTTP/1.1" 200 None
2026-03-30 11:08:33 [auto1.de] INFO: Scrape type for BG27909: 0
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-30 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY54532%27 HTTP/1.1" 200 None
2026-03-30 11:08:33 [auto1.de] INFO: Scrape type for HY54532: 0
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-30 11:08:33 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-30 11:08:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:34 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 9600 | hits on page: 40
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC84828%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for GC84828: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65486%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for AH65486: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY33433%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for AY33433: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB04104%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for SB04104: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC39197%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for TC39197: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH69826%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for MH69826: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU27466%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for EU27466: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR48762%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for ZR48762: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: HU76899
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC43890%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for BC43890: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ70756%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for DZ70756: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC98509%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for KC98509: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: ZY67532
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67532%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for ZY67532: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN84486%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for RN84486: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY30353%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for FY30353: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS83474%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for BS83474: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB23649%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for EB23649: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR55651%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for WR55651: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ64082%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for PZ64082: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: RU04475
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU04475%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for RU04475: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM46932%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for CM46932: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU99321%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [auto1.de] INFO: Scrape type for YU99321: 0
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-30 11:08:34 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-30 11:08:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:03 [scrapy.extensions.logstats] INFO: Crawled 842 pages (at 2 pages/min), scraped 1149 items (at 0 items/min)
2026-03-30 11:09:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:40 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 9609 | hits on page: 40
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR55651%27 HTTP/1.1" 200 None
2026-03-30 11:09:40 [auto1.de] INFO: Scrape type for WR55651: 0
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ64082%27 HTTP/1.1" 200 None
2026-03-30 11:09:40 [auto1.de] INFO: Scrape type for PZ64082: 0
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: RU04475
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU04475%27 HTTP/1.1" 200 None
2026-03-30 11:09:40 [auto1.de] INFO: Scrape type for RU04475: 0
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM46932%27 HTTP/1.1" 200 None
2026-03-30 11:09:40 [auto1.de] INFO: Scrape type for CM46932: 0
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU99321%27 HTTP/1.1" 200 None
2026-03-30 11:09:40 [auto1.de] INFO: Scrape type for YU99321: 0
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS30478%27 HTTP/1.1" 200 None
2026-03-30 11:09:40 [auto1.de] INFO: Scrape type for BS30478: 0
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR11096%27 HTTP/1.1" 200 None
2026-03-30 11:09:40 [auto1.de] INFO: Scrape type for GR11096: 0
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69696%27 HTTP/1.1" 200 None
2026-03-30 11:09:40 [auto1.de] INFO: Scrape type for BP69696: 0
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS98384%27 HTTP/1.1" 200 None
2026-03-30 11:09:40 [auto1.de] INFO: Scrape type for VS98384: 0
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH30601%27 HTTP/1.1" 200 None
2026-03-30 11:09:40 [auto1.de] INFO: Scrape type for CH30601: 0
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW30512%27 HTTP/1.1" 200 None
2026-03-30 11:09:40 [auto1.de] INFO: Scrape type for LW30512: 0
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43090%27 HTTP/1.1" 200 None
2026-03-30 11:09:40 [auto1.de] INFO: Scrape type for UZ43090: 0
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27132%27 HTTP/1.1" 200 None
2026-03-30 11:09:40 [auto1.de] INFO: Scrape type for GB27132: 0
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR98479%27 HTTP/1.1" 200 None
2026-03-30 11:09:40 [auto1.de] INFO: Scrape type for JR98479: 0
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD70727%27 HTTP/1.1" 200 None
2026-03-30 11:09:40 [auto1.de] INFO: Scrape type for ZD70727: 0
2026-03-30 11:09:40 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-30 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW15562%27 HTTP/1.1" 200 None
2026-03-30 11:09:41 [auto1.de] INFO: Scrape type for RW15562: 0
2026-03-30 11:09:41 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-30 11:09:41 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78889%27 HTTP/1.1" 200 None
2026-03-30 11:09:41 [auto1.de] INFO: Scrape type for RX78889: 0
2026-03-30 11:09:41 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV32823%27 HTTP/1.1" 200 None
2026-03-30 11:09:41 [auto1.de] INFO: Scrape type for AV32823: 0
2026-03-30 11:09:41 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB42809%27 HTTP/1.1" 200 None
2026-03-30 11:09:41 [auto1.de] INFO: Scrape type for FB42809: 0
2026-03-30 11:09:41 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-30 11:09:41 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU34060%27 HTTP/1.1" 200 None
2026-03-30 11:09:41 [auto1.de] INFO: Scrape type for WU34060: 0
2026-03-30 11:09:41 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD28346%27 HTTP/1.1" 200 None
2026-03-30 11:09:41 [auto1.de] INFO: Scrape type for DD28346: 0
2026-03-30 11:09:41 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT12990%27 HTTP/1.1" 200 None
2026-03-30 11:09:41 [auto1.de] INFO: Scrape type for YT12990: 0
2026-03-30 11:09:41 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT59111%27 HTTP/1.1" 200 None
2026-03-30 11:09:41 [auto1.de] INFO: Scrape type for MT59111: 0
2026-03-30 11:09:41 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-30 11:09:41 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV33102%27 HTTP/1.1" 200 None
2026-03-30 11:09:41 [auto1.de] INFO: Scrape type for HV33102: 0
2026-03-30 11:09:41 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-30 11:09:41 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14305%27 HTTP/1.1" 200 None
2026-03-30 11:09:41 [auto1.de] INFO: Scrape type for VX14305: 0
2026-03-30 11:09:41 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ15565%27 HTTP/1.1" 200 None
2026-03-30 11:09:41 [auto1.de] INFO: Scrape type for VZ15565: 0
2026-03-30 11:09:41 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-30 11:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:43 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 9610 | hits on page: 40
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV00892%27 HTTP/1.1" 200 None
2026-03-30 11:09:43 [auto1.de] INFO: Scrape type for NV00892: 0
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV84531%27 HTTP/1.1" 200 None
2026-03-30 11:09:43 [auto1.de] INFO: Scrape type for CV84531: 0
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF17826%27 HTTP/1.1" 200 None
2026-03-30 11:09:43 [auto1.de] INFO: Scrape type for UF17826: 0
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS44353%27 HTTP/1.1" 200 None
2026-03-30 11:09:43 [auto1.de] INFO: Scrape type for ZS44353: 0
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83953%27 HTTP/1.1" 200 None
2026-03-30 11:09:43 [auto1.de] INFO: Scrape type for KA83953: 0
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY07029%27 HTTP/1.1" 200 None
2026-03-30 11:09:43 [auto1.de] INFO: Scrape type for ZY07029: 0
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA52388%27 HTTP/1.1" 200 None
2026-03-30 11:09:43 [auto1.de] INFO: Scrape type for XA52388: 0
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD89320%27 HTTP/1.1" 200 None
2026-03-30 11:09:43 [auto1.de] INFO: Scrape type for XD89320: 0
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB97805%27 HTTP/1.1" 200 None
2026-03-30 11:09:43 [auto1.de] INFO: Scrape type for NB97805: 0
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA38517%27 HTTP/1.1" 200 None
2026-03-30 11:09:43 [auto1.de] INFO: Scrape type for AA38517: 0
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ60217%27 HTTP/1.1" 200 None
2026-03-30 11:09:43 [auto1.de] INFO: Scrape type for BZ60217: 0
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN58071%27 HTTP/1.1" 200 None
2026-03-30 11:09:43 [auto1.de] INFO: Scrape type for LN58071: 0
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD46064%27 HTTP/1.1" 200 None
2026-03-30 11:09:43 [auto1.de] INFO: Scrape type for BD46064: 0
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54184%27 HTTP/1.1" 200 None
2026-03-30 11:09:43 [auto1.de] INFO: Scrape type for JP54184: 0
2026-03-30 11:09:43 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-30 11:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:55 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 9613 | hits on page: 40
2026-03-30 11:09:55 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD46064%27 HTTP/1.1" 200 None
2026-03-30 11:09:55 [auto1.de] INFO: Scrape type for BD46064: 0
2026-03-30 11:09:55 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54184%27 HTTP/1.1" 200 None
2026-03-30 11:09:55 [auto1.de] INFO: Scrape type for JP54184: 0
2026-03-30 11:09:55 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-30 11:09:55 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-30 11:09:55 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-30 11:09:55 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-30 11:09:55 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB84476%27 HTTP/1.1" 200 None
2026-03-30 11:09:55 [auto1.de] INFO: Scrape type for FB84476: 0
2026-03-30 11:09:55 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80903%27 HTTP/1.1" 200 None
2026-03-30 11:09:55 [auto1.de] INFO: Scrape type for AW80903: 0
2026-03-30 11:09:55 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-30 11:09:55 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG89372%27 HTTP/1.1" 200 None
2026-03-30 11:09:55 [auto1.de] INFO: Scrape type for NG89372: 0
2026-03-30 11:09:55 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC98877%27 HTTP/1.1" 200 None
2026-03-30 11:09:55 [auto1.de] INFO: Scrape type for MC98877: 0
2026-03-30 11:09:55 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN54723%27 HTTP/1.1" 200 None
2026-03-30 11:09:55 [auto1.de] INFO: Scrape type for VN54723: 0
2026-03-30 11:09:55 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-30 11:09:55 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-30 11:09:55 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-30 11:09:56 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-30 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ83010%27 HTTP/1.1" 200 None
2026-03-30 11:09:56 [auto1.de] INFO: Scrape type for VZ83010: 0
2026-03-30 11:09:56 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-30 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK11382%27 HTTP/1.1" 200 None
2026-03-30 11:09:56 [auto1.de] INFO: Scrape type for CK11382: 0
2026-03-30 11:09:56 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-30 11:09:56 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-30 11:09:56 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-30 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH53597%27 HTTP/1.1" 200 None
2026-03-30 11:09:56 [auto1.de] INFO: Scrape type for NH53597: 0
2026-03-30 11:09:56 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-30 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA91230%27 HTTP/1.1" 200 None
2026-03-30 11:09:56 [auto1.de] INFO: Scrape type for PA91230: 2
2026-03-30 11:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e83648-ae68-5662-bf56-34c387ee1434 with identifier: PA91230
2026-03-30 11:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e83648-ae68-5662-bf56-34c387ee1434 with scrape type 2
2026-03-30 11:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2e83648-ae68-5662-bf56-34c387ee1434 with scrape type 2
2026-03-30 11:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2e83648-ae68-5662-bf56-34c387ee1434, identifier: PA91230
2026-03-30 11:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2e83648-ae68-5662-bf56-34c387ee1434 with identifier: PA91230
2026-03-30 11:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2e83648-ae68-5662-bf56-34c387ee1434 with identifier: PA91230
2026-03-30 11:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2e83648-ae68-5662-bf56-34c387ee1434 with identifier: PA91230 to the API
2026-03-30 11:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:36:38Z',
 'fuel_type': 'diesel',
 'id': 'e2e83648-ae68-5662-bf56-34c387ee1434',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA91230',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 100861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-15',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2014}
2026-03-30 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA91230%27 HTTP/1.1" 200 None
2026-03-30 11:09:56 [auto1.de] INFO: Saving data for PA91230: {'auction_closing_time': 1774884998.0, 'created_time': 1772725959.958995, 'last_price_update_time': 1774868996.836871}
2026-03-30 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA91230') HTTP/1.1" 204 0
2026-03-30 11:09:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC93517%27 HTTP/1.1" 200 None
2026-03-30 11:09:57 [auto1.de] INFO: Scrape type for MC93517: 0
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM30220%27 HTTP/1.1" 200 None
2026-03-30 11:09:57 [auto1.de] INFO: Scrape type for KM30220: 0
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP96455%27 HTTP/1.1" 200 None
2026-03-30 11:09:57 [auto1.de] INFO: Scrape type for EP96455: 0
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE80399%27 HTTP/1.1" 200 None
2026-03-30 11:09:57 [auto1.de] INFO: Scrape type for BE80399: 0
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC65369%27 HTTP/1.1" 200 None
2026-03-30 11:09:57 [auto1.de] INFO: Scrape type for BC65369: 0
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS51325%27 HTTP/1.1" 200 None
2026-03-30 11:09:57 [auto1.de] INFO: Scrape type for VS51325: 0
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-30 11:09:57 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM38981%27 HTTP/1.1" 200 None
2026-03-30 11:09:57 [auto1.de] INFO: Scrape type for SM38981: 0
2026-03-30 11:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:02 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 9615 | hits on page: 40
2026-03-30 11:10:02 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-30 11:10:02 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM38981%27 HTTP/1.1" 200 None
2026-03-30 11:10:02 [auto1.de] INFO: Scrape type for SM38981: 0
2026-03-30 11:10:02 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-30 11:10:02 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM37211%27 HTTP/1.1" 200 None
2026-03-30 11:10:02 [auto1.de] INFO: Scrape type for CM37211: 0
2026-03-30 11:10:02 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM68343%27 HTTP/1.1" 200 None
2026-03-30 11:10:02 [auto1.de] INFO: Scrape type for AM68343: 0
2026-03-30 11:10:02 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-30 11:10:02 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS74193%27 HTTP/1.1" 200 None
2026-03-30 11:10:02 [auto1.de] INFO: Scrape type for PS74193: 2
2026-03-30 11:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c911216f-2756-541d-8dfc-2e18f22bded4 with identifier: PS74193
2026-03-30 11:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c911216f-2756-541d-8dfc-2e18f22bded4 with scrape type 2
2026-03-30 11:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c911216f-2756-541d-8dfc-2e18f22bded4 with scrape type 2
2026-03-30 11:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c911216f-2756-541d-8dfc-2e18f22bded4, identifier: PS74193
2026-03-30 11:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c911216f-2756-541d-8dfc-2e18f22bded4 with identifier: PS74193
2026-03-30 11:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c911216f-2756-541d-8dfc-2e18f22bded4 with identifier: PS74193
2026-03-30 11:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c911216f-2756-541d-8dfc-2e18f22bded4 with identifier: PS74193 to the API
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-30T15:21:28Z',
 'fuel_type': 'petrol',
 'id': 'c911216f-2756-541d-8dfc-2e18f22bded4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS74193',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 186600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-26',
 'seller_name': None,
 'title': 'Porsche Panamera 4S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS74193%27 HTTP/1.1" 200 None
2026-03-30 11:10:02 [auto1.de] INFO: Saving data for PS74193: {'auction_closing_time': 1774884088.0, 'created_time': 1774035042.694787, 'last_price_update_time': 1774869002.824992}
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS74193') HTTP/1.1" 204 0
2026-03-30 11:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:02 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK10618%27 HTTP/1.1" 200 None
2026-03-30 11:10:02 [auto1.de] INFO: Scrape type for ZK10618: 0
2026-03-30 11:10:02 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD52714%27 HTTP/1.1" 200 None
2026-03-30 11:10:02 [auto1.de] INFO: Scrape type for WD52714: 0
2026-03-30 11:10:02 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-30 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE50334%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for JE50334: 0
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA26169%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for YA26169: 0
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98723%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for NX98723: 0
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN16480%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for XN16480: 0
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY28868%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for VY28868: 0
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE97424%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for DE97424: 0
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD67065%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for CD67065: 0
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH58090%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for EH58090: 0
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW78905%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for BW78905: 0
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS59240%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for SS59240: 0
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV93529%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for LV93529: 0
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK46158%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for LK46158: 0
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB25198%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for LB25198: 0
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN02562%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for DN02562: 0
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV26500%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for RV26500: 0
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27450%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for FP27450: 0
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-30 11:10:03 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV01596%27 HTTP/1.1" 200 None
2026-03-30 11:10:03 [auto1.de] INFO: Scrape type for TV01596: 0
2026-03-30 11:10:03 [scrapy.extensions.logstats] INFO: Crawled 846 pages (at 4 pages/min), scraped 1151 items (at 2 items/min)
2026-03-30 11:10:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:11:03 [scrapy.extensions.logstats] INFO: Crawled 846 pages (at 0 pages/min), scraped 1151 items (at 0 items/min)
2026-03-30 11:11:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:21 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 9626 | hits on page: 40
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS59240%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for SS59240: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV93529%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for LV93529: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK46158%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for LK46158: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB25198%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for LB25198: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN02562%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for DN02562: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV26500%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for RV26500: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27450%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for FP27450: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV01596%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for TV01596: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ83975%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for TJ83975: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU97238%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for MU97238: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU94182%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for SU94182: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA32054%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for NA32054: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16103%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for YT16103: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ70582%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for BJ70582: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW51780%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for DW51780: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB08013%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for JB08013: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC44114%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for RC44114: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE57502%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for AE57502: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC05500%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for HC05500: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: KE06488
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE06488%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for KE06488: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA86041%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for GA86041: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU61840%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for SU61840: 0
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-30 11:11:21 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY91581%27 HTTP/1.1" 200 None
2026-03-30 11:11:21 [auto1.de] INFO: Scrape type for BY91581: 0
2026-03-30 11:11:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:24 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 9626 | hits on page: 40
2026-03-30 11:11:24 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-30 11:11:24 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV30078%27 HTTP/1.1" 200 None
2026-03-30 11:11:24 [auto1.de] INFO: Scrape type for CV30078: 0
2026-03-30 11:11:24 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK55952%27 HTTP/1.1" 200 None
2026-03-30 11:11:24 [auto1.de] INFO: Scrape type for GK55952: 0
2026-03-30 11:11:24 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR33805%27 HTTP/1.1" 200 None
2026-03-30 11:11:24 [auto1.de] INFO: Scrape type for LR33805: 2
2026-03-30 11:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 594a4860-9eb1-537b-8539-49020243c248 with identifier: LR33805
2026-03-30 11:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 594a4860-9eb1-537b-8539-49020243c248 with scrape type 2
2026-03-30 11:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 594a4860-9eb1-537b-8539-49020243c248 with scrape type 2
2026-03-30 11:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 594a4860-9eb1-537b-8539-49020243c248, identifier: LR33805
2026-03-30 11:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 594a4860-9eb1-537b-8539-49020243c248 with identifier: LR33805
2026-03-30 11:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 594a4860-9eb1-537b-8539-49020243c248 with identifier: LR33805
2026-03-30 11:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 594a4860-9eb1-537b-8539-49020243c248 with identifier: LR33805 to the API
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:31Z',
 'fuel_type': 'diesel',
 'id': '594a4860-9eb1-537b-8539-49020243c248',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR33805',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 135638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line AWD',
 'transmission': 'manual',
 'trim': 'Exclusive-Line AWD',
 'year': 2016}
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR33805%27 HTTP/1.1" 200 None
2026-03-30 11:11:24 [auto1.de] INFO: Saving data for LR33805: {'auction_closing_time': 1774884871.0, 'created_time': 1774467939.741152, 'last_price_update_time': 1774869084.799204}
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR33805') HTTP/1.1" 204 0
2026-03-30 11:11:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:24 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90808%27 HTTP/1.1" 200 None
2026-03-30 11:11:24 [auto1.de] INFO: Scrape type for RD90808: 0
2026-03-30 11:11:24 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-30 11:11:24 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-30 11:11:24 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-30 11:11:24 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-30 11:11:24 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK64287%27 HTTP/1.1" 200 None
2026-03-30 11:11:24 [auto1.de] INFO: Scrape type for DK64287: 0
2026-03-30 11:11:24 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY49475%27 HTTP/1.1" 200 None
2026-03-30 11:11:24 [auto1.de] INFO: Scrape type for GY49475: 0
2026-03-30 11:11:24 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-30 11:11:24 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT00833%27 HTTP/1.1" 200 None
2026-03-30 11:11:24 [auto1.de] INFO: Scrape type for YT00833: 0
2026-03-30 11:11:24 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-30 11:11:24 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-30 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG01662%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for CG01662: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90006%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for TZ90006: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA89472%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for EA89472: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX83133%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for KX83133: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY51014%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for WY51014: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: US71241
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70146%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for CR70146: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF08436%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for ZF08436: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV05136%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for PV05136: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB27251%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for NB27251: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC52225%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for WC52225: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW68189%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for EW68189: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR27692%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for HR27692: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67708%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for TT67708: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN60983%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for PN60983: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: VU36521
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36521%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for VU36521: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN53329%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for LN53329: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ09435%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for EZ09435: 0
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-30 11:11:25 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL68554%27 HTTP/1.1" 200 None
2026-03-30 11:11:25 [auto1.de] INFO: Scrape type for TL68554: 0
2026-03-30 11:12:03 [scrapy.extensions.logstats] INFO: Crawled 848 pages (at 2 pages/min), scraped 1152 items (at 1 items/min)
2026-03-30 11:12:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:34 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 9635 | hits on page: 40
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR27692%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for HR27692: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67708%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for TT67708: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN60983%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for PN60983: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: VU36521
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36521%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for VU36521: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN53329%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for LN53329: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ09435%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for EZ09435: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL68554%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for TL68554: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW17934%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for GW17934: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK78678%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for LK78678: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE69699%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for UE69699: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY74574%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for HY74574: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD50866%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for HD50866: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN40806%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for SN40806: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ14073%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for WZ14073: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72429%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for KP72429: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC48090%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for BC48090: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV87591%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for YV87591: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU37583%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for VU37583: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89065%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for VS89065: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK06519%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for KK06519: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT80809%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for NT80809: 0
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-30 11:12:34 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV64790%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [auto1.de] INFO: Scrape type for HV64790: 0
2026-03-30 11:12:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:43 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 9636 | hits on page: 40
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV64790%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for HV64790: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR85001%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for LR85001: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK79183%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for MK79183: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF12247%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for NF12247: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06665%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for BW06665: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44182%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for TW44182: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK85869%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for RK85869: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ71204%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for RJ71204: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH34670%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for ZH34670: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE15343%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for BE15343: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD35847%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for WD35847: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80421%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for ZY80421: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU85783%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for PU85783: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN88282%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for EN88282: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD54519%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for JD54519: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS83797%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for MS83797: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK33490%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for XK33490: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: KS42383
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS42383%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for KS42383: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG75722%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for FG75722: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86536%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for YB86536: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG84508%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.de] INFO: Scrape type for LG84508: 0
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-30 11:12:43 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-30 11:12:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:51 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 9637 | hits on page: 40
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ43779%27 HTTP/1.1" 200 None
2026-03-30 11:12:51 [auto1.de] INFO: Scrape type for AJ43779: 0
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ54178%27 HTTP/1.1" 200 None
2026-03-30 11:12:51 [auto1.de] INFO: Scrape type for YZ54178: 0
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35132%27 HTTP/1.1" 200 None
2026-03-30 11:12:51 [auto1.de] INFO: Scrape type for NR35132: 0
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW12612%27 HTTP/1.1" 200 None
2026-03-30 11:12:51 [auto1.de] INFO: Scrape type for UW12612: 0
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17757%27 HTTP/1.1" 200 None
2026-03-30 11:12:51 [auto1.de] INFO: Scrape type for NS17757: 0
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE42269%27 HTTP/1.1" 200 None
2026-03-30 11:12:51 [auto1.de] INFO: Scrape type for KE42269: 0
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT68556%27 HTTP/1.1" 200 None
2026-03-30 11:12:51 [auto1.de] INFO: Scrape type for LT68556: 0
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC77037%27 HTTP/1.1" 200 None
2026-03-30 11:12:51 [auto1.de] INFO: Scrape type for AC77037: 0
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF69391%27 HTTP/1.1" 200 None
2026-03-30 11:12:51 [auto1.de] INFO: Scrape type for RF69391: 0
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA20304%27 HTTP/1.1" 200 None
2026-03-30 11:12:51 [auto1.de] INFO: Scrape type for PA20304: 0
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL99453%27 HTTP/1.1" 200 None
2026-03-30 11:12:51 [auto1.de] INFO: Scrape type for LL99453: 0
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT13980%27 HTTP/1.1" 200 None
2026-03-30 11:12:51 [auto1.de] INFO: Scrape type for YT13980: 0
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM28331%27 HTTP/1.1" 200 None
2026-03-30 11:12:51 [auto1.de] INFO: Scrape type for SM28331: 0
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV20028%27 HTTP/1.1" 200 None
2026-03-30 11:12:51 [auto1.de] INFO: Scrape type for GV20028: 0
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-30 11:12:51 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-30 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY66672%27 HTTP/1.1" 200 None
2026-03-30 11:12:52 [auto1.de] INFO: Scrape type for XY66672: 0
2026-03-30 11:12:52 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-30 11:12:52 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-30 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ33844%27 HTTP/1.1" 200 None
2026-03-30 11:12:52 [auto1.de] INFO: Scrape type for XJ33844: 0
2026-03-30 11:12:52 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-30 11:12:52 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-30 11:12:52 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-30 11:12:52 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-30 11:12:52 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-30 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP66547%27 HTTP/1.1" 200 None
2026-03-30 11:12:52 [auto1.de] INFO: Scrape type for TP66547: 0
2026-03-30 11:12:52 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-30 11:12:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:53 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 9637 | hits on page: 40
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK52975%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for BK52975: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP25295%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for VP25295: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE77804%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for DE77804: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG76834%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for RG76834: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN63665%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for MN63665: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC01296%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for KC01296: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL94841%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for JL94841: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH84573%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for WH84573: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV77064%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for MV77064: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ18082%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for HZ18082: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78580%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for UC78580: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV22200%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for KV22200: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX99530%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for MX99530: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH34786%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for SH34786: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46979%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for MV46979: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB52644%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for YB52644: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24808%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for UG24808: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN48846%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for WN48846: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42384%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for WA42384: 0
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-30 11:12:53 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR91976%27 HTTP/1.1" 200 None
2026-03-30 11:12:53 [auto1.de] INFO: Scrape type for GR91976: 0
2026-03-30 11:12:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:57 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 9638 | hits on page: 40
2026-03-30 11:12:57 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-30 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR91976%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [auto1.de] INFO: Scrape type for GR91976: 0
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD28635%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [auto1.de] INFO: Scrape type for WD28635: 0
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM78825%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [auto1.de] INFO: Scrape type for BM78825: 0
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78984%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [auto1.de] INFO: Scrape type for FM78984: 0
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN62521%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [auto1.de] INFO: Scrape type for NN62521: 0
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL40939%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [auto1.de] INFO: Scrape type for TL40939: 0
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA12198%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [auto1.de] INFO: Scrape type for DA12198: 0
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG03972%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [auto1.de] INFO: Scrape type for BG03972: 0
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY48346%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [auto1.de] INFO: Scrape type for HY48346: 0
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL44466%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [auto1.de] INFO: Scrape type for YL44466: 0
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF79768%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [auto1.de] INFO: Scrape type for KF79768: 0
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX46071%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [auto1.de] INFO: Scrape type for CX46071: 0
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-30 11:12:58 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC54286%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [auto1.de] INFO: Scrape type for PC54286: 2
2026-03-30 11:12:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f25b0ed4-b2b0-5977-919b-05d0ec3de59d with identifier: PC54286
2026-03-30 11:12:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f25b0ed4-b2b0-5977-919b-05d0ec3de59d with scrape type 2
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f25b0ed4-b2b0-5977-919b-05d0ec3de59d with scrape type 2
2026-03-30 11:12:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f25b0ed4-b2b0-5977-919b-05d0ec3de59d, identifier: PC54286
2026-03-30 11:12:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f25b0ed4-b2b0-5977-919b-05d0ec3de59d with identifier: PC54286
2026-03-30 11:12:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f25b0ed4-b2b0-5977-919b-05d0ec3de59d with identifier: PC54286
2026-03-30 11:12:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f25b0ed4-b2b0-5977-919b-05d0ec3de59d with identifier: PC54286 to the API
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:03:12Z',
 'fuel_type': 'petrol',
 'id': 'f25b0ed4-b2b0-5977-919b-05d0ec3de59d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC54286',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 209350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-27',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC54286%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [auto1.de] INFO: Saving data for PC54286: {'auction_closing_time': 1774882992.0, 'created_time': 1774031817.763492, 'last_price_update_time': 1774869179.038065}
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC54286') HTTP/1.1" 204 0
2026-03-30 11:12:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:59 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-30 11:12:59 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-30 11:12:59 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-30 11:12:59 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB91178%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [auto1.de] INFO: Scrape type for JB91178: 0
2026-03-30 11:12:59 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ50241%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [auto1.de] INFO: Scrape type for SZ50241: 0
2026-03-30 11:12:59 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG47191%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [auto1.de] INFO: Scrape type for TG47191: 0
2026-03-30 11:12:59 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-30 11:12:59 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR13548%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [auto1.de] INFO: Scrape type for RR13548: 0
2026-03-30 11:12:59 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW82332%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [auto1.de] INFO: Scrape type for RW82332: 0
2026-03-30 11:12:59 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV10923%27 HTTP/1.1" 200 None
2026-03-30 11:12:59 [auto1.de] INFO: Scrape type for ZV10923: 0
2026-03-30 11:12:59 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-30 11:12:59 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-30 11:13:03 [scrapy.extensions.logstats] INFO: Crawled 853 pages (at 5 pages/min), scraped 1153 items (at 1 items/min)
2026-03-30 11:13:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:07 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 9639 | hits on page: 40
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN11150%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for YN11150: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55380%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for LV55380: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ95747%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for HZ95747: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ73659%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for RJ73659: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ03157%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for FZ03157: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS97689%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for BS97689: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD43211%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for HD43211: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71563%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for KZ71563: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD76424%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for BD76424: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK80095%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for LK80095: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL45023%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for SL45023: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75545%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for YR75545: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM30450%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for CM30450: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA14963%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for HA14963: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB57575%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for HB57575: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP38143%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for BP38143: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX32204%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for GX32204: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25928%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for UA25928: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT24864%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for GT24864: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG65874%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for GG65874: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF58190%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for UF58190: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV42869%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for RV42869: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA93244%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for ZA93244: 0
2026-03-30 11:13:07 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL15511%27 HTTP/1.1" 200 None
2026-03-30 11:13:07 [auto1.de] INFO: Scrape type for AL15511: 0
2026-03-30 11:13:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:03 [scrapy.extensions.logstats] INFO: Crawled 854 pages (at 1 pages/min), scraped 1153 items (at 0 items/min)
2026-03-30 11:14:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:13 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 9647 | hits on page: 40
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG65874%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for GG65874: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF58190%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for UF58190: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV42869%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for RV42869: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA93244%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for ZA93244: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL15511%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for AL15511: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM92203%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for WM92203: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB15164%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for TB15164: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN06101%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for CN06101: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: NK87306
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK87306%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for NK87306: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82435%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for PS82435: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG20268%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for KG20268: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG36538%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for DG36538: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90215%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for UZ90215: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU93536%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for HU93536: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF09029%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for GF09029: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: JC65588
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE03495%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for AE03495: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ10151%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for PZ10151: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP24575%27 HTTP/1.1" 200 None
2026-03-30 11:14:13 [auto1.de] INFO: Scrape type for BP24575: 0
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-30 11:14:13 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-30 11:14:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:24 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 9647 | hits on page: 40
2026-03-30 11:14:24 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-30 11:14:24 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-30 11:14:24 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY22593%27 HTTP/1.1" 200 None
2026-03-30 11:14:24 [auto1.de] INFO: Scrape type for VY22593: 0
2026-03-30 11:14:24 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-30 11:14:24 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG87332%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.de] INFO: Scrape type for LG87332: 0
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW77788%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.de] INFO: Scrape type for SW77788: 0
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42199%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.de] INFO: Scrape type for XT42199: 0
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: RM72626
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM72626%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.de] INFO: Scrape type for RM72626: 0
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS43563%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.de] INFO: Scrape type for XS43563: 0
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA64656%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.de] INFO: Scrape type for JA64656: 0
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB65040%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.de] INFO: Scrape type for VB65040: 0
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH95210%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.de] INFO: Scrape type for UH95210: 0
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR69108%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.de] INFO: Scrape type for DR69108: 0
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT81151%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.de] INFO: Scrape type for GT81151: 0
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE02336%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.de] INFO: Scrape type for FE02336: 0
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ48017%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.de] INFO: Scrape type for MJ48017: 0
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG94250%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.de] INFO: Scrape type for MG94250: 0
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-30 11:14:25 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-30 11:14:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:26 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 9647 | hits on page: 40
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH51511%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for CH51511: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK99785%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for YK99785: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG55582%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for FG55582: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE71981%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for GE71981: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR34047%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for GR34047: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR65686%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for FR65686: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX17782%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for RX17782: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN13100%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for SN13100: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB32538%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for KB32538: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV05588%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for SV05588: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW87907%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for MW87907: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE51747%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for RE51747: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85495%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for VR85495: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT05555%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for RT05555: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04767%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for MM04767: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW64157%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for XW64157: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC69827%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for HC69827: 0
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-30 11:14:26 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77748%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.de] INFO: Scrape type for JZ77748: 2
2026-03-30 11:14:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbbe0278-0a93-56cc-96c8-0997bd0d329b with identifier: JZ77748
2026-03-30 11:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbbe0278-0a93-56cc-96c8-0997bd0d329b with scrape type 2
2026-03-30 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbbe0278-0a93-56cc-96c8-0997bd0d329b with scrape type 2
2026-03-30 11:14:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbbe0278-0a93-56cc-96c8-0997bd0d329b, identifier: JZ77748
2026-03-30 11:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbbe0278-0a93-56cc-96c8-0997bd0d329b with identifier: JZ77748
2026-03-30 11:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbbe0278-0a93-56cc-96c8-0997bd0d329b with identifier: JZ77748
2026-03-30 11:14:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbbe0278-0a93-56cc-96c8-0997bd0d329b with identifier: JZ77748 to the API
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:50:10Z',
 'fuel_type': 'petrol',
 'id': 'dbbe0278-0a93-56cc-96c8-0997bd0d329b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ77748',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 127615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-24',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77748%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [auto1.de] INFO: Saving data for JZ77748: {'auction_closing_time': 1774885810.0, 'created_time': 1773227161.848172, 'last_price_update_time': 1774869267.351995}
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ77748') HTTP/1.1" 204 0
2026-03-30 11:14:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:27 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-30 11:14:27 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH50819%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [auto1.de] INFO: Scrape type for TH50819: 0
2026-03-30 11:14:27 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV79476%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [auto1.de] INFO: Scrape type for VV79476: 0
2026-03-30 11:14:27 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY47977%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [auto1.de] INFO: Scrape type for XY47977: 0
2026-03-30 11:14:27 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-30 11:14:27 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-30 11:14:27 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY86490%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [auto1.de] INFO: Scrape type for HY86490: 0
2026-03-30 11:14:27 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-30 11:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:39 [auto1.de] INFO: Channel: 24h | Page: 156 | totalHits: 9647 | hits on page: 40
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG24612%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for AG24612: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK73701%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for BK73701: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA42625%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for TA42625: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV55096%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for NV55096: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC63536%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for JC63536: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ13004%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for AJ13004: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE47018%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for JE47018: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY59950%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for HY59950: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU99299%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for KU99299: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF30370%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for XF30370: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN35459%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for TN35459: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW80784%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for MW80784: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV46611%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for EV46611: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT59921%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for TT59921: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC51823%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for DC51823: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA91024%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for HA91024: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK45675%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for PK45675: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM63646%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for SM63646: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98394%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for KX98394: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC24735%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.de] INFO: Scrape type for KC24735: 0
2026-03-30 11:14:39 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-30 11:14:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:03 [scrapy.extensions.logstats] INFO: Crawled 858 pages (at 4 pages/min), scraped 1154 items (at 1 items/min)
2026-03-30 11:15:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:16:03 [scrapy.extensions.logstats] INFO: Crawled 858 pages (at 0 pages/min), scraped 1154 items (at 0 items/min)
2026-03-30 11:16:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:16:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.688(s), this was the 1st time calling it.
2026-03-30 11:16:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.709550340886919 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:16:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:16:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:59 [auto1.de] INFO: Channel: 24h | Page: 157 | totalHits: 9666 | hits on page: 40
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF30370%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for XF30370: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN35459%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for TN35459: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW80784%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for MW80784: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV46611%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for EV46611: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT59921%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for TT59921: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC51823%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for DC51823: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA91024%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for HA91024: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK45675%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for PK45675: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM63646%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for SM63646: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98394%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for KX98394: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC24735%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for KC24735: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX71576%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for LX71576: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88968%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for PE88968: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG79588%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for FG79588: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02117%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for AA02117: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE79625%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for ZE79625: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK47596%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for PK47596: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT31566%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for FT31566: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK24290%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for HK24290: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG58212%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for TG58212: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: JN51648
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN51648%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for JN51648: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW56593%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for LW56593: 0
2026-03-30 11:16:59 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN45666%27 HTTP/1.1" 200 None
2026-03-30 11:16:59 [auto1.de] INFO: Scrape type for AN45666: 0
2026-03-30 11:16:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:03 [scrapy.extensions.logstats] INFO: Crawled 859 pages (at 1 pages/min), scraped 1154 items (at 0 items/min)
2026-03-30 11:17:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:17:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:36 [auto1.de] INFO: Channel: 24h | Page: 158 | totalHits: 9667 | hits on page: 40
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN45666%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for AN45666: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK98414%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for KK98414: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL72774%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for WL72774: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS10539%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for LS10539: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91304%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for MW91304: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37955%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for MX37955: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY19816%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for UY19816: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR60138%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for AR60138: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH29152%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for AH29152: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP86406%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for LP86406: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD93182%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for MD93182: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT28740%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for DT28740: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE70317%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for VE70317: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ44442%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for FZ44442: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY19608%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for NY19608: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR18060%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for SR18060: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY55181%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for AY55181: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL50005%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for VL50005: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM65960%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for ZM65960: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX51383%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for DX51383: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL66452%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for TL66452: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR62561%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for XR62561: 0
2026-03-30 11:17:36 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK26503%27 HTTP/1.1" 200 None
2026-03-30 11:17:36 [auto1.de] INFO: Scrape type for WK26503: 0
2026-03-30 11:17:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:37 [auto1.de] INFO: Channel: 24h | Page: 159 | totalHits: 9668 | hits on page: 40
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK26503%27 HTTP/1.1" 200 None
2026-03-30 11:17:37 [auto1.de] INFO: Scrape type for WK26503: 0
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28152%27 HTTP/1.1" 200 None
2026-03-30 11:17:37 [auto1.de] INFO: Scrape type for UK28152: 0
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX94588%27 HTTP/1.1" 200 None
2026-03-30 11:17:37 [auto1.de] INFO: Scrape type for SX94588: 0
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB64139%27 HTTP/1.1" 200 None
2026-03-30 11:17:37 [auto1.de] INFO: Scrape type for DB64139: 0
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU59623%27 HTTP/1.1" 200 None
2026-03-30 11:17:37 [auto1.de] INFO: Scrape type for RU59623: 0
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ68996%27 HTTP/1.1" 200 None
2026-03-30 11:17:37 [auto1.de] INFO: Scrape type for YJ68996: 0
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX66232%27 HTTP/1.1" 200 None
2026-03-30 11:17:37 [auto1.de] INFO: Scrape type for HX66232: 0
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW72943%27 HTTP/1.1" 200 None
2026-03-30 11:17:37 [auto1.de] INFO: Scrape type for CW72943: 0
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP10978%27 HTTP/1.1" 200 None
2026-03-30 11:17:37 [auto1.de] INFO: Scrape type for HP10978: 0
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR64184%27 HTTP/1.1" 200 None
2026-03-30 11:17:37 [auto1.de] INFO: Scrape type for BR64184: 0
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX47984%27 HTTP/1.1" 200 None
2026-03-30 11:17:37 [auto1.de] INFO: Scrape type for NX47984: 0
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA25019%27 HTTP/1.1" 200 None
2026-03-30 11:17:37 [auto1.de] INFO: Scrape type for GA25019: 0
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH89346%27 HTTP/1.1" 200 None
2026-03-30 11:17:37 [auto1.de] INFO: Scrape type for YH89346: 0
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV89701%27 HTTP/1.1" 200 None
2026-03-30 11:17:37 [auto1.de] INFO: Scrape type for DV89701: 0
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS13699%27 HTTP/1.1" 200 None
2026-03-30 11:17:37 [auto1.de] INFO: Scrape type for CS13699: 0
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM94434%27 HTTP/1.1" 200 None
2026-03-30 11:17:37 [auto1.de] INFO: Scrape type for SM94434: 0
2026-03-30 11:17:37 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-30 11:17:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:56 [auto1.de] INFO: Channel: 24h | Page: 160 | totalHits: 9670 | hits on page: 40
2026-03-30 11:17:56 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-30 11:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM94434%27 HTTP/1.1" 200 None
2026-03-30 11:17:56 [auto1.de] INFO: Scrape type for SM94434: 0
2026-03-30 11:17:56 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-30 11:17:56 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-30 11:17:56 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-30 11:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ06587%27 HTTP/1.1" 200 None
2026-03-30 11:17:56 [auto1.de] INFO: Scrape type for CJ06587: 2
2026-03-30 11:17:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79d23631-b92a-58d3-be70-1118a41d2688 with identifier: CJ06587
2026-03-30 11:17:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79d23631-b92a-58d3-be70-1118a41d2688 with scrape type 2
2026-03-30 11:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79d23631-b92a-58d3-be70-1118a41d2688 with scrape type 2
2026-03-30 11:17:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79d23631-b92a-58d3-be70-1118a41d2688, identifier: CJ06587
2026-03-30 11:17:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79d23631-b92a-58d3-be70-1118a41d2688 with identifier: CJ06587
2026-03-30 11:17:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79d23631-b92a-58d3-be70-1118a41d2688 with identifier: CJ06587
2026-03-30 11:17:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79d23631-b92a-58d3-be70-1118a41d2688 with identifier: CJ06587 to the API
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:50:08Z',
 'fuel_type': 'petrol',
 'id': '79d23631-b92a-58d3-be70-1118a41d2688',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ06587',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 222505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2017}
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ06587%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Saving data for CJ06587: {'auction_closing_time': 1774885808.0, 'created_time': 1773861586.340075, 'last_price_update_time': 1774869477.273236}
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ06587') HTTP/1.1" 204 0
2026-03-30 11:17:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ35504%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for WJ35504: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER72643%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for ER72643: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: CL03732
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL03732%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for CL03732: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX80115%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for PX80115: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW76305%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for YW76305: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT78842%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for FT78842: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE32981%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for XE32981: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ10234%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for RJ10234: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU49323%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for GU49323: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU73268%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for PU73268: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23937%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for PR23937: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ53815%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for VZ53815: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC74080%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for FC74080: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ91667%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for NZ91667: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ43142%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for VJ43142: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54065%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for HH54065: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY94594%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for AY94594: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE56014%27 HTTP/1.1" 200 None
2026-03-30 11:17:57 [auto1.de] INFO: Scrape type for GE56014: 0
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-30 11:17:57 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-30 11:18:03 [scrapy.extensions.logstats] INFO: Crawled 862 pages (at 3 pages/min), scraped 1155 items (at 1 items/min)
2026-03-30 11:18:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:05 [auto1.de] INFO: Channel: 24h | Page: 161 | totalHits: 9671 | hits on page: 40
2026-03-30 11:18:05 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-30 11:18:05 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-30 11:18:05 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-30 11:18:05 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT78165%27 HTTP/1.1" 200 None
2026-03-30 11:18:05 [auto1.de] INFO: Scrape type for AT78165: 0
2026-03-30 11:18:05 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77915%27 HTTP/1.1" 200 None
2026-03-30 11:18:05 [auto1.de] INFO: Scrape type for DW77915: 0
2026-03-30 11:18:05 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB00511%27 HTTP/1.1" 200 None
2026-03-30 11:18:05 [auto1.de] INFO: Scrape type for ZB00511: 0
2026-03-30 11:18:05 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-30 11:18:05 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-30 11:18:05 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS80830%27 HTTP/1.1" 200 None
2026-03-30 11:18:06 [auto1.de] INFO: Scrape type for RS80830: 0
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: LK12622
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12622%27 HTTP/1.1" 200 None
2026-03-30 11:18:06 [auto1.de] INFO: Scrape type for LK12622: 0
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR01639%27 HTTP/1.1" 200 None
2026-03-30 11:18:06 [auto1.de] INFO: Scrape type for ZR01639: 0
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN50855%27 HTTP/1.1" 200 None
2026-03-30 11:18:06 [auto1.de] INFO: Scrape type for VN50855: 0
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU52980%27 HTTP/1.1" 200 None
2026-03-30 11:18:06 [auto1.de] INFO: Scrape type for JU52980: 0
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM78973%27 HTTP/1.1" 200 None
2026-03-30 11:18:06 [auto1.de] INFO: Scrape type for CM78973: 0
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX22671%27 HTTP/1.1" 200 None
2026-03-30 11:18:06 [auto1.de] INFO: Scrape type for EX22671: 0
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV45616%27 HTTP/1.1" 200 None
2026-03-30 11:18:06 [auto1.de] INFO: Scrape type for HV45616: 0
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ20795%27 HTTP/1.1" 200 None
2026-03-30 11:18:06 [auto1.de] INFO: Scrape type for TJ20795: 0
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP25437%27 HTTP/1.1" 200 None
2026-03-30 11:18:06 [auto1.de] INFO: Scrape type for PP25437: 0
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE19125%27 HTTP/1.1" 200 None
2026-03-30 11:18:06 [auto1.de] INFO: Scrape type for XE19125: 0
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT40648%27 HTTP/1.1" 200 None
2026-03-30 11:18:06 [auto1.de] INFO: Scrape type for TT40648: 0
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN10929%27 HTTP/1.1" 200 None
2026-03-30 11:18:06 [auto1.de] INFO: Scrape type for GN10929: 0
2026-03-30 11:18:06 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE66083%27 HTTP/1.1" 200 None
2026-03-30 11:18:06 [auto1.de] INFO: Scrape type for YE66083: 0
2026-03-30 11:18:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:07 [auto1.de] INFO: Channel: 24h | Page: 162 | totalHits: 9671 | hits on page: 40
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK08323%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for AK08323: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: GW69862
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW69862%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for GW69862: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK47916%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for AK47916: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW78451%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for AW78451: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE74286%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for NE74286: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW24568%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for JW24568: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC43990%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for ZC43990: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB25738%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for RB25738: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR21062%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for ZR21062: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV70498%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for WV70498: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH23061%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for ZH23061: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM72305%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for KM72305: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ33260%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for RZ33260: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX17488%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for FX17488: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW05211%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for DW05211: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA98436%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for AA98436: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU94869%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for PU94869: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM41961%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for AM41961: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS45157%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for RS45157: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG01413%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for WG01413: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05581%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for TW05581: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL43028%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for VL43028: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP84428%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for UP84428: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU86679%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for XU86679: 0
2026-03-30 11:18:07 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY60165%27 HTTP/1.1" 200 None
2026-03-30 11:18:07 [auto1.de] INFO: Scrape type for YY60165: 0
2026-03-30 11:18:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:09 [auto1.de] INFO: Channel: 24h | Page: 163 | totalHits: 9671 | hits on page: 40
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ29661%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.de] INFO: Scrape type for VJ29661: 0
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL67777%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.de] INFO: Scrape type for EL67777: 0
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX48590%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.de] INFO: Scrape type for UX48590: 0
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL95475%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.de] INFO: Scrape type for HL95475: 0
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN92590%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.de] INFO: Scrape type for LN92590: 0
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB75427%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.de] INFO: Scrape type for RB75427: 0
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ09616%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.de] INFO: Scrape type for HJ09616: 0
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR24224%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.de] INFO: Scrape type for UR24224: 0
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45396%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.de] INFO: Scrape type for SG45396: 0
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: TP00598
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV23538%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.de] INFO: Scrape type for SV23538: 0
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH15947%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.de] INFO: Scrape type for XH15947: 0
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-30 11:18:09 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE54360%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.de] INFO: Scrape type for DE54360: 0
2026-03-30 11:18:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:10 [auto1.de] INFO: Channel: 24h | Page: 164 | totalHits: 9671 | hits on page: 40
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK47364%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for LK47364: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43424%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for HA43424: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC46474%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for ZC46474: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE85756%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for CE85756: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK86210%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for AK86210: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63810%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for TP63810: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ24379%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for XJ24379: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ35506%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for WZ35506: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV42513%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for XV42513: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD49252%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for GD49252: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA72326%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for JA72326: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV88353%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for NV88353: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV81199%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for CV81199: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL87720%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for CL87720: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04240%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for HC04240: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK46360%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for CK46360: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF94363%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for XF94363: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN39495%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for WN39495: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF41308%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for KF41308: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD16829%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for SD16829: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS93004%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for CS93004: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD22353%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for FD22353: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK64393%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for LK64393: 0
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-30 11:18:10 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN30485%27 HTTP/1.1" 200 None
2026-03-30 11:18:10 [auto1.de] INFO: Scrape type for VN30485: 0
2026-03-30 11:18:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:17 [auto1.de] INFO: Channel: 24h | Page: 165 | totalHits: 9672 | hits on page: 40
2026-03-30 11:18:17 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN30485%27 HTTP/1.1" 200 None
2026-03-30 11:18:17 [auto1.de] INFO: Scrape type for VN30485: 0
2026-03-30 11:18:17 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD36670%27 HTTP/1.1" 200 None
2026-03-30 11:18:17 [auto1.de] INFO: Scrape type for SD36670: 2
2026-03-30 11:18:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf864095-e21b-5b8c-8e3c-8cf392cd4f28 with identifier: SD36670
2026-03-30 11:18:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf864095-e21b-5b8c-8e3c-8cf392cd4f28 with scrape type 2
2026-03-30 11:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf864095-e21b-5b8c-8e3c-8cf392cd4f28 with scrape type 2
2026-03-30 11:18:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf864095-e21b-5b8c-8e3c-8cf392cd4f28, identifier: SD36670
2026-03-30 11:18:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf864095-e21b-5b8c-8e3c-8cf392cd4f28 with identifier: SD36670
2026-03-30 11:18:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf864095-e21b-5b8c-8e3c-8cf392cd4f28 with identifier: SD36670
2026-03-30 11:18:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf864095-e21b-5b8c-8e3c-8cf392cd4f28 with identifier: SD36670 to the API
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:48:02Z',
 'fuel_type': 'diesel',
 'id': 'cf864095-e21b-5b8c-8e3c-8cf392cd4f28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD36670',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 121993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-21',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD36670%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.de] INFO: Saving data for SD36670: {'auction_closing_time': 1774885682.0, 'created_time': 1774034543.25496, 'last_price_update_time': 1774869498.572246}
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD36670') HTTP/1.1" 204 0
2026-03-30 11:18:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE98596%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.de] INFO: Scrape type for WE98596: 0
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ62547%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.de] INFO: Scrape type for AJ62547: 0
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80803%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.de] INFO: Scrape type for AW80803: 0
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU66110%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.de] INFO: Scrape type for GU66110: 0
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH52991%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.de] INFO: Scrape type for BH52991: 0
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL23415%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.de] INFO: Scrape type for AL23415: 0
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: VS72441
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY72629%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.de] INFO: Scrape type for KY72629: 0
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME89657%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.de] INFO: Scrape type for ME89657: 0
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM99082%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.de] INFO: Scrape type for ZM99082: 0
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ05712%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.de] INFO: Scrape type for GJ05712: 0
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT27495%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.de] INFO: Scrape type for TT27495: 0
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ59032%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.de] INFO: Scrape type for FJ59032: 0
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD50097%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.de] INFO: Scrape type for BD50097: 0
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC14916%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.de] INFO: Scrape type for EC14916: 0
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD03678%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.de] INFO: Scrape type for CD03678: 0
2026-03-30 11:18:18 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU55815%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [auto1.de] INFO: Scrape type for XU55815: 0
2026-03-30 11:18:19 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-30 11:18:19 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85601%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [auto1.de] INFO: Scrape type for LM85601: 0
2026-03-30 11:18:19 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX31470%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [auto1.de] INFO: Scrape type for YX31470: 0
2026-03-30 11:18:19 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG98454%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [auto1.de] INFO: Scrape type for FG98454: 0
2026-03-30 11:18:19 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-30 11:18:19 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-30 11:18:19 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-30 11:18:19 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-30 11:18:19 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK08111%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [auto1.de] INFO: Scrape type for MK08111: 0
2026-03-30 11:18:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:20 [auto1.de] INFO: Channel: 24h | Page: 166 | totalHits: 9673 | hits on page: 40
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK08111%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [auto1.de] INFO: Scrape type for MK08111: 0
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP02134%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [auto1.de] INFO: Scrape type for FP02134: 0
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC46979%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [auto1.de] INFO: Scrape type for NC46979: 0
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE87725%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [auto1.de] INFO: Scrape type for UE87725: 0
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC92552%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [auto1.de] INFO: Scrape type for XC92552: 0
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC42370%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [auto1.de] INFO: Scrape type for UC42370: 0
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN34178%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [auto1.de] INFO: Scrape type for LN34178: 0
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV16405%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [auto1.de] INFO: Scrape type for WV16405: 0
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT49963%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [auto1.de] INFO: Scrape type for BT49963: 0
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA68147%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [auto1.de] INFO: Scrape type for SA68147: 0
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-30 11:18:20 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32105%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [auto1.de] INFO: Scrape type for PR32105: 2
2026-03-30 11:18:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2ae2633-7f7c-5226-9c76-fec2d42174fc with identifier: PR32105
2026-03-30 11:18:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2ae2633-7f7c-5226-9c76-fec2d42174fc with scrape type 2
2026-03-30 11:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2ae2633-7f7c-5226-9c76-fec2d42174fc with scrape type 2
2026-03-30 11:18:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2ae2633-7f7c-5226-9c76-fec2d42174fc, identifier: PR32105
2026-03-30 11:18:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2ae2633-7f7c-5226-9c76-fec2d42174fc with identifier: PR32105
2026-03-30 11:18:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2ae2633-7f7c-5226-9c76-fec2d42174fc with identifier: PR32105
2026-03-30 11:18:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2ae2633-7f7c-5226-9c76-fec2d42174fc with identifier: PR32105 to the API
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:21:44Z',
 'fuel_type': 'diesel',
 'id': 'c2ae2633-7f7c-5226-9c76-fec2d42174fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR32105',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 138160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-13',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L1',
 'transmission': 'manual',
 'trim': 'Allure L1',
 'year': 2020}
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32105%27 HTTP/1.1" 200 None
2026-03-30 11:18:20 [auto1.de] INFO: Saving data for PR32105: {'auction_closing_time': 1774884104.0, 'created_time': 1774350285.186869, 'last_price_update_time': 1774869500.961923}
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR32105') HTTP/1.1" 204 0
2026-03-30 11:18:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC33817%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [auto1.de] INFO: Scrape type for WC33817: 0
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX08537%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [auto1.de] INFO: Scrape type for FX08537: 0
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP89368%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [auto1.de] INFO: Scrape type for MP89368: 0
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35717%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [auto1.de] INFO: Scrape type for PB35717: 0
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV26171%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [auto1.de] INFO: Scrape type for PV26171: 0
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW84791%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [auto1.de] INFO: Scrape type for RW84791: 0
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB58565%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [auto1.de] INFO: Scrape type for VB58565: 0
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK27182%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [auto1.de] INFO: Scrape type for EK27182: 0
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ06184%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [auto1.de] INFO: Scrape type for ZJ06184: 0
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS67551%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [auto1.de] INFO: Scrape type for MS67551: 0
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW20696%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [auto1.de] INFO: Scrape type for ZW20696: 0
2026-03-30 11:18:21 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU48960%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [auto1.de] INFO: Scrape type for BU48960: 0
2026-03-30 11:18:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:33 [auto1.de] INFO: Channel: 24h | Page: 167 | totalHits: 9674 | hits on page: 40
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU48960%27 HTTP/1.1" 200 None
2026-03-30 11:18:33 [auto1.de] INFO: Scrape type for BU48960: 0
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV16812%27 HTTP/1.1" 200 None
2026-03-30 11:18:33 [auto1.de] INFO: Scrape type for ZV16812: 0
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15707%27 HTTP/1.1" 200 None
2026-03-30 11:18:33 [auto1.de] INFO: Scrape type for RP15707: 0
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF33056%27 HTTP/1.1" 200 None
2026-03-30 11:18:33 [auto1.de] INFO: Scrape type for SF33056: 0
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR33136%27 HTTP/1.1" 200 None
2026-03-30 11:18:33 [auto1.de] INFO: Scrape type for CR33136: 0
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: CE31107
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH26087%27 HTTP/1.1" 200 None
2026-03-30 11:18:33 [auto1.de] INFO: Scrape type for TH26087: 0
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB95771%27 HTTP/1.1" 200 None
2026-03-30 11:18:33 [auto1.de] INFO: Scrape type for FB95771: 0
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB29224%27 HTTP/1.1" 200 None
2026-03-30 11:18:33 [auto1.de] INFO: Scrape type for EB29224: 0
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17125%27 HTTP/1.1" 200 None
2026-03-30 11:18:33 [auto1.de] INFO: Scrape type for UD17125: 0
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-30 11:18:33 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT29520%27 HTTP/1.1" 200 None
2026-03-30 11:18:34 [auto1.de] INFO: Scrape type for KT29520: 0
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU07666%27 HTTP/1.1" 200 None
2026-03-30 11:18:34 [auto1.de] INFO: Scrape type for VU07666: 0
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ36931%27 HTTP/1.1" 200 None
2026-03-30 11:18:34 [auto1.de] INFO: Scrape type for EZ36931: 0
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ27200%27 HTTP/1.1" 200 None
2026-03-30 11:18:34 [auto1.de] INFO: Scrape type for JZ27200: 0
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90003%27 HTTP/1.1" 200 None
2026-03-30 11:18:34 [auto1.de] INFO: Scrape type for RD90003: 0
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17316%27 HTTP/1.1" 200 None
2026-03-30 11:18:34 [auto1.de] INFO: Scrape type for NS17316: 0
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA79270%27 HTTP/1.1" 200 None
2026-03-30 11:18:34 [auto1.de] INFO: Scrape type for UA79270: 0
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS63557%27 HTTP/1.1" 200 None
2026-03-30 11:18:34 [auto1.de] INFO: Scrape type for LS63557: 0
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62580%27 HTTP/1.1" 200 None
2026-03-30 11:18:34 [auto1.de] INFO: Scrape type for CK62580: 0
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT34266%27 HTTP/1.1" 200 None
2026-03-30 11:18:34 [auto1.de] INFO: Scrape type for HT34266: 0
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA34239%27 HTTP/1.1" 200 None
2026-03-30 11:18:34 [auto1.de] INFO: Scrape type for GA34239: 2
2026-03-30 11:18:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cba1d9f-aa18-58b4-9a2e-8116d549879f with identifier: GA34239
2026-03-30 11:18:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cba1d9f-aa18-58b4-9a2e-8116d549879f with scrape type 2
2026-03-30 11:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cba1d9f-aa18-58b4-9a2e-8116d549879f with scrape type 2
2026-03-30 11:18:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cba1d9f-aa18-58b4-9a2e-8116d549879f, identifier: GA34239
2026-03-30 11:18:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cba1d9f-aa18-58b4-9a2e-8116d549879f with identifier: GA34239
2026-03-30 11:18:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cba1d9f-aa18-58b4-9a2e-8116d549879f with identifier: GA34239
2026-03-30 11:18:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cba1d9f-aa18-58b4-9a2e-8116d549879f with identifier: GA34239 to the API
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:09:47Z',
 'fuel_type': 'diesel',
 'id': '8cba1d9f-aa18-58b4-9a2e-8116d549879f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA34239',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 165456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-08',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA34239%27 HTTP/1.1" 200 None
2026-03-30 11:18:34 [auto1.de] INFO: Saving data for GA34239: {'auction_closing_time': 1774883387.0, 'created_time': 1774002471.95865, 'last_price_update_time': 1774869514.683846}
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA34239') HTTP/1.1" 204 0
2026-03-30 11:18:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS18464%27 HTTP/1.1" 200 None
2026-03-30 11:18:34 [auto1.de] INFO: Scrape type for AS18464: 0
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-30 11:18:34 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE68456%27 HTTP/1.1" 200 None
2026-03-30 11:18:34 [auto1.de] INFO: Scrape type for WE68456: 0
2026-03-30 11:18:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:48 [auto1.de] INFO: Channel: 24h | Page: 168 | totalHits: 9674 | hits on page: 40
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD24708%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for MD24708: 0
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH37191%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for JH37191: 0
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: BX95848
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD48947%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for GD48947: 0
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB93381%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for SB93381: 0
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY13516%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for ZY13516: 0
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS04882%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for DS04882: 0
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF58718%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for DF58718: 0
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW18097%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for VW18097: 0
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND71699%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for ND71699: 0
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT06802%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for PT06802: 0
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC89129%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for XC89129: 0
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV32986%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for DV32986: 0
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR51740%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for YR51740: 0
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: WA63684
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA63684%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for WA63684: 0
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK33698%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for DK33698: 0
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK34206%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for HK34206: 0
2026-03-30 11:18:48 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX53792%27 HTTP/1.1" 200 None
2026-03-30 11:18:48 [auto1.de] INFO: Scrape type for BX53792: 0
2026-03-30 11:18:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:56 [auto1.de] INFO: Channel: 24h | Page: 169 | totalHits: 9675 | hits on page: 40
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX53792%27 HTTP/1.1" 200 None
2026-03-30 11:18:56 [auto1.de] INFO: Scrape type for BX53792: 0
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS76993%27 HTTP/1.1" 200 None
2026-03-30 11:18:56 [auto1.de] INFO: Scrape type for FS76993: 0
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR87592%27 HTTP/1.1" 200 None
2026-03-30 11:18:56 [auto1.de] INFO: Scrape type for AR87592: 0
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS40485%27 HTTP/1.1" 200 None
2026-03-30 11:18:56 [auto1.de] INFO: Scrape type for RS40485: 0
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS96919%27 HTTP/1.1" 200 None
2026-03-30 11:18:56 [auto1.de] INFO: Scrape type for FS96919: 0
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56575%27 HTTP/1.1" 200 None
2026-03-30 11:18:56 [auto1.de] INFO: Scrape type for MK56575: 0
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD35692%27 HTTP/1.1" 200 None
2026-03-30 11:18:56 [auto1.de] INFO: Scrape type for SD35692: 0
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: EE67524
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA77246%27 HTTP/1.1" 200 None
2026-03-30 11:18:56 [auto1.de] INFO: Scrape type for EA77246: 0
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG69344%27 HTTP/1.1" 200 None
2026-03-30 11:18:56 [auto1.de] INFO: Scrape type for NG69344: 0
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV26734%27 HTTP/1.1" 200 None
2026-03-30 11:18:56 [auto1.de] INFO: Scrape type for XV26734: 0
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW88785%27 HTTP/1.1" 200 None
2026-03-30 11:18:56 [auto1.de] INFO: Scrape type for ZW88785: 0
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP74565%27 HTTP/1.1" 200 None
2026-03-30 11:18:56 [auto1.de] INFO: Scrape type for EP74565: 0
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-30 11:18:56 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC95378%27 HTTP/1.1" 200 None
2026-03-30 11:18:56 [auto1.de] INFO: Scrape type for AC95378: 0
2026-03-30 11:18:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:03 [scrapy.extensions.logstats] INFO: Crawled 871 pages (at 9 pages/min), scraped 1158 items (at 3 items/min)
2026-03-30 11:19:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:19:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:04 [auto1.de] INFO: Channel: 24h | Page: 170 | totalHits: 9676 | hits on page: 40
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC95378%27 HTTP/1.1" 200 None
2026-03-30 11:19:04 [auto1.de] INFO: Scrape type for AC95378: 0
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN13458%27 HTTP/1.1" 200 None
2026-03-30 11:19:04 [auto1.de] INFO: Scrape type for DN13458: 0
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG80172%27 HTTP/1.1" 200 None
2026-03-30 11:19:04 [auto1.de] INFO: Scrape type for UG80172: 0
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN38152%27 HTTP/1.1" 200 None
2026-03-30 11:19:04 [auto1.de] INFO: Scrape type for LN38152: 0
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS72291%27 HTTP/1.1" 200 None
2026-03-30 11:19:04 [auto1.de] INFO: Scrape type for YS72291: 0
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ83325%27 HTTP/1.1" 200 None
2026-03-30 11:19:04 [auto1.de] INFO: Scrape type for EJ83325: 0
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR97485%27 HTTP/1.1" 200 None
2026-03-30 11:19:04 [auto1.de] INFO: Scrape type for HR97485: 0
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY91019%27 HTTP/1.1" 200 None
2026-03-30 11:19:04 [auto1.de] INFO: Scrape type for HY91019: 0
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD62787%27 HTTP/1.1" 200 None
2026-03-30 11:19:04 [auto1.de] INFO: Scrape type for PD62787: 0
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY28796%27 HTTP/1.1" 200 None
2026-03-30 11:19:04 [auto1.de] INFO: Scrape type for ZY28796: 0
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL68687%27 HTTP/1.1" 200 None
2026-03-30 11:19:04 [auto1.de] INFO: Scrape type for EL68687: 0
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB37125%27 HTTP/1.1" 200 None
2026-03-30 11:19:04 [auto1.de] INFO: Scrape type for RB37125: 0
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB28206%27 HTTP/1.1" 200 None
2026-03-30 11:19:04 [auto1.de] INFO: Scrape type for SB28206: 0
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-30 11:19:04 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN24423%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [auto1.de] INFO: Scrape type for GN24423: 0
2026-03-30 11:19:05 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59851%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [auto1.de] INFO: Scrape type for UA59851: 0
2026-03-30 11:19:05 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG33600%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [auto1.de] INFO: Scrape type for MG33600: 0
2026-03-30 11:19:05 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-30 11:19:05 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN78451%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [auto1.de] INFO: Scrape type for AN78451: 0
2026-03-30 11:19:05 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-30 11:19:05 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-30 11:19:05 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-30 11:19:05 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW23884%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [auto1.de] INFO: Scrape type for UW23884: 0
2026-03-30 11:19:05 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD27320%27 HTTP/1.1" 200 None
2026-03-30 11:19:05 [auto1.de] INFO: Scrape type for MD27320: 0
2026-03-30 11:19:05 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-30 11:19:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:08 [auto1.de] INFO: Channel: 24h | Page: 171 | totalHits: 9676 | hits on page: 40
2026-03-30 11:19:08 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-30 11:19:08 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-30 11:19:08 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65942%27 HTTP/1.1" 200 None
2026-03-30 11:19:08 [auto1.de] INFO: Scrape type for CA65942: 0
2026-03-30 11:19:08 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX93586%27 HTTP/1.1" 200 None
2026-03-30 11:19:08 [auto1.de] INFO: Scrape type for EX93586: 0
2026-03-30 11:19:08 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY74953%27 HTTP/1.1" 200 None
2026-03-30 11:19:08 [auto1.de] INFO: Scrape type for UY74953: 0
2026-03-30 11:19:08 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP12697%27 HTTP/1.1" 200 None
2026-03-30 11:19:08 [auto1.de] INFO: Scrape type for KP12697: 0
2026-03-30 11:19:08 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB26055%27 HTTP/1.1" 200 None
2026-03-30 11:19:08 [auto1.de] INFO: Scrape type for UB26055: 0
2026-03-30 11:19:08 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV85283%27 HTTP/1.1" 200 None
2026-03-30 11:19:08 [auto1.de] INFO: Scrape type for NV85283: 0
2026-03-30 11:19:08 [auto1.de] INFO: Found listing with ID: VL71663
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL71663%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [auto1.de] INFO: Scrape type for VL71663: 0
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54532%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [auto1.de] INFO: Scrape type for JP54532: 0
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU60494%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [auto1.de] INFO: Scrape type for GU60494: 0
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU40384%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [auto1.de] INFO: Scrape type for NU40384: 0
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ93554%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [auto1.de] INFO: Scrape type for DJ93554: 0
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX70218%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [auto1.de] INFO: Scrape type for MX70218: 0
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP31898%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [auto1.de] INFO: Scrape type for EP31898: 0
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83336%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [auto1.de] INFO: Scrape type for EE83336: 0
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE21325%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [auto1.de] INFO: Scrape type for GE21325: 0
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS82974%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [auto1.de] INFO: Scrape type for XS82974: 0
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE81199%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [auto1.de] INFO: Scrape type for AE81199: 0
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ31328%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [auto1.de] INFO: Scrape type for MJ31328: 0
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT53290%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [auto1.de] INFO: Scrape type for DT53290: 0
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-30 11:19:09 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ72456%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [auto1.de] INFO: Scrape type for FJ72456: 0
2026-03-30 11:19:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:10 [auto1.de] INFO: Channel: 24h | Page: 172 | totalHits: 9676 | hits on page: 40
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ28276%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for HJ28276: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV53612%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for XV53612: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP66388%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for ZP66388: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44643%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for YH44643: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21750%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for YJ21750: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP08522%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for JP08522: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT78073%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for PT78073: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ72083%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for JJ72083: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN91045%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for CN91045: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM29891%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for MM29891: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX18884%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for CX18884: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC44419%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for YC44419: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ82092%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for VJ82092: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ42381%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for WZ42381: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36219%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for CD36219: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC57954%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for MC57954: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV03695%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for VV03695: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92494%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for MV92494: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE71125%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for AE71125: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP65815%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.de] INFO: Scrape type for RP65815: 0
2026-03-30 11:19:10 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-30 11:19:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:11 [auto1.de] INFO: Channel: 24h | Page: 173 | totalHits: 9676 | hits on page: 40
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ41620%27 HTTP/1.1" 200 None
2026-03-30 11:19:11 [auto1.de] INFO: Scrape type for MJ41620: 0
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV65540%27 HTTP/1.1" 200 None
2026-03-30 11:19:11 [auto1.de] INFO: Scrape type for HV65540: 0
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS05974%27 HTTP/1.1" 200 None
2026-03-30 11:19:11 [auto1.de] INFO: Scrape type for TS05974: 0
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME33936%27 HTTP/1.1" 200 None
2026-03-30 11:19:11 [auto1.de] INFO: Scrape type for ME33936: 0
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU80256%27 HTTP/1.1" 200 None
2026-03-30 11:19:11 [auto1.de] INFO: Scrape type for CU80256: 0
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG19497%27 HTTP/1.1" 200 None
2026-03-30 11:19:11 [auto1.de] INFO: Scrape type for DG19497: 0
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH86896%27 HTTP/1.1" 200 None
2026-03-30 11:19:11 [auto1.de] INFO: Scrape type for NH86896: 0
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB80286%27 HTTP/1.1" 200 None
2026-03-30 11:19:11 [auto1.de] INFO: Scrape type for CB80286: 0
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV38848%27 HTTP/1.1" 200 None
2026-03-30 11:19:11 [auto1.de] INFO: Scrape type for WV38848: 0
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH59786%27 HTTP/1.1" 200 None
2026-03-30 11:19:11 [auto1.de] INFO: Scrape type for RH59786: 0
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG97713%27 HTTP/1.1" 200 None
2026-03-30 11:19:11 [auto1.de] INFO: Scrape type for LG97713: 0
2026-03-30 11:19:11 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-30 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21744%27 HTTP/1.1" 200 None
2026-03-30 11:19:12 [auto1.de] INFO: Scrape type for RX21744: 0
2026-03-30 11:19:12 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN24396%27 HTTP/1.1" 200 None
2026-03-30 11:19:12 [auto1.de] INFO: Scrape type for HN24396: 0
2026-03-30 11:19:12 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS84197%27 HTTP/1.1" 200 None
2026-03-30 11:19:12 [auto1.de] INFO: Scrape type for PS84197: 0
2026-03-30 11:19:12 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD49468%27 HTTP/1.1" 200 None
2026-03-30 11:19:12 [auto1.de] INFO: Scrape type for KD49468: 0
2026-03-30 11:19:12 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-30 11:19:12 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-30 11:19:12 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-30 11:19:12 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV56275%27 HTTP/1.1" 200 None
2026-03-30 11:19:12 [auto1.de] INFO: Scrape type for MV56275: 0
2026-03-30 11:19:12 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17279%27 HTTP/1.1" 200 None
2026-03-30 11:19:12 [auto1.de] INFO: Scrape type for UD17279: 0
2026-03-30 11:19:12 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG53647%27 HTTP/1.1" 200 None
2026-03-30 11:19:12 [auto1.de] INFO: Scrape type for AG53647: 0
2026-03-30 11:19:12 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73613%27 HTTP/1.1" 200 None
2026-03-30 11:19:12 [auto1.de] INFO: Scrape type for MR73613: 0
2026-03-30 11:19:12 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-30 11:19:12 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE18178%27 HTTP/1.1" 200 None
2026-03-30 11:19:12 [auto1.de] INFO: Scrape type for TE18178: 0
2026-03-30 11:19:12 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-30 11:19:12 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77332%27 HTTP/1.1" 200 None
2026-03-30 11:19:12 [auto1.de] INFO: Scrape type for UR77332: 2
2026-03-30 11:19:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abbab86b-5980-5ed7-8c91-7c14255e0f1a with identifier: UR77332
2026-03-30 11:19:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abbab86b-5980-5ed7-8c91-7c14255e0f1a with scrape type 2
2026-03-30 11:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abbab86b-5980-5ed7-8c91-7c14255e0f1a with scrape type 2
2026-03-30 11:19:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abbab86b-5980-5ed7-8c91-7c14255e0f1a, identifier: UR77332
2026-03-30 11:19:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abbab86b-5980-5ed7-8c91-7c14255e0f1a with identifier: UR77332
2026-03-30 11:19:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abbab86b-5980-5ed7-8c91-7c14255e0f1a with identifier: UR77332
2026-03-30 11:19:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abbab86b-5980-5ed7-8c91-7c14255e0f1a with identifier: UR77332 to the API
2026-03-30 11:19:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:03:06Z',
 'fuel_type': 'petrol',
 'id': 'abbab86b-5980-5ed7-8c91-7c14255e0f1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR77332',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 48407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-10',
 'seller_name': None,
 'title': 'BMW 3er 330i xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2017}
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77332%27 HTTP/1.1" 200 None
2026-03-30 11:19:14 [auto1.de] INFO: Saving data for UR77332: {'auction_closing_time': 1774882986.0, 'created_time': 1773342034.199119, 'last_price_update_time': 1774869554.032708}
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR77332') HTTP/1.1" 204 0
2026-03-30 11:19:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:14 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-30 11:19:14 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-30 11:19:14 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-30 11:19:14 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM70147%27 HTTP/1.1" 200 None
2026-03-30 11:19:14 [auto1.de] INFO: Scrape type for JM70147: 0
2026-03-30 11:19:14 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA92521%27 HTTP/1.1" 200 None
2026-03-30 11:19:14 [auto1.de] INFO: Scrape type for TA92521: 0
2026-03-30 11:19:14 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ76571%27 HTTP/1.1" 200 None
2026-03-30 11:19:14 [auto1.de] INFO: Scrape type for GZ76571: 0
2026-03-30 11:19:14 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD52891%27 HTTP/1.1" 200 None
2026-03-30 11:19:14 [auto1.de] INFO: Scrape type for HD52891: 0
2026-03-30 11:19:14 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA13205%27 HTTP/1.1" 200 None
2026-03-30 11:19:14 [auto1.de] INFO: Scrape type for LA13205: 0
2026-03-30 11:19:14 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-30 11:20:03 [scrapy.extensions.logstats] INFO: Crawled 875 pages (at 4 pages/min), scraped 1159 items (at 1 items/min)
2026-03-30 11:20:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:21:03 [scrapy.extensions.logstats] INFO: Crawled 875 pages (at 0 pages/min), scraped 1159 items (at 0 items/min)
2026-03-30 11:21:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:21:23 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.542(s), this was the 1st time calling it.
2026-03-30 11:21:23 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.994039432519176 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:21:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:21:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:29 [auto1.de] INFO: Channel: 24h | Page: 174 | totalHits: 9687 | hits on page: 40
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77332%27 HTTP/1.1" 200 None
2026-03-30 11:21:29 [auto1.de] INFO: Scrape type for UR77332: 0
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM70147%27 HTTP/1.1" 200 None
2026-03-30 11:21:29 [auto1.de] INFO: Scrape type for JM70147: 0
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA92521%27 HTTP/1.1" 200 None
2026-03-30 11:21:29 [auto1.de] INFO: Scrape type for TA92521: 0
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ76571%27 HTTP/1.1" 200 None
2026-03-30 11:21:29 [auto1.de] INFO: Scrape type for GZ76571: 0
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD52891%27 HTTP/1.1" 200 None
2026-03-30 11:21:29 [auto1.de] INFO: Scrape type for HD52891: 0
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA13205%27 HTTP/1.1" 200 None
2026-03-30 11:21:29 [auto1.de] INFO: Scrape type for LA13205: 0
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS16825%27 HTTP/1.1" 200 None
2026-03-30 11:21:29 [auto1.de] INFO: Scrape type for NS16825: 0
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN25126%27 HTTP/1.1" 200 None
2026-03-30 11:21:29 [auto1.de] INFO: Scrape type for RN25126: 0
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK60563%27 HTTP/1.1" 200 None
2026-03-30 11:21:29 [auto1.de] INFO: Scrape type for JK60563: 0
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA95211%27 HTTP/1.1" 200 None
2026-03-30 11:21:29 [auto1.de] INFO: Scrape type for TA95211: 0
2026-03-30 11:21:29 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-30 11:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN86111%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for UN86111: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP73203%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for CP73203: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ44451%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for KJ44451: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ29676%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for YZ29676: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP13767%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for GP13767: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX22441%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for SX22441: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ80305%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for FZ80305: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH83727%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for FH83727: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR36805%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for XR36805: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: JX01740
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51432%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for RU51432: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB82459%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for BB82459: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV29238%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for MV29238: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA20314%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for NA20314: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP93832%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for AP93832: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF39104%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for LF39104: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG78657%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for CG78657: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC16092%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for VC16092: 0
2026-03-30 11:21:30 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR76591%27 HTTP/1.1" 200 None
2026-03-30 11:21:30 [auto1.de] INFO: Scrape type for TR76591: 0
2026-03-30 11:21:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:31 [auto1.de] INFO: Channel: 24h | Page: 175 | totalHits: 9687 | hits on page: 40
2026-03-30 11:21:31 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-30 11:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47451%27 HTTP/1.1" 200 None
2026-03-30 11:21:31 [auto1.de] INFO: Scrape type for EE47451: 0
2026-03-30 11:21:31 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-30 11:21:31 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-30 11:21:31 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-30 11:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD80564%27 HTTP/1.1" 200 None
2026-03-30 11:21:31 [auto1.de] INFO: Scrape type for RD80564: 0
2026-03-30 11:21:31 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-30 11:21:31 [auto1.de] INFO: Found listing with ID: XY17081
2026-03-30 11:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY17081%27 HTTP/1.1" 200 None
2026-03-30 11:21:31 [auto1.de] INFO: Scrape type for XY17081: 0
2026-03-30 11:21:31 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-30 11:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP68247%27 HTTP/1.1" 200 None
2026-03-30 11:21:31 [auto1.de] INFO: Scrape type for YP68247: 0
2026-03-30 11:21:31 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-30 11:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE83152%27 HTTP/1.1" 200 None
2026-03-30 11:21:31 [auto1.de] INFO: Scrape type for BE83152: 0
2026-03-30 11:21:31 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-30 11:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM75105%27 HTTP/1.1" 200 None
2026-03-30 11:21:31 [auto1.de] INFO: Scrape type for JM75105: 0
2026-03-30 11:21:31 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-30 11:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD70369%27 HTTP/1.1" 200 None
2026-03-30 11:21:31 [auto1.de] INFO: Scrape type for GD70369: 0
2026-03-30 11:21:31 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-30 11:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB26924%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for ZB26924: 0
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ38457%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for SZ38457: 0
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW39086%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for VW39086: 0
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG70282%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for DG70282: 0
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50981%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for XV50981: 0
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN98252%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for KN98252: 0
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV32169%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for SV32169: 0
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC54847%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for XC54847: 0
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN43410%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for RN43410: 2
2026-03-30 11:21:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28523152-d07c-56ea-b88b-c7e3a0042f31 with identifier: RN43410
2026-03-30 11:21:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28523152-d07c-56ea-b88b-c7e3a0042f31 with scrape type 2
2026-03-30 11:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28523152-d07c-56ea-b88b-c7e3a0042f31 with scrape type 2
2026-03-30 11:21:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28523152-d07c-56ea-b88b-c7e3a0042f31, identifier: RN43410
2026-03-30 11:21:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28523152-d07c-56ea-b88b-c7e3a0042f31 with identifier: RN43410
2026-03-30 11:21:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28523152-d07c-56ea-b88b-c7e3a0042f31 with identifier: RN43410
2026-03-30 11:21:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28523152-d07c-56ea-b88b-c7e3a0042f31 with identifier: RN43410 to the API
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:42Z',
 'fuel_type': 'diesel',
 'id': '28523152-d07c-56ea-b88b-c7e3a0042f31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN43410',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 236933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-03',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN43410%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Saving data for RN43410: {'auction_closing_time': 1774884522.0, 'created_time': 1774596971.362515, 'last_price_update_time': 1774869692.74605}
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN43410') HTTP/1.1" 204 0
2026-03-30 11:21:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG85302%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for DG85302: 0
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE30080%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for RE30080: 0
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW61170%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for VW61170: 0
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ98450%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for FZ98450: 0
2026-03-30 11:21:32 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM90896%27 HTTP/1.1" 200 None
2026-03-30 11:21:32 [auto1.de] INFO: Scrape type for TM90896: 0
2026-03-30 11:21:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:34 [auto1.de] INFO: Channel: 24h | Page: 176 | totalHits: 9688 | hits on page: 40
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM90896%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for TM90896: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX47602%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for RX47602: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY25128%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for XY25128: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: XC20802
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC20802%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for XC20802: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX93034%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for ZX93034: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ76677%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for LZ76677: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF65798%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for XF65798: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV91582%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for TV91582: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS77012%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for YS77012: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB21266%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for VB21266: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX98688%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for CX98688: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU40553%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for AU40553: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP48264%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for JP48264: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP72129%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for BP72129: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ75769%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for BZ75769: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM05292%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for RM05292: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV92794%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for HV92794: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP56939%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for XP56939: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG22409%27 HTTP/1.1" 200 None
2026-03-30 11:21:34 [auto1.de] INFO: Scrape type for KG22409: 0
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-30 11:21:34 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-30 11:21:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:36 [auto1.de] INFO: Channel: 24h | Page: 177 | totalHits: 9688 | hits on page: 40
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ83963%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for GJ83963: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39163%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for BP39163: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV66765%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for YV66765: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH89792%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for JH89792: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW99084%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for ZW99084: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT23330%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for ZT23330: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT17633%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for RT17633: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY57954%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for NY57954: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ83474%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for MZ83474: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02529%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for BR02529: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA30689%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for PA30689: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: UA03321
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA03321%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for UA03321: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG58570%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for PG58570: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE50485%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for CE50485: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR69139%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for BR69139: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM20101%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for SM20101: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF24484%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for AF24484: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE45367%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for ZE45367: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST81436%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for ST81436: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD52714%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for GD52714: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA71883%27 HTTP/1.1" 200 None
2026-03-30 11:21:36 [auto1.de] INFO: Scrape type for SA71883: 0
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-30 11:21:36 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-30 11:21:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:21:51 [auto1.de] INFO: Channel: 24h | Page: 178 | totalHits: 9689 | hits on page: 40
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT49707%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.de] INFO: Scrape type for RT49707: 0
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG76209%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.de] INFO: Scrape type for KG76209: 0
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC36387%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.de] INFO: Scrape type for BC36387: 0
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC79950%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.de] INFO: Scrape type for RC79950: 0
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED78349%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.de] INFO: Scrape type for ED78349: 0
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK39735%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.de] INFO: Scrape type for YK39735: 0
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF85970%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.de] INFO: Scrape type for YF85970: 2
2026-03-30 11:21:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ba7b37e-8645-57d6-a834-024d0e89230f with identifier: YF85970
2026-03-30 11:21:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ba7b37e-8645-57d6-a834-024d0e89230f with scrape type 2
2026-03-30 11:21:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ba7b37e-8645-57d6-a834-024d0e89230f with scrape type 2
2026-03-30 11:21:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ba7b37e-8645-57d6-a834-024d0e89230f, identifier: YF85970
2026-03-30 11:21:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ba7b37e-8645-57d6-a834-024d0e89230f with identifier: YF85970
2026-03-30 11:21:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ba7b37e-8645-57d6-a834-024d0e89230f with identifier: YF85970
2026-03-30 11:21:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ba7b37e-8645-57d6-a834-024d0e89230f with identifier: YF85970 to the API
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:21:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:00:29Z',
 'fuel_type': 'petrol',
 'id': '6ba7b37e-8645-57d6-a834-024d0e89230f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF85970',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 100217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-31',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Instyle 2WD',
 'transmission': 'manual',
 'trim': 'Instyle 2WD',
 'year': 2011}
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF85970%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.de] INFO: Saving data for YF85970: {'auction_closing_time': 1774882829.0, 'created_time': 1774596940.65839, 'last_price_update_time': 1774869711.762435}
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF85970') HTTP/1.1" 204 0
2026-03-30 11:21:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA20211%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.de] INFO: Scrape type for SA20211: 0
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ35604%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.de] INFO: Scrape type for LZ35604: 0
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU80618%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.de] INFO: Scrape type for NU80618: 0
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34994%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.de] INFO: Scrape type for AX34994: 0
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53394%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.de] INFO: Scrape type for KL53394: 0
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA20411%27 HTTP/1.1" 200 None
2026-03-30 11:21:51 [auto1.de] INFO: Scrape type for GA20411: 0
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-30 11:21:51 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-30 11:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH91436%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.de] INFO: Scrape type for UH91436: 0
2026-03-30 11:21:52 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV57223%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.de] INFO: Scrape type for DV57223: 0
2026-03-30 11:21:52 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-30 11:21:52 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-30 11:21:52 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV29717%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.de] INFO: Scrape type for JV29717: 0
2026-03-30 11:21:52 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT97786%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.de] INFO: Scrape type for XT97786: 0
2026-03-30 11:21:52 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL01247%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.de] INFO: Scrape type for YL01247: 0
2026-03-30 11:21:52 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-30 11:21:52 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-30 11:21:52 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-30 11:21:52 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-30 11:21:52 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL91584%27 HTTP/1.1" 200 None
2026-03-30 11:21:52 [auto1.de] INFO: Scrape type for PL91584: 0
2026-03-30 11:21:52 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-30 11:22:03 [scrapy.extensions.logstats] INFO: Crawled 880 pages (at 5 pages/min), scraped 1161 items (at 2 items/min)
2026-03-30 11:22:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:22:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:08 [auto1.de] INFO: Channel: 24h | Page: 179 | totalHits: 9689 | hits on page: 40
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB13775%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for DB13775: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR52623%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for CR52623: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS79013%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for BS79013: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP77608%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for PP77608: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ21667%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for LZ21667: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU14126%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for CU14126: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ57500%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for SJ57500: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP90277%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for SP90277: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06445%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for VX06445: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH48062%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for RH48062: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV42130%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for CV42130: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD42318%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for BD42318: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS04135%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for KS04135: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY94421%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for ZY94421: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU63404%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for BU63404: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE85293%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for VE85293: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT41484%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for HT41484: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS23827%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for FS23827: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS31792%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for XS31792: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW07623%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for FW07623: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP43988%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for TP43988: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS65125%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for TS65125: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV59345%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for ZV59345: 0
2026-03-30 11:22:08 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ95000%27 HTTP/1.1" 200 None
2026-03-30 11:22:08 [auto1.de] INFO: Scrape type for DZ95000: 0
2026-03-30 11:22:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:09 [auto1.de] INFO: Channel: 24h | Page: 180 | totalHits: 9689 | hits on page: 40
2026-03-30 11:22:09 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-30 11:22:09 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-30 11:22:09 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH02928%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for MH02928: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR03810%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for WR03810: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS21396%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for CS21396: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT54020%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for XT54020: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX95177%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for XX95177: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98136%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for HA98136: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA91193%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for KA91193: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF22867%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for CF22867: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14154%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for UH14154: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ83535%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for XJ83535: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN79660%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for NN79660: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: UP35116
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02409%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for FB02409: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB08927%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for MB08927: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: AU13367
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU13367%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for AU13367: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK58652%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for FK58652: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV14336%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for RV14336: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS09512%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for HS09512: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ03964%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for YZ03964: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY64031%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for GY64031: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB33384%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for TB33384: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM71162%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for BM71162: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF27065%27 HTTP/1.1" 200 None
2026-03-30 11:22:10 [auto1.de] INFO: Scrape type for RF27065: 0
2026-03-30 11:22:10 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-30 11:22:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:42 [auto1.de] INFO: Channel: 24h | Page: 181 | totalHits: 9692 | hits on page: 40
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF27065%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for RF27065: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS78216%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for KS78216: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85810%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for ZS85810: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: DJ74321
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY25775%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for AY25775: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63230%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for UK63230: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP68837%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for XP68837: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX37466%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for NX37466: 0
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-30 11:22:42 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN11461%27 HTTP/1.1" 200 None
2026-03-30 11:22:42 [auto1.de] INFO: Scrape type for XN11461: 2
2026-03-30 11:22:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3ed502f-5fb2-550e-b9bc-f4f8804a11e4 with identifier: XN11461
2026-03-30 11:22:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3ed502f-5fb2-550e-b9bc-f4f8804a11e4 with scrape type 2
2026-03-30 11:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3ed502f-5fb2-550e-b9bc-f4f8804a11e4 with scrape type 2
2026-03-30 11:22:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3ed502f-5fb2-550e-b9bc-f4f8804a11e4, identifier: XN11461
2026-03-30 11:22:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3ed502f-5fb2-550e-b9bc-f4f8804a11e4 with identifier: XN11461
2026-03-30 11:22:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3ed502f-5fb2-550e-b9bc-f4f8804a11e4 with identifier: XN11461
2026-03-30 11:22:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3ed502f-5fb2-550e-b9bc-f4f8804a11e4 with identifier: XN11461 to the API
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:22:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:37:07Z',
 'fuel_type': 'diesel',
 'id': 'a3ed502f-5fb2-550e-b9bc-f4f8804a11e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN11461',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 360930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-08',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN11461%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.de] INFO: Saving data for XN11461: {'auction_closing_time': 1774885027.0, 'created_time': 1773831612.340969, 'last_price_update_time': 1774869763.287808}
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN11461') HTTP/1.1" 204 0
2026-03-30 11:22:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL53532%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.de] INFO: Scrape type for EL53532: 0
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA48706%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.de] INFO: Scrape type for LA48706: 0
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS90319%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.de] INFO: Scrape type for PS90319: 0
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ18784%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.de] INFO: Scrape type for RJ18784: 0
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW74456%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.de] INFO: Scrape type for HW74456: 0
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA02242%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.de] INFO: Scrape type for BA02242: 0
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT31718%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.de] INFO: Scrape type for YT31718: 0
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX79326%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.de] INFO: Scrape type for MX79326: 0
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR37106%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.de] INFO: Scrape type for XR37106: 0
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ08846%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.de] INFO: Scrape type for CZ08846: 0
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP57282%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.de] INFO: Scrape type for XP57282: 0
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR02811%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.de] INFO: Scrape type for MR02811: 0
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-30 11:22:43 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG68469%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.de] INFO: Scrape type for SG68469: 0
2026-03-30 11:23:03 [scrapy.extensions.logstats] INFO: Crawled 883 pages (at 3 pages/min), scraped 1162 items (at 1 items/min)
2026-03-30 11:23:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:23:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:04 [auto1.de] INFO: Channel: 24h | Page: 182 | totalHits: 9694 | hits on page: 40
2026-03-30 11:23:04 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-30 11:23:04 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-30 11:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG68469%27 HTTP/1.1" 200 None
2026-03-30 11:23:04 [auto1.de] INFO: Scrape type for SG68469: 0
2026-03-30 11:23:04 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-30 11:23:04 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-30 11:23:04 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-30 11:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU12004%27 HTTP/1.1" 200 None
2026-03-30 11:23:04 [auto1.de] INFO: Scrape type for CU12004: 0
2026-03-30 11:23:04 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-30 11:23:04 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-30 11:23:04 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX83538%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Scrape type for VX83538: 0
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW63428%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Scrape type for KW63428: 0
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB29022%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Scrape type for MB29022: 0
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96570%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Scrape type for KF96570: 0
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM29335%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Scrape type for LM29335: 0
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS36559%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Scrape type for TS36559: 0
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35901%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Scrape type for JG35901: 0
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM26865%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Scrape type for MM26865: 0
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG62846%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Scrape type for DG62846: 0
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ05104%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Scrape type for KZ05104: 0
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS09440%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Scrape type for AS09440: 0
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX86126%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Scrape type for KX86126: 0
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW86673%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Scrape type for SW86673: 2
2026-03-30 11:23:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35341618-13a7-5cb5-a1b4-395d3318c4a8 with identifier: SW86673
2026-03-30 11:23:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35341618-13a7-5cb5-a1b4-395d3318c4a8 with scrape type 2
2026-03-30 11:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35341618-13a7-5cb5-a1b4-395d3318c4a8 with scrape type 2
2026-03-30 11:23:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35341618-13a7-5cb5-a1b4-395d3318c4a8, identifier: SW86673
2026-03-30 11:23:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35341618-13a7-5cb5-a1b4-395d3318c4a8 with identifier: SW86673
2026-03-30 11:23:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35341618-13a7-5cb5-a1b4-395d3318c4a8 with identifier: SW86673
2026-03-30 11:23:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35341618-13a7-5cb5-a1b4-395d3318c4a8 with identifier: SW86673 to the API
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:08Z',
 'fuel_type': 'petrol',
 'id': '35341618-13a7-5cb5-a1b4-395d3318c4a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW86673',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 284606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-24',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.6 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW86673%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Saving data for SW86673: {'auction_closing_time': 1774885628.0, 'created_time': 1773383311.01312, 'last_price_update_time': 1774869785.685782}
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW86673') HTTP/1.1" 204 0
2026-03-30 11:23:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS47149%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Scrape type for BS47149: 0
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW84065%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Scrape type for FW84065: 0
2026-03-30 11:23:05 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND74491%27 HTTP/1.1" 200 None
2026-03-30 11:23:05 [auto1.de] INFO: Scrape type for ND74491: 0
2026-03-30 11:23:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:36 [auto1.de] INFO: Channel: 24h | Page: 183 | totalHits: 9700 | hits on page: 40
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS09440%27 HTTP/1.1" 200 None
2026-03-30 11:23:36 [auto1.de] INFO: Scrape type for AS09440: 0
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX86126%27 HTTP/1.1" 200 None
2026-03-30 11:23:36 [auto1.de] INFO: Scrape type for KX86126: 0
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW86673%27 HTTP/1.1" 200 None
2026-03-30 11:23:36 [auto1.de] INFO: Scrape type for SW86673: 0
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS47149%27 HTTP/1.1" 200 None
2026-03-30 11:23:36 [auto1.de] INFO: Scrape type for BS47149: 0
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW84065%27 HTTP/1.1" 200 None
2026-03-30 11:23:36 [auto1.de] INFO: Scrape type for FW84065: 0
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND74491%27 HTTP/1.1" 200 None
2026-03-30 11:23:36 [auto1.de] INFO: Scrape type for ND74491: 0
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM26302%27 HTTP/1.1" 200 None
2026-03-30 11:23:36 [auto1.de] INFO: Scrape type for KM26302: 0
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB70760%27 HTTP/1.1" 200 None
2026-03-30 11:23:36 [auto1.de] INFO: Scrape type for FB70760: 0
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV20692%27 HTTP/1.1" 200 None
2026-03-30 11:23:36 [auto1.de] INFO: Scrape type for TV20692: 0
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55762%27 HTTP/1.1" 200 None
2026-03-30 11:23:36 [auto1.de] INFO: Scrape type for LV55762: 0
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK36887%27 HTTP/1.1" 200 None
2026-03-30 11:23:36 [auto1.de] INFO: Scrape type for SK36887: 0
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH49369%27 HTTP/1.1" 200 None
2026-03-30 11:23:36 [auto1.de] INFO: Scrape type for KH49369: 0
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-30 11:23:36 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS68475%27 HTTP/1.1" 200 None
2026-03-30 11:23:36 [auto1.de] INFO: Scrape type for AS68475: 2
2026-03-30 11:23:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 109df886-ff4d-5331-b6d9-47070ddbdf1a with identifier: AS68475
2026-03-30 11:23:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 109df886-ff4d-5331-b6d9-47070ddbdf1a with scrape type 2
2026-03-30 11:23:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 109df886-ff4d-5331-b6d9-47070ddbdf1a with scrape type 2
2026-03-30 11:23:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 109df886-ff4d-5331-b6d9-47070ddbdf1a, identifier: AS68475
2026-03-30 11:23:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 109df886-ff4d-5331-b6d9-47070ddbdf1a with identifier: AS68475
2026-03-30 11:23:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 109df886-ff4d-5331-b6d9-47070ddbdf1a with identifier: AS68475
2026-03-30 11:23:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 109df886-ff4d-5331-b6d9-47070ddbdf1a with identifier: AS68475 to the API
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:23:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:12:17Z',
 'fuel_type': 'diesel',
 'id': '109df886-ff4d-5331-b6d9-47070ddbdf1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS68475',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 211699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS68475%27 HTTP/1.1" 200 None
2026-03-30 11:23:37 [auto1.de] INFO: Saving data for AS68475: {'auction_closing_time': 1774883537.0, 'created_time': 1774596938.65833, 'last_price_update_time': 1774869817.198759}
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS68475') HTTP/1.1" 204 0
2026-03-30 11:23:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR50974%27 HTTP/1.1" 200 None
2026-03-30 11:23:37 [auto1.de] INFO: Scrape type for YR50974: 0
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57679%27 HTTP/1.1" 200 None
2026-03-30 11:23:37 [auto1.de] INFO: Scrape type for FY57679: 0
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL15513%27 HTTP/1.1" 200 None
2026-03-30 11:23:37 [auto1.de] INFO: Scrape type for EL15513: 0
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB57132%27 HTTP/1.1" 200 None
2026-03-30 11:23:37 [auto1.de] INFO: Scrape type for BB57132: 0
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG41026%27 HTTP/1.1" 200 None
2026-03-30 11:23:37 [auto1.de] INFO: Scrape type for TG41026: 0
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR63212%27 HTTP/1.1" 200 None
2026-03-30 11:23:37 [auto1.de] INFO: Scrape type for DR63212: 0
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH41107%27 HTTP/1.1" 200 None
2026-03-30 11:23:37 [auto1.de] INFO: Scrape type for XH41107: 0
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81482%27 HTTP/1.1" 200 None
2026-03-30 11:23:37 [auto1.de] INFO: Scrape type for MA81482: 0
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV00084%27 HTTP/1.1" 200 None
2026-03-30 11:23:37 [auto1.de] INFO: Scrape type for GV00084: 0
2026-03-30 11:23:37 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-30 11:23:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:51 [auto1.de] INFO: Channel: 24h | Page: 184 | totalHits: 9701 | hits on page: 40
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC15982%27 HTTP/1.1" 200 None
2026-03-30 11:23:51 [auto1.de] INFO: Scrape type for UC15982: 0
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV35825%27 HTTP/1.1" 200 None
2026-03-30 11:23:51 [auto1.de] INFO: Scrape type for NV35825: 0
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS67256%27 HTTP/1.1" 200 None
2026-03-30 11:23:51 [auto1.de] INFO: Scrape type for XS67256: 0
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: US02416
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02416%27 HTTP/1.1" 200 None
2026-03-30 11:23:51 [auto1.de] INFO: Scrape type for US02416: 0
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL77379%27 HTTP/1.1" 200 None
2026-03-30 11:23:51 [auto1.de] INFO: Scrape type for SL77379: 0
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ13428%27 HTTP/1.1" 200 None
2026-03-30 11:23:51 [auto1.de] INFO: Scrape type for BJ13428: 0
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: SP71400
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE95129%27 HTTP/1.1" 200 None
2026-03-30 11:23:51 [auto1.de] INFO: Scrape type for WE95129: 0
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85358%27 HTTP/1.1" 200 None
2026-03-30 11:23:51 [auto1.de] INFO: Scrape type for ZS85358: 0
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT62931%27 HTTP/1.1" 200 None
2026-03-30 11:23:51 [auto1.de] INFO: Scrape type for YT62931: 0
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV85362%27 HTTP/1.1" 200 None
2026-03-30 11:23:51 [auto1.de] INFO: Scrape type for WV85362: 0
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN73181%27 HTTP/1.1" 200 None
2026-03-30 11:23:51 [auto1.de] INFO: Scrape type for LN73181: 0
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68264%27 HTTP/1.1" 200 None
2026-03-30 11:23:51 [auto1.de] INFO: Scrape type for DR68264: 0
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP23640%27 HTTP/1.1" 200 None
2026-03-30 11:23:51 [auto1.de] INFO: Scrape type for MP23640: 0
2026-03-30 11:23:51 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP07382%27 HTTP/1.1" 200 None
2026-03-30 11:23:51 [auto1.de] INFO: Scrape type for FP07382: 0
2026-03-30 11:23:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:03 [scrapy.extensions.logstats] INFO: Crawled 886 pages (at 3 pages/min), scraped 1164 items (at 2 items/min)
2026-03-30 11:24:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:24:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:12 [auto1.de] INFO: Channel: 24h | Page: 185 | totalHits: 9704 | hits on page: 40
2026-03-30 11:24:12 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-30 11:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68264%27 HTTP/1.1" 200 None
2026-03-30 11:24:12 [auto1.de] INFO: Scrape type for DR68264: 0
2026-03-30 11:24:12 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-30 11:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP23640%27 HTTP/1.1" 200 None
2026-03-30 11:24:12 [auto1.de] INFO: Scrape type for MP23640: 0
2026-03-30 11:24:12 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-30 11:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP07382%27 HTTP/1.1" 200 None
2026-03-30 11:24:12 [auto1.de] INFO: Scrape type for FP07382: 0
2026-03-30 11:24:12 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-30 11:24:12 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-30 11:24:12 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-30 11:24:12 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-30 11:24:12 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-30 11:24:12 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-30 11:24:12 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-30 11:24:12 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-30 11:24:12 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-30 11:24:12 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-30 11:24:12 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-30 11:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV64816%27 HTTP/1.1" 200 None
2026-03-30 11:24:12 [auto1.de] INFO: Scrape type for AV64816: 0
2026-03-30 11:24:12 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-30 11:24:12 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-30 11:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX01006%27 HTTP/1.1" 200 None
2026-03-30 11:24:13 [auto1.de] INFO: Scrape type for FX01006: 0
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: MH95503
2026-03-30 11:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH95503%27 HTTP/1.1" 200 None
2026-03-30 11:24:13 [auto1.de] INFO: Scrape type for MH95503: 0
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-30 11:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS07911%27 HTTP/1.1" 200 None
2026-03-30 11:24:13 [auto1.de] INFO: Scrape type for KS07911: 0
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: MV27472
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-30 11:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY62389%27 HTTP/1.1" 200 None
2026-03-30 11:24:13 [auto1.de] INFO: Scrape type for EY62389: 0
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-30 11:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN74001%27 HTTP/1.1" 200 None
2026-03-30 11:24:13 [auto1.de] INFO: Scrape type for CN74001: 0
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-30 11:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX39792%27 HTTP/1.1" 200 None
2026-03-30 11:24:13 [auto1.de] INFO: Scrape type for FX39792: 0
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-30 11:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY59732%27 HTTP/1.1" 200 None
2026-03-30 11:24:13 [auto1.de] INFO: Scrape type for NY59732: 0
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-30 11:24:13 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-30 11:24:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:16 [auto1.de] INFO: Channel: 24h | Page: 186 | totalHits: 9704 | hits on page: 40
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR89322%27 HTTP/1.1" 200 None
2026-03-30 11:24:16 [auto1.de] INFO: Scrape type for GR89322: 0
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP29614%27 HTTP/1.1" 200 None
2026-03-30 11:24:16 [auto1.de] INFO: Scrape type for ZP29614: 0
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR51863%27 HTTP/1.1" 200 None
2026-03-30 11:24:16 [auto1.de] INFO: Scrape type for AR51863: 0
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH41700%27 HTTP/1.1" 200 None
2026-03-30 11:24:16 [auto1.de] INFO: Scrape type for KH41700: 0
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY25945%27 HTTP/1.1" 200 None
2026-03-30 11:24:16 [auto1.de] INFO: Scrape type for CY25945: 0
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06572%27 HTTP/1.1" 200 None
2026-03-30 11:24:16 [auto1.de] INFO: Scrape type for WT06572: 0
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39417%27 HTTP/1.1" 200 None
2026-03-30 11:24:16 [auto1.de] INFO: Scrape type for GH39417: 0
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU39005%27 HTTP/1.1" 200 None
2026-03-30 11:24:16 [auto1.de] INFO: Scrape type for AU39005: 0
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU93663%27 HTTP/1.1" 200 None
2026-03-30 11:24:16 [auto1.de] INFO: Scrape type for EU93663: 0
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ37362%27 HTTP/1.1" 200 None
2026-03-30 11:24:16 [auto1.de] INFO: Scrape type for AZ37362: 0
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06535%27 HTTP/1.1" 200 None
2026-03-30 11:24:16 [auto1.de] INFO: Scrape type for CP06535: 0
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ60943%27 HTTP/1.1" 200 None
2026-03-30 11:24:16 [auto1.de] INFO: Scrape type for DJ60943: 0
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47026%27 HTTP/1.1" 200 None
2026-03-30 11:24:16 [auto1.de] INFO: Scrape type for EE47026: 0
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-30 11:24:16 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD94034%27 HTTP/1.1" 200 None
2026-03-30 11:24:16 [auto1.de] INFO: Scrape type for YD94034: 2
2026-03-30 11:24:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4503613a-afd0-52bf-b7c5-43e77f74da28 with identifier: YD94034
2026-03-30 11:24:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4503613a-afd0-52bf-b7c5-43e77f74da28 with scrape type 2
2026-03-30 11:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4503613a-afd0-52bf-b7c5-43e77f74da28 with scrape type 2
2026-03-30 11:24:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4503613a-afd0-52bf-b7c5-43e77f74da28, identifier: YD94034
2026-03-30 11:24:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4503613a-afd0-52bf-b7c5-43e77f74da28 with identifier: YD94034
2026-03-30 11:24:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4503613a-afd0-52bf-b7c5-43e77f74da28 with identifier: YD94034
2026-03-30 11:24:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4503613a-afd0-52bf-b7c5-43e77f74da28 with identifier: YD94034 to the API
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:24:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:02:22Z',
 'fuel_type': 'petrol',
 'id': '4503613a-afd0-52bf-b7c5-43e77f74da28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD94034',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 53753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-12',
 'seller_name': None,
 'title': 'BMW 3er 328i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD94034%27 HTTP/1.1" 200 None
2026-03-30 11:24:16 [auto1.de] INFO: Saving data for YD94034: {'auction_closing_time': 1774882942.0, 'created_time': 1773136346.902415, 'last_price_update_time': 1774869856.952525}
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD94034') HTTP/1.1" 204 0
2026-03-30 11:24:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:17 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC89740%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.de] INFO: Scrape type for VC89740: 0
2026-03-30 11:24:17 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ97789%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.de] INFO: Scrape type for EJ97789: 0
2026-03-30 11:24:17 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-30 11:24:17 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML30380%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.de] INFO: Scrape type for ML30380: 0
2026-03-30 11:24:17 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-30 11:24:17 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07165%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.de] INFO: Scrape type for NC07165: 0
2026-03-30 11:24:17 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-30 11:24:17 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-30 11:24:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:25 [auto1.de] INFO: Channel: 24h | Page: 187 | totalHits: 9707 | hits on page: 40
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07165%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for NC07165: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG84988%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for AG84988: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA07752%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for RA07752: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG73343%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for WG73343: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY21095%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for UY21095: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD64601%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for SD64601: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU06993%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for VU06993: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME01390%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for ME01390: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK37699%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for NK37699: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88240%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for HG88240: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB67874%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for RB67874: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR29139%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for JR29139: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: UA34873
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA34873%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for UA34873: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE75609%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for CE75609: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA05617%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for XA05617: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF39305%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for CF39305: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX54402%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for MX54402: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68108%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for ES68108: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW68760%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for HW68760: 0
2026-03-30 11:24:25 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY32384%27 HTTP/1.1" 200 None
2026-03-30 11:24:25 [auto1.de] INFO: Scrape type for TY32384: 0
2026-03-30 11:24:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:03 [scrapy.extensions.logstats] INFO: Crawled 889 pages (at 3 pages/min), scraped 1165 items (at 1 items/min)
2026-03-30 11:25:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:25:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:33 [auto1.de] INFO: Channel: 24h | Page: 188 | totalHits: 9715 | hits on page: 40
2026-03-30 11:25:33 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-30 11:25:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA05617%27 HTTP/1.1" 200 None
2026-03-30 11:25:33 [auto1.de] INFO: Scrape type for XA05617: 0
2026-03-30 11:25:33 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-30 11:25:33 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-30 11:25:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF39305%27 HTTP/1.1" 200 None
2026-03-30 11:25:33 [auto1.de] INFO: Scrape type for CF39305: 0
2026-03-30 11:25:33 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-30 11:25:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX54402%27 HTTP/1.1" 200 None
2026-03-30 11:25:33 [auto1.de] INFO: Scrape type for MX54402: 0
2026-03-30 11:25:33 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-30 11:25:33 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-30 11:25:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68108%27 HTTP/1.1" 200 None
2026-03-30 11:25:33 [auto1.de] INFO: Scrape type for ES68108: 0
2026-03-30 11:25:33 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-30 11:25:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW68760%27 HTTP/1.1" 200 None
2026-03-30 11:25:33 [auto1.de] INFO: Scrape type for HW68760: 0
2026-03-30 11:25:33 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-30 11:25:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY32384%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for TY32384: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS39817%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for MS39817: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ51858%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for LZ51858: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH85059%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for AH85059: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD61700%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for TD61700: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM15583%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for YM15583: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD93379%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for AD93379: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP24640%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for MP24640: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN62534%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for VN62534: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM54936%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for SM54936: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR25220%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for BR25220: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG81314%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for CG81314: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN66940%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for KN66940: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK08756%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for UK08756: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR88792%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for CR88792: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ66164%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for CZ66164: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU68975%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for FU68975: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB65858%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for UB65858: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK53162%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for ZK53162: 0
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-30 11:25:34 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL77051%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.de] INFO: Scrape type for VL77051: 0
2026-03-30 11:25:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:50 [auto1.de] INFO: Channel: 24h | Page: 189 | totalHits: 9719 | hits on page: 40
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK53162%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for ZK53162: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL77051%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for VL77051: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80176%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for EJ80176: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN36712%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for AN36712: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW09087%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for SW09087: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX34445%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for KX34445: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL67140%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for VL67140: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT81385%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for FT81385: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX59150%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for MX59150: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM43166%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for AM43166: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE09507%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for SE09507: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY93547%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for ZY93547: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP27370%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for CP27370: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH54290%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for BH54290: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK49641%27 HTTP/1.1" 200 None
2026-03-30 11:25:50 [auto1.de] INFO: Scrape type for UK49641: 0
2026-03-30 11:25:50 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-30 11:25:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ93598%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [auto1.de] INFO: Scrape type for HZ93598: 0
2026-03-30 11:25:51 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-30 11:25:51 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL82245%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [auto1.de] INFO: Scrape type for DL82245: 0
2026-03-30 11:25:51 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-30 11:25:51 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG67799%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [auto1.de] INFO: Scrape type for UG67799: 0
2026-03-30 11:25:51 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT01639%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [auto1.de] INFO: Scrape type for WT01639: 0
2026-03-30 11:25:51 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW65482%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [auto1.de] INFO: Scrape type for CW65482: 0
2026-03-30 11:25:51 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF94997%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [auto1.de] INFO: Scrape type for WF94997: 0
2026-03-30 11:25:51 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-30 11:25:51 [auto1.de] INFO: Found listing with ID: US61717
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US61717%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [auto1.de] INFO: Scrape type for US61717: 0
2026-03-30 11:25:51 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-30 11:25:51 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF55621%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [auto1.de] INFO: Scrape type for YF55621: 0
2026-03-30 11:25:51 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU16772%27 HTTP/1.1" 200 None
2026-03-30 11:25:51 [auto1.de] INFO: Scrape type for MU16772: 0
2026-03-30 11:25:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:52 [auto1.de] INFO: Channel: 24h | Page: 190 | totalHits: 9719 | hits on page: 40
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV63052%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for JV63052: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE48673%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for UE48673: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87101%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for WE87101: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14649%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for SG14649: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM79611%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for AM79611: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE71066%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for JE71066: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK35927%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for EK35927: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17185%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for JX17185: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV40482%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for DV40482: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW43883%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for HW43883: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH17233%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for BH17233: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC42699%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for ZC42699: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU37680%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for HU37680: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB42941%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for TB42941: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG24427%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for XG24427: 0
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-30 11:25:52 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU82600%27 HTTP/1.1" 200 None
2026-03-30 11:25:52 [auto1.de] INFO: Scrape type for ZU82600: 2
2026-03-30 11:25:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38244341-64d9-58c5-9419-05167a0f6b75 with identifier: ZU82600
2026-03-30 11:25:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38244341-64d9-58c5-9419-05167a0f6b75 with scrape type 2
2026-03-30 11:25:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38244341-64d9-58c5-9419-05167a0f6b75 with scrape type 2
2026-03-30 11:25:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38244341-64d9-58c5-9419-05167a0f6b75, identifier: ZU82600
2026-03-30 11:25:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38244341-64d9-58c5-9419-05167a0f6b75 with identifier: ZU82600
2026-03-30 11:25:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38244341-64d9-58c5-9419-05167a0f6b75 with identifier: ZU82600
2026-03-30 11:25:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38244341-64d9-58c5-9419-05167a0f6b75 with identifier: ZU82600 to the API
2026-03-30 11:25:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:01:14Z',
 'fuel_type': 'diesel',
 'id': '38244341-64d9-58c5-9419-05167a0f6b75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU82600',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 125778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion Tech',
 'year': 2014}
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU82600%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Saving data for ZU82600: {'auction_closing_time': 1774882874.0, 'created_time': 1774034601.346195, 'last_price_update_time': 1774869953.160473}
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU82600') HTTP/1.1" 204 0
2026-03-30 11:25:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE19293%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Scrape type for AE19293: 0
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM49539%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Scrape type for DM49539: 0
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK80269%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Scrape type for VK80269: 0
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF75522%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Scrape type for NF75522: 0
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY85656%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Scrape type for WY85656: 0
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP61239%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Scrape type for BP61239: 0
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-30 11:25:53 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59487%27 HTTP/1.1" 200 None
2026-03-30 11:25:53 [auto1.de] INFO: Scrape type for DS59487: 0
2026-03-30 11:26:03 [scrapy.extensions.logstats] INFO: Crawled 892 pages (at 3 pages/min), scraped 1166 items (at 1 items/min)
2026-03-30 11:26:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:26:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:05 [auto1.de] INFO: Channel: 24h | Page: 191 | totalHits: 9719 | hits on page: 40
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ01431%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for BZ01431: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE00518%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for HE00518: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV69297%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for AV69297: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP15063%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for WP15063: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA57205%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for LA57205: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS46414%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for MS46414: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM24732%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for FM24732: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE30814%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for WE30814: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB43981%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for EB43981: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR84974%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for KR84974: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT09261%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for RT09261: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD09602%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for DD09602: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB14031%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for SB14031: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: NC07171
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07171%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for NC07171: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86569%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for XC86569: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW02228%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for HW02228: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST04128%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for ST04128: 0
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-30 11:26:05 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD01129%27 HTTP/1.1" 200 None
2026-03-30 11:26:05 [auto1.de] INFO: Scrape type for PD01129: 0
2026-03-30 11:26:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:42 [auto1.de] INFO: Channel: 24h | Page: 192 | totalHits: 9723 | hits on page: 40
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST04128%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for ST04128: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD01129%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for PD01129: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB61823%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for UB61823: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68340%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for KW68340: 0
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-30 11:26:42 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR15033%27 HTTP/1.1" 200 None
2026-03-30 11:26:42 [auto1.de] INFO: Scrape type for GR15033: 2
2026-03-30 11:26:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc7345c6-e58d-57e4-9dfd-933afac4f56f with identifier: GR15033
2026-03-30 11:26:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc7345c6-e58d-57e4-9dfd-933afac4f56f with scrape type 2
2026-03-30 11:26:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc7345c6-e58d-57e4-9dfd-933afac4f56f with scrape type 2
2026-03-30 11:26:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc7345c6-e58d-57e4-9dfd-933afac4f56f, identifier: GR15033
2026-03-30 11:26:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc7345c6-e58d-57e4-9dfd-933afac4f56f with identifier: GR15033
2026-03-30 11:26:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc7345c6-e58d-57e4-9dfd-933afac4f56f with identifier: GR15033
2026-03-30 11:26:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc7345c6-e58d-57e4-9dfd-933afac4f56f with identifier: GR15033 to the API
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:02:08Z',
 'fuel_type': 'petrol',
 'id': 'cc7345c6-e58d-57e4-9dfd-933afac4f56f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR15033',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 43423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 MPI Cool Plus',
 'transmission': 'manual',
 'trim': 'Cool Plus',
 'year': 2019}
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR15033%27 HTTP/1.1" 200 None
2026-03-30 11:26:43 [auto1.de] INFO: Saving data for GR15033: {'auction_closing_time': 1774882928.0, 'created_time': 1774031831.967567, 'last_price_update_time': 1774870003.290893}
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR15033') HTTP/1.1" 204 0
2026-03-30 11:26:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW69161%27 HTTP/1.1" 200 None
2026-03-30 11:26:43 [auto1.de] INFO: Scrape type for DW69161: 0
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE92744%27 HTTP/1.1" 200 None
2026-03-30 11:26:43 [auto1.de] INFO: Scrape type for UE92744: 0
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH92759%27 HTTP/1.1" 200 None
2026-03-30 11:26:43 [auto1.de] INFO: Scrape type for VH92759: 0
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH05961%27 HTTP/1.1" 200 None
2026-03-30 11:26:43 [auto1.de] INFO: Scrape type for UH05961: 0
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX45513%27 HTTP/1.1" 200 None
2026-03-30 11:26:43 [auto1.de] INFO: Scrape type for BX45513: 0
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX50197%27 HTTP/1.1" 200 None
2026-03-30 11:26:43 [auto1.de] INFO: Scrape type for SX50197: 0
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK09354%27 HTTP/1.1" 200 None
2026-03-30 11:26:43 [auto1.de] INFO: Scrape type for JK09354: 0
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-30 11:26:43 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB99639%27 HTTP/1.1" 200 None
2026-03-30 11:26:43 [auto1.de] INFO: Scrape type for MB99639: 2
2026-03-30 11:26:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e48e594-4a99-577b-88b8-867a479ecbf9 with identifier: MB99639
2026-03-30 11:26:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e48e594-4a99-577b-88b8-867a479ecbf9 with scrape type 2
2026-03-30 11:26:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e48e594-4a99-577b-88b8-867a479ecbf9 with scrape type 2
2026-03-30 11:26:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e48e594-4a99-577b-88b8-867a479ecbf9, identifier: MB99639
2026-03-30 11:26:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e48e594-4a99-577b-88b8-867a479ecbf9 with identifier: MB99639
2026-03-30 11:26:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e48e594-4a99-577b-88b8-867a479ecbf9 with identifier: MB99639
2026-03-30 11:26:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e48e594-4a99-577b-88b8-867a479ecbf9 with identifier: MB99639 to the API
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:28:14Z',
 'fuel_type': 'petrol',
 'id': '8e48e594-4a99-577b-88b8-867a479ecbf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB99639',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 195836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-07',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB99639%27 HTTP/1.1" 200 None
2026-03-30 11:26:43 [auto1.de] INFO: Saving data for MB99639: {'auction_closing_time': 1774884494.0, 'created_time': 1774350859.604669, 'last_price_update_time': 1774870003.920211}
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB99639') HTTP/1.1" 204 0
2026-03-30 11:26:44 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-30 11:26:44 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-30 11:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF93739%27 HTTP/1.1" 200 None
2026-03-30 11:26:44 [auto1.de] INFO: Scrape type for XF93739: 0
2026-03-30 11:26:44 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-30 11:26:44 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-30 11:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB48782%27 HTTP/1.1" 200 None
2026-03-30 11:26:44 [auto1.de] INFO: Scrape type for FB48782: 0
2026-03-30 11:26:44 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-30 11:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT56584%27 HTTP/1.1" 200 None
2026-03-30 11:26:44 [auto1.de] INFO: Scrape type for MT56584: 0
2026-03-30 11:26:44 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-30 11:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ30357%27 HTTP/1.1" 200 None
2026-03-30 11:26:44 [auto1.de] INFO: Scrape type for XJ30357: 0
2026-03-30 11:26:44 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-30 11:26:44 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-30 11:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20975%27 HTTP/1.1" 200 None
2026-03-30 11:26:44 [auto1.de] INFO: Scrape type for JY20975: 0
2026-03-30 11:26:44 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-30 11:26:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:48 [auto1.de] INFO: Channel: 24h | Page: 193 | totalHits: 9724 | hits on page: 40
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA13792%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.de] INFO: Scrape type for VA13792: 2
2026-03-30 11:26:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41b82ed4-8cba-5fa6-a37a-0d700f148967 with identifier: VA13792
2026-03-30 11:26:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41b82ed4-8cba-5fa6-a37a-0d700f148967 with scrape type 2
2026-03-30 11:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41b82ed4-8cba-5fa6-a37a-0d700f148967 with scrape type 2
2026-03-30 11:26:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41b82ed4-8cba-5fa6-a37a-0d700f148967, identifier: VA13792
2026-03-30 11:26:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41b82ed4-8cba-5fa6-a37a-0d700f148967 with identifier: VA13792
2026-03-30 11:26:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41b82ed4-8cba-5fa6-a37a-0d700f148967 with identifier: VA13792
2026-03-30 11:26:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41b82ed4-8cba-5fa6-a37a-0d700f148967 with identifier: VA13792 to the API
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:35:20Z',
 'fuel_type': 'petrol',
 'id': '41b82ed4-8cba-5fa6-a37a-0d700f148967',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA13792',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 14905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-23',
 'seller_name': None,
 'title': 'Ford Focus 2.3 EcoBoost ST X',
 'transmission': 'automatic',
 'trim': 'ST X',
 'year': 2023}
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA13792%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.de] INFO: Saving data for VA13792: {'auction_closing_time': 1774884920.0, 'created_time': 1773686290.298045, 'last_price_update_time': 1774870008.514304}
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA13792') HTTP/1.1" 204 0
2026-03-30 11:26:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP67485%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.de] INFO: Scrape type for SP67485: 0
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM58161%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.de] INFO: Scrape type for CM58161: 0
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC52904%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.de] INFO: Scrape type for BC52904: 0
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC54043%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.de] INFO: Scrape type for YC54043: 0
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU59461%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.de] INFO: Scrape type for JU59461: 0
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF47459%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.de] INFO: Scrape type for YF47459: 0
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98939%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.de] INFO: Scrape type for TS98939: 0
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX55522%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.de] INFO: Scrape type for HX55522: 0
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY76457%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.de] INFO: Scrape type for YY76457: 0
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV91199%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.de] INFO: Scrape type for NV91199: 0
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM16548%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.de] INFO: Scrape type for JM16548: 0
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ49473%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.de] INFO: Scrape type for RZ49473: 0
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-30 11:26:48 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ94185%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.de] INFO: Scrape type for SZ94185: 2
2026-03-30 11:26:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0c33989-853a-5f5f-adfc-109e77f7342a with identifier: SZ94185
2026-03-30 11:26:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0c33989-853a-5f5f-adfc-109e77f7342a with scrape type 2
2026-03-30 11:26:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0c33989-853a-5f5f-adfc-109e77f7342a with scrape type 2
2026-03-30 11:26:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0c33989-853a-5f5f-adfc-109e77f7342a, identifier: SZ94185
2026-03-30 11:26:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0c33989-853a-5f5f-adfc-109e77f7342a with identifier: SZ94185
2026-03-30 11:26:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0c33989-853a-5f5f-adfc-109e77f7342a with identifier: SZ94185
2026-03-30 11:26:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0c33989-853a-5f5f-adfc-109e77f7342a with identifier: SZ94185 to the API
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:26:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:31:23Z',
 'fuel_type': 'diesel',
 'id': 'a0c33989-853a-5f5f-adfc-109e77f7342a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ94185',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 156954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion',
 'year': 2019}
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ94185%27 HTTP/1.1" 200 None
2026-03-30 11:26:49 [auto1.de] INFO: Saving data for SZ94185: {'auction_closing_time': 1774884683.0, 'created_time': 1773304983.267014, 'last_price_update_time': 1774870009.383307}
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ94185') HTTP/1.1" 204 0
2026-03-30 11:26:49 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA80690%27 HTTP/1.1" 200 None
2026-03-30 11:26:49 [auto1.de] INFO: Scrape type for EA80690: 0
2026-03-30 11:26:49 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN68055%27 HTTP/1.1" 200 None
2026-03-30 11:26:49 [auto1.de] INFO: Scrape type for WN68055: 0
2026-03-30 11:26:49 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE65946%27 HTTP/1.1" 200 None
2026-03-30 11:26:49 [auto1.de] INFO: Scrape type for HE65946: 0
2026-03-30 11:27:03 [scrapy.extensions.logstats] INFO: Crawled 895 pages (at 3 pages/min), scraped 1170 items (at 4 items/min)
2026-03-30 11:27:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:27:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:05 [auto1.de] INFO: Channel: 24h | Page: 194 | totalHits: 9725 | hits on page: 40
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE65946%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for HE65946: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX99081%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for PX99081: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW60338%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for ZW60338: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX11435%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for MX11435: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: VW88901
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21289%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for YJ21289: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY78752%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for GY78752: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN65963%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for EN65963: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36237%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for VU36237: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77152%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for HL77152: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43781%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for UZ43781: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF87432%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for JF87432: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: UW42720
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU98141%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for UU98141: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY76053%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for DY76053: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: US56502
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40728%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for TX40728: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB09552%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for EB09552: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN47186%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for MN47186: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC78323%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for RC78323: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF76340%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for LF76340: 0
2026-03-30 11:27:05 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL50388%27 HTTP/1.1" 200 None
2026-03-30 11:27:05 [auto1.de] INFO: Scrape type for JL50388: 0
2026-03-30 11:27:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:09 [auto1.de] INFO: Channel: 24h | Page: 195 | totalHits: 9725 | hits on page: 40
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY49158%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for AY49158: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64301%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for RC64301: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS95073%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for PS95073: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW95477%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for WW95477: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18846%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for KV18846: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT47398%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for YT47398: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA60248%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for ZA60248: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX72009%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for SX72009: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG18386%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for VG18386: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB52240%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for BB52240: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK52419%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for RK52419: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU21879%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for YU21879: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD93241%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for HD93241: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP80486%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for DP80486: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS15843%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for ZS15843: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: US92808
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL98851%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for HL98851: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG82631%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for ZG82631: 0
2026-03-30 11:27:09 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR57027%27 HTTP/1.1" 200 None
2026-03-30 11:27:09 [auto1.de] INFO: Scrape type for WR57027: 2
2026-03-30 11:27:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0173d4a8-f869-5e9c-82e6-21afda6f2cfd with identifier: WR57027
2026-03-30 11:27:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0173d4a8-f869-5e9c-82e6-21afda6f2cfd with scrape type 2
2026-03-30 11:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0173d4a8-f869-5e9c-82e6-21afda6f2cfd with scrape type 2
2026-03-30 11:27:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0173d4a8-f869-5e9c-82e6-21afda6f2cfd, identifier: WR57027
2026-03-30 11:27:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0173d4a8-f869-5e9c-82e6-21afda6f2cfd with identifier: WR57027
2026-03-30 11:27:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0173d4a8-f869-5e9c-82e6-21afda6f2cfd with identifier: WR57027
2026-03-30 11:27:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0173d4a8-f869-5e9c-82e6-21afda6f2cfd with identifier: WR57027 to the API
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:03:39Z',
 'fuel_type': 'petrol',
 'id': '0173d4a8-f869-5e9c-82e6-21afda6f2cfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR57027',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 123369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-20',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR57027%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.de] INFO: Saving data for WR57027: {'auction_closing_time': 1774883019.0, 'created_time': 1772728240.762251, 'last_price_update_time': 1774870030.651677}
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR57027') HTTP/1.1" 204 0
2026-03-30 11:27:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:10 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-30 11:27:10 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT14298%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.de] INFO: Scrape type for GT14298: 0
2026-03-30 11:27:10 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ53783%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.de] INFO: Scrape type for JZ53783: 0
2026-03-30 11:27:10 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33048%27 HTTP/1.1" 200 None
2026-03-30 11:27:10 [auto1.de] INFO: Scrape type for KV33048: 0
2026-03-30 11:27:10 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-30 11:27:10 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-30 11:27:10 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-30 11:27:10 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-30 11:27:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:19 [auto1.de] INFO: Channel: 24h | Page: 196 | totalHits: 9725 | hits on page: 40
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH55559%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for JH55559: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB80015%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for JB80015: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75518%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for CJ75518: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW18782%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for ZW18782: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV93424%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for DV93424: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX09791%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for JX09791: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF75953%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for RF75953: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR32988%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for DR32988: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU68423%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for HU68423: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT22641%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for CT22641: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ55086%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for UJ55086: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH01499%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for RH01499: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX92669%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for JX92669: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL46030%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for VL46030: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY09014%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for FY09014: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF99280%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for AF99280: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU04620%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for JU04620: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: JG45711
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX96959%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for GX96959: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP49973%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for NP49973: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM81365%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for NM81365: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK72696%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for VK72696: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: PC42452
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11616%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for BX11616: 0
2026-03-30 11:27:19 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD95192%27 HTTP/1.1" 200 None
2026-03-30 11:27:19 [auto1.de] INFO: Scrape type for PD95192: 0
2026-03-30 11:27:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:24 [auto1.de] INFO: Channel: 24h | Page: 197 | totalHits: 9727 | hits on page: 40
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11616%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for BX11616: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD95192%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for PD95192: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE82761%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for FE82761: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP99262%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for RP99262: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW40365%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for SW40365: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL73476%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for KL73476: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW50653%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for YW50653: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ47858%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for KZ47858: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE13487%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for NE13487: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR43966%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for BR43966: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX67630%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for FX67630: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU15721%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for YU15721: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG77097%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for JG77097: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX01041%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for MX01041: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL59024%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for LL59024: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ29273%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for GZ29273: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC20634%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for BC20634: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL95797%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for NL95797: 0
2026-03-30 11:27:24 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE56554%27 HTTP/1.1" 200 None
2026-03-30 11:27:24 [auto1.de] INFO: Scrape type for DE56554: 2
2026-03-30 11:27:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26ff99e6-3497-52e8-8aa9-b4f7550fca68 with identifier: DE56554
2026-03-30 11:27:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26ff99e6-3497-52e8-8aa9-b4f7550fca68 with scrape type 2
2026-03-30 11:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26ff99e6-3497-52e8-8aa9-b4f7550fca68 with scrape type 2
2026-03-30 11:27:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26ff99e6-3497-52e8-8aa9-b4f7550fca68, identifier: DE56554
2026-03-30 11:27:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26ff99e6-3497-52e8-8aa9-b4f7550fca68 with identifier: DE56554
2026-03-30 11:27:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26ff99e6-3497-52e8-8aa9-b4f7550fca68 with identifier: DE56554
2026-03-30 11:27:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26ff99e6-3497-52e8-8aa9-b4f7550fca68 with identifier: DE56554 to the API
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:27:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:30:56Z',
 'fuel_type': 'petrol',
 'id': '26ff99e6-3497-52e8-8aa9-b4f7550fca68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE56554',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'MX-5',
 'odometer': 38109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-22',
 'seller_name': None,
 'title': 'Mazda MX-5 1.8 Center-Line Roadster Coupe',
 'transmission': 'manual',
 'trim': 'Center-Line Roadster Coupe',
 'year': 2014}
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE56554%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.de] INFO: Saving data for DE56554: {'auction_closing_time': 1774884656.0, 'created_time': 1773303472.439749, 'last_price_update_time': 1774870045.787068}
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE56554') HTTP/1.1" 204 0
2026-03-30 11:27:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:25 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN04984%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.de] INFO: Scrape type for TN04984: 0
2026-03-30 11:27:25 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-30 11:27:25 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-30 11:27:25 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL37437%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.de] INFO: Scrape type for JL37437: 0
2026-03-30 11:27:25 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH05972%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.de] INFO: Scrape type for FH05972: 0
2026-03-30 11:27:25 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-30 11:27:25 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-30 11:27:25 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-30 11:27:25 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-30 11:27:25 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-30 11:27:25 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG94407%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.de] INFO: Scrape type for LG94407: 0
2026-03-30 11:27:25 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-30 11:27:25 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-30 11:27:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:28 [auto1.de] INFO: Channel: 24h | Page: 198 | totalHits: 9727 | hits on page: 40
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34556%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for JN34556: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB28690%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for UB28690: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR98876%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for WR98876: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB03108%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for LB03108: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61912%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for GL61912: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC78051%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for PC78051: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF57615%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for WF57615: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG12536%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for KG12536: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18345%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for KV18345: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY51393%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for BY51393: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF81800%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for LF81800: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU36809%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for EU36809: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK89545%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for LK89545: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE15652%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for NE15652: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06361%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for WT06361: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY20606%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for TY20606: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31653%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for GA31653: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ37789%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for MZ37789: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ01572%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for NZ01572: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB50178%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for VB50178: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE19972%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for NE19972: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP50790%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for CP50790: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU91677%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for WU91677: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF79248%27 HTTP/1.1" 200 None
2026-03-30 11:27:28 [auto1.de] INFO: Scrape type for YF79248: 0
2026-03-30 11:27:28 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-30 11:27:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:40 [auto1.de] INFO: Channel: 24h | Page: 199 | totalHits: 9727 | hits on page: 40
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14297%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.de] INFO: Scrape type for SG14297: 0
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK53054%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.de] INFO: Scrape type for NK53054: 0
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX81034%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.de] INFO: Scrape type for XX81034: 0
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG05559%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.de] INFO: Scrape type for KG05559: 0
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV33356%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.de] INFO: Scrape type for GV33356: 0
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA12811%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.de] INFO: Scrape type for MA12811: 0
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91338%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.de] INFO: Scrape type for XY91338: 0
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH43917%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.de] INFO: Scrape type for BH43917: 0
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE97467%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.de] INFO: Scrape type for TE97467: 0
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY47772%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.de] INFO: Scrape type for SY47772: 0
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG98772%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.de] INFO: Scrape type for KG98772: 0
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK49169%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.de] INFO: Scrape type for VK49169: 0
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN92666%27 HTTP/1.1" 200 None
2026-03-30 11:27:40 [auto1.de] INFO: Scrape type for EN92666: 0
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-30 11:27:40 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-30 11:27:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:03 [scrapy.extensions.logstats] INFO: Crawled 901 pages (at 6 pages/min), scraped 1172 items (at 2 items/min)
2026-03-30 11:28:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:28:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:50 [auto1.de] INFO: Channel: 24h | Page: 200 | totalHits: 9729 | hits on page: 40
2026-03-30 11:28:50 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-30 11:28:50 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-30 11:28:50 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-30 11:28:50 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-30 11:28:50 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-30 11:28:50 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-30 11:28:50 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-30 11:28:50 [auto1.de] INFO: Found listing with ID: GK27432
2026-03-30 11:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK27432%27 HTTP/1.1" 200 None
2026-03-30 11:28:50 [auto1.de] INFO: Scrape type for GK27432: 0
2026-03-30 11:28:50 [auto1.de] INFO: Found listing with ID: VK36740
2026-03-30 11:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK36740%27 HTTP/1.1" 200 None
2026-03-30 11:28:51 [auto1.de] INFO: Scrape type for VK36740: 0
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL85831%27 HTTP/1.1" 200 None
2026-03-30 11:28:51 [auto1.de] INFO: Scrape type for WL85831: 0
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ39551%27 HTTP/1.1" 200 None
2026-03-30 11:28:51 [auto1.de] INFO: Scrape type for LJ39551: 0
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92076%27 HTTP/1.1" 200 None
2026-03-30 11:28:51 [auto1.de] INFO: Scrape type for TX92076: 0
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV21429%27 HTTP/1.1" 200 None
2026-03-30 11:28:51 [auto1.de] INFO: Scrape type for FV21429: 0
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR82363%27 HTTP/1.1" 200 None
2026-03-30 11:28:51 [auto1.de] INFO: Scrape type for CR82363: 0
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY33039%27 HTTP/1.1" 200 None
2026-03-30 11:28:51 [auto1.de] INFO: Scrape type for CY33039: 0
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA00227%27 HTTP/1.1" 200 None
2026-03-30 11:28:51 [auto1.de] INFO: Scrape type for KA00227: 0
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL68094%27 HTTP/1.1" 200 None
2026-03-30 11:28:51 [auto1.de] INFO: Scrape type for KL68094: 0
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45535%27 HTTP/1.1" 200 None
2026-03-30 11:28:51 [auto1.de] INFO: Scrape type for SZ45535: 0
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM31151%27 HTTP/1.1" 200 None
2026-03-30 11:28:51 [auto1.de] INFO: Scrape type for BM31151: 0
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM88586%27 HTTP/1.1" 200 None
2026-03-30 11:28:51 [auto1.de] INFO: Scrape type for PM88586: 0
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG98787%27 HTTP/1.1" 200 None
2026-03-30 11:28:51 [auto1.de] INFO: Scrape type for GG98787: 0
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE24372%27 HTTP/1.1" 200 None
2026-03-30 11:28:51 [auto1.de] INFO: Scrape type for BE24372: 0
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX18202%27 HTTP/1.1" 200 None
2026-03-30 11:28:51 [auto1.de] INFO: Scrape type for HX18202: 0
2026-03-30 11:28:51 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN65231%27 HTTP/1.1" 200 None
2026-03-30 11:28:51 [auto1.de] INFO: Scrape type for ZN65231: 0
2026-03-30 11:28:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:03 [scrapy.extensions.logstats] INFO: Crawled 902 pages (at 1 pages/min), scraped 1172 items (at 0 items/min)
2026-03-30 11:29:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:29:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:09 [auto1.de] INFO: Channel: 24h | Page: 201 | totalHits: 9731 | hits on page: 40
2026-03-30 11:29:09 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX18202%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for HX18202: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN65231%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for ZN65231: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV47567%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for LV47567: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB58638%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for FB58638: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK36654%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for FK36654: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67137%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for TT67137: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD81555%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for CD81555: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS32666%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for FS32666: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT28462%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for FT28462: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK53846%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for UK53846: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW34309%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for YW34309: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14078%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for UC14078: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: UT49919
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT49919%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for UT49919: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: DE59201
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ86438%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for BJ86438: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX24181%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for WX24181: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP46589%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for NP46589: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM05172%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for BM05172: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ50890%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for PJ50890: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY31624%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for ZY31624: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV38151%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for BV38151: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77542%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for JZ77542: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC48761%27 HTTP/1.1" 200 None
2026-03-30 11:29:10 [auto1.de] INFO: Scrape type for RC48761: 0
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-30 11:29:10 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-30 11:29:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:15 [auto1.de] INFO: Channel: 24h | Page: 202 | totalHits: 9732 | hits on page: 40
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX11356%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for LX11356: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD57431%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for LD57431: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX92939%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for HX92939: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN16508%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for FN16508: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ98399%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for MZ98399: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: AJ27375
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ27375%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for AJ27375: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE25486%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for NE25486: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA53170%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for MA53170: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: MF48816
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF48816%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for MF48816: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB30393%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for TB30393: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW17525%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for EW17525: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC80296%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for VC80296: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ36938%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for CZ36938: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD08059%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for CD08059: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL21750%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for JL21750: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY11260%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for KY11260: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW98263%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for PW98263: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU90892%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for PU90892: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK60330%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for RK60330: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU72855%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for HU72855: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK67833%27 HTTP/1.1" 200 None
2026-03-30 11:29:15 [auto1.de] INFO: Scrape type for NK67833: 0
2026-03-30 11:29:15 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-30 11:29:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:19 [auto1.de] INFO: Channel: 24h | Page: 203 | totalHits: 9734 | hits on page: 40
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK67833%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for NK67833: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN12652%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for WN12652: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27254%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for VF27254: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ82865%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for PZ82865: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT58589%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for LT58589: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH12576%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for NH12576: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA54655%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for XA54655: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY06483%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for HY06483: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ38540%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for DZ38540: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ43118%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for GZ43118: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY30704%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for PY30704: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU32595%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for BU32595: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV94610%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for FV94610: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: KF40481
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: XP52765
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR01056%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for XR01056: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83216%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for GY83216: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY63966%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for XY63966: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH14315%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for GH14315: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX66491%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for MX66491: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67116%27 HTTP/1.1" 200 None
2026-03-30 11:29:19 [auto1.de] INFO: Scrape type for ZY67116: 0
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-30 11:29:19 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-30 11:29:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:24 [auto1.de] INFO: Channel: 24h | Page: 204 | totalHits: 9735 | hits on page: 40
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ16162%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for MJ16162: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50003%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for WY50003: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33465%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for MM33465: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK50656%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for JK50656: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE17013%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for ZE17013: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN69903%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for VN69903: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS25100%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for XS25100: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ00075%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for YJ00075: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59934%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for ZB59934: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN23623%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for LN23623: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE31655%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for NE31655: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ97474%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for XJ97474: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM27166%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for CM27166: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01361%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for DX01361: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW02544%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for EW02544: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: NW02543
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW02543%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for NW02543: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68869%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for JV68869: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX10948%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for RX10948: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN65057%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for XN65057: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL98433%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for ZL98433: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV35353%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for YV35353: 0
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-30 11:29:24 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS93446%27 HTTP/1.1" 200 None
2026-03-30 11:29:24 [auto1.de] INFO: Scrape type for XS93446: 0
2026-03-30 11:29:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:25 [auto1.de] INFO: Channel: 24h | Page: 205 | totalHits: 9735 | hits on page: 40
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC35903%27 HTTP/1.1" 200 None
2026-03-30 11:29:25 [auto1.de] INFO: Scrape type for PC35903: 0
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY06770%27 HTTP/1.1" 200 None
2026-03-30 11:29:25 [auto1.de] INFO: Scrape type for KY06770: 0
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR25014%27 HTTP/1.1" 200 None
2026-03-30 11:29:25 [auto1.de] INFO: Scrape type for VR25014: 0
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ83009%27 HTTP/1.1" 200 None
2026-03-30 11:29:25 [auto1.de] INFO: Scrape type for AJ83009: 0
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH20850%27 HTTP/1.1" 200 None
2026-03-30 11:29:25 [auto1.de] INFO: Scrape type for GH20850: 0
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ38471%27 HTTP/1.1" 200 None
2026-03-30 11:29:25 [auto1.de] INFO: Scrape type for JZ38471: 0
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17394%27 HTTP/1.1" 200 None
2026-03-30 11:29:25 [auto1.de] INFO: Scrape type for JR17394: 0
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: EX67189
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS14457%27 HTTP/1.1" 200 None
2026-03-30 11:29:25 [auto1.de] INFO: Scrape type for XS14457: 0
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG28999%27 HTTP/1.1" 200 None
2026-03-30 11:29:25 [auto1.de] INFO: Scrape type for ZG28999: 0
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46177%27 HTTP/1.1" 200 None
2026-03-30 11:29:25 [auto1.de] INFO: Scrape type for WA46177: 0
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND29954%27 HTTP/1.1" 200 None
2026-03-30 11:29:25 [auto1.de] INFO: Scrape type for ND29954: 0
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW15546%27 HTTP/1.1" 200 None
2026-03-30 11:29:25 [auto1.de] INFO: Scrape type for GW15546: 0
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: US86443
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX36135%27 HTTP/1.1" 200 None
2026-03-30 11:29:25 [auto1.de] INFO: Scrape type for BX36135: 0
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF63690%27 HTTP/1.1" 200 None
2026-03-30 11:29:25 [auto1.de] INFO: Scrape type for MF63690: 0
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-30 11:29:25 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-30 11:29:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP55195%27 HTTP/1.1" 200 None
2026-03-30 11:29:26 [auto1.de] INFO: Scrape type for DP55195: 0
2026-03-30 11:29:26 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-30 11:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS08913%27 HTTP/1.1" 200 None
2026-03-30 11:29:26 [auto1.de] INFO: Scrape type for DS08913: 0
2026-03-30 11:29:26 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-30 11:29:26 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-30 11:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS42918%27 HTTP/1.1" 200 None
2026-03-30 11:29:26 [auto1.de] INFO: Scrape type for VS42918: 0
2026-03-30 11:29:26 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-30 11:29:26 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-30 11:29:26 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-30 11:29:26 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-30 11:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM97642%27 HTTP/1.1" 200 None
2026-03-30 11:29:26 [auto1.de] INFO: Scrape type for FM97642: 0
2026-03-30 11:29:26 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-30 11:29:26 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-30 11:29:26 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-30 11:29:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:28 [auto1.de] INFO: Channel: 24h | Page: 206 | totalHits: 9736 | hits on page: 40
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP95286%27 HTTP/1.1" 200 None
2026-03-30 11:29:28 [auto1.de] INFO: Scrape type for ZP95286: 0
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41479%27 HTTP/1.1" 200 None
2026-03-30 11:29:28 [auto1.de] INFO: Scrape type for MF41479: 0
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC37462%27 HTTP/1.1" 200 None
2026-03-30 11:29:28 [auto1.de] INFO: Scrape type for KC37462: 0
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD31530%27 HTTP/1.1" 200 None
2026-03-30 11:29:28 [auto1.de] INFO: Scrape type for XD31530: 0
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ90236%27 HTTP/1.1" 200 None
2026-03-30 11:29:28 [auto1.de] INFO: Scrape type for VJ90236: 0
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP43066%27 HTTP/1.1" 200 None
2026-03-30 11:29:28 [auto1.de] INFO: Scrape type for PP43066: 0
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT93934%27 HTTP/1.1" 200 None
2026-03-30 11:29:28 [auto1.de] INFO: Scrape type for UT93934: 0
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU48092%27 HTTP/1.1" 200 None
2026-03-30 11:29:28 [auto1.de] INFO: Scrape type for GU48092: 0
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ31172%27 HTTP/1.1" 200 None
2026-03-30 11:29:28 [auto1.de] INFO: Scrape type for GZ31172: 0
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS86460%27 HTTP/1.1" 200 None
2026-03-30 11:29:28 [auto1.de] INFO: Scrape type for MS86460: 0
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-30 11:29:28 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-30 11:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN70453%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.de] INFO: Scrape type for GN70453: 0
2026-03-30 11:29:29 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-30 11:29:29 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD53590%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.de] INFO: Scrape type for KD53590: 0
2026-03-30 11:29:29 [auto1.de] INFO: Found listing with ID: XD68871
2026-03-30 11:29:29 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-30 11:29:29 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09551%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.de] INFO: Scrape type for WE09551: 0
2026-03-30 11:29:29 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP84657%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.de] INFO: Scrape type for WP84657: 0
2026-03-30 11:29:29 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-30 11:29:29 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ82929%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.de] INFO: Scrape type for UZ82929: 0
2026-03-30 11:29:29 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-30 11:29:29 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH71903%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.de] INFO: Scrape type for VH71903: 0
2026-03-30 11:29:29 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-30 11:29:29 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97195%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.de] INFO: Scrape type for AU97195: 0
2026-03-30 11:29:29 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG36185%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.de] INFO: Scrape type for LG36185: 0
2026-03-30 11:29:29 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL81874%27 HTTP/1.1" 200 None
2026-03-30 11:29:29 [auto1.de] INFO: Scrape type for LL81874: 0
2026-03-30 11:29:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:31 [auto1.de] INFO: Channel: 24h | Page: 207 | totalHits: 9737 | hits on page: 40
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL81874%27 HTTP/1.1" 200 None
2026-03-30 11:29:31 [auto1.de] INFO: Scrape type for LL81874: 0
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98670%27 HTTP/1.1" 200 None
2026-03-30 11:29:31 [auto1.de] INFO: Scrape type for EU98670: 0
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH64157%27 HTTP/1.1" 200 None
2026-03-30 11:29:31 [auto1.de] INFO: Scrape type for VH64157: 0
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH41953%27 HTTP/1.1" 200 None
2026-03-30 11:29:31 [auto1.de] INFO: Scrape type for ZH41953: 0
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS82653%27 HTTP/1.1" 200 None
2026-03-30 11:29:31 [auto1.de] INFO: Scrape type for GS82653: 0
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN87643%27 HTTP/1.1" 200 None
2026-03-30 11:29:31 [auto1.de] INFO: Scrape type for EN87643: 0
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY27021%27 HTTP/1.1" 200 None
2026-03-30 11:29:31 [auto1.de] INFO: Scrape type for DY27021: 0
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM56533%27 HTTP/1.1" 200 None
2026-03-30 11:29:31 [auto1.de] INFO: Scrape type for HM56533: 0
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL85069%27 HTTP/1.1" 200 None
2026-03-30 11:29:31 [auto1.de] INFO: Scrape type for LL85069: 0
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG81564%27 HTTP/1.1" 200 None
2026-03-30 11:29:31 [auto1.de] INFO: Scrape type for EG81564: 0
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV94916%27 HTTP/1.1" 200 None
2026-03-30 11:29:31 [auto1.de] INFO: Scrape type for RV94916: 0
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-30 11:29:31 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ63393%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.de] INFO: Scrape type for JZ63393: 0
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS60844%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.de] INFO: Scrape type for BS60844: 0
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX23158%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.de] INFO: Scrape type for XX23158: 0
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW98108%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.de] INFO: Scrape type for GW98108: 0
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ99289%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.de] INFO: Scrape type for XJ99289: 0
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP61348%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.de] INFO: Scrape type for VP61348: 0
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY66130%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.de] INFO: Scrape type for CY66130: 0
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH87635%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.de] INFO: Scrape type for KH87635: 0
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM53714%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.de] INFO: Scrape type for VM53714: 0
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ21452%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.de] INFO: Scrape type for NZ21452: 0
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: FN51585
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN51585%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.de] INFO: Scrape type for FN51585: 0
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE67956%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.de] INFO: Scrape type for AE67956: 0
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB15916%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.de] INFO: Scrape type for PB15916: 0
2026-03-30 11:29:32 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA39997%27 HTTP/1.1" 200 None
2026-03-30 11:29:32 [auto1.de] INFO: Scrape type for NA39997: 0
2026-03-30 11:29:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:39 [auto1.de] INFO: Channel: 24h | Page: 208 | totalHits: 9739 | hits on page: 40
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB15916%27 HTTP/1.1" 200 None
2026-03-30 11:29:39 [auto1.de] INFO: Scrape type for PB15916: 0
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA39997%27 HTTP/1.1" 200 None
2026-03-30 11:29:39 [auto1.de] INFO: Scrape type for NA39997: 0
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA58180%27 HTTP/1.1" 200 None
2026-03-30 11:29:39 [auto1.de] INFO: Scrape type for DA58180: 0
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR34905%27 HTTP/1.1" 200 None
2026-03-30 11:29:39 [auto1.de] INFO: Scrape type for SR34905: 0
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR30933%27 HTTP/1.1" 200 None
2026-03-30 11:29:39 [auto1.de] INFO: Scrape type for XR30933: 0
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF73856%27 HTTP/1.1" 200 None
2026-03-30 11:29:39 [auto1.de] INFO: Scrape type for ZF73856: 0
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56565%27 HTTP/1.1" 200 None
2026-03-30 11:29:39 [auto1.de] INFO: Scrape type for MK56565: 0
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ79041%27 HTTP/1.1" 200 None
2026-03-30 11:29:39 [auto1.de] INFO: Scrape type for BZ79041: 0
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW13301%27 HTTP/1.1" 200 None
2026-03-30 11:29:39 [auto1.de] INFO: Scrape type for SW13301: 0
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72354%27 HTTP/1.1" 200 None
2026-03-30 11:29:39 [auto1.de] INFO: Scrape type for ME72354: 0
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV52621%27 HTTP/1.1" 200 None
2026-03-30 11:29:39 [auto1.de] INFO: Scrape type for KV52621: 0
2026-03-30 11:29:39 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-30 11:29:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51805%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for ER51805: 0
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX26482%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for BX26482: 0
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN01227%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for FN01227: 0
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC49554%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for RC49554: 0
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK04993%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for MK04993: 0
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA95780%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for RA95780: 0
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS31762%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for SS31762: 0
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01853%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for VR01853: 0
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ09626%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for FJ09626: 0
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL59525%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for UL59525: 0
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW50467%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for CW50467: 0
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58036%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for LJ58036: 2
2026-03-30 11:29:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96122428-d793-559c-8524-837455f005f7 with identifier: LJ58036
2026-03-30 11:29:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96122428-d793-559c-8524-837455f005f7 with scrape type 2
2026-03-30 11:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96122428-d793-559c-8524-837455f005f7 with scrape type 2
2026-03-30 11:29:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96122428-d793-559c-8524-837455f005f7, identifier: LJ58036
2026-03-30 11:29:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96122428-d793-559c-8524-837455f005f7 with identifier: LJ58036
2026-03-30 11:29:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96122428-d793-559c-8524-837455f005f7 with identifier: LJ58036
2026-03-30 11:29:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96122428-d793-559c-8524-837455f005f7 with identifier: LJ58036 to the API
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:29:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:17:10Z',
 'fuel_type': 'petrol',
 'id': '96122428-d793-559c-8524-837455f005f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ58036',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 146505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-09',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58036%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Saving data for LJ58036: {'auction_closing_time': 1774883830.0, 'created_time': 1774510535.21847, 'last_price_update_time': 1774870180.684459}
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ58036') HTTP/1.1" 204 0
2026-03-30 11:29:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06694%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for HH06694: 0
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH08686%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for GH08686: 0
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV68047%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for EV68047: 0
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR02584%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for GR02584: 0
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT67219%27 HTTP/1.1" 200 None
2026-03-30 11:29:40 [auto1.de] INFO: Scrape type for MT67219: 0
2026-03-30 11:29:40 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-30 11:29:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:57 [auto1.de] INFO: Channel: 24h | Page: 209 | totalHits: 9740 | hits on page: 40
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED94101%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for ED94101: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93561%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for NL93561: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV90195%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for VV90195: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR95379%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for FR95379: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK09580%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for HK09580: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72135%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for KP72135: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08680%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for SG08680: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP92221%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for XP92221: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG24809%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for HG24809: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH21613%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for BH21613: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05978%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for AB05978: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN37925%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for GN37925: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89473%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for ZL89473: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL82276%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for LL82276: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX27927%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for BX27927: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX19940%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for BX19940: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS31989%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for WS31989: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG38319%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for SG38319: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD58686%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for MD58686: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ84842%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for DZ84842: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR15690%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for LR15690: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB81454%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for SB81454: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR79819%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for AR79819: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV65723%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for FV65723: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR96123%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for PR96123: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS57096%27 HTTP/1.1" 200 None
2026-03-30 11:29:57 [auto1.de] INFO: Scrape type for KS57096: 0
2026-03-30 11:29:57 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-30 11:29:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:01 [auto1.de] INFO: Channel: 24h | Page: 210 | totalHits: 9740 | hits on page: 40
2026-03-30 11:30:01 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-30 11:30:01 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-30 11:30:01 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE53934%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for GE53934: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ82429%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for MZ82429: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB05903%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for UB05903: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX10720%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for GX10720: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA14077%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for KA14077: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP03484%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for XP03484: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: CL18387
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL18387%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for CL18387: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN41265%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for PN41265: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP39271%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for EP39271: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD47381%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for WD47381: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT15230%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for PT15230: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE73798%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for KE73798: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH12349%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for RH12349: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX40224%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for SX40224: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK86846%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for SK86846: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB16241%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for XB16241: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN58705%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for VN58705: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY30583%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for JY30583: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC45431%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for DC45431: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS06029%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for FS06029: 0
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-30 11:30:02 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75557%27 HTTP/1.1" 200 None
2026-03-30 11:30:02 [auto1.de] INFO: Scrape type for DA75557: 0
2026-03-30 11:30:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:03 [auto1.de] INFO: Channel: 24h | Page: 211 | totalHits: 9740 | hits on page: 40
2026-03-30 11:30:03 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL45042%27 HTTP/1.1" 200 None
2026-03-30 11:30:03 [auto1.de] INFO: Scrape type for WL45042: 0
2026-03-30 11:30:03 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE62268%27 HTTP/1.1" 200 None
2026-03-30 11:30:03 [auto1.de] INFO: Scrape type for TE62268: 0
2026-03-30 11:30:03 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU37095%27 HTTP/1.1" 200 None
2026-03-30 11:30:03 [auto1.de] INFO: Scrape type for PU37095: 0
2026-03-30 11:30:03 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT18435%27 HTTP/1.1" 200 None
2026-03-30 11:30:03 [auto1.de] INFO: Scrape type for CT18435: 0
2026-03-30 11:30:03 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV26733%27 HTTP/1.1" 200 None
2026-03-30 11:30:03 [auto1.de] INFO: Scrape type for DV26733: 0
2026-03-30 11:30:03 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC25913%27 HTTP/1.1" 200 None
2026-03-30 11:30:03 [auto1.de] INFO: Scrape type for MC25913: 0
2026-03-30 11:30:03 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-30 11:30:03 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB69488%27 HTTP/1.1" 200 None
2026-03-30 11:30:03 [auto1.de] INFO: Scrape type for DB69488: 0
2026-03-30 11:30:03 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-30 11:30:03 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ52581%27 HTTP/1.1" 200 None
2026-03-30 11:30:03 [auto1.de] INFO: Scrape type for WJ52581: 0
2026-03-30 11:30:03 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ53227%27 HTTP/1.1" 200 None
2026-03-30 11:30:03 [auto1.de] INFO: Scrape type for GJ53227: 0
2026-03-30 11:30:03 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-30 11:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS07294%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.de] INFO: Scrape type for XS07294: 0
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH48828%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.de] INFO: Scrape type for MH48828: 0
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR12459%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.de] INFO: Scrape type for HR12459: 0
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU28825%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.de] INFO: Scrape type for MU28825: 0
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00058%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.de] INFO: Scrape type for PH00058: 0
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU48054%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.de] INFO: Scrape type for KU48054: 0
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF51688%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.de] INFO: Scrape type for SF51688: 0
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW78119%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.de] INFO: Scrape type for VW78119: 0
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC14239%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.de] INFO: Scrape type for WC14239: 0
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34410%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.de] INFO: Scrape type for DG34410: 0
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP16968%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.de] INFO: Scrape type for UP16968: 0
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH60803%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.de] INFO: Scrape type for XH60803: 0
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH55403%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.de] INFO: Scrape type for YH55403: 0
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED54075%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.de] INFO: Scrape type for ED54075: 0
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63697%27 HTTP/1.1" 200 None
2026-03-30 11:30:04 [auto1.de] INFO: Scrape type for XB63697: 0
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-30 11:30:04 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-30 11:30:04 [scrapy.extensions.logstats] INFO: Crawled 913 pages (at 11 pages/min), scraped 1173 items (at 1 items/min)
2026-03-30 11:30:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:30:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:10 [auto1.de] INFO: Channel: 24h | Page: 212 | totalHits: 9740 | hits on page: 40
2026-03-30 11:30:10 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-30 11:30:10 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-30 11:30:10 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-30 11:30:10 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-30 11:30:10 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-30 11:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA34634%27 HTTP/1.1" 200 None
2026-03-30 11:30:10 [auto1.de] INFO: Scrape type for AA34634: 0
2026-03-30 11:30:10 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-30 11:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13972%27 HTTP/1.1" 200 None
2026-03-30 11:30:10 [auto1.de] INFO: Scrape type for TR13972: 2
2026-03-30 11:30:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55562edd-05c9-53a6-8b99-5d825810cd48 with identifier: TR13972
2026-03-30 11:30:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55562edd-05c9-53a6-8b99-5d825810cd48 with scrape type 2
2026-03-30 11:30:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55562edd-05c9-53a6-8b99-5d825810cd48 with scrape type 2
2026-03-30 11:30:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55562edd-05c9-53a6-8b99-5d825810cd48, identifier: TR13972
2026-03-30 11:30:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55562edd-05c9-53a6-8b99-5d825810cd48 with identifier: TR13972
2026-03-30 11:30:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55562edd-05c9-53a6-8b99-5d825810cd48 with identifier: TR13972
2026-03-30 11:30:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55562edd-05c9-53a6-8b99-5d825810cd48 with identifier: TR13972 to the API
2026-03-30 11:30:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-30T15:14:08Z',
 'fuel_type': 'petrol',
 'id': '55562edd-05c9-53a6-8b99-5d825810cd48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR13972',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'S-TYPE',
 'odometer': 192016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-08-26',
 'seller_name': None,
 'title': 'Jaguar S-TYPE 3.0 V6',
 'transmission': 'automatic',
 'trim': '',
 'year': 1999}
2026-03-30 11:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13972%27 HTTP/1.1" 200 None
2026-03-30 11:30:12 [auto1.de] INFO: Saving data for TR13972: {'auction_closing_time': 1774883648.0, 'created_time': 1774510537.288954, 'last_price_update_time': 1774870212.90301}
2026-03-30 11:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR13972') HTTP/1.1" 204 0
2026-03-30 11:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB72166%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for TB72166: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH76263%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for AH76263: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK82878%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for GK82878: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE63209%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for JE63209: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ08446%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for KZ08446: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17291%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for RE17291: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF69711%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for XF69711: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW17566%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for FW17566: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU80975%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for BU80975: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB37977%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for BB37977: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG14715%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for LG14715: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP00162%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for DP00162: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF92726%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for BF92726: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK34658%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for MK34658: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR27730%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for XR27730: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV93929%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for YV93929: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ02891%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for YZ02891: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY14800%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for KY14800: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL60244%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for XL60244: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV90463%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for LV90463: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE33138%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for TE33138: 0
2026-03-30 11:30:13 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85812%27 HTTP/1.1" 200 None
2026-03-30 11:30:13 [auto1.de] INFO: Scrape type for XB85812: 0
2026-03-30 11:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:15 [auto1.de] INFO: Channel: 24h | Page: 213 | totalHits: 9740 | hits on page: 40
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ45055%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.de] INFO: Scrape type for FZ45055: 0
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX16558%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.de] INFO: Scrape type for SX16558: 0
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL71783%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.de] INFO: Scrape type for JL71783: 0
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ50044%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.de] INFO: Scrape type for AZ50044: 0
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ21973%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.de] INFO: Scrape type for WZ21973: 0
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF91602%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.de] INFO: Scrape type for CF91602: 0
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS24568%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.de] INFO: Scrape type for CS24568: 0
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY92615%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.de] INFO: Scrape type for YY92615: 0
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW97614%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.de] INFO: Scrape type for NW97614: 0
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT11339%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.de] INFO: Scrape type for YT11339: 0
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML67017%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.de] INFO: Scrape type for ML67017: 0
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS86318%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.de] INFO: Scrape type for SS86318: 0
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB28144%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.de] INFO: Scrape type for PB28144: 0
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS92843%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.de] INFO: Scrape type for LS92843: 0
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG95107%27 HTTP/1.1" 200 None
2026-03-30 11:30:15 [auto1.de] INFO: Scrape type for RG95107: 0
2026-03-30 11:30:15 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD21201%27 HTTP/1.1" 200 None
2026-03-30 11:30:16 [auto1.de] INFO: Scrape type for AD21201: 0
2026-03-30 11:30:16 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-30 11:30:16 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV60739%27 HTTP/1.1" 200 None
2026-03-30 11:30:16 [auto1.de] INFO: Scrape type for SV60739: 0
2026-03-30 11:30:16 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH60355%27 HTTP/1.1" 200 None
2026-03-30 11:30:16 [auto1.de] INFO: Scrape type for FH60355: 0
2026-03-30 11:30:16 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD67638%27 HTTP/1.1" 200 None
2026-03-30 11:30:16 [auto1.de] INFO: Scrape type for ZD67638: 0
2026-03-30 11:30:16 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW39556%27 HTTP/1.1" 200 None
2026-03-30 11:30:16 [auto1.de] INFO: Scrape type for KW39556: 0
2026-03-30 11:30:16 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB59521%27 HTTP/1.1" 200 None
2026-03-30 11:30:16 [auto1.de] INFO: Scrape type for UB59521: 0
2026-03-30 11:30:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:37 [auto1.de] INFO: Channel: 24h | Page: 214 | totalHits: 9743 | hits on page: 40
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD67638%27 HTTP/1.1" 200 None
2026-03-30 11:30:37 [auto1.de] INFO: Scrape type for ZD67638: 0
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW39556%27 HTTP/1.1" 200 None
2026-03-30 11:30:37 [auto1.de] INFO: Scrape type for KW39556: 0
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB59521%27 HTTP/1.1" 200 None
2026-03-30 11:30:37 [auto1.de] INFO: Scrape type for UB59521: 0
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ07739%27 HTTP/1.1" 200 None
2026-03-30 11:30:37 [auto1.de] INFO: Scrape type for RZ07739: 0
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT58505%27 HTTP/1.1" 200 None
2026-03-30 11:30:37 [auto1.de] INFO: Scrape type for GT58505: 0
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL23730%27 HTTP/1.1" 200 None
2026-03-30 11:30:37 [auto1.de] INFO: Scrape type for EL23730: 0
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92511%27 HTTP/1.1" 200 None
2026-03-30 11:30:37 [auto1.de] INFO: Scrape type for BD92511: 0
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX33214%27 HTTP/1.1" 200 None
2026-03-30 11:30:37 [auto1.de] INFO: Scrape type for TX33214: 0
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94447%27 HTTP/1.1" 200 None
2026-03-30 11:30:37 [auto1.de] INFO: Scrape type for CJ94447: 0
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW65379%27 HTTP/1.1" 200 None
2026-03-30 11:30:37 [auto1.de] INFO: Scrape type for KW65379: 0
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV35373%27 HTTP/1.1" 200 None
2026-03-30 11:30:37 [auto1.de] INFO: Scrape type for UV35373: 0
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE25450%27 HTTP/1.1" 200 None
2026-03-30 11:30:37 [auto1.de] INFO: Scrape type for EE25450: 2
2026-03-30 11:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce31b62f-8942-54ce-8a06-f809b686ca47 with identifier: EE25450
2026-03-30 11:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce31b62f-8942-54ce-8a06-f809b686ca47 with scrape type 2
2026-03-30 11:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce31b62f-8942-54ce-8a06-f809b686ca47 with scrape type 2
2026-03-30 11:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce31b62f-8942-54ce-8a06-f809b686ca47, identifier: EE25450
2026-03-30 11:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce31b62f-8942-54ce-8a06-f809b686ca47 with identifier: EE25450
2026-03-30 11:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce31b62f-8942-54ce-8a06-f809b686ca47 with identifier: EE25450
2026-03-30 11:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce31b62f-8942-54ce-8a06-f809b686ca47 with identifier: EE25450 to the API
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:34:06Z',
 'fuel_type': 'diesel',
 'id': 'ce31b62f-8942-54ce-8a06-f809b686ca47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE25450',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 207585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Style BlueMotion',
 'transmission': 'manual',
 'trim': 'Style BlueMotion',
 'year': 2012}
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE25450%27 HTTP/1.1" 200 None
2026-03-30 11:30:37 [auto1.de] INFO: Saving data for EE25450: {'auction_closing_time': 1774884846.0, 'created_time': 1774031844.534341, 'last_price_update_time': 1774870237.815864}
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE25450') HTTP/1.1" 204 0
2026-03-30 11:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU38253%27 HTTP/1.1" 200 None
2026-03-30 11:30:37 [auto1.de] INFO: Scrape type for KU38253: 0
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT34897%27 HTTP/1.1" 200 None
2026-03-30 11:30:37 [auto1.de] INFO: Scrape type for TT34897: 0
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC35648%27 HTTP/1.1" 200 None
2026-03-30 11:30:37 [auto1.de] INFO: Scrape type for UC35648: 0
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-30 11:30:37 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW03247%27 HTTP/1.1" 200 None
2026-03-30 11:30:38 [auto1.de] INFO: Scrape type for GW03247: 0
2026-03-30 11:30:38 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-30 11:30:38 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-30 11:30:38 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-30 11:30:38 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-30 11:30:38 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN24608%27 HTTP/1.1" 200 None
2026-03-30 11:30:38 [auto1.de] INFO: Scrape type for TN24608: 0
2026-03-30 11:30:38 [auto1.de] INFO: Found listing with ID: HD35365
2026-03-30 11:30:38 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-30 11:30:38 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB14981%27 HTTP/1.1" 200 None
2026-03-30 11:30:38 [auto1.de] INFO: Scrape type for TB14981: 0
2026-03-30 11:30:38 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-30 11:30:38 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER30285%27 HTTP/1.1" 200 None
2026-03-30 11:30:38 [auto1.de] INFO: Scrape type for ER30285: 0
2026-03-30 11:30:38 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-30 11:30:38 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-30 11:30:38 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-30 11:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:40 [auto1.de] INFO: Channel: 24h | Page: 215 | totalHits: 9743 | hits on page: 40
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ96775%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.de] INFO: Scrape type for MJ96775: 0
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS41473%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.de] INFO: Scrape type for KS41473: 0
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU47228%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.de] INFO: Scrape type for NU47228: 0
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB77280%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.de] INFO: Scrape type for LB77280: 0
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA40469%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.de] INFO: Scrape type for EA40469: 0
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET23804%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.de] INFO: Scrape type for ET23804: 0
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX83651%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.de] INFO: Scrape type for NX83651: 0
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ16195%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.de] INFO: Scrape type for FZ16195: 0
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: SS79198
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS79198%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.de] INFO: Scrape type for SS79198: 0
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK96887%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.de] INFO: Scrape type for WK96887: 0
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP30819%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.de] INFO: Scrape type for NP30819: 0
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK39591%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.de] INFO: Scrape type for KK39591: 2
2026-03-30 11:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f463eca-7c88-5191-8bae-76d29a9d5b8d with identifier: KK39591
2026-03-30 11:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f463eca-7c88-5191-8bae-76d29a9d5b8d with scrape type 2
2026-03-30 11:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f463eca-7c88-5191-8bae-76d29a9d5b8d with scrape type 2
2026-03-30 11:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f463eca-7c88-5191-8bae-76d29a9d5b8d, identifier: KK39591
2026-03-30 11:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f463eca-7c88-5191-8bae-76d29a9d5b8d with identifier: KK39591
2026-03-30 11:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f463eca-7c88-5191-8bae-76d29a9d5b8d with identifier: KK39591
2026-03-30 11:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f463eca-7c88-5191-8bae-76d29a9d5b8d with identifier: KK39591 to the API
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:28:05Z',
 'fuel_type': 'petrol',
 'id': '6f463eca-7c88-5191-8bae-76d29a9d5b8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK39591',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 57524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-21',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2013}
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK39591%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.de] INFO: Saving data for KK39591: {'auction_closing_time': 1774884485.0, 'created_time': 1774596933.424869, 'last_price_update_time': 1774870240.859731}
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK39591') HTTP/1.1" 204 0
2026-03-30 11:30:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:40 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH61376%27 HTTP/1.1" 200 None
2026-03-30 11:30:41 [auto1.de] INFO: Scrape type for JH61376: 0
2026-03-30 11:30:41 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-30 11:30:41 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD45668%27 HTTP/1.1" 200 None
2026-03-30 11:30:41 [auto1.de] INFO: Scrape type for SD45668: 0
2026-03-30 11:30:41 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT28734%27 HTTP/1.1" 200 None
2026-03-30 11:30:41 [auto1.de] INFO: Scrape type for UT28734: 0
2026-03-30 11:30:41 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-30 11:30:41 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-30 11:30:41 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP92588%27 HTTP/1.1" 200 None
2026-03-30 11:30:41 [auto1.de] INFO: Scrape type for FP92588: 0
2026-03-30 11:30:41 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-30 11:30:41 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-30 11:30:41 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV47877%27 HTTP/1.1" 200 None
2026-03-30 11:30:41 [auto1.de] INFO: Scrape type for XV47877: 0
2026-03-30 11:30:41 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH38301%27 HTTP/1.1" 200 None
2026-03-30 11:30:41 [auto1.de] INFO: Scrape type for KH38301: 0
2026-03-30 11:30:41 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-30 11:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:42 [auto1.de] INFO: Channel: 24h | Page: 216 | totalHits: 9744 | hits on page: 40
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT05209%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for ZT05209: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF17671%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for XF17671: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD21444%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for BD21444: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB45839%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for NB45839: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE08810%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for VE08810: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW71594%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for XW71594: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH58707%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for WH58707: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP78752%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for DP78752: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ33404%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for PZ33404: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT41344%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for VT41344: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH98757%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for FH98757: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK98498%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for MK98498: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV09356%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for CV09356: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC92366%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for AC92366: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: NH48980
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: PW96816
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW96816%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for PW96816: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: UZ14919
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: JU61936
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU61936%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for JU61936: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: KC56991
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: FY38947
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY38947%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for FY38947: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: MU41228
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU41228%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for MU41228: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: NG13141
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG13141%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for NG13141: 0
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: SP37211
2026-03-30 11:30:42 [auto1.de] INFO: Found listing with ID: BP15722
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP15722%27 HTTP/1.1" 200 None
2026-03-30 11:30:42 [auto1.de] INFO: Scrape type for BP15722: 0
2026-03-30 11:30:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:46 [auto1.de] INFO: Channel: 24h | Page: 217 | totalHits: 9744 | hits on page: 40
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: ZJ20785
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: PG70940
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG70940%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for PG70940: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: HJ15324
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: YJ96267
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ96267%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for YJ96267: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: BH45975
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH45975%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for BH45975: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: JS30878
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS30878%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for JS30878: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: NL79635
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: LF10236
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF10236%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for LF10236: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: DP76469
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: ST53597
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST53597%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for ST53597: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: AD05986
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD05986%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for AD05986: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: LU20114
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: WT09019
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT09019%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for WT09019: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: MA38279
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: PZ30496
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: CH12661
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: HC35889
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: AX97123
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX97123%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for AX97123: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: ZM69821
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: ZW92608
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW92608%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for ZW92608: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: KF80964
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: CE00984
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE00984%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for CE00984: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: KR40526
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: NS83554
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: UV09635
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: CS70589
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS70589%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for CS70589: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: MK47455
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK47455%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for MK47455: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: ND12794
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND12794%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for ND12794: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: TW63260
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW63260%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for TW63260: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: SE34706
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE34706%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for SE34706: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: LR83897
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: EX09851
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: RT47788
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: NM77711
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM77711%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for NM77711: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: NF65308
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: SM15553
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM15553%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for SM15553: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: RB21288
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: TL00985
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: WM78340
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM78340%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for WM78340: 0
2026-03-30 11:30:46 [auto1.de] INFO: Found listing with ID: NF79967
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF79967%27 HTTP/1.1" 200 None
2026-03-30 11:30:46 [auto1.de] INFO: Scrape type for NF79967: 0
2026-03-30 11:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:55 [auto1.de] INFO: Channel: 24h | Page: 218 | totalHits: 9745 | hits on page: 40
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: NF79967
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF79967%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for NF79967: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: BP86172
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP86172%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for BP86172: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: SM64754
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: PL66942
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: LR99893
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR99893%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for LR99893: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: VG16481
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG16481%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for VG16481: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: RU39212
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: PH19268
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH19268%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for PH19268: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: ZS99681
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: PU80535
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU80535%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for PU80535: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: AF19813
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF19813%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for AF19813: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: AN91174
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN91174%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for AN91174: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: DK08847
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK08847%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for DK08847: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: JB87569
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB87569%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for JB87569: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: EE75447
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: RP15985
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: TA77613
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA77613%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for TA77613: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: SP96955
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: DW77268
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77268%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for DW77268: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: DJ18232
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ18232%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for DJ18232: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: RL54518
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL54518%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for RL54518: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: GS31332
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: GS03100
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS03100%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for GS03100: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: FC21553
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC21553%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for FC21553: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: CT45397
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT45397%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for CT45397: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: TH39634
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: MY94359
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: FZ92426
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ92426%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for FZ92426: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: RE77380
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE77380%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for RE77380: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: ZS85048
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: ZY92659
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: DK37949
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: ZY32657
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY32657%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for ZY32657: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: RF12873
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: WK31693
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK31693%27 HTTP/1.1" 200 None
2026-03-30 11:30:55 [auto1.de] INFO: Scrape type for WK31693: 0
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: XR35811
2026-03-30 11:30:55 [auto1.de] INFO: Found listing with ID: WL69602
2026-03-30 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL69602%27 HTTP/1.1" 200 None
2026-03-30 11:30:56 [auto1.de] INFO: Scrape type for WL69602: 0
2026-03-30 11:30:56 [auto1.de] INFO: Found listing with ID: NC71734
2026-03-30 11:30:56 [auto1.de] INFO: Found listing with ID: XU03488
2026-03-30 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU03488%27 HTTP/1.1" 200 None
2026-03-30 11:30:56 [auto1.de] INFO: Scrape type for XU03488: 0
2026-03-30 11:30:56 [auto1.de] INFO: Found listing with ID: JN07474
2026-03-30 11:30:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:03 [scrapy.extensions.logstats] INFO: Crawled 920 pages (at 7 pages/min), scraped 1176 items (at 3 items/min)
2026-03-30 11:31:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:07 [auto1.de] INFO: Channel: 24h | Page: 219 | totalHits: 9747 | hits on page: 40
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: XU03488
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU03488%27 HTTP/1.1" 200 None
2026-03-30 11:31:07 [auto1.de] INFO: Scrape type for XU03488: 0
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: JN07474
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: CT96582
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT96582%27 HTTP/1.1" 200 None
2026-03-30 11:31:07 [auto1.de] INFO: Scrape type for CT96582: 0
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: XZ21442
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: EK71515
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK71515%27 HTTP/1.1" 200 None
2026-03-30 11:31:07 [auto1.de] INFO: Scrape type for EK71515: 0
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: YE73742
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: CA87699
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: XU33519
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: HK31829
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK31829%27 HTTP/1.1" 200 None
2026-03-30 11:31:07 [auto1.de] INFO: Scrape type for HK31829: 0
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: NK26673
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: XD40949
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD40949%27 HTTP/1.1" 200 None
2026-03-30 11:31:07 [auto1.de] INFO: Scrape type for XD40949: 0
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: NM76791
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: HA62575
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA62575%27 HTTP/1.1" 200 None
2026-03-30 11:31:07 [auto1.de] INFO: Scrape type for HA62575: 0
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: UN89180
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: YH18669
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: EL96080
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL96080%27 HTTP/1.1" 200 None
2026-03-30 11:31:07 [auto1.de] INFO: Scrape type for EL96080: 0
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: KD63113
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: FL46038
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: NX82618
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: ZD28041
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: LK56613
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: DS29172
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS29172%27 HTTP/1.1" 200 None
2026-03-30 11:31:07 [auto1.de] INFO: Scrape type for DS29172: 0
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: WE31393
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE31393%27 HTTP/1.1" 200 None
2026-03-30 11:31:07 [auto1.de] INFO: Scrape type for WE31393: 0
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: CC29120
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC29120%27 HTTP/1.1" 200 None
2026-03-30 11:31:07 [auto1.de] INFO: Scrape type for CC29120: 0
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: FT90380
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT90380%27 HTTP/1.1" 200 None
2026-03-30 11:31:07 [auto1.de] INFO: Scrape type for FT90380: 0
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: SA04539
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA04539%27 HTTP/1.1" 200 None
2026-03-30 11:31:07 [auto1.de] INFO: Scrape type for SA04539: 0
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: KV17598
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: TV41751
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV41751%27 HTTP/1.1" 200 None
2026-03-30 11:31:07 [auto1.de] INFO: Scrape type for TV41751: 0
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: HX78633
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: TE40935
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE40935%27 HTTP/1.1" 200 None
2026-03-30 11:31:07 [auto1.de] INFO: Scrape type for TE40935: 0
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: GY13468
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY13468%27 HTTP/1.1" 200 None
2026-03-30 11:31:07 [auto1.de] INFO: Scrape type for GY13468: 0
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: GY83312
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: BG42804
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: GM83626
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM83626%27 HTTP/1.1" 200 None
2026-03-30 11:31:07 [auto1.de] INFO: Scrape type for GM83626: 0
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: HG43188
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: CW85183
2026-03-30 11:31:07 [auto1.de] INFO: Found listing with ID: NP47731
2026-03-30 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP47731%27 HTTP/1.1" 200 None
2026-03-30 11:31:08 [auto1.de] INFO: Scrape type for NP47731: 0
2026-03-30 11:31:08 [auto1.de] INFO: Found listing with ID: KV68719
2026-03-30 11:31:08 [auto1.de] INFO: Found listing with ID: GJ18953
2026-03-30 11:31:08 [auto1.de] INFO: Found listing with ID: GR83992
2026-03-30 11:31:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:25 [auto1.de] INFO: Channel: 24h | Page: 220 | totalHits: 9747 | hits on page: 40
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: JJ86463
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ86463%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for JJ86463: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: BV89454
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: MX21840
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: DR45963
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: UB44378
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB44378%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for UB44378: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: CE18724
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE18724%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for CE18724: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: WN98696
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN98696%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for WN98696: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: RW68722
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: AJ11888
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ11888%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for AJ11888: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: YD40390
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD40390%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for YD40390: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: JX30830
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: EC85375
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: NN03303
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN03303%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for NN03303: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: VX97978
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: LB43778
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB43778%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for LB43778: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: ED69500
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: HC86157
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC86157%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for HC86157: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: AN99140
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: FD40697
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: UK28270
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: TM32674
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM32674%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for TM32674: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: UG29438
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: NY30954
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: AJ75381
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ75381%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for AJ75381: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: NZ79152
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: HH84481
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: KA54911
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: TV53465
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: UP69379
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: TP61394
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: SG76993
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG76993%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for SG76993: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: EY95933
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95933%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for EY95933: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: KR30537
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR30537%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for KR30537: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: BU21003
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: JY00372
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY00372%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for JY00372: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: CG91765
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: NG66001
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: BP09693
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP09693%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for BP09693: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: BT01554
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT01554%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for BT01554: 0
2026-03-30 11:31:25 [auto1.de] INFO: Found listing with ID: MG61327
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG61327%27 HTTP/1.1" 200 None
2026-03-30 11:31:25 [auto1.de] INFO: Scrape type for MG61327: 0
2026-03-30 11:31:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:33 [auto1.de] INFO: Channel: 24h | Page: 221 | totalHits: 9749 | hits on page: 40
2026-03-30 11:31:33 [auto1.de] INFO: Found listing with ID: BT01554
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT01554%27 HTTP/1.1" 200 None
2026-03-30 11:31:33 [auto1.de] INFO: Scrape type for BT01554: 0
2026-03-30 11:31:33 [auto1.de] INFO: Found listing with ID: MG61327
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG61327%27 HTTP/1.1" 200 None
2026-03-30 11:31:33 [auto1.de] INFO: Scrape type for MG61327: 0
2026-03-30 11:31:33 [auto1.de] INFO: Found listing with ID: BM00053
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM00053%27 HTTP/1.1" 200 None
2026-03-30 11:31:33 [auto1.de] INFO: Scrape type for BM00053: 0
2026-03-30 11:31:33 [auto1.de] INFO: Found listing with ID: MK22023
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK22023%27 HTTP/1.1" 200 None
2026-03-30 11:31:33 [auto1.de] INFO: Scrape type for MK22023: 0
2026-03-30 11:31:33 [auto1.de] INFO: Found listing with ID: EA38947
2026-03-30 11:31:33 [auto1.de] INFO: Found listing with ID: BG08845
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG08845%27 HTTP/1.1" 200 None
2026-03-30 11:31:33 [auto1.de] INFO: Scrape type for BG08845: 0
2026-03-30 11:31:33 [auto1.de] INFO: Found listing with ID: TR37501
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR37501%27 HTTP/1.1" 200 None
2026-03-30 11:31:33 [auto1.de] INFO: Scrape type for TR37501: 0
2026-03-30 11:31:33 [auto1.de] INFO: Found listing with ID: UL05357
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL05357%27 HTTP/1.1" 200 None
2026-03-30 11:31:33 [auto1.de] INFO: Scrape type for UL05357: 0
2026-03-30 11:31:33 [auto1.de] INFO: Found listing with ID: HZ69536
2026-03-30 11:31:33 [auto1.de] INFO: Found listing with ID: TK93923
2026-03-30 11:31:33 [auto1.de] INFO: Found listing with ID: LW29658
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW29658%27 HTTP/1.1" 200 None
2026-03-30 11:31:33 [auto1.de] INFO: Scrape type for LW29658: 0
2026-03-30 11:31:33 [auto1.de] INFO: Found listing with ID: DV23135
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV23135%27 HTTP/1.1" 200 None
2026-03-30 11:31:33 [auto1.de] INFO: Scrape type for DV23135: 0
2026-03-30 11:31:33 [auto1.de] INFO: Found listing with ID: VR46217
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR46217%27 HTTP/1.1" 200 None
2026-03-30 11:31:33 [auto1.de] INFO: Scrape type for VR46217: 0
2026-03-30 11:31:33 [auto1.de] INFO: Found listing with ID: XH28612
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH28612%27 HTTP/1.1" 200 None
2026-03-30 11:31:33 [auto1.de] INFO: Scrape type for XH28612: 0
2026-03-30 11:31:33 [auto1.de] INFO: Found listing with ID: KJ41571
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ41571%27 HTTP/1.1" 200 None
2026-03-30 11:31:33 [auto1.de] INFO: Scrape type for KJ41571: 0
2026-03-30 11:31:33 [auto1.de] INFO: Found listing with ID: UD70348
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD70348%27 HTTP/1.1" 200 None
2026-03-30 11:31:34 [auto1.de] INFO: Scrape type for UD70348: 0
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: CS73315
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: SE41978
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: NS35557
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: JJ64066
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ64066%27 HTTP/1.1" 200 None
2026-03-30 11:31:34 [auto1.de] INFO: Scrape type for JJ64066: 0
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: MD22344
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD22344%27 HTTP/1.1" 200 None
2026-03-30 11:31:34 [auto1.de] INFO: Scrape type for MD22344: 0
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: LW95470
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: GN95458
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN95458%27 HTTP/1.1" 200 None
2026-03-30 11:31:34 [auto1.de] INFO: Scrape type for GN95458: 0
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: ZG18767
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG18767%27 HTTP/1.1" 200 None
2026-03-30 11:31:34 [auto1.de] INFO: Scrape type for ZG18767: 0
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: GY54695
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: TM38106
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM38106%27 HTTP/1.1" 200 None
2026-03-30 11:31:34 [auto1.de] INFO: Scrape type for TM38106: 0
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: TK68896
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK68896%27 HTTP/1.1" 200 None
2026-03-30 11:31:34 [auto1.de] INFO: Scrape type for TK68896: 0
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: TV85934
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: YN89436
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN89436%27 HTTP/1.1" 200 None
2026-03-30 11:31:34 [auto1.de] INFO: Scrape type for YN89436: 0
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: YN15081
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: PR24120
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: WB47522
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: PM63573
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM63573%27 HTTP/1.1" 200 None
2026-03-30 11:31:34 [auto1.de] INFO: Scrape type for PM63573: 0
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: JL46304
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: LL96634
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: HV52023
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: YT21216
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: YW86530
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW86530%27 HTTP/1.1" 200 None
2026-03-30 11:31:34 [auto1.de] INFO: Scrape type for YW86530: 0
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: EH91304
2026-03-30 11:31:34 [auto1.de] INFO: Found listing with ID: WE57631
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE57631%27 HTTP/1.1" 200 None
2026-03-30 11:31:34 [auto1.de] INFO: Scrape type for WE57631: 0
2026-03-30 11:31:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:37 [auto1.de] INFO: Channel: 24h | Page: 222 | totalHits: 9749 | hits on page: 40
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: RR27166
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: SJ72548
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: XR20146
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR20146%27 HTTP/1.1" 200 None
2026-03-30 11:31:37 [auto1.de] INFO: Scrape type for XR20146: 0
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: RL75454
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL75454%27 HTTP/1.1" 200 None
2026-03-30 11:31:37 [auto1.de] INFO: Scrape type for RL75454: 0
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: SY42721
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: RM21545
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: UC78524
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: WG52031
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: RY75144
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: BX11542
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: FL40114
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL40114%27 HTTP/1.1" 200 None
2026-03-30 11:31:37 [auto1.de] INFO: Scrape type for FL40114: 0
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: DN27813
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: HZ35402
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: WA51516
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: VY12832
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY12832%27 HTTP/1.1" 200 None
2026-03-30 11:31:37 [auto1.de] INFO: Scrape type for VY12832: 0
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: GA49917
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: CC10989
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: FW05091
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW05091%27 HTTP/1.1" 200 None
2026-03-30 11:31:37 [auto1.de] INFO: Scrape type for FW05091: 0
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: AZ02782
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ02782%27 HTTP/1.1" 200 None
2026-03-30 11:31:37 [auto1.de] INFO: Scrape type for AZ02782: 0
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: MP53713
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: YA63127
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: YD24318
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD24318%27 HTTP/1.1" 200 None
2026-03-30 11:31:37 [auto1.de] INFO: Scrape type for YD24318: 0
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: FZ76900
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ76900%27 HTTP/1.1" 200 None
2026-03-30 11:31:37 [auto1.de] INFO: Scrape type for FZ76900: 0
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: WK48382
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: PS79135
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS79135%27 HTTP/1.1" 200 None
2026-03-30 11:31:37 [auto1.de] INFO: Scrape type for PS79135: 0
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: AN23805
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: VL97674
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: UT78656
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: JE05181
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE05181%27 HTTP/1.1" 200 None
2026-03-30 11:31:37 [auto1.de] INFO: Scrape type for JE05181: 0
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: LZ68363
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ68363%27 HTTP/1.1" 200 None
2026-03-30 11:31:37 [auto1.de] INFO: Scrape type for LZ68363: 0
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: RT81127
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: XL66615
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL66615%27 HTTP/1.1" 200 None
2026-03-30 11:31:37 [auto1.de] INFO: Scrape type for XL66615: 0
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: KK21790
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: TV45930
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: DZ20117
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: BR60141
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: UA53111
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA53111%27 HTTP/1.1" 200 None
2026-03-30 11:31:37 [auto1.de] INFO: Scrape type for UA53111: 0
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: YA36470
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: VR29597
2026-03-30 11:31:37 [auto1.de] INFO: Found listing with ID: LT01381
2026-03-30 11:31:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:46 [auto1.de] INFO: Channel: 24h | Page: 223 | totalHits: 9750 | hits on page: 40
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: LT01381
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: ZX19467
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: PL33602
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL33602%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for PL33602: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: BC54503
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: SN24216
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN24216%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for SN24216: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: PR44802
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR44802%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for PR44802: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: YR75150
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: TP97389
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: EC10607
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: LE99206
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: KJ49270
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ49270%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for KJ49270: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: ZD15058
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD15058%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for ZD15058: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: PH13735
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: NR79425
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR79425%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for NR79425: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: CY46145
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: NC58057
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: UF03546
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF03546%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for UF03546: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: TF03370
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: WU29396
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU29396%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for WU29396: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: FF37262
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: UL28707
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: LM47126
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM47126%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for LM47126: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: FR17679
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: XG50299
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: MU09493
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU09493%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for MU09493: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: VR85555
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: VB32886
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: EF60589
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF60589%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for EF60589: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: MR72428
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72428%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for MR72428: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: UT14776
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT14776%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for UT14776: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: DC55349
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: LR58414
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR58414%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for LR58414: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: HM04559
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: EN17555
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN17555%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for EN17555: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: HN29475
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN29475%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for HN29475: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: UY60901
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY60901%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for UY60901: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: BE81625
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE81625%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for BE81625: 0
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: CE21106
2026-03-30 11:31:46 [auto1.de] INFO: Found listing with ID: GY94515
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY94515%27 HTTP/1.1" 200 None
2026-03-30 11:31:46 [auto1.de] INFO: Scrape type for GY94515: 0
2026-03-30 11:31:47 [auto1.de] INFO: Found listing with ID: CV44457
2026-03-30 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV44457%27 HTTP/1.1" 200 None
2026-03-30 11:31:47 [auto1.de] INFO: Scrape type for CV44457: 0
2026-03-30 11:31:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:49 [auto1.de] INFO: Channel: 24h | Page: 224 | totalHits: 9752 | hits on page: 40
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: GY94515
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY94515%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for GY94515: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: CV44457
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV44457%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for CV44457: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: LM12575
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM12575%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for LM12575: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: BN42758
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: ZH67756
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: PN96283
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: AZ23133
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ23133%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for AZ23133: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: XV62286
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV62286%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for XV62286: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: ZS47010
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47010%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for ZS47010: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: KZ38664
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: MF03624
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: FX61417
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX61417%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for FX61417: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: EK32140
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: ZG89267
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG89267%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for ZG89267: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: WW30345
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW30345%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for WW30345: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: BH61935
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: TH50247
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH50247%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for TH50247: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: CV13370
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: GF54025
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: KK05104
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: DT00553
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: LR61927
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR61927%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for LR61927: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: PR38296
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR38296%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for PR38296: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: MN30135
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30135%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for MN30135: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: GM93554
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: KC33777
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: JD18961
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: EU91257
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: YV19830
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV19830%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for YV19830: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: TF95367
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF95367%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for TF95367: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: MJ24427
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: WE87104
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87104%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for WE87104: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: TY73105
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: ZC07667
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: RY65257
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: YC98449
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC98449%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.de] INFO: Scrape type for YC98449: 0
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: AN00284
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: XZ09557
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: PW75443
2026-03-30 11:31:49 [auto1.de] INFO: Found listing with ID: ZU51849
2026-03-30 11:31:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:50 [auto1.de] INFO: Channel: 24h | Page: 225 | totalHits: 9752 | hits on page: 40
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: KD69831
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD69831%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for KD69831: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: VS08295
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: DZ10370
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: YE71263
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE71263%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for YE71263: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: PW03502
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW03502%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for PW03502: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: LH85097
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: TZ90544
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90544%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for TZ90544: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: MW28967
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: ZB32219
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: HL71303
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: BU00937
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU00937%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for BU00937: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: CB58662
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB58662%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for CB58662: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: WN13628
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN13628%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for WN13628: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: SC39619
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC39619%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for SC39619: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: HP58071
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: VW03364
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW03364%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for VW03364: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: DN85056
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN85056%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for DN85056: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: DZ90314
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: KV10415
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV10415%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for KV10415: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: SF76682
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF76682%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for SF76682: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: CE35567
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE35567%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for CE35567: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: EC92138
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC92138%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for EC92138: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: RN02934
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN02934%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for RN02934: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: UY39264
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY39264%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for UY39264: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: ZD05213
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: VL59163
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL59163%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for VL59163: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: AH54106
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH54106%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for AH54106: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: WC53392
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: KB62882
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62882%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.de] INFO: Scrape type for KB62882: 0
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: JZ33625
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: SS01468
2026-03-30 11:31:50 [auto1.de] INFO: Found listing with ID: RX82336
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX82336%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.de] INFO: Scrape type for RX82336: 0
2026-03-30 11:31:51 [auto1.de] INFO: Found listing with ID: VU61436
2026-03-30 11:31:51 [auto1.de] INFO: Found listing with ID: KE07703
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE07703%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.de] INFO: Scrape type for KE07703: 0
2026-03-30 11:31:51 [auto1.de] INFO: Found listing with ID: EW87662
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW87662%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.de] INFO: Scrape type for EW87662: 0
2026-03-30 11:31:51 [auto1.de] INFO: Found listing with ID: YD79813
2026-03-30 11:31:51 [auto1.de] INFO: Found listing with ID: WS06165
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS06165%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.de] INFO: Scrape type for WS06165: 0
2026-03-30 11:31:51 [auto1.de] INFO: Found listing with ID: XE70546
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE70546%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.de] INFO: Scrape type for XE70546: 0
2026-03-30 11:31:51 [auto1.de] INFO: Found listing with ID: JR23306
2026-03-30 11:31:51 [auto1.de] INFO: Found listing with ID: FK29510
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK29510%27 HTTP/1.1" 200 None
2026-03-30 11:31:51 [auto1.de] INFO: Scrape type for FK29510: 0
2026-03-30 11:31:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:03 [scrapy.extensions.logstats] INFO: Crawled 927 pages (at 7 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:32:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:59 [auto1.de] INFO: Channel: 24h | Page: 226 | totalHits: 9758 | hits on page: 40
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: EW87662
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW87662%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for EW87662: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: YD79813
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: WS06165
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS06165%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for WS06165: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: XE70546
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE70546%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for XE70546: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: JR23306
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: FK29510
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK29510%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for FK29510: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: YN71631
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: AP27322
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27322%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for AP27322: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: NW52708
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW52708%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for NW52708: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: NH18171
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH18171%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for NH18171: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: EM86154
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: JN22818
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN22818%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for JN22818: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: SK06184
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: SZ07968
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: RT44513
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: JB74543
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: HX73394
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: ES38254
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: PU69799
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: BM68891
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: AN35443
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: XA64298
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA64298%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for XA64298: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: FU18032
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU18032%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for FU18032: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: RT07537
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT07537%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for RT07537: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: CP64572
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: CA31284
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: JE64211
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: FJ20192
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ20192%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for FJ20192: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: ZV42561
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV42561%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for ZV42561: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: YZ24956
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ24956%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for YZ24956: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: RU51924
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: UM98970
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: PP81333
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: DG65550
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG65550%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for DG65550: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: SW06849
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW06849%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for SW06849: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: GZ70356
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ70356%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for GZ70356: 0
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: RS29828
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: WB65429
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: BV82977
2026-03-30 11:32:59 [auto1.de] INFO: Found listing with ID: XM98153
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM98153%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.de] INFO: Scrape type for XM98153: 0
2026-03-30 11:32:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:03 [scrapy.extensions.logstats] INFO: Crawled 928 pages (at 1 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:33:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:34:03 [scrapy.extensions.logstats] INFO: Crawled 928 pages (at 0 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:34:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:09 [auto1.de] INFO: Channel: 24h | Page: 227 | totalHits: 9769 | hits on page: 40
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: YZ24956
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ24956%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.de] INFO: Scrape type for YZ24956: 0
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: RU51924
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: UM98970
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: PP81333
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: DG65550
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG65550%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.de] INFO: Scrape type for DG65550: 0
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: SW06849
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW06849%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.de] INFO: Scrape type for SW06849: 0
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: GZ70356
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ70356%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.de] INFO: Scrape type for GZ70356: 0
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: RS29828
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: WB65429
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: BV82977
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: XM98153
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM98153%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.de] INFO: Scrape type for XM98153: 0
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: ZV11386
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: TM97127
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM97127%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.de] INFO: Scrape type for TM97127: 0
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: FW24707
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: ZB09378
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB09378%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.de] INFO: Scrape type for ZB09378: 0
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: NE29415
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: ES97586
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES97586%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.de] INFO: Scrape type for ES97586: 0
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: LF31183
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: RU06209
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: MW27042
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW27042%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.de] INFO: Scrape type for MW27042: 0
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: CN30644
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: VF79484
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF79484%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.de] INFO: Scrape type for VF79484: 0
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: PC42361
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: ZD03679
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: AJ68338
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: YS53721
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS53721%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.de] INFO: Scrape type for YS53721: 0
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: XY91311
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: NX07210
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX07210%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.de] INFO: Scrape type for NX07210: 0
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: UJ32060
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: LR70378
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR70378%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.de] INFO: Scrape type for LR70378: 0
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: VX51529
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: ZX35580
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: MB10012
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: JB16135
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: WX88880
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: VG60095
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG60095%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.de] INFO: Scrape type for VG60095: 0
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: AL99999
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: NW19977
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW19977%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [auto1.de] INFO: Scrape type for NW19977: 0
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: LD20816
2026-03-30 11:34:09 [auto1.de] INFO: Found listing with ID: FR59515
2026-03-30 11:34:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:10 [auto1.de] INFO: Channel: 24h | Page: 228 | totalHits: 9769 | hits on page: 40
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: ND45572
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND45572%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.de] INFO: Scrape type for ND45572: 0
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: XK76650
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK76650%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.de] INFO: Scrape type for XK76650: 0
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: CL01053
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL01053%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.de] INFO: Scrape type for CL01053: 0
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: PB68045
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: TD36353
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD36353%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.de] INFO: Scrape type for TD36353: 0
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: UX88157
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX88157%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.de] INFO: Scrape type for UX88157: 0
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: PS96436
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS96436%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.de] INFO: Scrape type for PS96436: 0
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: CA26041
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA26041%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.de] INFO: Scrape type for CA26041: 0
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: FK87134
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: AC64408
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: MS92853
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: HJ08295
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ08295%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.de] INFO: Scrape type for HJ08295: 0
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: KJ96076
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: AL40501
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL40501%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.de] INFO: Scrape type for AL40501: 0
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: US66744
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: WF58596
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF58596%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.de] INFO: Scrape type for WF58596: 0
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: HP30052
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP30052%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.de] INFO: Scrape type for HP30052: 0
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: RT47702
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47702%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.de] INFO: Scrape type for RT47702: 0
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: GB90564
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: RL85498
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: NV50024
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: WB83413
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: NX27502
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: BY26931
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26931%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.de] INFO: Scrape type for BY26931: 0
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: MF21991
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: MV86263
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV86263%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.de] INFO: Scrape type for MV86263: 0
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: GZ82101
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: XR92513
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: MH61351
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH61351%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [auto1.de] INFO: Scrape type for MH61351: 0
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: FT59815
2026-03-30 11:34:10 [auto1.de] INFO: Found listing with ID: TT73177
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT73177%27 HTTP/1.1" 200 None
2026-03-30 11:34:11 [auto1.de] INFO: Scrape type for TT73177: 0
2026-03-30 11:34:11 [auto1.de] INFO: Found listing with ID: TN55271
2026-03-30 11:34:11 [auto1.de] INFO: Found listing with ID: DZ73228
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ73228%27 HTTP/1.1" 200 None
2026-03-30 11:34:11 [auto1.de] INFO: Scrape type for DZ73228: 0
2026-03-30 11:34:11 [auto1.de] INFO: Found listing with ID: ZA78506
2026-03-30 11:34:11 [auto1.de] INFO: Found listing with ID: BT55955
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT55955%27 HTTP/1.1" 200 None
2026-03-30 11:34:11 [auto1.de] INFO: Scrape type for BT55955: 0
2026-03-30 11:34:11 [auto1.de] INFO: Found listing with ID: XT21551
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT21551%27 HTTP/1.1" 200 None
2026-03-30 11:34:11 [auto1.de] INFO: Scrape type for XT21551: 0
2026-03-30 11:34:11 [auto1.de] INFO: Found listing with ID: KB45443
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB45443%27 HTTP/1.1" 200 None
2026-03-30 11:34:11 [auto1.de] INFO: Scrape type for KB45443: 0
2026-03-30 11:34:11 [auto1.de] INFO: Found listing with ID: XT20747
2026-03-30 11:34:11 [auto1.de] INFO: Found listing with ID: GF23268
2026-03-30 11:34:11 [auto1.de] INFO: Found listing with ID: YD01023
2026-03-30 11:34:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:13 [auto1.de] INFO: Channel: 24h | Page: 229 | totalHits: 9769 | hits on page: 40
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: GJ73585
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: VA37364
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA37364%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.de] INFO: Scrape type for VA37364: 0
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: CA66668
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA66668%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.de] INFO: Scrape type for CA66668: 0
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: NZ98006
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ98006%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.de] INFO: Scrape type for NZ98006: 0
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: MP14986
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP14986%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.de] INFO: Scrape type for MP14986: 0
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: YC95910
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: KU30255
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU30255%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.de] INFO: Scrape type for KU30255: 0
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: HE47734
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: JR52179
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: LD23223
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: LM31898
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: HL01555
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: WJ67055
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: EJ09183
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: TM08126
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM08126%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.de] INFO: Scrape type for TM08126: 0
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: GZ17275
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: JG89144
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG89144%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.de] INFO: Scrape type for JG89144: 0
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: GY04691
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: WD20973
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: RN07993
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: NT23997
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT23997%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.de] INFO: Scrape type for NT23997: 0
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: EC99072
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: EN09392
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: DT06996
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: LX07481
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX07481%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.de] INFO: Scrape type for LX07481: 0
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: DK35136
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: WJ60429
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: RX22328
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: XE09172
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE09172%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.de] INFO: Scrape type for XE09172: 0
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: ST78231
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78231%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.de] INFO: Scrape type for ST78231: 0
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: VE13678
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: FG48361
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: XX85358
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX85358%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.de] INFO: Scrape type for XX85358: 0
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: WM91088
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: NY40403
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY40403%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.de] INFO: Scrape type for NY40403: 0
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: JY99626
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY99626%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.de] INFO: Scrape type for JY99626: 0
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: CG06120
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: XX47236
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: MA20139
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20139%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.de] INFO: Scrape type for MA20139: 0
2026-03-30 11:34:13 [auto1.de] INFO: Found listing with ID: GK17224
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK17224%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.de] INFO: Scrape type for GK17224: 0
2026-03-30 11:34:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:03 [scrapy.extensions.logstats] INFO: Crawled 931 pages (at 3 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:35:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:36:03 [scrapy.extensions.logstats] INFO: Crawled 931 pages (at 0 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:36:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:36:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.401(s), this was the 1st time calling it.
2026-03-30 11:36:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.277342177112709 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:36:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:36:40 [scrapy.core.engine] DEBUG: Crawled (401) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:40 [auto1.de] WARNING: Received 401 for https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07 (token age: 3679.1s). Queued for retry (1 pending).
2026-03-30 11:36:40 [auto1.de] INFO: Initiating token refresh...
2026-03-30 11:36:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:03 [scrapy.extensions.logstats] INFO: Crawled 932 pages (at 1 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:37:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:38:03 [scrapy.extensions.logstats] INFO: Crawled 932 pages (at 0 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:38:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:38:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.276(s), this was the 1st time calling it.
2026-03-30 11:38:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.677933722619958 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:39:03 [scrapy.extensions.logstats] INFO: Crawled 932 pages (at 0 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:39:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:40:03 [scrapy.extensions.logstats] INFO: Crawled 932 pages (at 0 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:40:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:41:03 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 262.392(s), this was the 2nd time calling it.
2026-03-30 11:41:03 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.5741572299582565 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:41:03 [scrapy.extensions.logstats] INFO: Crawled 932 pages (at 0 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:41:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:41:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:22 [auto1.de] INFO: Token refreshed successfully. Replaying 1 pending requests.
2026-03-30 11:41:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:03 [scrapy.extensions.logstats] INFO: Crawled 933 pages (at 1 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:42:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:43:03 [scrapy.extensions.logstats] INFO: Crawled 933 pages (at 0 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:43:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:43:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.769(s), this was the 1st time calling it.
2026-03-30 11:43:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.468063143193628 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:43:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:44:03 [scrapy.extensions.logstats] INFO: Crawled 933 pages (at 0 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:44:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:43 [auto1.de] INFO: Channel: 24h | Page: 230 | totalHits: 9852 | hits on page: 40
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: NW19977
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW19977%27 HTTP/1.1" 200 None
2026-03-30 11:44:43 [auto1.de] INFO: Scrape type for NW19977: 0
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: LD20816
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: FR59515
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: ND45572
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND45572%27 HTTP/1.1" 200 None
2026-03-30 11:44:43 [auto1.de] INFO: Scrape type for ND45572: 0
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: XK76650
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK76650%27 HTTP/1.1" 200 None
2026-03-30 11:44:43 [auto1.de] INFO: Scrape type for XK76650: 0
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: CL01053
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL01053%27 HTTP/1.1" 200 None
2026-03-30 11:44:43 [auto1.de] INFO: Scrape type for CL01053: 0
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: PB68045
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: TD36353
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD36353%27 HTTP/1.1" 200 None
2026-03-30 11:44:43 [auto1.de] INFO: Scrape type for TD36353: 0
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: UX88157
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX88157%27 HTTP/1.1" 200 None
2026-03-30 11:44:43 [auto1.de] INFO: Scrape type for UX88157: 0
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: PS96436
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS96436%27 HTTP/1.1" 200 None
2026-03-30 11:44:43 [auto1.de] INFO: Scrape type for PS96436: 0
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: CA26041
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA26041%27 HTTP/1.1" 200 None
2026-03-30 11:44:43 [auto1.de] INFO: Scrape type for CA26041: 0
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: FK87134
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: AC64408
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: MS92853
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: HJ08295
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ08295%27 HTTP/1.1" 200 None
2026-03-30 11:44:43 [auto1.de] INFO: Scrape type for HJ08295: 0
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: KJ96076
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: AL40501
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL40501%27 HTTP/1.1" 200 None
2026-03-30 11:44:43 [auto1.de] INFO: Scrape type for AL40501: 0
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: US66744
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: WF58596
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF58596%27 HTTP/1.1" 200 None
2026-03-30 11:44:43 [auto1.de] INFO: Scrape type for WF58596: 0
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: HP30052
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP30052%27 HTTP/1.1" 200 None
2026-03-30 11:44:43 [auto1.de] INFO: Scrape type for HP30052: 0
2026-03-30 11:44:43 [auto1.de] INFO: Found listing with ID: RT47702
2026-03-30 11:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47702%27 HTTP/1.1" 200 None
2026-03-30 11:44:44 [auto1.de] INFO: Scrape type for RT47702: 0
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: GB90564
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: RL85498
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: NV50024
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: WB83413
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: NX27502
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: BY26931
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26931%27 HTTP/1.1" 200 None
2026-03-30 11:44:44 [auto1.de] INFO: Scrape type for BY26931: 0
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: MF21991
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: MV86263
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV86263%27 HTTP/1.1" 200 None
2026-03-30 11:44:44 [auto1.de] INFO: Scrape type for MV86263: 0
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: GZ82101
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: XR92513
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: MH61351
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH61351%27 HTTP/1.1" 200 None
2026-03-30 11:44:44 [auto1.de] INFO: Scrape type for MH61351: 0
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: FT59815
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: TT73177
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT73177%27 HTTP/1.1" 200 None
2026-03-30 11:44:44 [auto1.de] INFO: Scrape type for TT73177: 0
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: TN55271
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: DZ73228
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ73228%27 HTTP/1.1" 200 None
2026-03-30 11:44:44 [auto1.de] INFO: Scrape type for DZ73228: 0
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: ZA78506
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: BT55955
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT55955%27 HTTP/1.1" 200 None
2026-03-30 11:44:44 [auto1.de] INFO: Scrape type for BT55955: 0
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: XT21551
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT21551%27 HTTP/1.1" 200 None
2026-03-30 11:44:44 [auto1.de] INFO: Scrape type for XT21551: 0
2026-03-30 11:44:44 [auto1.de] INFO: Found listing with ID: KB45443
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB45443%27 HTTP/1.1" 200 None
2026-03-30 11:44:44 [auto1.de] INFO: Scrape type for KB45443: 0
2026-03-30 11:44:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:45 [auto1.de] INFO: Channel: 24h | Page: 231 | totalHits: 9852 | hits on page: 40
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: XT20747
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: GF23268
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: YD01023
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: GJ73585
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: VA37364
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA37364%27 HTTP/1.1" 200 None
2026-03-30 11:44:45 [auto1.de] INFO: Scrape type for VA37364: 0
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: CA66668
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA66668%27 HTTP/1.1" 200 None
2026-03-30 11:44:45 [auto1.de] INFO: Scrape type for CA66668: 0
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: NZ98006
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ98006%27 HTTP/1.1" 200 None
2026-03-30 11:44:45 [auto1.de] INFO: Scrape type for NZ98006: 0
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: MP14986
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP14986%27 HTTP/1.1" 200 None
2026-03-30 11:44:45 [auto1.de] INFO: Scrape type for MP14986: 0
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: YC95910
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: KU30255
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU30255%27 HTTP/1.1" 200 None
2026-03-30 11:44:45 [auto1.de] INFO: Scrape type for KU30255: 0
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: HE47734
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: JR52179
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: LD23223
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: LM31898
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: HL01555
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: WJ67055
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: EJ09183
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: TM08126
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM08126%27 HTTP/1.1" 200 None
2026-03-30 11:44:45 [auto1.de] INFO: Scrape type for TM08126: 0
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: GZ17275
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: JG89144
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG89144%27 HTTP/1.1" 200 None
2026-03-30 11:44:45 [auto1.de] INFO: Scrape type for JG89144: 0
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: GY04691
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: WD20973
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: RN07993
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: NT23997
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT23997%27 HTTP/1.1" 200 None
2026-03-30 11:44:45 [auto1.de] INFO: Scrape type for NT23997: 0
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: EC99072
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: EN09392
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: DT06996
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: LX07481
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX07481%27 HTTP/1.1" 200 None
2026-03-30 11:44:45 [auto1.de] INFO: Scrape type for LX07481: 0
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: DK35136
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: WJ60429
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: RX22328
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: XE09172
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE09172%27 HTTP/1.1" 200 None
2026-03-30 11:44:45 [auto1.de] INFO: Scrape type for XE09172: 0
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: ST78231
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78231%27 HTTP/1.1" 200 None
2026-03-30 11:44:45 [auto1.de] INFO: Scrape type for ST78231: 0
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: VE13678
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: FG48361
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: XX85358
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX85358%27 HTTP/1.1" 200 None
2026-03-30 11:44:45 [auto1.de] INFO: Scrape type for XX85358: 0
2026-03-30 11:44:45 [auto1.de] INFO: Found listing with ID: WM91088
2026-03-30 11:44:46 [auto1.de] INFO: Found listing with ID: NY40403
2026-03-30 11:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY40403%27 HTTP/1.1" 200 None
2026-03-30 11:44:46 [auto1.de] INFO: Scrape type for NY40403: 0
2026-03-30 11:44:46 [auto1.de] INFO: Found listing with ID: JY99626
2026-03-30 11:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY99626%27 HTTP/1.1" 200 None
2026-03-30 11:44:46 [auto1.de] INFO: Scrape type for JY99626: 0
2026-03-30 11:44:46 [auto1.de] INFO: Found listing with ID: CG06120
2026-03-30 11:44:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:58 [auto1.de] INFO: Channel: 24h | Page: 232 | totalHits: 9852 | hits on page: 40
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: XX47236
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: MA20139
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20139%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for MA20139: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: GK17224
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK17224%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for GK17224: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: AY24824
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: CE16613
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE16613%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for CE16613: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: AK16963
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK16963%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for AK16963: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: PG11291
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG11291%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for PG11291: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: HE64708
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE64708%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for HE64708: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: ZK51432
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK51432%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for ZK51432: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: JR48888
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: JU28029
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU28029%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for JU28029: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: WX17645
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: BE75867
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE75867%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for BE75867: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: FP27721
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: KV56642
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56642%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for KV56642: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: KC60426
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: ZU41188
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU41188%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for ZU41188: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: VD40849
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD40849%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for VD40849: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: EL78604
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: ZA94641
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA94641%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for ZA94641: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: YL33228
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL33228%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for YL33228: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: XU87047
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU87047%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for XU87047: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: KP52427
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: GW71090
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW71090%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for GW71090: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: UZ60031
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: FD59666
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD59666%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for FD59666: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: YP26052
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: UW39915
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39915%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for UW39915: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: GC53202
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC53202%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for GC53202: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: RF84100
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF84100%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for RF84100: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: BW84058
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW84058%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for BW84058: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: UX04638
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: WJ96014
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ96014%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for WJ96014: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: XT42092
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: ER27214
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: VK18000
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK18000%27 HTTP/1.1" 200 None
2026-03-30 11:44:58 [auto1.de] INFO: Scrape type for VK18000: 0
2026-03-30 11:44:58 [auto1.de] INFO: Found listing with ID: ZJ88951
2026-03-30 11:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ88951%27 HTTP/1.1" 200 None
2026-03-30 11:44:59 [auto1.de] INFO: Scrape type for ZJ88951: 0
2026-03-30 11:44:59 [auto1.de] INFO: Found listing with ID: DS51520
2026-03-30 11:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS51520%27 HTTP/1.1" 200 None
2026-03-30 11:44:59 [auto1.de] INFO: Scrape type for DS51520: 0
2026-03-30 11:44:59 [auto1.de] INFO: Found listing with ID: DU68074
2026-03-30 11:44:59 [auto1.de] INFO: Found listing with ID: AX34662
2026-03-30 11:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34662%27 HTTP/1.1" 200 None
2026-03-30 11:44:59 [auto1.de] INFO: Scrape type for AX34662: 0
2026-03-30 11:44:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:45:02 [auto1.de] INFO: Channel: 24h | Page: 233 | totalHits: 9854 | hits on page: 40
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: DU68074
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: AX34662
2026-03-30 11:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34662%27 HTTP/1.1" 200 None
2026-03-30 11:45:02 [auto1.de] INFO: Scrape type for AX34662: 0
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: VP32069
2026-03-30 11:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP32069%27 HTTP/1.1" 200 None
2026-03-30 11:45:02 [auto1.de] INFO: Scrape type for VP32069: 0
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: ZU11253
2026-03-30 11:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU11253%27 HTTP/1.1" 200 None
2026-03-30 11:45:02 [auto1.de] INFO: Scrape type for ZU11253: 0
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: ZN38550
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: TR40985
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: BW25069
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: UH14714
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: WR70011
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: FL42692
2026-03-30 11:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL42692%27 HTTP/1.1" 200 None
2026-03-30 11:45:02 [auto1.de] INFO: Scrape type for FL42692: 0
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: UP55636
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: EP24311
2026-03-30 11:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP24311%27 HTTP/1.1" 200 None
2026-03-30 11:45:02 [auto1.de] INFO: Scrape type for EP24311: 0
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: ZT83144
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: UY91981
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: AX05001
2026-03-30 11:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX05001%27 HTTP/1.1" 200 None
2026-03-30 11:45:02 [auto1.de] INFO: Scrape type for AX05001: 0
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: LT27218
2026-03-30 11:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT27218%27 HTTP/1.1" 200 None
2026-03-30 11:45:02 [auto1.de] INFO: Scrape type for LT27218: 0
2026-03-30 11:45:02 [auto1.de] INFO: Found listing with ID: TG23617
2026-03-30 11:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG23617%27 HTTP/1.1" 200 None
2026-03-30 11:45:03 [auto1.de] INFO: Scrape type for TG23617: 0
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: DL01383
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL01383%27 HTTP/1.1" 200 None
2026-03-30 11:45:03 [auto1.de] INFO: Scrape type for DL01383: 0
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: VR01975
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: BC68366
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC68366%27 HTTP/1.1" 200 None
2026-03-30 11:45:03 [auto1.de] INFO: Scrape type for BC68366: 0
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: UW30616
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW30616%27 HTTP/1.1" 200 None
2026-03-30 11:45:03 [auto1.de] INFO: Scrape type for UW30616: 0
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: RT08508
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT08508%27 HTTP/1.1" 200 None
2026-03-30 11:45:03 [auto1.de] INFO: Scrape type for RT08508: 0
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: HL66974
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: CJ73141
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: LT88740
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: FE36611
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: MY97693
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97693%27 HTTP/1.1" 200 None
2026-03-30 11:45:03 [auto1.de] INFO: Scrape type for MY97693: 0
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: VH99628
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH99628%27 HTTP/1.1" 200 None
2026-03-30 11:45:03 [auto1.de] INFO: Scrape type for VH99628: 0
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: ST78057
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: PV80087
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: HD58306
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD58306%27 HTTP/1.1" 200 None
2026-03-30 11:45:03 [auto1.de] INFO: Scrape type for HD58306: 0
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: KY32435
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: BE46966
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE46966%27 HTTP/1.1" 200 None
2026-03-30 11:45:03 [auto1.de] INFO: Scrape type for BE46966: 0
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: ZZ46464
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ46464%27 HTTP/1.1" 200 None
2026-03-30 11:45:03 [auto1.de] INFO: Scrape type for ZZ46464: 0
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: PY07739
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: NX87227
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX87227%27 HTTP/1.1" 200 None
2026-03-30 11:45:03 [auto1.de] INFO: Scrape type for NX87227: 0
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: TH73061
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH73061%27 HTTP/1.1" 200 None
2026-03-30 11:45:03 [auto1.de] INFO: Scrape type for TH73061: 0
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: DN86096
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: YK83419
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK83419%27 HTTP/1.1" 200 None
2026-03-30 11:45:03 [auto1.de] INFO: Scrape type for YK83419: 0
2026-03-30 11:45:03 [auto1.de] INFO: Found listing with ID: RV77607
2026-03-30 11:45:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:03 [scrapy.extensions.logstats] INFO: Crawled 937 pages (at 4 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:45:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:45:13 [auto1.de] INFO: Channel: 24h | Page: 234 | totalHits: 9858 | hits on page: 40
2026-03-30 11:45:13 [auto1.de] INFO: Found listing with ID: TH73061
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH73061%27 HTTP/1.1" 200 None
2026-03-30 11:45:13 [auto1.de] INFO: Scrape type for TH73061: 0
2026-03-30 11:45:13 [auto1.de] INFO: Found listing with ID: DN86096
2026-03-30 11:45:13 [auto1.de] INFO: Found listing with ID: YK83419
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK83419%27 HTTP/1.1" 200 None
2026-03-30 11:45:13 [auto1.de] INFO: Scrape type for YK83419: 0
2026-03-30 11:45:13 [auto1.de] INFO: Found listing with ID: RV77607
2026-03-30 11:45:13 [auto1.de] INFO: Found listing with ID: PS10948
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS10948%27 HTTP/1.1" 200 None
2026-03-30 11:45:13 [auto1.de] INFO: Scrape type for PS10948: 0
2026-03-30 11:45:13 [auto1.de] INFO: Found listing with ID: HF23324
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF23324%27 HTTP/1.1" 200 None
2026-03-30 11:45:13 [auto1.de] INFO: Scrape type for HF23324: 0
2026-03-30 11:45:13 [auto1.de] INFO: Found listing with ID: XA19312
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA19312%27 HTTP/1.1" 200 None
2026-03-30 11:45:13 [auto1.de] INFO: Scrape type for XA19312: 0
2026-03-30 11:45:13 [auto1.de] INFO: Found listing with ID: UP26126
2026-03-30 11:45:13 [auto1.de] INFO: Found listing with ID: GP53136
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP53136%27 HTTP/1.1" 200 None
2026-03-30 11:45:13 [auto1.de] INFO: Scrape type for GP53136: 0
2026-03-30 11:45:13 [auto1.de] INFO: Found listing with ID: TV59519
2026-03-30 11:45:13 [auto1.de] INFO: Found listing with ID: XL14326
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL14326%27 HTTP/1.1" 200 None
2026-03-30 11:45:13 [auto1.de] INFO: Scrape type for XL14326: 0
2026-03-30 11:45:13 [auto1.de] INFO: Found listing with ID: AC34212
2026-03-30 11:45:13 [auto1.de] INFO: Found listing with ID: EW67018
2026-03-30 11:45:13 [auto1.de] INFO: Found listing with ID: KN87388
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN87388%27 HTTP/1.1" 200 None
2026-03-30 11:45:13 [auto1.de] INFO: Scrape type for KN87388: 0
2026-03-30 11:45:13 [auto1.de] INFO: Found listing with ID: MB20164
2026-03-30 11:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB20164%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for MB20164: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: HL64703
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL64703%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for HL64703: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: YW30232
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW30232%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for YW30232: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: AL30364
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: FW19107
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: HF87037
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF87037%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for HF87037: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: SJ02125
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: GZ99340
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ99340%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for GZ99340: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: VL24807
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: FB16153
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB16153%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for FB16153: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: AX69067
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX69067%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for AX69067: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: CM63557
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM63557%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for CM63557: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: YR62229
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR62229%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for YR62229: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: NF97550
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: AR94395
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR94395%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for AR94395: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: RF06599
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF06599%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for RF06599: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: AD51126
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD51126%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for AD51126: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: ZA82087
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: PR51827
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: KU26816
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: LD78650
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD78650%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for LD78650: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: KB26549
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB26549%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for KB26549: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: VL06986
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06986%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for VL06986: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: WB94106
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94106%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for WB94106: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: ZP72952
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP72952%27 HTTP/1.1" 200 None
2026-03-30 11:45:14 [auto1.de] INFO: Scrape type for ZP72952: 0
2026-03-30 11:45:14 [auto1.de] INFO: Found listing with ID: CM42106
2026-03-30 11:45:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:45:30 [auto1.de] INFO: Channel: 24h | Page: 235 | totalHits: 9866 | hits on page: 40
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: PR51827
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: KU26816
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: LD78650
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD78650%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for LD78650: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: KB26549
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB26549%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for KB26549: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: VL06986
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06986%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for VL06986: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: WB94106
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94106%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for WB94106: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: ZP72952
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP72952%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for ZP72952: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: CM42106
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: UP78086
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP78086%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for UP78086: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: WP34859
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP34859%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for WP34859: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: UR14680
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: JS00894
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS00894%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for JS00894: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: GZ33681
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: KE41699
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE41699%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for KE41699: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: WH78013
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH78013%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for WH78013: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: GL25834
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL25834%27 HTTP/1.1" 200 None
2026-03-30 11:45:30 [auto1.de] INFO: Scrape type for GL25834: 0
2026-03-30 11:45:30 [auto1.de] INFO: Found listing with ID: AB16604
2026-03-30 11:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB16604%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for AB16604: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: PM83477
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM83477%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for PM83477: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: XE10609
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE10609%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for XE10609: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: XT67395
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: XT85364
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: AU58197
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU58197%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for AU58197: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: KJ39198
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: ED37424
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED37424%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for ED37424: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: HP09567
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP09567%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for HP09567: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: EX55373
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: BN44220
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: YV25001
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV25001%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for YV25001: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: DF34301
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF34301%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for DF34301: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: KT60539
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: VA98416
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA98416%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for VA98416: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: JM65569
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: LX23482
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: RS04004
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS04004%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for RS04004: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: KC29293
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: EP86808
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP86808%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for EP86808: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: YA04256
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA04256%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for YA04256: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: WS15050
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS15050%27 HTTP/1.1" 200 None
2026-03-30 11:45:31 [auto1.de] INFO: Scrape type for WS15050: 0
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: HM10485
2026-03-30 11:45:31 [auto1.de] INFO: Found listing with ID: GZ74020
2026-03-30 11:45:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:45:51 [auto1.de] INFO: Channel: 24h | Page: 236 | totalHits: 9869 | hits on page: 40
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: WS15050
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS15050%27 HTTP/1.1" 200 None
2026-03-30 11:45:51 [auto1.de] INFO: Scrape type for WS15050: 0
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: HM10485
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: GZ74020
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: HZ02763
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: KZ16493
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: UN41694
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN41694%27 HTTP/1.1" 200 None
2026-03-30 11:45:51 [auto1.de] INFO: Scrape type for UN41694: 0
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: DF05561
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: GK39429
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: UJ06873
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ06873%27 HTTP/1.1" 200 None
2026-03-30 11:45:51 [auto1.de] INFO: Scrape type for UJ06873: 0
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: KR32445
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR32445%27 HTTP/1.1" 200 None
2026-03-30 11:45:51 [auto1.de] INFO: Scrape type for KR32445: 0
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: MV07839
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: YR28195
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR28195%27 HTTP/1.1" 200 None
2026-03-30 11:45:51 [auto1.de] INFO: Scrape type for YR28195: 0
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: AW19440
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: DG41556
2026-03-30 11:45:51 [auto1.de] INFO: Found listing with ID: SR75246
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR75246%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for SR75246: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: HU15676
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: SV56483
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: ZM61762
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: SC91438
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC91438%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for SC91438: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: LJ25581
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: LL75700
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: RG78174
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG78174%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for RG78174: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: NG57043
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: SK20247
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20247%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for SK20247: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: KY61393
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY61393%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for KY61393: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: XA48872
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: ZZ30319
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: HK51191
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK51191%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for HK51191: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: FJ78997
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: NH81778
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81778%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for NH81778: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: SC04632
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: CA87929
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: GL40281
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: RZ32125
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ32125%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for RZ32125: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: LC33446
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33446%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for LC33446: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: JA37481
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA37481%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for JA37481: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: ZT00661
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00661%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [auto1.de] INFO: Scrape type for ZT00661: 0
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: WC65602
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: HF13996
2026-03-30 11:45:52 [auto1.de] INFO: Found listing with ID: RX58241
2026-03-30 11:45:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:03 [scrapy.extensions.logstats] INFO: Crawled 940 pages (at 3 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:46:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:47:03 [scrapy.extensions.logstats] INFO: Crawled 940 pages (at 0 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:47:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:48:03 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.975(s), this was the 1st time calling it.
2026-03-30 11:48:03 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.116391748760217 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:48:03 [scrapy.extensions.logstats] INFO: Crawled 940 pages (at 0 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:48:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:48:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:49:03 [scrapy.extensions.logstats] INFO: Crawled 940 pages (at 0 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:49:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:50:03 [scrapy.extensions.logstats] INFO: Crawled 940 pages (at 0 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:50:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:50:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.143(s), this was the 2nd time calling it.
2026-03-30 11:50:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.595636299243477 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:50:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:59 [auto1.de] INFO: Channel: 24h | Page: 237 | totalHits: 9916 | hits on page: 40
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: VA98416
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA98416%27 HTTP/1.1" 200 None
2026-03-30 11:50:59 [auto1.de] INFO: Scrape type for VA98416: 0
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: JM65569
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: LX23482
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: RS04004
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS04004%27 HTTP/1.1" 200 None
2026-03-30 11:50:59 [auto1.de] INFO: Scrape type for RS04004: 0
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: KC29293
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: EP86808
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP86808%27 HTTP/1.1" 200 None
2026-03-30 11:50:59 [auto1.de] INFO: Scrape type for EP86808: 0
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: YA04256
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA04256%27 HTTP/1.1" 200 None
2026-03-30 11:50:59 [auto1.de] INFO: Scrape type for YA04256: 0
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: WS15050
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS15050%27 HTTP/1.1" 200 None
2026-03-30 11:50:59 [auto1.de] INFO: Scrape type for WS15050: 0
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: HM10485
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: GZ74020
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: HZ02763
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: KZ16493
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: UN41694
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN41694%27 HTTP/1.1" 200 None
2026-03-30 11:50:59 [auto1.de] INFO: Scrape type for UN41694: 0
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: DF05561
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: GK39429
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: UJ06873
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ06873%27 HTTP/1.1" 200 None
2026-03-30 11:50:59 [auto1.de] INFO: Scrape type for UJ06873: 0
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: KR32445
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR32445%27 HTTP/1.1" 200 None
2026-03-30 11:50:59 [auto1.de] INFO: Scrape type for KR32445: 0
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: MV07839
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: YR28195
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR28195%27 HTTP/1.1" 200 None
2026-03-30 11:50:59 [auto1.de] INFO: Scrape type for YR28195: 0
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: AW19440
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: DG41556
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: SR75246
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR75246%27 HTTP/1.1" 200 None
2026-03-30 11:50:59 [auto1.de] INFO: Scrape type for SR75246: 0
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: HU15676
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: SV56483
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: ZM61762
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: SC91438
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC91438%27 HTTP/1.1" 200 None
2026-03-30 11:50:59 [auto1.de] INFO: Scrape type for SC91438: 0
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: LJ25581
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: LL75700
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: RG78174
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG78174%27 HTTP/1.1" 200 None
2026-03-30 11:50:59 [auto1.de] INFO: Scrape type for RG78174: 0
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: NG57043
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: SK20247
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20247%27 HTTP/1.1" 200 None
2026-03-30 11:50:59 [auto1.de] INFO: Scrape type for SK20247: 0
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: KY61393
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY61393%27 HTTP/1.1" 200 None
2026-03-30 11:50:59 [auto1.de] INFO: Scrape type for KY61393: 0
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: XA48872
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: ZZ30319
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: HK51191
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK51191%27 HTTP/1.1" 200 None
2026-03-30 11:50:59 [auto1.de] INFO: Scrape type for HK51191: 0
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: FJ78997
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: NH81778
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81778%27 HTTP/1.1" 200 None
2026-03-30 11:50:59 [auto1.de] INFO: Scrape type for NH81778: 0
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: SC04632
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: CA87929
2026-03-30 11:50:59 [auto1.de] INFO: Found listing with ID: GL40281
2026-03-30 11:50:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:03 [scrapy.extensions.logstats] INFO: Crawled 941 pages (at 1 pages/min), scraped 1176 items (at 0 items/min)
2026-03-30 11:51:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:10 [auto1.de] INFO: Channel: 24h | Page: 238 | totalHits: 9917 | hits on page: 40
2026-03-30 11:51:10 [auto1.de] INFO: Found listing with ID: GL40281
2026-03-30 11:51:10 [auto1.de] INFO: Found listing with ID: RZ32125
2026-03-30 11:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ32125%27 HTTP/1.1" 200 None
2026-03-30 11:51:10 [auto1.de] INFO: Scrape type for RZ32125: 0
2026-03-30 11:51:10 [auto1.de] INFO: Found listing with ID: LC33446
2026-03-30 11:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33446%27 HTTP/1.1" 200 None
2026-03-30 11:51:10 [auto1.de] INFO: Scrape type for LC33446: 0
2026-03-30 11:51:10 [auto1.de] INFO: Found listing with ID: JA37481
2026-03-30 11:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA37481%27 HTTP/1.1" 200 None
2026-03-30 11:51:10 [auto1.de] INFO: Scrape type for JA37481: 0
2026-03-30 11:51:10 [auto1.de] INFO: Found listing with ID: ZT00661
2026-03-30 11:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00661%27 HTTP/1.1" 200 None
2026-03-30 11:51:10 [auto1.de] INFO: Scrape type for ZT00661: 0
2026-03-30 11:51:10 [auto1.de] INFO: Found listing with ID: WC65602
2026-03-30 11:51:10 [auto1.de] INFO: Found listing with ID: HF13996
2026-03-30 11:51:10 [auto1.de] INFO: Found listing with ID: RX58241
2026-03-30 11:51:10 [auto1.de] INFO: Found listing with ID: DG46200
2026-03-30 11:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG46200%27 HTTP/1.1" 200 None
2026-03-30 11:51:10 [auto1.de] INFO: Scrape type for DG46200: 2
2026-03-30 11:51:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9a72b18-588d-5085-b89f-6448e85a5c91 with identifier: DG46200
2026-03-30 11:51:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9a72b18-588d-5085-b89f-6448e85a5c91 with scrape type 2
2026-03-30 11:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9a72b18-588d-5085-b89f-6448e85a5c91 with scrape type 2
2026-03-30 11:51:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9a72b18-588d-5085-b89f-6448e85a5c91, identifier: DG46200
2026-03-30 11:51:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9a72b18-588d-5085-b89f-6448e85a5c91 with identifier: DG46200
2026-03-30 11:51:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9a72b18-588d-5085-b89f-6448e85a5c91 with identifier: DG46200
2026-03-30 11:51:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9a72b18-588d-5085-b89f-6448e85a5c91 with identifier: DG46200 to the API
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:46:51Z',
 'fuel_type': 'petrol',
 'id': 'a9a72b18-588d-5085-b89f-6448e85a5c91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG46200',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 159787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-12',
 'seller_name': None,
 'title': 'BMW 5er 528i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG46200%27 HTTP/1.1" 200 None
2026-03-30 11:51:11 [auto1.de] INFO: Saving data for DG46200: {'auction_closing_time': 1774885611.0, 'created_time': 1774694165.857857, 'last_price_update_time': 1774871471.241922}
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG46200') HTTP/1.1" 204 0
2026-03-30 11:51:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:11 [auto1.de] INFO: Found listing with ID: BU17582
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU17582%27 HTTP/1.1" 200 None
2026-03-30 11:51:11 [auto1.de] INFO: Scrape type for BU17582: 2
2026-03-30 11:51:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with identifier: BU17582
2026-03-30 11:51:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with scrape type 2
2026-03-30 11:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with scrape type 2
2026-03-30 11:51:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc, identifier: BU17582
2026-03-30 11:51:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with identifier: BU17582
2026-03-30 11:51:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with identifier: BU17582
2026-03-30 11:51:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with identifier: BU17582 to the API
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:54:20Z',
 'fuel_type': 'petrol',
 'id': 'ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU17582',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 67413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-16',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 T4 Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2019}
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU17582%27 HTTP/1.1" 200 None
2026-03-30 11:51:11 [auto1.de] INFO: Saving data for BU17582: {'auction_closing_time': 1774886060.0, 'created_time': 1774033778.877449, 'last_price_update_time': 1774871471.720076}
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU17582') HTTP/1.1" 204 0
2026-03-30 11:51:11 [auto1.de] INFO: Found listing with ID: HN71880
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN71880%27 HTTP/1.1" 200 None
2026-03-30 11:51:11 [auto1.de] INFO: Scrape type for HN71880: 2
2026-03-30 11:51:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46e8c254-7c22-5967-8026-a6e882764890 with identifier: HN71880
2026-03-30 11:51:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46e8c254-7c22-5967-8026-a6e882764890 with scrape type 2
2026-03-30 11:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46e8c254-7c22-5967-8026-a6e882764890 with scrape type 2
2026-03-30 11:51:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46e8c254-7c22-5967-8026-a6e882764890, identifier: HN71880
2026-03-30 11:51:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46e8c254-7c22-5967-8026-a6e882764890 with identifier: HN71880
2026-03-30 11:51:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46e8c254-7c22-5967-8026-a6e882764890 with identifier: HN71880
2026-03-30 11:51:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46e8c254-7c22-5967-8026-a6e882764890 with identifier: HN71880 to the API
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:04:04Z',
 'fuel_type': 'petrol',
 'id': '46e8c254-7c22-5967-8026-a6e882764890',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN71880',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 122855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-08',
 'seller_name': None,
 'title': "Renault Megane 1.6 Je t'aime",
 'transmission': 'manual',
 'trim': "Je t'aime",
 'year': 2011}
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN71880%27 HTTP/1.1" 200 None
2026-03-30 11:51:12 [auto1.de] INFO: Saving data for HN71880: {'auction_closing_time': 1774883044.0, 'created_time': 1774694180.024189, 'last_price_update_time': 1774871472.122276}
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN71880') HTTP/1.1" 204 0
2026-03-30 11:51:12 [auto1.de] INFO: Found listing with ID: VN03026
2026-03-30 11:51:12 [auto1.de] INFO: Found listing with ID: NS77188
2026-03-30 11:51:12 [auto1.de] INFO: Found listing with ID: GT32005
2026-03-30 11:51:12 [auto1.de] INFO: Found listing with ID: UT62888
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT62888%27 HTTP/1.1" 200 None
2026-03-30 11:51:12 [auto1.de] INFO: Scrape type for UT62888: 2
2026-03-30 11:51:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65718b7a-816f-50fb-9360-dbd5b4eeb25f with identifier: UT62888
2026-03-30 11:51:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65718b7a-816f-50fb-9360-dbd5b4eeb25f with scrape type 2
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65718b7a-816f-50fb-9360-dbd5b4eeb25f with scrape type 2
2026-03-30 11:51:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65718b7a-816f-50fb-9360-dbd5b4eeb25f, identifier: UT62888
2026-03-30 11:51:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65718b7a-816f-50fb-9360-dbd5b4eeb25f with identifier: UT62888
2026-03-30 11:51:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65718b7a-816f-50fb-9360-dbd5b4eeb25f with identifier: UT62888
2026-03-30 11:51:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65718b7a-816f-50fb-9360-dbd5b4eeb25f with identifier: UT62888 to the API
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:39:12Z',
 'fuel_type': 'diesel',
 'id': '65718b7a-816f-50fb-9360-dbd5b4eeb25f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT62888',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 114198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-24',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 110 CDI FWD lang',
 'transmission': 'automatic',
 'trim': 'FWD lang',
 'year': 2021}
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT62888%27 HTTP/1.1" 200 None
2026-03-30 11:51:12 [auto1.de] INFO: Saving data for UT62888: {'auction_closing_time': 1774885152.0, 'created_time': 1774380418.96552, 'last_price_update_time': 1774871472.51173}
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT62888') HTTP/1.1" 204 0
2026-03-30 11:51:12 [auto1.de] INFO: Found listing with ID: CN24608
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN24608%27 HTTP/1.1" 200 None
2026-03-30 11:51:12 [auto1.de] INFO: Scrape type for CN24608: 2
2026-03-30 11:51:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with identifier: CN24608
2026-03-30 11:51:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with scrape type 2
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with scrape type 2
2026-03-30 11:51:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d, identifier: CN24608
2026-03-30 11:51:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with identifier: CN24608
2026-03-30 11:51:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with identifier: CN24608
2026-03-30 11:51:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with identifier: CN24608 to the API
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:51:54Z',
 'fuel_type': 'diesel',
 'id': '30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN24608',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 276222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-30',
 'seller_name': None,
 'title': 'Honda Civic 2.2 CTDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2008}
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN24608%27 HTTP/1.1" 200 None
2026-03-30 11:51:12 [auto1.de] INFO: Saving data for CN24608: {'auction_closing_time': 1774885914.0, 'created_time': 1774694349.374981, 'last_price_update_time': 1774871472.914354}
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN24608') HTTP/1.1" 204 0
2026-03-30 11:51:12 [auto1.de] INFO: Found listing with ID: BE39564
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE39564%27 HTTP/1.1" 200 None
2026-03-30 11:51:12 [auto1.de] INFO: Scrape type for BE39564: 2
2026-03-30 11:51:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dae1123b-22f1-50a4-9708-3b1358d76717 with identifier: BE39564
2026-03-30 11:51:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dae1123b-22f1-50a4-9708-3b1358d76717 with scrape type 2
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dae1123b-22f1-50a4-9708-3b1358d76717 with scrape type 2
2026-03-30 11:51:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dae1123b-22f1-50a4-9708-3b1358d76717, identifier: BE39564
2026-03-30 11:51:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dae1123b-22f1-50a4-9708-3b1358d76717 with identifier: BE39564
2026-03-30 11:51:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dae1123b-22f1-50a4-9708-3b1358d76717 with identifier: BE39564
2026-03-30 11:51:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dae1123b-22f1-50a4-9708-3b1358d76717 with identifier: BE39564 to the API
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:52:33Z',
 'fuel_type': 'diesel',
 'id': 'dae1123b-22f1-50a4-9708-3b1358d76717',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE39564',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 347895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-23',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D3 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2014}
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE39564%27 HTTP/1.1" 200 None
2026-03-30 11:51:13 [auto1.de] INFO: Saving data for BE39564: {'auction_closing_time': 1774885953.0, 'created_time': 1774694169.601926, 'last_price_update_time': 1774871473.32475}
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE39564') HTTP/1.1" 204 0
2026-03-30 11:51:13 [auto1.de] INFO: Found listing with ID: SF89930
2026-03-30 11:51:13 [auto1.de] INFO: Found listing with ID: FF09080
2026-03-30 11:51:13 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-30 11:51:13 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV82579%27 HTTP/1.1" 200 None
2026-03-30 11:51:13 [auto1.de] INFO: Scrape type for WV82579: 2
2026-03-30 11:51:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with identifier: WV82579
2026-03-30 11:51:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with scrape type 2
2026-03-30 11:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with scrape type 2
2026-03-30 11:51:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d, identifier: WV82579
2026-03-30 11:51:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with identifier: WV82579
2026-03-30 11:51:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with identifier: WV82579
2026-03-30 11:51:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with identifier: WV82579 to the API
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:39:10Z',
 'fuel_type': 'petrol',
 'id': '32fd4dcc-6f40-5219-9e5a-a86bc1acd48d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV82579',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 198919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-16',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2014}
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV82579%27 HTTP/1.1" 200 None
2026-03-30 11:51:13 [auto1.de] INFO: Saving data for WV82579: {'auction_closing_time': 1774885150.0, 'created_time': 1774694353.584955, 'last_price_update_time': 1774871473.718604}
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV82579') HTTP/1.1" 204 0
2026-03-30 11:51:13 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-30 11:51:13 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP80469%27 HTTP/1.1" 200 None
2026-03-30 11:51:13 [auto1.de] INFO: Scrape type for ZP80469: 2
2026-03-30 11:51:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54f9a65b-b0b4-5940-8897-00099051e33e with identifier: ZP80469
2026-03-30 11:51:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54f9a65b-b0b4-5940-8897-00099051e33e with scrape type 2
2026-03-30 11:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54f9a65b-b0b4-5940-8897-00099051e33e with scrape type 2
2026-03-30 11:51:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54f9a65b-b0b4-5940-8897-00099051e33e, identifier: ZP80469
2026-03-30 11:51:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54f9a65b-b0b4-5940-8897-00099051e33e with identifier: ZP80469
2026-03-30 11:51:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54f9a65b-b0b4-5940-8897-00099051e33e with identifier: ZP80469
2026-03-30 11:51:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54f9a65b-b0b4-5940-8897-00099051e33e with identifier: ZP80469 to the API
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:47:21Z',
 'fuel_type': 'petrol',
 'id': '54f9a65b-b0b4-5940-8897-00099051e33e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP80469',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 118029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-13',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Comfort + 4x4',
 'transmission': 'automatic',
 'trim': 'Comfort + 4x4',
 'year': 2018}
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP80469%27 HTTP/1.1" 200 None
2026-03-30 11:51:14 [auto1.de] INFO: Saving data for ZP80469: {'auction_closing_time': 1774885641.0, 'created_time': 1773381260.065967, 'last_price_update_time': 1774871474.191076}
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP80469') HTTP/1.1" 204 0
2026-03-30 11:51:14 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-30 11:51:14 [auto1.de] INFO: Found listing with ID: CW56448
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW56448%27 HTTP/1.1" 200 None
2026-03-30 11:51:14 [auto1.de] INFO: Scrape type for CW56448: 2
2026-03-30 11:51:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6249825-b358-5ffd-997c-66c5ec00f94d with identifier: CW56448
2026-03-30 11:51:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6249825-b358-5ffd-997c-66c5ec00f94d with scrape type 2
2026-03-30 11:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6249825-b358-5ffd-997c-66c5ec00f94d with scrape type 2
2026-03-30 11:51:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6249825-b358-5ffd-997c-66c5ec00f94d, identifier: CW56448
2026-03-30 11:51:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6249825-b358-5ffd-997c-66c5ec00f94d with identifier: CW56448
2026-03-30 11:51:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6249825-b358-5ffd-997c-66c5ec00f94d with identifier: CW56448
2026-03-30 11:51:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6249825-b358-5ffd-997c-66c5ec00f94d with identifier: CW56448 to the API
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:40:55Z',
 'fuel_type': 'diesel',
 'id': 'c6249825-b358-5ffd-997c-66c5ec00f94d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW56448',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 80034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-17',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi 360',
 'transmission': 'automatic',
 'trim': '360',
 'year': 2015}
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW56448%27 HTTP/1.1" 200 None
2026-03-30 11:51:14 [auto1.de] INFO: Saving data for CW56448: {'auction_closing_time': 1774885255.0, 'created_time': 1774694168.496588, 'last_price_update_time': 1774871474.567107}
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW56448') HTTP/1.1" 204 0
2026-03-30 11:51:14 [auto1.de] INFO: Found listing with ID: DL34972
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL34972%27 HTTP/1.1" 200 None
2026-03-30 11:51:14 [auto1.de] INFO: Scrape type for DL34972: 2
2026-03-30 11:51:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df46b9d6-a35b-5d8f-b100-3abb90134705 with identifier: DL34972
2026-03-30 11:51:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df46b9d6-a35b-5d8f-b100-3abb90134705 with scrape type 2
2026-03-30 11:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df46b9d6-a35b-5d8f-b100-3abb90134705 with scrape type 2
2026-03-30 11:51:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df46b9d6-a35b-5d8f-b100-3abb90134705, identifier: DL34972
2026-03-30 11:51:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df46b9d6-a35b-5d8f-b100-3abb90134705 with identifier: DL34972
2026-03-30 11:51:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df46b9d6-a35b-5d8f-b100-3abb90134705 with identifier: DL34972
2026-03-30 11:51:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df46b9d6-a35b-5d8f-b100-3abb90134705 with identifier: DL34972 to the API
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:03:17Z',
 'fuel_type': 'petrol',
 'id': 'df46b9d6-a35b-5d8f-b100-3abb90134705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL34972',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 161127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-02',
 'seller_name': None,
 'title': 'Hyundai i40 1.6 Trend Blue',
 'transmission': 'manual',
 'trim': 'Trend Blue',
 'year': 2017}
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL34972%27 HTTP/1.1" 200 None
2026-03-30 11:51:14 [auto1.de] INFO: Saving data for DL34972: {'auction_closing_time': 1774882997.0, 'created_time': 1773427051.394267, 'last_price_update_time': 1774871474.950046}
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL34972') HTTP/1.1" 204 0
2026-03-30 11:51:14 [auto1.de] INFO: Found listing with ID: JR73784
2026-03-30 11:51:14 [auto1.de] INFO: Found listing with ID: TK15682
2026-03-30 11:51:14 [auto1.de] INFO: Found listing with ID: ZD10006
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD10006%27 HTTP/1.1" 200 None
2026-03-30 11:51:14 [auto1.de] INFO: Scrape type for ZD10006: 2
2026-03-30 11:51:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with identifier: ZD10006
2026-03-30 11:51:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with scrape type 2
2026-03-30 11:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with scrape type 2
2026-03-30 11:51:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 179f74e2-e4af-5acb-99fb-b8a56a7d87c8, identifier: ZD10006
2026-03-30 11:51:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with identifier: ZD10006
2026-03-30 11:51:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with identifier: ZD10006
2026-03-30 11:51:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with identifier: ZD10006 to the API
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:21:36Z',
 'fuel_type': 'petrol',
 'id': '179f74e2-e4af-5acb-99fb-b8a56a7d87c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD10006',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 132301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-09',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD10006%27 HTTP/1.1" 200 None
2026-03-30 11:51:15 [auto1.de] INFO: Saving data for ZD10006: {'auction_closing_time': 1774884096.0, 'created_time': 1774694200.971985, 'last_price_update_time': 1774871475.334327}
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD10006') HTTP/1.1" 204 0
2026-03-30 11:51:15 [auto1.de] INFO: Found listing with ID: FX32904
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32904%27 HTTP/1.1" 200 None
2026-03-30 11:51:15 [auto1.de] INFO: Scrape type for FX32904: 2
2026-03-30 11:51:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83a13b29-1f3b-5e38-82de-d63f81df926d with identifier: FX32904
2026-03-30 11:51:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83a13b29-1f3b-5e38-82de-d63f81df926d with scrape type 2
2026-03-30 11:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83a13b29-1f3b-5e38-82de-d63f81df926d with scrape type 2
2026-03-30 11:51:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83a13b29-1f3b-5e38-82de-d63f81df926d, identifier: FX32904
2026-03-30 11:51:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83a13b29-1f3b-5e38-82de-d63f81df926d with identifier: FX32904
2026-03-30 11:51:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83a13b29-1f3b-5e38-82de-d63f81df926d with identifier: FX32904
2026-03-30 11:51:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83a13b29-1f3b-5e38-82de-d63f81df926d with identifier: FX32904 to the API
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:10:55Z',
 'fuel_type': 'petrol',
 'id': '83a13b29-1f3b-5e38-82de-d63f81df926d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX32904',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 122294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-08-30',
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 GLS',
 'transmission': 'manual',
 'trim': 'GLS',
 'year': 2004}
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32904%27 HTTP/1.1" 200 None
2026-03-30 11:51:15 [auto1.de] INFO: Saving data for FX32904: {'auction_closing_time': 1774883455.0, 'created_time': 1774694347.458179, 'last_price_update_time': 1774871475.717479}
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX32904') HTTP/1.1" 204 0
2026-03-30 11:51:15 [auto1.de] INFO: Found listing with ID: DT59270
2026-03-30 11:51:15 [auto1.de] INFO: Found listing with ID: SD29600
2026-03-30 11:51:15 [auto1.de] INFO: Found listing with ID: AY51976
2026-03-30 11:51:15 [auto1.de] INFO: Found listing with ID: PB79978
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB79978%27 HTTP/1.1" 200 None
2026-03-30 11:51:15 [auto1.de] INFO: Scrape type for PB79978: 2
2026-03-30 11:51:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with identifier: PB79978
2026-03-30 11:51:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with scrape type 2
2026-03-30 11:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with scrape type 2
2026-03-30 11:51:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 935cdd8d-12b7-5c60-b749-5efc19aed1d9, identifier: PB79978
2026-03-30 11:51:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with identifier: PB79978
2026-03-30 11:51:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with identifier: PB79978
2026-03-30 11:51:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with identifier: PB79978 to the API
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:39:12Z',
 'fuel_type': 'petrol',
 'id': '935cdd8d-12b7-5c60-b749-5efc19aed1d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB79978',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 88914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-28',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2017}
2026-03-30 11:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB79978%27 HTTP/1.1" 200 None
2026-03-30 11:51:16 [auto1.de] INFO: Saving data for PB79978: {'auction_closing_time': 1774885152.0, 'created_time': 1774694352.142157, 'last_price_update_time': 1774871476.111459}
2026-03-30 11:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB79978') HTTP/1.1" 204 0
2026-03-30 11:51:16 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-30 11:51:16 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-30 11:51:16 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-30 11:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX18437%27 HTTP/1.1" 200 None
2026-03-30 11:51:16 [auto1.de] INFO: Scrape type for SX18437: 2
2026-03-30 11:51:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08505e1b-1ad2-576d-a433-f2885f6dfcfc with identifier: SX18437
2026-03-30 11:51:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc with scrape type 2
2026-03-30 11:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc with scrape type 2
2026-03-30 11:51:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08505e1b-1ad2-576d-a433-f2885f6dfcfc, identifier: SX18437
2026-03-30 11:51:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08505e1b-1ad2-576d-a433-f2885f6dfcfc with identifier: SX18437
2026-03-30 11:51:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08505e1b-1ad2-576d-a433-f2885f6dfcfc with identifier: SX18437
2026-03-30 11:51:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08505e1b-1ad2-576d-a433-f2885f6dfcfc with identifier: SX18437 to the API
2026-03-30 11:51:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-30T15:01:49Z',
 'fuel_type': 'petrol',
 'id': '08505e1b-1ad2-576d-a433-f2885f6dfcfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX18437',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 29420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-20',
 'seller_name': None,
 'title': 'Peugeot 108 1.0 VTi TOP Collection',
 'transmission': 'manual',
 'trim': 'TOP Collection',
 'year': 2020}
2026-03-30 11:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX18437%27 HTTP/1.1" 200 None
2026-03-30 11:51:16 [auto1.de] INFO: Saving data for SX18437: {'auction_closing_time': 1774882909.0, 'created_time': 1774694198.402438, 'last_price_update_time': 1774871476.578858}
2026-03-30 11:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX18437') HTTP/1.1" 204 0
2026-03-30 11:51:16 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-30 11:51:16 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-30 11:51:16 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-30 11:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:33 [auto1.de] INFO: Channel: 24h | Page: 239 | totalHits: 9918 | hits on page: 40
2026-03-30 11:51:33 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-30 11:51:33 [auto1.de] INFO: Found listing with ID: HA56884
2026-03-30 11:51:33 [auto1.de] INFO: Found listing with ID: FD80393
2026-03-30 11:51:33 [auto1.de] INFO: Found listing with ID: GF30877
2026-03-30 11:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF30877%27 HTTP/1.1" 200 None
2026-03-30 11:51:33 [auto1.de] INFO: Scrape type for GF30877: 2
2026-03-30 11:51:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with identifier: GF30877
2026-03-30 11:51:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with scrape type 2
2026-03-30 11:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with scrape type 2
2026-03-30 11:51:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3a6b116-b784-5c90-b66e-ba9ca30b5cf9, identifier: GF30877
2026-03-30 11:51:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with identifier: GF30877
2026-03-30 11:51:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with identifier: GF30877
2026-03-30 11:51:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with identifier: GF30877 to the API
2026-03-30 11:51:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:22:32Z',
 'fuel_type': 'diesel',
 'id': 'e3a6b116-b784-5c90-b66e-ba9ca30b5cf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF30877',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 125395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-25',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-30 11:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF30877%27 HTTP/1.1" 200 None
2026-03-30 11:51:33 [auto1.de] INFO: Saving data for GF30877: {'auction_closing_time': 1774884152.0, 'created_time': 1773946982.55872, 'last_price_update_time': 1774871493.468531}
2026-03-30 11:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF30877') HTTP/1.1" 204 0
2026-03-30 11:51:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:33 [auto1.de] INFO: Found listing with ID: CD84483
2026-03-30 11:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD84483%27 HTTP/1.1" 200 None
2026-03-30 11:51:33 [auto1.de] INFO: Scrape type for CD84483: 2
2026-03-30 11:51:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with identifier: CD84483
2026-03-30 11:51:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with scrape type 2
2026-03-30 11:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with scrape type 2
2026-03-30 11:51:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb, identifier: CD84483
2026-03-30 11:51:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with identifier: CD84483
2026-03-30 11:51:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with identifier: CD84483
2026-03-30 11:51:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with identifier: CD84483 to the API
2026-03-30 11:51:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:49Z',
 'fuel_type': 'diesel',
 'id': 'e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD84483',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 191041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-20',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 11:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD84483%27 HTTP/1.1" 200 None
2026-03-30 11:51:33 [auto1.de] INFO: Saving data for CD84483: {'auction_closing_time': 1774885309.0, 'created_time': 1773383273.43793, 'last_price_update_time': 1774871493.936567}
2026-03-30 11:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD84483') HTTP/1.1" 204 0
2026-03-30 11:51:34 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-30 11:51:34 [auto1.de] INFO: Found listing with ID: GM88868
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM88868%27 HTTP/1.1" 200 None
2026-03-30 11:51:34 [auto1.de] INFO: Scrape type for GM88868: 2
2026-03-30 11:51:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with identifier: GM88868
2026-03-30 11:51:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with scrape type 2
2026-03-30 11:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with scrape type 2
2026-03-30 11:51:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7129dd7-5d9c-58fd-a786-ca35f83a0ec9, identifier: GM88868
2026-03-30 11:51:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with identifier: GM88868
2026-03-30 11:51:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with identifier: GM88868
2026-03-30 11:51:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with identifier: GM88868 to the API
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:39:52Z',
 'fuel_type': 'diesel',
 'id': 'c7129dd7-5d9c-58fd-a786-ca35f83a0ec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM88868',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce Verso',
 'odometer': 122558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-26',
 'seller_name': None,
 'title': 'Toyota ProAce Verso 2.0 D-4D L1 Family Comfort',
 'transmission': 'automatic',
 'trim': 'L1 Family Comfort',
 'year': 2021}
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM88868%27 HTTP/1.1" 200 None
2026-03-30 11:51:34 [auto1.de] INFO: Saving data for GM88868: {'auction_closing_time': 1774885192.0, 'created_time': 1773401101.469245, 'last_price_update_time': 1774871494.444942}
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM88868') HTTP/1.1" 204 0
2026-03-30 11:51:34 [auto1.de] INFO: Found listing with ID: AT60125
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT60125%27 HTTP/1.1" 200 None
2026-03-30 11:51:34 [auto1.de] INFO: Scrape type for AT60125: 2
2026-03-30 11:51:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with identifier: AT60125
2026-03-30 11:51:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with scrape type 2
2026-03-30 11:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with scrape type 2
2026-03-30 11:51:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7a90115-bf44-5b9d-b03f-a2efb7f94f77, identifier: AT60125
2026-03-30 11:51:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with identifier: AT60125
2026-03-30 11:51:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with identifier: AT60125
2026-03-30 11:51:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with identifier: AT60125 to the API
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:50:55Z',
 'fuel_type': 'diesel',
 'id': 'd7a90115-bf44-5b9d-b03f-a2efb7f94f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT60125',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 157868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-13',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT60125%27 HTTP/1.1" 200 None
2026-03-30 11:51:34 [auto1.de] INFO: Saving data for AT60125: {'auction_closing_time': 1774885855.0, 'created_time': 1774694188.487276, 'last_price_update_time': 1774871494.831679}
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT60125') HTTP/1.1" 204 0
2026-03-30 11:51:34 [auto1.de] INFO: Found listing with ID: WA47251
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA47251%27 HTTP/1.1" 200 None
2026-03-30 11:51:34 [auto1.de] INFO: Scrape type for WA47251: 2
2026-03-30 11:51:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with identifier: WA47251
2026-03-30 11:51:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with scrape type 2
2026-03-30 11:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with scrape type 2
2026-03-30 11:51:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 016bcf8d-8f85-5ed7-9177-03a81ff48f2f, identifier: WA47251
2026-03-30 11:51:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with identifier: WA47251
2026-03-30 11:51:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with identifier: WA47251
2026-03-30 11:51:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with identifier: WA47251 to the API
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:34:15Z',
 'fuel_type': 'petrol',
 'id': '016bcf8d-8f85-5ed7-9177-03a81ff48f2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA47251',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso-S',
 'odometer': 56588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-19',
 'seller_name': None,
 'title': 'Toyota Verso-S 1.33 Dual VVT-i Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2012}
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA47251%27 HTTP/1.1" 200 None
2026-03-30 11:51:35 [auto1.de] INFO: Saving data for WA47251: {'auction_closing_time': 1774884855.0, 'created_time': 1774694235.697099, 'last_price_update_time': 1774871495.218129}
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA47251') HTTP/1.1" 204 0
2026-03-30 11:51:35 [auto1.de] INFO: Found listing with ID: DA22909
2026-03-30 11:51:35 [auto1.de] INFO: Found listing with ID: RC64872
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64872%27 HTTP/1.1" 200 None
2026-03-30 11:51:35 [auto1.de] INFO: Scrape type for RC64872: 2
2026-03-30 11:51:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64e4cb5-9aec-5664-97ce-719fbb0b1efa with identifier: RC64872
2026-03-30 11:51:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa with scrape type 2
2026-03-30 11:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa with scrape type 2
2026-03-30 11:51:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e64e4cb5-9aec-5664-97ce-719fbb0b1efa, identifier: RC64872
2026-03-30 11:51:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e64e4cb5-9aec-5664-97ce-719fbb0b1efa with identifier: RC64872
2026-03-30 11:51:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e64e4cb5-9aec-5664-97ce-719fbb0b1efa with identifier: RC64872
2026-03-30 11:51:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e64e4cb5-9aec-5664-97ce-719fbb0b1efa with identifier: RC64872 to the API
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:54:48Z',
 'fuel_type': 'petrol',
 'id': 'e64e4cb5-9aec-5664-97ce-719fbb0b1efa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC64872',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 78284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-15',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2008}
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64872%27 HTTP/1.1" 200 None
2026-03-30 11:51:35 [auto1.de] INFO: Saving data for RC64872: {'auction_closing_time': 1774886088.0, 'created_time': 1774694189.227025, 'last_price_update_time': 1774871495.618791}
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC64872') HTTP/1.1" 204 0
2026-03-30 11:51:35 [auto1.de] INFO: Found listing with ID: GV73009
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV73009%27 HTTP/1.1" 200 None
2026-03-30 11:51:35 [auto1.de] INFO: Scrape type for GV73009: 2
2026-03-30 11:51:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b835a100-c137-5ebc-a5a4-6858cd247fdd with identifier: GV73009
2026-03-30 11:51:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b835a100-c137-5ebc-a5a4-6858cd247fdd with scrape type 2
2026-03-30 11:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b835a100-c137-5ebc-a5a4-6858cd247fdd with scrape type 2
2026-03-30 11:51:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b835a100-c137-5ebc-a5a4-6858cd247fdd, identifier: GV73009
2026-03-30 11:51:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b835a100-c137-5ebc-a5a4-6858cd247fdd with identifier: GV73009
2026-03-30 11:51:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b835a100-c137-5ebc-a5a4-6858cd247fdd with identifier: GV73009
2026-03-30 11:51:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b835a100-c137-5ebc-a5a4-6858cd247fdd with identifier: GV73009 to the API
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:02:00Z',
 'fuel_type': 'petrol',
 'id': 'b835a100-c137-5ebc-a5a4-6858cd247fdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV73009',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 65735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-22',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2018}
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV73009%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Saving data for GV73009: {'auction_closing_time': 1774882920.0, 'created_time': 1774002126.769679, 'last_price_update_time': 1774871496.054354}
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV73009') HTTP/1.1" 204 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: SR63291
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63291%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for SR63291: 2
2026-03-30 11:51:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with identifier: SR63291
2026-03-30 11:51:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with scrape type 2
2026-03-30 11:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with scrape type 2
2026-03-30 11:51:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7348ca3-e5e5-50cf-bd19-bbcfd3215afe, identifier: SR63291
2026-03-30 11:51:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with identifier: SR63291
2026-03-30 11:51:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with identifier: SR63291
2026-03-30 11:51:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with identifier: SR63291 to the API
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:03:52Z',
 'fuel_type': 'petrol',
 'id': 'd7348ca3-e5e5-50cf-bd19-bbcfd3215afe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR63291',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 97387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-15',
 'seller_name': None,
 'title': 'Fiat 500C 0.9 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63291%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Saving data for SR63291: {'auction_closing_time': 1774883032.0, 'created_time': 1774032247.76233, 'last_price_update_time': 1774871496.448933}
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR63291') HTTP/1.1" 204 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: BF10429
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: EP03101
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP03101%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for EP03101: 2
2026-03-30 11:51:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb5dc92-ba1e-529c-ad3b-24ef5caca626 with identifier: EP03101
2026-03-30 11:51:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb5dc92-ba1e-529c-ad3b-24ef5caca626 with scrape type 2
2026-03-30 11:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efb5dc92-ba1e-529c-ad3b-24ef5caca626 with scrape type 2
2026-03-30 11:51:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efb5dc92-ba1e-529c-ad3b-24ef5caca626, identifier: EP03101
2026-03-30 11:51:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efb5dc92-ba1e-529c-ad3b-24ef5caca626 with identifier: EP03101
2026-03-30 11:51:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efb5dc92-ba1e-529c-ad3b-24ef5caca626 with identifier: EP03101
2026-03-30 11:51:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efb5dc92-ba1e-529c-ad3b-24ef5caca626 with identifier: EP03101 to the API
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:26:13Z',
 'fuel_type': 'diesel',
 'id': 'efb5dc92-ba1e-529c-ad3b-24ef5caca626',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP03101',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 162474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-15',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2017}
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP03101%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Saving data for EP03101: {'auction_closing_time': 1774884373.0, 'created_time': 1774694237.621273, 'last_price_update_time': 1774871496.82489}
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP03101') HTTP/1.1" 204 0
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: XY13632
2026-03-30 11:51:36 [auto1.de] INFO: Found listing with ID: HA64256
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA64256%27 HTTP/1.1" 200 None
2026-03-30 11:51:36 [auto1.de] INFO: Scrape type for HA64256: 2
2026-03-30 11:51:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5b16257-e87c-536c-81c4-4eac4e3c9c7b with identifier: HA64256
2026-03-30 11:51:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b with scrape type 2
2026-03-30 11:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b with scrape type 2
2026-03-30 11:51:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5b16257-e87c-536c-81c4-4eac4e3c9c7b, identifier: HA64256
2026-03-30 11:51:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5b16257-e87c-536c-81c4-4eac4e3c9c7b with identifier: HA64256
2026-03-30 11:51:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5b16257-e87c-536c-81c4-4eac4e3c9c7b with identifier: HA64256
2026-03-30 11:51:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5b16257-e87c-536c-81c4-4eac4e3c9c7b with identifier: HA64256 to the API
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:45:07Z',
 'fuel_type': 'diesel',
 'id': 'e5b16257-e87c-536c-81c4-4eac4e3c9c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA64256',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 230787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-21',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium S',
 'transmission': 'manual',
 'trim': 'Titanium S',
 'year': 2013}
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA64256%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Saving data for HA64256: {'auction_closing_time': 1774885507.0, 'created_time': 1774694202.404007, 'last_price_update_time': 1774871497.239314}
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA64256') HTTP/1.1" 204 0
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: BH34221
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH34221%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Scrape type for BH34221: 2
2026-03-30 11:51:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with identifier: BH34221
2026-03-30 11:51:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with scrape type 2
2026-03-30 11:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with scrape type 2
2026-03-30 11:51:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e, identifier: BH34221
2026-03-30 11:51:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with identifier: BH34221
2026-03-30 11:51:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with identifier: BH34221
2026-03-30 11:51:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with identifier: BH34221 to the API
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:27:16Z',
 'fuel_type': 'petrol',
 'id': 'a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH34221',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 89105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1994-07-31',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Joy',
 'transmission': 'automatic',
 'trim': 'Joy',
 'year': 1994}
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH34221%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Saving data for BH34221: {'auction_closing_time': 1774884436.0, 'created_time': 1774694212.743347, 'last_price_update_time': 1774871497.711859}
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH34221') HTTP/1.1" 204 0
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: CU51280
2026-03-30 11:51:37 [auto1.de] INFO: Found listing with ID: PT22331
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT22331%27 HTTP/1.1" 200 None
2026-03-30 11:51:37 [auto1.de] INFO: Scrape type for PT22331: 2
2026-03-30 11:51:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f153be52-7eed-5477-8858-c6eb7905279c with identifier: PT22331
2026-03-30 11:51:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f153be52-7eed-5477-8858-c6eb7905279c with scrape type 2
2026-03-30 11:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f153be52-7eed-5477-8858-c6eb7905279c with scrape type 2
2026-03-30 11:51:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f153be52-7eed-5477-8858-c6eb7905279c, identifier: PT22331
2026-03-30 11:51:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f153be52-7eed-5477-8858-c6eb7905279c with identifier: PT22331
2026-03-30 11:51:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f153be52-7eed-5477-8858-c6eb7905279c with identifier: PT22331
2026-03-30 11:51:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f153be52-7eed-5477-8858-c6eb7905279c with identifier: PT22331 to the API
2026-03-30 11:51:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:43:51Z',
 'fuel_type': 'petrol',
 'id': 'f153be52-7eed-5477-8858-c6eb7905279c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT22331',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 132789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-27',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2013}
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT22331%27 HTTP/1.1" 200 None
2026-03-30 11:51:38 [auto1.de] INFO: Saving data for PT22331: {'auction_closing_time': 1774885431.0, 'created_time': 1773398777.031536, 'last_price_update_time': 1774871498.134949}
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT22331') HTTP/1.1" 204 0
2026-03-30 11:51:38 [auto1.de] INFO: Found listing with ID: TS47391
2026-03-30 11:51:38 [auto1.de] INFO: Found listing with ID: JD30879
2026-03-30 11:51:38 [auto1.de] INFO: Found listing with ID: BC15764
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC15764%27 HTTP/1.1" 200 None
2026-03-30 11:51:38 [auto1.de] INFO: Scrape type for BC15764: 2
2026-03-30 11:51:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with identifier: BC15764
2026-03-30 11:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with scrape type 2
2026-03-30 11:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with scrape type 2
2026-03-30 11:51:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 561e8718-84c7-588c-bf25-6bb9f51ff1c1, identifier: BC15764
2026-03-30 11:51:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with identifier: BC15764
2026-03-30 11:51:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with identifier: BC15764
2026-03-30 11:51:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with identifier: BC15764 to the API
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:48:15Z',
 'fuel_type': 'petrol',
 'id': '561e8718-84c7-588c-bf25-6bb9f51ff1c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC15764',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 105416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-10',
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC15764%27 HTTP/1.1" 200 None
2026-03-30 11:51:38 [auto1.de] INFO: Saving data for BC15764: {'auction_closing_time': 1774885695.0, 'created_time': 1774694206.331029, 'last_price_update_time': 1774871498.507464}
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC15764') HTTP/1.1" 204 0
2026-03-30 11:51:38 [auto1.de] INFO: Found listing with ID: YW82863
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW82863%27 HTTP/1.1" 200 None
2026-03-30 11:51:38 [auto1.de] INFO: Scrape type for YW82863: 2
2026-03-30 11:51:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 773025ac-9114-5ff3-bce6-ad06fcf1366b with identifier: YW82863
2026-03-30 11:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 773025ac-9114-5ff3-bce6-ad06fcf1366b with scrape type 2
2026-03-30 11:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 773025ac-9114-5ff3-bce6-ad06fcf1366b with scrape type 2
2026-03-30 11:51:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 773025ac-9114-5ff3-bce6-ad06fcf1366b, identifier: YW82863
2026-03-30 11:51:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 773025ac-9114-5ff3-bce6-ad06fcf1366b with identifier: YW82863
2026-03-30 11:51:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 773025ac-9114-5ff3-bce6-ad06fcf1366b with identifier: YW82863
2026-03-30 11:51:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 773025ac-9114-5ff3-bce6-ad06fcf1366b with identifier: YW82863 to the API
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:13:59Z',
 'fuel_type': 'diesel',
 'id': '773025ac-9114-5ff3-bce6-ad06fcf1366b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW82863',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 182810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-10',
 'seller_name': None,
 'title': 'Opel Crossland X 1.5 CDTI 120 Jahre',
 'transmission': 'automatic',
 'trim': '120 Jahre',
 'year': 2019}
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW82863%27 HTTP/1.1" 200 None
2026-03-30 11:51:38 [auto1.de] INFO: Saving data for YW82863: {'auction_closing_time': 1774883639.0, 'created_time': 1774694209.615634, 'last_price_update_time': 1774871498.93967}
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW82863') HTTP/1.1" 204 0
2026-03-30 11:51:38 [auto1.de] INFO: Found listing with ID: AR37862
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR37862%27 HTTP/1.1" 200 None
2026-03-30 11:51:38 [auto1.de] INFO: Scrape type for AR37862: 2
2026-03-30 11:51:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be914301-f5ec-5d06-972c-f7e752f50444 with identifier: AR37862
2026-03-30 11:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be914301-f5ec-5d06-972c-f7e752f50444 with scrape type 2
2026-03-30 11:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be914301-f5ec-5d06-972c-f7e752f50444 with scrape type 2
2026-03-30 11:51:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be914301-f5ec-5d06-972c-f7e752f50444, identifier: AR37862
2026-03-30 11:51:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be914301-f5ec-5d06-972c-f7e752f50444 with identifier: AR37862
2026-03-30 11:51:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be914301-f5ec-5d06-972c-f7e752f50444 with identifier: AR37862
2026-03-30 11:51:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be914301-f5ec-5d06-972c-f7e752f50444 with identifier: AR37862 to the API
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:25:30Z',
 'fuel_type': 'diesel',
 'id': 'be914301-f5ec-5d06-972c-f7e752f50444',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR37862',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 269526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-06',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR37862%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Saving data for AR37862: {'auction_closing_time': 1774884330.0, 'created_time': 1774694394.995399, 'last_price_update_time': 1774871499.325906}
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR37862') HTTP/1.1" 204 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: XR83794
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR83794%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for XR83794: 2
2026-03-30 11:51:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9f36d93-22b3-5f7b-bc96-916d6060ce90 with identifier: XR83794
2026-03-30 11:51:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9f36d93-22b3-5f7b-bc96-916d6060ce90 with scrape type 2
2026-03-30 11:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9f36d93-22b3-5f7b-bc96-916d6060ce90 with scrape type 2
2026-03-30 11:51:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9f36d93-22b3-5f7b-bc96-916d6060ce90, identifier: XR83794
2026-03-30 11:51:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9f36d93-22b3-5f7b-bc96-916d6060ce90 with identifier: XR83794
2026-03-30 11:51:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9f36d93-22b3-5f7b-bc96-916d6060ce90 with identifier: XR83794
2026-03-30 11:51:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9f36d93-22b3-5f7b-bc96-916d6060ce90 with identifier: XR83794 to the API
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:34:50Z',
 'fuel_type': 'diesel',
 'id': 'd9f36d93-22b3-5f7b-bc96-916d6060ce90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR83794',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 233592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-22',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2016}
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR83794%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Saving data for XR83794: {'auction_closing_time': 1774884890.0, 'created_time': 1773382492.08787, 'last_price_update_time': 1774871499.713116}
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR83794') HTTP/1.1" 204 0
2026-03-30 11:51:39 [auto1.de] INFO: Found listing with ID: DM55805
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM55805%27 HTTP/1.1" 200 None
2026-03-30 11:51:39 [auto1.de] INFO: Scrape type for DM55805: 2
2026-03-30 11:51:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a3f917b-5f2b-5942-8e54-3d38f01058ca with identifier: DM55805
2026-03-30 11:51:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a3f917b-5f2b-5942-8e54-3d38f01058ca with scrape type 2
2026-03-30 11:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a3f917b-5f2b-5942-8e54-3d38f01058ca with scrape type 2
2026-03-30 11:51:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a3f917b-5f2b-5942-8e54-3d38f01058ca, identifier: DM55805
2026-03-30 11:51:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a3f917b-5f2b-5942-8e54-3d38f01058ca with identifier: DM55805
2026-03-30 11:51:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a3f917b-5f2b-5942-8e54-3d38f01058ca with identifier: DM55805
2026-03-30 11:51:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a3f917b-5f2b-5942-8e54-3d38f01058ca with identifier: DM55805 to the API
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:20:15Z',
 'fuel_type': 'petrol',
 'id': '5a3f917b-5f2b-5942-8e54-3d38f01058ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM55805',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 136090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM55805%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.de] INFO: Saving data for DM55805: {'auction_closing_time': 1774884015.0, 'created_time': 1774694358.070033, 'last_price_update_time': 1774871500.096748}
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM55805') HTTP/1.1" 204 0
2026-03-30 11:51:40 [auto1.de] INFO: Found listing with ID: ZF87196
2026-03-30 11:51:40 [auto1.de] INFO: Found listing with ID: DK10749
2026-03-30 11:51:40 [auto1.de] INFO: Found listing with ID: DD00982
2026-03-30 11:51:40 [auto1.de] INFO: Found listing with ID: BR74031
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR74031%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.de] INFO: Scrape type for BR74031: 2
2026-03-30 11:51:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3798b733-219f-5dc5-ab2f-2667d938148a with identifier: BR74031
2026-03-30 11:51:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3798b733-219f-5dc5-ab2f-2667d938148a with scrape type 2
2026-03-30 11:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3798b733-219f-5dc5-ab2f-2667d938148a with scrape type 2
2026-03-30 11:51:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3798b733-219f-5dc5-ab2f-2667d938148a, identifier: BR74031
2026-03-30 11:51:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3798b733-219f-5dc5-ab2f-2667d938148a with identifier: BR74031
2026-03-30 11:51:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3798b733-219f-5dc5-ab2f-2667d938148a with identifier: BR74031
2026-03-30 11:51:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3798b733-219f-5dc5-ab2f-2667d938148a with identifier: BR74031 to the API
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:55:02Z',
 'fuel_type': 'petrol',
 'id': '3798b733-219f-5dc5-ab2f-2667d938148a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR74031',
 'listing': 'auction',
 'make': 'Audi',
 'model': '80',
 'odometer': 188538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1987-12-09',
 'seller_name': None,
 'title': 'Audi 80 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 1987}
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR74031%27 HTTP/1.1" 200 None
2026-03-30 11:51:41 [auto1.de] INFO: Saving data for BR74031: {'auction_closing_time': 1774886102.0, 'created_time': 1774118691.729781, 'last_price_update_time': 1774871501.199253}
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR74031') HTTP/1.1" 204 0
2026-03-30 11:51:41 [auto1.de] INFO: Found listing with ID: JV93942
2026-03-30 11:51:41 [auto1.de] INFO: Found listing with ID: RR37288
2026-03-30 11:51:41 [auto1.de] INFO: Found listing with ID: ZG46471
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG46471%27 HTTP/1.1" 200 None
2026-03-30 11:51:41 [auto1.de] INFO: Scrape type for ZG46471: 2
2026-03-30 11:51:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2bcd83c-a27a-55fa-984e-91e5916927ba with identifier: ZG46471
2026-03-30 11:51:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2bcd83c-a27a-55fa-984e-91e5916927ba with scrape type 2
2026-03-30 11:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2bcd83c-a27a-55fa-984e-91e5916927ba with scrape type 2
2026-03-30 11:51:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2bcd83c-a27a-55fa-984e-91e5916927ba, identifier: ZG46471
2026-03-30 11:51:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2bcd83c-a27a-55fa-984e-91e5916927ba with identifier: ZG46471
2026-03-30 11:51:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2bcd83c-a27a-55fa-984e-91e5916927ba with identifier: ZG46471
2026-03-30 11:51:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2bcd83c-a27a-55fa-984e-91e5916927ba with identifier: ZG46471 to the API
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:00:37Z',
 'fuel_type': 'petrol',
 'id': 'b2bcd83c-a27a-55fa-984e-91e5916927ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG46471',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Orlando',
 'odometer': 113922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-01',
 'seller_name': None,
 'title': 'Chevrolet Orlando 1.8 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2012}
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG46471%27 HTTP/1.1" 200 None
2026-03-30 11:51:41 [auto1.de] INFO: Saving data for ZG46471: {'auction_closing_time': 1774882837.0, 'created_time': 1774035345.555718, 'last_price_update_time': 1774871501.607019}
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG46471') HTTP/1.1" 204 0
2026-03-30 11:51:41 [auto1.de] INFO: Found listing with ID: ZR61272
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR61272%27 HTTP/1.1" 200 None
2026-03-30 11:51:41 [auto1.de] INFO: Scrape type for ZR61272: 2
2026-03-30 11:51:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcb4f497-9e25-55a0-b724-bb623217da7d with identifier: ZR61272
2026-03-30 11:51:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcb4f497-9e25-55a0-b724-bb623217da7d with scrape type 2
2026-03-30 11:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcb4f497-9e25-55a0-b724-bb623217da7d with scrape type 2
2026-03-30 11:51:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bcb4f497-9e25-55a0-b724-bb623217da7d, identifier: ZR61272
2026-03-30 11:51:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bcb4f497-9e25-55a0-b724-bb623217da7d with identifier: ZR61272
2026-03-30 11:51:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bcb4f497-9e25-55a0-b724-bb623217da7d with identifier: ZR61272
2026-03-30 11:51:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bcb4f497-9e25-55a0-b724-bb623217da7d with identifier: ZR61272 to the API
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:26:41Z',
 'fuel_type': 'diesel',
 'id': 'bcb4f497-9e25-55a0-b724-bb623217da7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR61272',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 207080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2014}
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR61272%27 HTTP/1.1" 200 None
2026-03-30 11:51:42 [auto1.de] INFO: Saving data for ZR61272: {'auction_closing_time': 1774884401.0, 'created_time': 1774694320.306227, 'last_price_update_time': 1774871502.000728}
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR61272') HTTP/1.1" 204 0
2026-03-30 11:51:42 [auto1.de] INFO: Found listing with ID: XL20163
2026-03-30 11:51:42 [auto1.de] INFO: Found listing with ID: YU16554
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU16554%27 HTTP/1.1" 200 None
2026-03-30 11:51:42 [auto1.de] INFO: Scrape type for YU16554: 2
2026-03-30 11:51:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 984a1914-17a6-5a58-b562-c04073490779 with identifier: YU16554
2026-03-30 11:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 984a1914-17a6-5a58-b562-c04073490779 with scrape type 2
2026-03-30 11:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 984a1914-17a6-5a58-b562-c04073490779 with scrape type 2
2026-03-30 11:51:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 984a1914-17a6-5a58-b562-c04073490779, identifier: YU16554
2026-03-30 11:51:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 984a1914-17a6-5a58-b562-c04073490779 with identifier: YU16554
2026-03-30 11:51:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 984a1914-17a6-5a58-b562-c04073490779 with identifier: YU16554
2026-03-30 11:51:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 984a1914-17a6-5a58-b562-c04073490779 with identifier: YU16554 to the API
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:42:18Z',
 'fuel_type': 'diesel',
 'id': '984a1914-17a6-5a58-b562-c04073490779',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU16554',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 192828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-30',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU16554%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Saving data for YU16554: {'auction_closing_time': 1774885338.0, 'created_time': 1773946998.261386, 'last_price_update_time': 1774871503.158338}
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU16554') HTTP/1.1" 204 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: PR78588
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR78588%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for PR78588: 2
2026-03-30 11:51:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9531b28b-a3bb-5142-8b97-7531dea6b329 with identifier: PR78588
2026-03-30 11:51:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9531b28b-a3bb-5142-8b97-7531dea6b329 with scrape type 2
2026-03-30 11:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9531b28b-a3bb-5142-8b97-7531dea6b329 with scrape type 2
2026-03-30 11:51:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9531b28b-a3bb-5142-8b97-7531dea6b329, identifier: PR78588
2026-03-30 11:51:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9531b28b-a3bb-5142-8b97-7531dea6b329 with identifier: PR78588
2026-03-30 11:51:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9531b28b-a3bb-5142-8b97-7531dea6b329 with identifier: PR78588
2026-03-30 11:51:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9531b28b-a3bb-5142-8b97-7531dea6b329 with identifier: PR78588 to the API
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:58:41Z',
 'fuel_type': 'diesel',
 'id': '9531b28b-a3bb-5142-8b97-7531dea6b329',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR78588',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 225847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-10',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2014}
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR78588%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Saving data for PR78588: {'auction_closing_time': 1774886321.0, 'created_time': 1774118964.206734, 'last_price_update_time': 1774871503.57127}
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR78588') HTTP/1.1" 204 0
2026-03-30 11:51:43 [auto1.de] INFO: Found listing with ID: RK30802
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK30802%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.de] INFO: Scrape type for RK30802: 2
2026-03-30 11:51:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with identifier: RK30802
2026-03-30 11:51:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with scrape type 2
2026-03-30 11:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with scrape type 2
2026-03-30 11:51:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c, identifier: RK30802
2026-03-30 11:51:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with identifier: RK30802
2026-03-30 11:51:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with identifier: RK30802
2026-03-30 11:51:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with identifier: RK30802 to the API
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:00:07Z',
 'fuel_type': 'petrol',
 'id': '3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK30802',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 190674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-11',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2014}
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK30802%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.de] INFO: Saving data for RK30802: {'auction_closing_time': 1774882807.0, 'created_time': 1774349927.690798, 'last_price_update_time': 1774871504.075997}
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK30802') HTTP/1.1" 204 0
2026-03-30 11:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:46 [auto1.de] INFO: Channel: 24h | Page: 240 | totalHits: 9922 | hits on page: 40
2026-03-30 11:51:46 [auto1.de] INFO: Found listing with ID: XL20163
2026-03-30 11:51:46 [auto1.de] INFO: Found listing with ID: YU16554
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU16554%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.de] INFO: Scrape type for YU16554: 0
2026-03-30 11:51:46 [auto1.de] INFO: Found listing with ID: PR78588
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR78588%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.de] INFO: Scrape type for PR78588: 0
2026-03-30 11:51:46 [auto1.de] INFO: Found listing with ID: RK30802
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK30802%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.de] INFO: Scrape type for RK30802: 0
2026-03-30 11:51:46 [auto1.de] INFO: Found listing with ID: RW03523
2026-03-30 11:51:46 [auto1.de] INFO: Found listing with ID: ZY17523
2026-03-30 11:51:46 [auto1.de] INFO: Found listing with ID: GW53776
2026-03-30 11:51:46 [auto1.de] INFO: Found listing with ID: UB66562
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB66562%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.de] INFO: Scrape type for UB66562: 2
2026-03-30 11:51:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with identifier: UB66562
2026-03-30 11:51:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with scrape type 2
2026-03-30 11:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with scrape type 2
2026-03-30 11:51:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed, identifier: UB66562
2026-03-30 11:51:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with identifier: UB66562
2026-03-30 11:51:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with identifier: UB66562
2026-03-30 11:51:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with identifier: UB66562 to the API
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:04:09Z',
 'fuel_type': 'diesel',
 'id': 'cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB66562',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 202966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-06',
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 JTD 130',
 'transmission': 'manual',
 'trim': '130',
 'year': 2017}
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB66562%27 HTTP/1.1" 200 None
2026-03-30 11:51:47 [auto1.de] INFO: Saving data for UB66562: {'auction_closing_time': 1774883049.0, 'created_time': 1774694343.367679, 'last_price_update_time': 1774871507.223439}
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB66562') HTTP/1.1" 204 0
2026-03-30 11:51:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:47 [auto1.de] INFO: Found listing with ID: PH41345
2026-03-30 11:51:47 [auto1.de] INFO: Found listing with ID: FB79072
2026-03-30 11:51:47 [auto1.de] INFO: Found listing with ID: DY16606
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY16606%27 HTTP/1.1" 200 None
2026-03-30 11:51:47 [auto1.de] INFO: Scrape type for DY16606: 2
2026-03-30 11:51:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with identifier: DY16606
2026-03-30 11:51:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with scrape type 2
2026-03-30 11:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with scrape type 2
2026-03-30 11:51:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e6bc9f2-b57f-5116-95a6-37e82f613bf1, identifier: DY16606
2026-03-30 11:51:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with identifier: DY16606
2026-03-30 11:51:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with identifier: DY16606
2026-03-30 11:51:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with identifier: DY16606 to the API
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:23:50Z',
 'fuel_type': 'petrol',
 'id': '5e6bc9f2-b57f-5116-95a6-37e82f613bf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY16606',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 61153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-25',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY16606%27 HTTP/1.1" 200 None
2026-03-30 11:51:47 [auto1.de] INFO: Saving data for DY16606: {'auction_closing_time': 1774884230.0, 'created_time': 1774694193.535791, 'last_price_update_time': 1774871507.639556}
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY16606') HTTP/1.1" 204 0
2026-03-30 11:51:47 [auto1.de] INFO: Found listing with ID: DK90225
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK90225%27 HTTP/1.1" 200 None
2026-03-30 11:51:47 [auto1.de] INFO: Scrape type for DK90225: 2
2026-03-30 11:51:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 124e09ec-1c44-5b2e-b9b8-a61131db057c with identifier: DK90225
2026-03-30 11:51:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 124e09ec-1c44-5b2e-b9b8-a61131db057c with scrape type 2
2026-03-30 11:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 124e09ec-1c44-5b2e-b9b8-a61131db057c with scrape type 2
2026-03-30 11:51:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 124e09ec-1c44-5b2e-b9b8-a61131db057c, identifier: DK90225
2026-03-30 11:51:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 124e09ec-1c44-5b2e-b9b8-a61131db057c with identifier: DK90225
2026-03-30 11:51:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 124e09ec-1c44-5b2e-b9b8-a61131db057c with identifier: DK90225
2026-03-30 11:51:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 124e09ec-1c44-5b2e-b9b8-a61131db057c with identifier: DK90225 to the API
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:19:49Z',
 'fuel_type': 'diesel',
 'id': '124e09ec-1c44-5b2e-b9b8-a61131db057c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK90225',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 261565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-23',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 CRDi Style AWD',
 'transmission': 'manual',
 'trim': 'Style AWD',
 'year': 2012}
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK90225%27 HTTP/1.1" 200 None
2026-03-30 11:51:48 [auto1.de] INFO: Saving data for DK90225: {'auction_closing_time': 1774883989.0, 'created_time': 1774031875.673412, 'last_price_update_time': 1774871508.164167}
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK90225') HTTP/1.1" 204 0
2026-03-30 11:51:48 [auto1.de] INFO: Found listing with ID: MC13380
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC13380%27 HTTP/1.1" 200 None
2026-03-30 11:51:48 [auto1.de] INFO: Scrape type for MC13380: 2
2026-03-30 11:51:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f744190-c74d-5c3b-9391-86d742611d60 with identifier: MC13380
2026-03-30 11:51:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f744190-c74d-5c3b-9391-86d742611d60 with scrape type 2
2026-03-30 11:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f744190-c74d-5c3b-9391-86d742611d60 with scrape type 2
2026-03-30 11:51:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f744190-c74d-5c3b-9391-86d742611d60, identifier: MC13380
2026-03-30 11:51:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f744190-c74d-5c3b-9391-86d742611d60 with identifier: MC13380
2026-03-30 11:51:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f744190-c74d-5c3b-9391-86d742611d60 with identifier: MC13380
2026-03-30 11:51:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f744190-c74d-5c3b-9391-86d742611d60 with identifier: MC13380 to the API
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:25Z',
 'fuel_type': 'petrol',
 'id': '0f744190-c74d-5c3b-9391-86d742611d60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC13380',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 73,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2020}
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC13380%27 HTTP/1.1" 200 None
2026-03-30 11:51:48 [auto1.de] INFO: Saving data for MC13380: {'auction_closing_time': 1774883125.0, 'created_time': 1774032003.611331, 'last_price_update_time': 1774871508.568452}
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC13380') HTTP/1.1" 204 0
2026-03-30 11:51:48 [auto1.de] INFO: Found listing with ID: KW07987
2026-03-30 11:51:48 [auto1.de] INFO: Found listing with ID: HC06893
2026-03-30 11:51:48 [auto1.de] INFO: Found listing with ID: BM85402
2026-03-30 11:51:48 [auto1.de] INFO: Found listing with ID: CA67550
2026-03-30 11:51:48 [auto1.de] INFO: Found listing with ID: ZG02351
2026-03-30 11:51:48 [auto1.de] INFO: Found listing with ID: TD16668
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD16668%27 HTTP/1.1" 200 None
2026-03-30 11:51:48 [auto1.de] INFO: Scrape type for TD16668: 2
2026-03-30 11:51:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d0020c2-0353-533d-adce-6bd1bb043478 with identifier: TD16668
2026-03-30 11:51:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d0020c2-0353-533d-adce-6bd1bb043478 with scrape type 2
2026-03-30 11:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d0020c2-0353-533d-adce-6bd1bb043478 with scrape type 2
2026-03-30 11:51:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d0020c2-0353-533d-adce-6bd1bb043478, identifier: TD16668
2026-03-30 11:51:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d0020c2-0353-533d-adce-6bd1bb043478 with identifier: TD16668
2026-03-30 11:51:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d0020c2-0353-533d-adce-6bd1bb043478 with identifier: TD16668
2026-03-30 11:51:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d0020c2-0353-533d-adce-6bd1bb043478 with identifier: TD16668 to the API
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:33:24Z',
 'fuel_type': 'petrol',
 'id': '6d0020c2-0353-533d-adce-6bd1bb043478',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD16668',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 161194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-09-09',
 'seller_name': None,
 'title': 'Audi TT 1.8 Turbo Roadster',
 'transmission': 'manual',
 'trim': 'Roadster',
 'year': 2003}
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD16668%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.de] INFO: Saving data for TD16668: {'auction_closing_time': 1774884804.0, 'created_time': 1773427413.427599, 'last_price_update_time': 1774871509.019552}
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD16668') HTTP/1.1" 204 0
2026-03-30 11:51:49 [auto1.de] INFO: Found listing with ID: UK87241
2026-03-30 11:51:49 [auto1.de] INFO: Found listing with ID: GF54285
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54285%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.de] INFO: Scrape type for GF54285: 2
2026-03-30 11:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f338615-b78e-533c-a800-4bc3378e5914 with identifier: GF54285
2026-03-30 11:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f338615-b78e-533c-a800-4bc3378e5914 with scrape type 2
2026-03-30 11:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f338615-b78e-533c-a800-4bc3378e5914 with scrape type 2
2026-03-30 11:51:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f338615-b78e-533c-a800-4bc3378e5914, identifier: GF54285
2026-03-30 11:51:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f338615-b78e-533c-a800-4bc3378e5914 with identifier: GF54285
2026-03-30 11:51:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f338615-b78e-533c-a800-4bc3378e5914 with identifier: GF54285
2026-03-30 11:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f338615-b78e-533c-a800-4bc3378e5914 with identifier: GF54285 to the API
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 295,
 'expiration_date': '2026-03-30T15:11:09Z',
 'fuel_type': 'petrol',
 'id': '9f338615-b78e-533c-a800-4bc3378e5914',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF54285',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayman',
 'odometer': 59722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-24',
 'seller_name': None,
 'title': 'Porsche Cayman S',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54285%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.de] INFO: Saving data for GF54285: {'auction_closing_time': 1774883469.0, 'created_time': 1774694437.31208, 'last_price_update_time': 1774871509.438136}
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF54285') HTTP/1.1" 204 0
2026-03-30 11:51:49 [auto1.de] INFO: Found listing with ID: JM74850
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM74850%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.de] INFO: Scrape type for JM74850: 2
2026-03-30 11:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3eb70cd-2042-5bf9-90f8-52567c64b389 with identifier: JM74850
2026-03-30 11:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3eb70cd-2042-5bf9-90f8-52567c64b389 with scrape type 2
2026-03-30 11:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3eb70cd-2042-5bf9-90f8-52567c64b389 with scrape type 2
2026-03-30 11:51:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3eb70cd-2042-5bf9-90f8-52567c64b389, identifier: JM74850
2026-03-30 11:51:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3eb70cd-2042-5bf9-90f8-52567c64b389 with identifier: JM74850
2026-03-30 11:51:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3eb70cd-2042-5bf9-90f8-52567c64b389 with identifier: JM74850
2026-03-30 11:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3eb70cd-2042-5bf9-90f8-52567c64b389 with identifier: JM74850 to the API
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:08:39Z',
 'fuel_type': 'diesel',
 'id': 'b3eb70cd-2042-5bf9-90f8-52567c64b389',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM74850',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 141603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-19',
 'seller_name': None,
 'title': 'Opel Meriva 1.7 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2011}
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM74850%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.de] INFO: Saving data for JM74850: {'auction_closing_time': 1774883319.0, 'created_time': 1774694436.370204, 'last_price_update_time': 1774871509.848851}
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM74850') HTTP/1.1" 204 0
2026-03-30 11:51:49 [auto1.de] INFO: Found listing with ID: PJ27517
2026-03-30 11:51:49 [auto1.de] INFO: Found listing with ID: MN00804
2026-03-30 11:51:49 [auto1.de] INFO: Found listing with ID: CR42013
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR42013%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.de] INFO: Scrape type for CR42013: 2
2026-03-30 11:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 803d7cd5-1181-5f39-a4cb-4550646e3bdb with identifier: CR42013
2026-03-30 11:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 803d7cd5-1181-5f39-a4cb-4550646e3bdb with scrape type 2
2026-03-30 11:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 803d7cd5-1181-5f39-a4cb-4550646e3bdb with scrape type 2
2026-03-30 11:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 803d7cd5-1181-5f39-a4cb-4550646e3bdb, identifier: CR42013
2026-03-30 11:51:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 803d7cd5-1181-5f39-a4cb-4550646e3bdb with identifier: CR42013
2026-03-30 11:51:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 803d7cd5-1181-5f39-a4cb-4550646e3bdb with identifier: CR42013
2026-03-30 11:51:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 803d7cd5-1181-5f39-a4cb-4550646e3bdb with identifier: CR42013 to the API
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:24:51Z',
 'fuel_type': 'petrol',
 'id': '803d7cd5-1181-5f39-a4cb-4550646e3bdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR42013',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 138881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-28',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI ACT Ambition ultra',
 'transmission': 'manual',
 'trim': 'Ambition ultra',
 'year': 2015}
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR42013%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.de] INFO: Saving data for CR42013: {'auction_closing_time': 1774884291.0, 'created_time': 1774694197.253983, 'last_price_update_time': 1774871510.810167}
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR42013') HTTP/1.1" 204 0
2026-03-30 11:51:50 [auto1.de] INFO: Found listing with ID: GH25955
2026-03-30 11:51:50 [auto1.de] INFO: Found listing with ID: AF81396
2026-03-30 11:51:50 [auto1.de] INFO: Found listing with ID: FJ89028
2026-03-30 11:51:50 [auto1.de] INFO: Found listing with ID: CU69011
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU69011%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.de] INFO: Scrape type for CU69011: 2
2026-03-30 11:51:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd22ca28-403f-5268-aabe-0e6a40051b9a with identifier: CU69011
2026-03-30 11:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd22ca28-403f-5268-aabe-0e6a40051b9a with scrape type 2
2026-03-30 11:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd22ca28-403f-5268-aabe-0e6a40051b9a with scrape type 2
2026-03-30 11:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd22ca28-403f-5268-aabe-0e6a40051b9a, identifier: CU69011
2026-03-30 11:51:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd22ca28-403f-5268-aabe-0e6a40051b9a with identifier: CU69011
2026-03-30 11:51:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd22ca28-403f-5268-aabe-0e6a40051b9a with identifier: CU69011
2026-03-30 11:51:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd22ca28-403f-5268-aabe-0e6a40051b9a with identifier: CU69011 to the API
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-30T15:20:19Z',
 'fuel_type': 'petrol',
 'id': 'bd22ca28-403f-5268-aabe-0e6a40051b9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU69011',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 75347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
 'transmission': 'automatic',
 'trim': 'GTI TCR',
 'year': 2020}
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU69011%27 HTTP/1.1" 200 None
2026-03-30 11:51:51 [auto1.de] INFO: Saving data for CU69011: {'auction_closing_time': 1774884019.0, 'created_time': 1774035193.015698, 'last_price_update_time': 1774871511.855318}
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU69011') HTTP/1.1" 204 0
2026-03-30 11:51:51 [auto1.de] INFO: Found listing with ID: GY71036
2026-03-30 11:51:51 [auto1.de] INFO: Found listing with ID: HB96226
2026-03-30 11:51:51 [auto1.de] INFO: Found listing with ID: GS36349
2026-03-30 11:51:51 [auto1.de] INFO: Found listing with ID: HA50795
2026-03-30 11:51:51 [auto1.de] INFO: Found listing with ID: UZ55149
2026-03-30 11:51:51 [auto1.de] INFO: Found listing with ID: NC03535
2026-03-30 11:51:51 [auto1.de] INFO: Found listing with ID: HR22131
2026-03-30 11:51:51 [auto1.de] INFO: Found listing with ID: YM01256
2026-03-30 11:51:51 [auto1.de] INFO: Found listing with ID: WD92607
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD92607%27 HTTP/1.1" 200 None
2026-03-30 11:51:51 [auto1.de] INFO: Scrape type for WD92607: 2
2026-03-30 11:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54737d39-fdf4-5dfd-86f5-23815799b0a9 with identifier: WD92607
2026-03-30 11:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54737d39-fdf4-5dfd-86f5-23815799b0a9 with scrape type 2
2026-03-30 11:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54737d39-fdf4-5dfd-86f5-23815799b0a9 with scrape type 2
2026-03-30 11:51:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54737d39-fdf4-5dfd-86f5-23815799b0a9, identifier: WD92607
2026-03-30 11:51:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54737d39-fdf4-5dfd-86f5-23815799b0a9 with identifier: WD92607
2026-03-30 11:51:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54737d39-fdf4-5dfd-86f5-23815799b0a9 with identifier: WD92607
2026-03-30 11:51:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54737d39-fdf4-5dfd-86f5-23815799b0a9 with identifier: WD92607 to the API
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:27:59Z',
 'fuel_type': 'petrol',
 'id': '54737d39-fdf4-5dfd-86f5-23815799b0a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD92607',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 164426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-10',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2006}
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD92607%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Saving data for WD92607: {'auction_closing_time': 1774884479.0, 'created_time': 1774694203.288782, 'last_price_update_time': 1774871512.268368}
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD92607') HTTP/1.1" 204 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: GM28208
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM28208%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for GM28208: 2
2026-03-30 11:51:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b18d3337-9dac-5715-b7de-07abedf435ab with identifier: GM28208
2026-03-30 11:51:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b18d3337-9dac-5715-b7de-07abedf435ab with scrape type 2
2026-03-30 11:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b18d3337-9dac-5715-b7de-07abedf435ab with scrape type 2
2026-03-30 11:51:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b18d3337-9dac-5715-b7de-07abedf435ab, identifier: GM28208
2026-03-30 11:51:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b18d3337-9dac-5715-b7de-07abedf435ab with identifier: GM28208
2026-03-30 11:51:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b18d3337-9dac-5715-b7de-07abedf435ab with identifier: GM28208
2026-03-30 11:51:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b18d3337-9dac-5715-b7de-07abedf435ab with identifier: GM28208 to the API
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:24:39Z',
 'fuel_type': 'petrol',
 'id': 'b18d3337-9dac-5715-b7de-07abedf435ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM28208',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Soul',
 'odometer': 244754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-17',
 'seller_name': None,
 'title': 'Kia Soul 1.6 Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2009}
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM28208%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Saving data for GM28208: {'auction_closing_time': 1774884279.0, 'created_time': 1774694195.641473, 'last_price_update_time': 1774871512.748856}
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM28208') HTTP/1.1" 204 0
2026-03-30 11:51:52 [auto1.de] INFO: Found listing with ID: XE92374
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE92374%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.de] INFO: Scrape type for XE92374: 2
2026-03-30 11:51:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8c23c2c-e67e-5a29-8050-c0aa11265903 with identifier: XE92374
2026-03-30 11:51:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c23c2c-e67e-5a29-8050-c0aa11265903 with scrape type 2
2026-03-30 11:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8c23c2c-e67e-5a29-8050-c0aa11265903 with scrape type 2
2026-03-30 11:51:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8c23c2c-e67e-5a29-8050-c0aa11265903, identifier: XE92374
2026-03-30 11:51:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8c23c2c-e67e-5a29-8050-c0aa11265903 with identifier: XE92374
2026-03-30 11:51:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8c23c2c-e67e-5a29-8050-c0aa11265903 with identifier: XE92374
2026-03-30 11:51:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8c23c2c-e67e-5a29-8050-c0aa11265903 with identifier: XE92374 to the API
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:29:26Z',
 'fuel_type': 'petrol',
 'id': 'c8c23c2c-e67e-5a29-8050-c0aa11265903',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE92374',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 96383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-24',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-30 11:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE92374%27 HTTP/1.1" 200 None
2026-03-30 11:51:53 [auto1.de] INFO: Saving data for XE92374: {'auction_closing_time': 1774884566.0, 'created_time': 1774694338.560635, 'last_price_update_time': 1774871513.151773}
2026-03-30 11:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE92374') HTTP/1.1" 204 0
2026-03-30 11:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:54 [auto1.de] INFO: Channel: 24h | Page: 241 | totalHits: 9926 | hits on page: 40
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: YM01256
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: WD92607
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD92607%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for WD92607: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: GM28208
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM28208%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for GM28208: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: XE92374
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE92374%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for XE92374: 0
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: EZ06190
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ06190%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for EZ06190: 2
2026-03-30 11:51:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with identifier: EZ06190
2026-03-30 11:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with scrape type 2
2026-03-30 11:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with scrape type 2
2026-03-30 11:51:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2, identifier: EZ06190
2026-03-30 11:51:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with identifier: EZ06190
2026-03-30 11:51:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with identifier: EZ06190
2026-03-30 11:51:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with identifier: EZ06190 to the API
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:27:56Z',
 'fuel_type': 'diesel',
 'id': '15c44ef8-64b7-58f1-aa0f-aa69c71c22d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ06190',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 171828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-04-13',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2003}
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ06190%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Saving data for EZ06190: {'auction_closing_time': 1774884476.0, 'created_time': 1774694196.872689, 'last_price_update_time': 1774871514.559737}
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ06190') HTTP/1.1" 204 0
2026-03-30 11:51:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: AD09354
2026-03-30 11:51:54 [auto1.de] INFO: Found listing with ID: RE79871
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE79871%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.de] INFO: Scrape type for RE79871: 2
2026-03-30 11:51:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d742c00-bce8-52f3-be15-56c84b379a5f with identifier: RE79871
2026-03-30 11:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d742c00-bce8-52f3-be15-56c84b379a5f with scrape type 2
2026-03-30 11:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d742c00-bce8-52f3-be15-56c84b379a5f with scrape type 2
2026-03-30 11:51:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d742c00-bce8-52f3-be15-56c84b379a5f, identifier: RE79871
2026-03-30 11:51:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d742c00-bce8-52f3-be15-56c84b379a5f with identifier: RE79871
2026-03-30 11:51:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d742c00-bce8-52f3-be15-56c84b379a5f with identifier: RE79871
2026-03-30 11:51:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d742c00-bce8-52f3-be15-56c84b379a5f with identifier: RE79871 to the API
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:09:55Z',
 'fuel_type': 'petrol',
 'id': '4d742c00-bce8-52f3-be15-56c84b379a5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE79871',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 115917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-15',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost SYNC Edition',
 'transmission': 'manual',
 'trim': 'SYNC Edition',
 'year': 2014}
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE79871%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.de] INFO: Saving data for RE79871: {'auction_closing_time': 1774883395.0, 'created_time': 1774694190.366859, 'last_price_update_time': 1774871515.007989}
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE79871') HTTP/1.1" 204 0
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: YD36788
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: EY64053
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: NK14391
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: HA88960
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: CV20886
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: BF20079
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: GJ71513
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71513%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.de] INFO: Scrape type for GJ71513: 2
2026-03-30 11:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcc87069-f6a2-5836-8bb9-53c3df7f289b with identifier: GJ71513
2026-03-30 11:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcc87069-f6a2-5836-8bb9-53c3df7f289b with scrape type 2
2026-03-30 11:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcc87069-f6a2-5836-8bb9-53c3df7f289b with scrape type 2
2026-03-30 11:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcc87069-f6a2-5836-8bb9-53c3df7f289b, identifier: GJ71513
2026-03-30 11:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcc87069-f6a2-5836-8bb9-53c3df7f289b with identifier: GJ71513
2026-03-30 11:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcc87069-f6a2-5836-8bb9-53c3df7f289b with identifier: GJ71513
2026-03-30 11:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcc87069-f6a2-5836-8bb9-53c3df7f289b with identifier: GJ71513 to the API
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:16:02Z',
 'fuel_type': 'diesel',
 'id': 'fcc87069-f6a2-5836-8bb9-53c3df7f289b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ71513',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 169877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-26',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71513%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.de] INFO: Saving data for GJ71513: {'auction_closing_time': 1774883762.0, 'created_time': 1774694236.473767, 'last_price_update_time': 1774871515.421619}
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ71513') HTTP/1.1" 204 0
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: XT67531
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67531%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.de] INFO: Scrape type for XT67531: 2
2026-03-30 11:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61c1af49-815a-504c-a558-02cf66456752 with identifier: XT67531
2026-03-30 11:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61c1af49-815a-504c-a558-02cf66456752 with scrape type 2
2026-03-30 11:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61c1af49-815a-504c-a558-02cf66456752 with scrape type 2
2026-03-30 11:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61c1af49-815a-504c-a558-02cf66456752, identifier: XT67531
2026-03-30 11:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61c1af49-815a-504c-a558-02cf66456752 with identifier: XT67531
2026-03-30 11:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61c1af49-815a-504c-a558-02cf66456752 with identifier: XT67531
2026-03-30 11:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61c1af49-815a-504c-a558-02cf66456752 with identifier: XT67531 to the API
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:45:40Z',
 'fuel_type': 'diesel',
 'id': '61c1af49-815a-504c-a558-02cf66456752',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT67531',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 25866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-11',
 'seller_name': None,
 'title': 'Audi A4 40 TDI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67531%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.de] INFO: Saving data for XT67531: {'auction_closing_time': 1774885540.0, 'created_time': 1773400883.719555, 'last_price_update_time': 1774871515.926902}
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT67531') HTTP/1.1" 204 0
2026-03-30 11:51:55 [auto1.de] INFO: Found listing with ID: PB33753
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB33753%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.de] INFO: Scrape type for PB33753: 2
2026-03-30 11:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4097f511-da79-5ae6-8838-5c787425998b with identifier: PB33753
2026-03-30 11:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4097f511-da79-5ae6-8838-5c787425998b with scrape type 2
2026-03-30 11:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4097f511-da79-5ae6-8838-5c787425998b with scrape type 2
2026-03-30 11:51:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4097f511-da79-5ae6-8838-5c787425998b, identifier: PB33753
2026-03-30 11:51:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4097f511-da79-5ae6-8838-5c787425998b with identifier: PB33753
2026-03-30 11:51:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4097f511-da79-5ae6-8838-5c787425998b with identifier: PB33753
2026-03-30 11:51:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4097f511-da79-5ae6-8838-5c787425998b with identifier: PB33753 to the API
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 449,
 'expiration_date': '2026-03-30T15:50:30Z',
 'fuel_type': 'hybrid',
 'id': '4097f511-da79-5ae6-8838-5c787425998b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB33753',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A8',
 'odometer': 99949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seller_name': None,
 'title': 'Audi A8 60 TFSIe quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB33753%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.de] INFO: Saving data for PB33753: {'auction_closing_time': 1774885830.0, 'created_time': 1774157730.125484, 'last_price_update_time': 1774871516.389264}
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB33753') HTTP/1.1" 204 0
2026-03-30 11:51:56 [auto1.de] INFO: Found listing with ID: TU57767
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU57767%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.de] INFO: Scrape type for TU57767: 2
2026-03-30 11:51:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with identifier: TU57767
2026-03-30 11:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with scrape type 2
2026-03-30 11:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with scrape type 2
2026-03-30 11:51:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bb187f1-529f-5012-a4d4-fe1c6e24e1df, identifier: TU57767
2026-03-30 11:51:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with identifier: TU57767
2026-03-30 11:51:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with identifier: TU57767
2026-03-30 11:51:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with identifier: TU57767 to the API
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:45:46Z',
 'fuel_type': 'petrol',
 'id': '1bb187f1-529f-5012-a4d4-fe1c6e24e1df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU57767',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 54108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seller_name': None,
 'title': 'MINI One Essential Trim',
 'transmission': 'automatic',
 'trim': 'Essential Trim',
 'year': 2022}
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU57767%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.de] INFO: Saving data for TU57767: {'auction_closing_time': 1774885546.0, 'created_time': 1774034539.307449, 'last_price_update_time': 1774871516.780878}
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU57767') HTTP/1.1" 204 0
2026-03-30 11:51:56 [auto1.de] INFO: Found listing with ID: YH86831
2026-03-30 11:51:56 [auto1.de] INFO: Found listing with ID: GU24004
2026-03-30 11:51:56 [auto1.de] INFO: Found listing with ID: KR12848
2026-03-30 11:51:56 [auto1.de] INFO: Found listing with ID: HR78495
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR78495%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.de] INFO: Scrape type for HR78495: 2
2026-03-30 11:51:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with identifier: HR78495
2026-03-30 11:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with scrape type 2
2026-03-30 11:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with scrape type 2
2026-03-30 11:51:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a, identifier: HR78495
2026-03-30 11:51:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with identifier: HR78495
2026-03-30 11:51:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with identifier: HR78495
2026-03-30 11:51:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with identifier: HR78495 to the API
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:45:48Z',
 'fuel_type': 'petrol',
 'id': '1d4587a8-cf35-5bc1-88a2-55a4d6348a0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR78495',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 244554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-30',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR78495%27 HTTP/1.1" 200 None
2026-03-30 11:51:57 [auto1.de] INFO: Saving data for HR78495: {'auction_closing_time': 1774885548.0, 'created_time': 1774694231.535546, 'last_price_update_time': 1774871517.184685}
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR78495') HTTP/1.1" 204 0
2026-03-30 11:51:57 [auto1.de] INFO: Found listing with ID: RR83304
2026-03-30 11:51:57 [auto1.de] INFO: Found listing with ID: UE39516
2026-03-30 11:51:57 [auto1.de] INFO: Found listing with ID: GM93366
2026-03-30 11:51:57 [auto1.de] INFO: Found listing with ID: VV13794
2026-03-30 11:51:57 [auto1.de] INFO: Found listing with ID: RU85035
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU85035%27 HTTP/1.1" 200 None
2026-03-30 11:51:57 [auto1.de] INFO: Scrape type for RU85035: 2
2026-03-30 11:51:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4b5d4e7-2221-54c7-b92b-845280338fb5 with identifier: RU85035
2026-03-30 11:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4b5d4e7-2221-54c7-b92b-845280338fb5 with scrape type 2
2026-03-30 11:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4b5d4e7-2221-54c7-b92b-845280338fb5 with scrape type 2
2026-03-30 11:51:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4b5d4e7-2221-54c7-b92b-845280338fb5, identifier: RU85035
2026-03-30 11:51:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4b5d4e7-2221-54c7-b92b-845280338fb5 with identifier: RU85035
2026-03-30 11:51:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4b5d4e7-2221-54c7-b92b-845280338fb5 with identifier: RU85035
2026-03-30 11:51:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4b5d4e7-2221-54c7-b92b-845280338fb5 with identifier: RU85035 to the API
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:56:28Z',
 'fuel_type': 'petrol',
 'id': 'd4b5d4e7-2221-54c7-b92b-845280338fb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU85035',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 146737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Renault Megane 1.4 TCe Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2012}
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU85035%27 HTTP/1.1" 200 None
2026-03-30 11:51:57 [auto1.de] INFO: Saving data for RU85035: {'auction_closing_time': 1774886188.0, 'created_time': 1774694357.354765, 'last_price_update_time': 1774871517.601336}
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU85035') HTTP/1.1" 204 0
2026-03-30 11:51:57 [auto1.de] INFO: Found listing with ID: YZ93314
2026-03-30 11:51:57 [auto1.de] INFO: Found listing with ID: VJ45584
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ45584%27 HTTP/1.1" 200 None
2026-03-30 11:51:57 [auto1.de] INFO: Scrape type for VJ45584: 2
2026-03-30 11:51:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with identifier: VJ45584
2026-03-30 11:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with scrape type 2
2026-03-30 11:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with scrape type 2
2026-03-30 11:51:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34e114cc-68be-5e54-af11-1d5fd7bb5bc3, identifier: VJ45584
2026-03-30 11:51:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with identifier: VJ45584
2026-03-30 11:51:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with identifier: VJ45584
2026-03-30 11:51:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with identifier: VJ45584 to the API
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:35Z',
 'fuel_type': 'petrol',
 'id': '34e114cc-68be-5e54-af11-1d5fd7bb5bc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ45584',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 137753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-09',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2016}
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ45584%27 HTTP/1.1" 200 None
2026-03-30 11:51:58 [auto1.de] INFO: Saving data for VJ45584: {'auction_closing_time': 1774885115.0, 'created_time': 1774694304.98772, 'last_price_update_time': 1774871518.123795}
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ45584') HTTP/1.1" 204 0
2026-03-30 11:51:58 [auto1.de] INFO: Found listing with ID: ZE64138
2026-03-30 11:51:58 [auto1.de] INFO: Found listing with ID: FH72870
2026-03-30 11:51:58 [auto1.de] INFO: Found listing with ID: GR32471
2026-03-30 11:51:58 [auto1.de] INFO: Found listing with ID: RV36249
2026-03-30 11:51:58 [auto1.de] INFO: Found listing with ID: UB45344
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45344%27 HTTP/1.1" 200 None
2026-03-30 11:51:58 [auto1.de] INFO: Scrape type for UB45344: 2
2026-03-30 11:51:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a9796d0-696a-55e5-92f4-c02db7e684e3 with identifier: UB45344
2026-03-30 11:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a9796d0-696a-55e5-92f4-c02db7e684e3 with scrape type 2
2026-03-30 11:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a9796d0-696a-55e5-92f4-c02db7e684e3 with scrape type 2
2026-03-30 11:51:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a9796d0-696a-55e5-92f4-c02db7e684e3, identifier: UB45344
2026-03-30 11:51:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a9796d0-696a-55e5-92f4-c02db7e684e3 with identifier: UB45344
2026-03-30 11:51:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a9796d0-696a-55e5-92f4-c02db7e684e3 with identifier: UB45344
2026-03-30 11:51:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a9796d0-696a-55e5-92f4-c02db7e684e3 with identifier: UB45344 to the API
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:54Z',
 'fuel_type': 'petrol',
 'id': '2a9796d0-696a-55e5-92f4-c02db7e684e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB45344',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 205575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-04',
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45344%27 HTTP/1.1" 200 None
2026-03-30 11:51:58 [auto1.de] INFO: Saving data for UB45344: {'auction_closing_time': 1774885194.0, 'created_time': 1774694306.941891, 'last_price_update_time': 1774871518.516395}
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB45344') HTTP/1.1" 204 0
2026-03-30 11:51:58 [auto1.de] INFO: Found listing with ID: TJ69669
2026-03-30 11:51:58 [auto1.de] INFO: Found listing with ID: CX33153
2026-03-30 11:51:58 [auto1.de] INFO: Found listing with ID: XL82798
2026-03-30 11:51:58 [auto1.de] INFO: Found listing with ID: NF65282
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65282%27 HTTP/1.1" 200 None
2026-03-30 11:51:58 [auto1.de] INFO: Scrape type for NF65282: 2
2026-03-30 11:51:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8b74cfa-2c76-5a7c-8e97-787bfee53098 with identifier: NF65282
2026-03-30 11:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8b74cfa-2c76-5a7c-8e97-787bfee53098 with scrape type 2
2026-03-30 11:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8b74cfa-2c76-5a7c-8e97-787bfee53098 with scrape type 2
2026-03-30 11:51:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8b74cfa-2c76-5a7c-8e97-787bfee53098, identifier: NF65282
2026-03-30 11:51:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8b74cfa-2c76-5a7c-8e97-787bfee53098 with identifier: NF65282
2026-03-30 11:51:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8b74cfa-2c76-5a7c-8e97-787bfee53098 with identifier: NF65282
2026-03-30 11:51:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8b74cfa-2c76-5a7c-8e97-787bfee53098 with identifier: NF65282 to the API
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:23:46Z',
 'fuel_type': 'petrol',
 'id': 'e8b74cfa-2c76-5a7c-8e97-787bfee53098',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF65282',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 120688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-26',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS 245',
 'transmission': 'automatic',
 'trim': 'RS 245',
 'year': 2020}
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65282%27 HTTP/1.1" 200 None
2026-03-30 11:51:58 [auto1.de] INFO: Saving data for NF65282: {'auction_closing_time': 1774884226.0, 'created_time': 1774350218.094065, 'last_price_update_time': 1774871518.921695}
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF65282') HTTP/1.1" 204 0
2026-03-30 11:51:59 [auto1.de] INFO: Found listing with ID: DE88009
2026-03-30 11:51:59 [auto1.de] INFO: Found listing with ID: HF51839
2026-03-30 11:51:59 [auto1.de] INFO: Found listing with ID: LM10522
2026-03-30 11:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10522%27 HTTP/1.1" 200 None
2026-03-30 11:51:59 [auto1.de] INFO: Scrape type for LM10522: 2
2026-03-30 11:51:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with identifier: LM10522
2026-03-30 11:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with scrape type 2
2026-03-30 11:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with scrape type 2
2026-03-30 11:51:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3, identifier: LM10522
2026-03-30 11:51:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with identifier: LM10522
2026-03-30 11:51:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with identifier: LM10522
2026-03-30 11:51:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with identifier: LM10522 to the API
2026-03-30 11:51:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:17:13Z',
 'fuel_type': 'diesel',
 'id': 'ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM10522',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 274926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-17',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-30 11:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10522%27 HTTP/1.1" 200 None
2026-03-30 11:51:59 [auto1.de] INFO: Saving data for LM10522: {'auction_closing_time': 1774883833.0, 'created_time': 1774694455.470477, 'last_price_update_time': 1774871519.431508}
2026-03-30 11:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM10522') HTTP/1.1" 204 0
2026-03-30 11:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:01 [auto1.de] INFO: Channel: 24h | Page: 242 | totalHits: 9929 | hits on page: 40
2026-03-30 11:52:01 [auto1.de] INFO: Found listing with ID: DE88009
2026-03-30 11:52:01 [auto1.de] INFO: Found listing with ID: HF51839
2026-03-30 11:52:01 [auto1.de] INFO: Found listing with ID: LM10522
2026-03-30 11:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10522%27 HTTP/1.1" 200 None
2026-03-30 11:52:01 [auto1.de] INFO: Scrape type for LM10522: 0
2026-03-30 11:52:01 [auto1.de] INFO: Found listing with ID: VG29831
2026-03-30 11:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG29831%27 HTTP/1.1" 200 None
2026-03-30 11:52:01 [auto1.de] INFO: Scrape type for VG29831: 2
2026-03-30 11:52:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with identifier: VG29831
2026-03-30 11:52:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with scrape type 2
2026-03-30 11:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with scrape type 2
2026-03-30 11:52:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6c7c0a9-8c10-5695-be4f-4099aeac8b34, identifier: VG29831
2026-03-30 11:52:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with identifier: VG29831
2026-03-30 11:52:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with identifier: VG29831
2026-03-30 11:52:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with identifier: VG29831 to the API
2026-03-30 11:52:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:17:42Z',
 'fuel_type': 'petrol',
 'id': 'e6c7c0a9-8c10-5695-be4f-4099aeac8b34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG29831',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 87251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-24',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 YES!',
 'transmission': 'manual',
 'trim': 'YES!',
 'year': 2015}
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG29831%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.de] INFO: Saving data for VG29831: {'auction_closing_time': 1774883862.0, 'created_time': 1774694275.877066, 'last_price_update_time': 1774871522.012523}
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG29831') HTTP/1.1" 204 0
2026-03-30 11:52:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:02 [auto1.de] INFO: Found listing with ID: GX51381
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX51381%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.de] INFO: Scrape type for GX51381: 2
2026-03-30 11:52:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71515936-d968-56b2-a834-e33fb484c195 with identifier: GX51381
2026-03-30 11:52:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71515936-d968-56b2-a834-e33fb484c195 with scrape type 2
2026-03-30 11:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71515936-d968-56b2-a834-e33fb484c195 with scrape type 2
2026-03-30 11:52:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71515936-d968-56b2-a834-e33fb484c195, identifier: GX51381
2026-03-30 11:52:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71515936-d968-56b2-a834-e33fb484c195 with identifier: GX51381
2026-03-30 11:52:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71515936-d968-56b2-a834-e33fb484c195 with identifier: GX51381
2026-03-30 11:52:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71515936-d968-56b2-a834-e33fb484c195 with identifier: GX51381 to the API
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:08:56Z',
 'fuel_type': 'petrol',
 'id': '71515936-d968-56b2-a834-e33fb484c195',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX51381',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 55455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-06',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TSI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2021}
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX51381%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.de] INFO: Saving data for GX51381: {'auction_closing_time': 1774883336.0, 'created_time': 1774694273.6877, 'last_price_update_time': 1774871522.407672}
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX51381') HTTP/1.1" 204 0
2026-03-30 11:52:02 [auto1.de] INFO: Found listing with ID: EC79074
2026-03-30 11:52:02 [auto1.de] INFO: Found listing with ID: YP50016
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP50016%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.de] INFO: Scrape type for YP50016: 2
2026-03-30 11:52:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with identifier: YP50016
2026-03-30 11:52:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with scrape type 2
2026-03-30 11:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with scrape type 2
2026-03-30 11:52:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99, identifier: YP50016
2026-03-30 11:52:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with identifier: YP50016
2026-03-30 11:52:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with identifier: YP50016
2026-03-30 11:52:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with identifier: YP50016 to the API
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:09:20Z',
 'fuel_type': 'diesel',
 'id': 'a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP50016',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 212946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-22',
 'seller_name': None,
 'title': 'Honda Civic 1.6 DTEC Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2014}
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP50016%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.de] INFO: Saving data for YP50016: {'auction_closing_time': 1774883360.0, 'created_time': 1774034636.245534, 'last_price_update_time': 1774871522.795299}
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP50016') HTTP/1.1" 204 0
2026-03-30 11:52:02 [auto1.de] INFO: Found listing with ID: KE20907
2026-03-30 11:52:02 [auto1.de] INFO: Found listing with ID: XN06908
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN06908%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.de] INFO: Scrape type for XN06908: 2
2026-03-30 11:52:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with identifier: XN06908
2026-03-30 11:52:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with scrape type 2
2026-03-30 11:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with scrape type 2
2026-03-30 11:52:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d01d59a-ee3b-566a-8040-a9a8ecc225e8, identifier: XN06908
2026-03-30 11:52:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with identifier: XN06908
2026-03-30 11:52:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with identifier: XN06908
2026-03-30 11:52:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with identifier: XN06908 to the API
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-30T15:52:23Z',
 'fuel_type': 'petrol',
 'id': '6d01d59a-ee3b-566a-8040-a9a8ecc225e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN06908',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 127929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-25',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Skyactiv-G Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2019}
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN06908%27 HTTP/1.1" 200 None
2026-03-30 11:52:03 [auto1.de] INFO: Saving data for XN06908: {'auction_closing_time': 1774885943.0, 'created_time': 1774694359.75549, 'last_price_update_time': 1774871523.213411}
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN06908') HTTP/1.1" 204 0
2026-03-30 11:52:03 [auto1.de] INFO: Found listing with ID: SY64199
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY64199%27 HTTP/1.1" 200 None
2026-03-30 11:52:03 [auto1.de] INFO: Scrape type for SY64199: 2
2026-03-30 11:52:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fc5a3a0-9801-53af-970f-10ff26ba3835 with identifier: SY64199
2026-03-30 11:52:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fc5a3a0-9801-53af-970f-10ff26ba3835 with scrape type 2
2026-03-30 11:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fc5a3a0-9801-53af-970f-10ff26ba3835 with scrape type 2
2026-03-30 11:52:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fc5a3a0-9801-53af-970f-10ff26ba3835, identifier: SY64199
2026-03-30 11:52:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fc5a3a0-9801-53af-970f-10ff26ba3835 with identifier: SY64199
2026-03-30 11:52:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fc5a3a0-9801-53af-970f-10ff26ba3835 with identifier: SY64199
2026-03-30 11:52:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fc5a3a0-9801-53af-970f-10ff26ba3835 with identifier: SY64199 to the API
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:07:04Z',
 'fuel_type': 'petrol',
 'id': '7fc5a3a0-9801-53af-970f-10ff26ba3835',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY64199',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 182142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-19',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY64199%27 HTTP/1.1" 200 None
2026-03-30 11:52:03 [auto1.de] INFO: Saving data for SY64199: {'auction_closing_time': 1774883224.0, 'created_time': 1774694435.998221, 'last_price_update_time': 1774871523.682029}
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY64199') HTTP/1.1" 204 0
2026-03-30 11:52:03 [auto1.de] INFO: Found listing with ID: ZM57049
2026-03-30 11:52:03 [auto1.de] INFO: Found listing with ID: KW41122
2026-03-30 11:52:03 [auto1.de] INFO: Found listing with ID: XV62067
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV62067%27 HTTP/1.1" 200 None
2026-03-30 11:52:03 [auto1.de] INFO: Scrape type for XV62067: 2
2026-03-30 11:52:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with identifier: XV62067
2026-03-30 11:52:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with scrape type 2
2026-03-30 11:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with scrape type 2
2026-03-30 11:52:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2, identifier: XV62067
2026-03-30 11:52:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with identifier: XV62067
2026-03-30 11:52:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with identifier: XV62067
2026-03-30 11:52:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with identifier: XV62067 to the API
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:41:29Z',
 'fuel_type': 'petrol',
 'id': '18d97808-f0bc-552c-8bd0-eeaadb2d7ef2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV62067',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 164146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-04-29',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 1996}
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV62067%27 HTTP/1.1" 200 None
2026-03-30 11:52:04 [auto1.de] INFO: Saving data for XV62067: {'auction_closing_time': 1774885289.0, 'created_time': 1773945976.585571, 'last_price_update_time': 1774871524.079716}
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV62067') HTTP/1.1" 204 0
2026-03-30 11:52:04 [auto1.de] INFO: Found listing with ID: EH91582
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91582%27 HTTP/1.1" 200 None
2026-03-30 11:52:04 [auto1.de] INFO: Scrape type for EH91582: 2
2026-03-30 11:52:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81a41971-c6f3-510c-954d-42f399c3ec57 with identifier: EH91582
2026-03-30 11:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81a41971-c6f3-510c-954d-42f399c3ec57 with scrape type 2
2026-03-30 11:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81a41971-c6f3-510c-954d-42f399c3ec57 with scrape type 2
2026-03-30 11:52:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81a41971-c6f3-510c-954d-42f399c3ec57, identifier: EH91582
2026-03-30 11:52:04 [scrapy.extensions.logstats] INFO: Crawled 946 pages (at 5 pages/min), scraped 1243 items (at 67 items/min)
2026-03-30 11:52:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81a41971-c6f3-510c-954d-42f399c3ec57 with identifier: EH91582
2026-03-30 11:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81a41971-c6f3-510c-954d-42f399c3ec57 with identifier: EH91582
2026-03-30 11:52:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81a41971-c6f3-510c-954d-42f399c3ec57 with identifier: EH91582 to the API
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:00:45Z',
 'fuel_type': 'petrol',
 'id': '81a41971-c6f3-510c-954d-42f399c3ec57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH91582',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 105169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-02',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI I-Tech',
 'transmission': 'manual',
 'trim': 'I-Tech',
 'year': 2014}
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91582%27 HTTP/1.1" 200 None
2026-03-30 11:52:04 [auto1.de] INFO: Saving data for EH91582: {'auction_closing_time': 1774882845.0, 'created_time': 1774694322.227487, 'last_price_update_time': 1774871524.503607}
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH91582') HTTP/1.1" 204 0
2026-03-30 11:52:04 [auto1.de] INFO: Found listing with ID: SG58819
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58819%27 HTTP/1.1" 200 None
2026-03-30 11:52:04 [auto1.de] INFO: Scrape type for SG58819: 2
2026-03-30 11:52:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12c55a55-ee92-5264-82e0-9b651a1d2289 with identifier: SG58819
2026-03-30 11:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12c55a55-ee92-5264-82e0-9b651a1d2289 with scrape type 2
2026-03-30 11:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12c55a55-ee92-5264-82e0-9b651a1d2289 with scrape type 2
2026-03-30 11:52:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12c55a55-ee92-5264-82e0-9b651a1d2289, identifier: SG58819
2026-03-30 11:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12c55a55-ee92-5264-82e0-9b651a1d2289 with identifier: SG58819
2026-03-30 11:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12c55a55-ee92-5264-82e0-9b651a1d2289 with identifier: SG58819
2026-03-30 11:52:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12c55a55-ee92-5264-82e0-9b651a1d2289 with identifier: SG58819 to the API
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 421,
 'expiration_date': '2026-03-30T15:54:21Z',
 'fuel_type': 'petrol',
 'id': '12c55a55-ee92-5264-82e0-9b651a1d2289',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG58819',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'G-Klasse',
 'odometer': 143946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-27',
 'seller_name': None,
 'title': 'Mercedes-Benz G-Klasse G 500',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58819%27 HTTP/1.1" 200 None
2026-03-30 11:52:04 [auto1.de] INFO: Saving data for SG58819: {'auction_closing_time': 1774886061.0, 'created_time': 1774349913.495331, 'last_price_update_time': 1774871524.948508}
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG58819') HTTP/1.1" 204 0
2026-03-30 11:52:04 [auto1.de] INFO: Found listing with ID: EU16330
2026-03-30 11:52:04 [auto1.de] INFO: Found listing with ID: FE70575
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE70575%27 HTTP/1.1" 200 None
2026-03-30 11:52:04 [auto1.de] INFO: Scrape type for FE70575: 2
2026-03-30 11:52:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with identifier: FE70575
2026-03-30 11:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with scrape type 2
2026-03-30 11:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with scrape type 2
2026-03-30 11:52:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45c0f44c-60b5-54b0-8222-5d08a2fb38ab, identifier: FE70575
2026-03-30 11:52:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with identifier: FE70575
2026-03-30 11:52:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with identifier: FE70575
2026-03-30 11:52:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with identifier: FE70575 to the API
2026-03-30 11:52:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:06:57Z',
 'fuel_type': 'hybrid',
 'id': '45c0f44c-60b5-54b0-8222-5d08a2fb38ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE70575',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 48393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-21',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE70575%27 HTTP/1.1" 200 None
2026-03-30 11:52:06 [auto1.de] INFO: Saving data for FE70575: {'auction_closing_time': 1774883217.0, 'created_time': 1774694375.387094, 'last_price_update_time': 1774871526.157956}
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE70575') HTTP/1.1" 204 0
2026-03-30 11:52:06 [auto1.de] INFO: Found listing with ID: TK97651
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK97651%27 HTTP/1.1" 200 None
2026-03-30 11:52:06 [auto1.de] INFO: Scrape type for TK97651: 2
2026-03-30 11:52:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b75c04b3-7995-515e-9f2f-2cafcaffcafd with identifier: TK97651
2026-03-30 11:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75c04b3-7995-515e-9f2f-2cafcaffcafd with scrape type 2
2026-03-30 11:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b75c04b3-7995-515e-9f2f-2cafcaffcafd with scrape type 2
2026-03-30 11:52:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b75c04b3-7995-515e-9f2f-2cafcaffcafd, identifier: TK97651
2026-03-30 11:52:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b75c04b3-7995-515e-9f2f-2cafcaffcafd with identifier: TK97651
2026-03-30 11:52:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b75c04b3-7995-515e-9f2f-2cafcaffcafd with identifier: TK97651
2026-03-30 11:52:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b75c04b3-7995-515e-9f2f-2cafcaffcafd with identifier: TK97651 to the API
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:10:29Z',
 'fuel_type': 'diesel',
 'id': 'b75c04b3-7995-515e-9f2f-2cafcaffcafd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK97651',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 199076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-11',
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK97651%27 HTTP/1.1" 200 None
2026-03-30 11:52:06 [auto1.de] INFO: Saving data for TK97651: {'auction_closing_time': 1774883429.0, 'created_time': 1773946695.393411, 'last_price_update_time': 1774871526.569098}
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK97651') HTTP/1.1" 204 0
2026-03-30 11:52:06 [auto1.de] INFO: Found listing with ID: DR88922
2026-03-30 11:52:06 [auto1.de] INFO: Found listing with ID: SL55745
2026-03-30 11:52:06 [auto1.de] INFO: Found listing with ID: WA61115
2026-03-30 11:52:06 [auto1.de] INFO: Found listing with ID: SJ49235
2026-03-30 11:52:06 [auto1.de] INFO: Found listing with ID: ER21698
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER21698%27 HTTP/1.1" 200 None
2026-03-30 11:52:06 [auto1.de] INFO: Scrape type for ER21698: 2
2026-03-30 11:52:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with identifier: ER21698
2026-03-30 11:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with scrape type 2
2026-03-30 11:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with scrape type 2
2026-03-30 11:52:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a, identifier: ER21698
2026-03-30 11:52:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with identifier: ER21698
2026-03-30 11:52:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with identifier: ER21698
2026-03-30 11:52:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with identifier: ER21698 to the API
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:27:48Z',
 'fuel_type': 'diesel',
 'id': '7b3a2def-38e4-533c-8fe9-46a77f4b4c1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER21698',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 92121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Business VIP L2',
 'transmission': 'automatic',
 'trim': 'Business VIP L2',
 'year': 2021}
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER21698%27 HTTP/1.1" 200 None
2026-03-30 11:52:06 [auto1.de] INFO: Saving data for ER21698: {'auction_closing_time': 1774884468.0, 'created_time': 1774034765.436798, 'last_price_update_time': 1774871526.979922}
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER21698') HTTP/1.1" 204 0
2026-03-30 11:52:07 [auto1.de] INFO: Found listing with ID: BT33018
2026-03-30 11:52:07 [auto1.de] INFO: Found listing with ID: DY33691
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY33691%27 HTTP/1.1" 200 None
2026-03-30 11:52:07 [auto1.de] INFO: Scrape type for DY33691: 2
2026-03-30 11:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdca34c6-973f-594f-951f-40ea40b01917 with identifier: DY33691
2026-03-30 11:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdca34c6-973f-594f-951f-40ea40b01917 with scrape type 2
2026-03-30 11:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdca34c6-973f-594f-951f-40ea40b01917 with scrape type 2
2026-03-30 11:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdca34c6-973f-594f-951f-40ea40b01917, identifier: DY33691
2026-03-30 11:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdca34c6-973f-594f-951f-40ea40b01917 with identifier: DY33691
2026-03-30 11:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdca34c6-973f-594f-951f-40ea40b01917 with identifier: DY33691
2026-03-30 11:52:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdca34c6-973f-594f-951f-40ea40b01917 with identifier: DY33691 to the API
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 285,
 'expiration_date': '2026-03-30T15:14:20Z',
 'fuel_type': 'diesel',
 'id': 'bdca34c6-973f-594f-951f-40ea40b01917',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY33691',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 263215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-22',
 'seller_name': None,
 'title': 'BMW X5 xDrive 35d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY33691%27 HTTP/1.1" 200 None
2026-03-30 11:52:07 [auto1.de] INFO: Saving data for DY33691: {'auction_closing_time': 1774883660.0, 'created_time': 1774694317.574954, 'last_price_update_time': 1774871527.470262}
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY33691') HTTP/1.1" 204 0
2026-03-30 11:52:07 [auto1.de] INFO: Found listing with ID: KT95165
2026-03-30 11:52:07 [auto1.de] INFO: Found listing with ID: WV98635
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV98635%27 HTTP/1.1" 200 None
2026-03-30 11:52:07 [auto1.de] INFO: Scrape type for WV98635: 2
2026-03-30 11:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7971cec-1407-5682-aca5-7e5d833ea3b9 with identifier: WV98635
2026-03-30 11:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7971cec-1407-5682-aca5-7e5d833ea3b9 with scrape type 2
2026-03-30 11:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7971cec-1407-5682-aca5-7e5d833ea3b9 with scrape type 2
2026-03-30 11:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7971cec-1407-5682-aca5-7e5d833ea3b9, identifier: WV98635
2026-03-30 11:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7971cec-1407-5682-aca5-7e5d833ea3b9 with identifier: WV98635
2026-03-30 11:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7971cec-1407-5682-aca5-7e5d833ea3b9 with identifier: WV98635
2026-03-30 11:52:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7971cec-1407-5682-aca5-7e5d833ea3b9 with identifier: WV98635 to the API
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:59:00Z',
 'fuel_type': 'petrol',
 'id': 'a7971cec-1407-5682-aca5-7e5d833ea3b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV98635',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 238227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-09',
 'seller_name': None,
 'title': 'Audi A4 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV98635%27 HTTP/1.1" 200 None
2026-03-30 11:52:07 [auto1.de] INFO: Saving data for WV98635: {'auction_closing_time': 1774886340.0, 'created_time': 1773380193.808751, 'last_price_update_time': 1774871527.8675}
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV98635') HTTP/1.1" 204 0
2026-03-30 11:52:07 [auto1.de] INFO: Found listing with ID: JX65004
2026-03-30 11:52:07 [auto1.de] INFO: Found listing with ID: VG77732
2026-03-30 11:52:07 [auto1.de] INFO: Found listing with ID: MW16405
2026-03-30 11:52:07 [auto1.de] INFO: Found listing with ID: WF26983
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF26983%27 HTTP/1.1" 200 None
2026-03-30 11:52:07 [auto1.de] INFO: Scrape type for WF26983: 2
2026-03-30 11:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with identifier: WF26983
2026-03-30 11:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with scrape type 2
2026-03-30 11:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with scrape type 2
2026-03-30 11:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5, identifier: WF26983
2026-03-30 11:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with identifier: WF26983
2026-03-30 11:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with identifier: WF26983
2026-03-30 11:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with identifier: WF26983 to the API
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:21:05Z',
 'fuel_type': 'diesel',
 'id': '7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF26983',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 164214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-21',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF26983%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Saving data for WF26983: {'auction_closing_time': 1774884065.0, 'created_time': 1774694316.954325, 'last_price_update_time': 1774871528.237209}
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF26983') HTTP/1.1" 204 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: BY24352
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: SV90594
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: CN43056
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: RA08562
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: EL77757
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: MZ03639
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: BS45971
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: PB01809
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB01809%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for PB01809: 2
2026-03-30 11:52:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with identifier: PB01809
2026-03-30 11:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with scrape type 2
2026-03-30 11:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with scrape type 2
2026-03-30 11:52:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907, identifier: PB01809
2026-03-30 11:52:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with identifier: PB01809
2026-03-30 11:52:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with identifier: PB01809
2026-03-30 11:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with identifier: PB01809 to the API
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:21:03Z',
 'fuel_type': 'petrol',
 'id': '7c9efe3b-66b6-5e56-9f8d-49eec0c9e907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB01809',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 57474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-20',
 'seller_name': None,
 'title': 'Fiat 500X 1.6 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2016}
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB01809%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Saving data for PB01809: {'auction_closing_time': 1774884063.0, 'created_time': 1774694318.668045, 'last_price_update_time': 1774871528.646187}
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB01809') HTTP/1.1" 204 0
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: NT95392
2026-03-30 11:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:08 [auto1.de] INFO: Channel: 24h | Page: 243 | totalHits: 9930 | hits on page: 40
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: NT95392
2026-03-30 11:52:08 [auto1.de] INFO: Found listing with ID: DA97993
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA97993%27 HTTP/1.1" 200 None
2026-03-30 11:52:08 [auto1.de] INFO: Scrape type for DA97993: 2
2026-03-30 11:52:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52995c24-6e8c-547b-9aa5-966c7278154e with identifier: DA97993
2026-03-30 11:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52995c24-6e8c-547b-9aa5-966c7278154e with scrape type 2
2026-03-30 11:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52995c24-6e8c-547b-9aa5-966c7278154e with scrape type 2
2026-03-30 11:52:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52995c24-6e8c-547b-9aa5-966c7278154e, identifier: DA97993
2026-03-30 11:52:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52995c24-6e8c-547b-9aa5-966c7278154e with identifier: DA97993
2026-03-30 11:52:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52995c24-6e8c-547b-9aa5-966c7278154e with identifier: DA97993
2026-03-30 11:52:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52995c24-6e8c-547b-9aa5-966c7278154e with identifier: DA97993 to the API
2026-03-30 11:52:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:08:11Z',
 'fuel_type': 'diesel',
 'id': '52995c24-6e8c-547b-9aa5-966c7278154e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA97993',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 171886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-03',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Trendline BlueMotion Tech.',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech.',
 'year': 2013}
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA97993%27 HTTP/1.1" 200 None
2026-03-30 11:52:10 [auto1.de] INFO: Saving data for DA97993: {'auction_closing_time': 1774883291.0, 'created_time': 1774694319.865234, 'last_price_update_time': 1774871530.080789}
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA97993') HTTP/1.1" 204 0
2026-03-30 11:52:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:10 [auto1.de] INFO: Found listing with ID: AD84103
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD84103%27 HTTP/1.1" 200 None
2026-03-30 11:52:10 [auto1.de] INFO: Scrape type for AD84103: 2
2026-03-30 11:52:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1609c20e-b5f6-584f-a876-6176ac2bfe54 with identifier: AD84103
2026-03-30 11:52:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1609c20e-b5f6-584f-a876-6176ac2bfe54 with scrape type 2
2026-03-30 11:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1609c20e-b5f6-584f-a876-6176ac2bfe54 with scrape type 2
2026-03-30 11:52:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1609c20e-b5f6-584f-a876-6176ac2bfe54, identifier: AD84103
2026-03-30 11:52:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1609c20e-b5f6-584f-a876-6176ac2bfe54 with identifier: AD84103
2026-03-30 11:52:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1609c20e-b5f6-584f-a876-6176ac2bfe54 with identifier: AD84103
2026-03-30 11:52:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1609c20e-b5f6-584f-a876-6176ac2bfe54 with identifier: AD84103 to the API
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:59Z',
 'fuel_type': 'petrol',
 'id': '1609c20e-b5f6-584f-a876-6176ac2bfe54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD84103',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 86235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-13',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Monte Carlo',
 'transmission': 'manual',
 'trim': 'Monte Carlo',
 'year': 2018}
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD84103%27 HTTP/1.1" 200 None
2026-03-30 11:52:10 [auto1.de] INFO: Saving data for AD84103: {'auction_closing_time': 1774884539.0, 'created_time': 1774694340.231013, 'last_price_update_time': 1774871530.46707}
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD84103') HTTP/1.1" 204 0
2026-03-30 11:52:10 [auto1.de] INFO: Found listing with ID: NV43592
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV43592%27 HTTP/1.1" 200 None
2026-03-30 11:52:10 [auto1.de] INFO: Scrape type for NV43592: 2
2026-03-30 11:52:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with identifier: NV43592
2026-03-30 11:52:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with scrape type 2
2026-03-30 11:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with scrape type 2
2026-03-30 11:52:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f55ea5d-89ce-55b9-9fb0-fb45030a874c, identifier: NV43592
2026-03-30 11:52:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with identifier: NV43592
2026-03-30 11:52:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with identifier: NV43592
2026-03-30 11:52:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with identifier: NV43592 to the API
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:45:05Z',
 'fuel_type': 'diesel',
 'id': '1f55ea5d-89ce-55b9-9fb0-fb45030a874c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV43592',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 221725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-19',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2013}
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV43592%27 HTTP/1.1" 200 None
2026-03-30 11:52:10 [auto1.de] INFO: Saving data for NV43592: {'auction_closing_time': 1774885505.0, 'created_time': 1774694322.978863, 'last_price_update_time': 1774871530.865408}
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV43592') HTTP/1.1" 204 0
2026-03-30 11:52:10 [auto1.de] INFO: Found listing with ID: PL81843
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL81843%27 HTTP/1.1" 200 None
2026-03-30 11:52:10 [auto1.de] INFO: Scrape type for PL81843: 2
2026-03-30 11:52:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with identifier: PL81843
2026-03-30 11:52:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with scrape type 2
2026-03-30 11:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with scrape type 2
2026-03-30 11:52:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f3806e6-ae0e-5507-8814-b80c53bb1b64, identifier: PL81843
2026-03-30 11:52:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with identifier: PL81843
2026-03-30 11:52:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with identifier: PL81843
2026-03-30 11:52:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with identifier: PL81843 to the API
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:54:00Z',
 'fuel_type': 'petrol',
 'id': '0f3806e6-ae0e-5507-8814-b80c53bb1b64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL81843',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 177365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-13',
 'seller_name': None,
 'title': 'Skoda Superb 1.4 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2010}
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL81843%27 HTTP/1.1" 200 None
2026-03-30 11:52:11 [auto1.de] INFO: Saving data for PL81843: {'auction_closing_time': 1774886040.0, 'created_time': 1773946067.150305, 'last_price_update_time': 1774871531.323449}
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL81843') HTTP/1.1" 204 0
2026-03-30 11:52:11 [auto1.de] INFO: Found listing with ID: FB20065
2026-03-30 11:52:11 [auto1.de] INFO: Found listing with ID: YV73995
2026-03-30 11:52:11 [auto1.de] INFO: Found listing with ID: WW38185
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW38185%27 HTTP/1.1" 200 None
2026-03-30 11:52:11 [auto1.de] INFO: Scrape type for WW38185: 2
2026-03-30 11:52:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5e4fc3a-031c-54c8-a55c-ad86b83df945 with identifier: WW38185
2026-03-30 11:52:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e4fc3a-031c-54c8-a55c-ad86b83df945 with scrape type 2
2026-03-30 11:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5e4fc3a-031c-54c8-a55c-ad86b83df945 with scrape type 2
2026-03-30 11:52:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5e4fc3a-031c-54c8-a55c-ad86b83df945, identifier: WW38185
2026-03-30 11:52:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5e4fc3a-031c-54c8-a55c-ad86b83df945 with identifier: WW38185
2026-03-30 11:52:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5e4fc3a-031c-54c8-a55c-ad86b83df945 with identifier: WW38185
2026-03-30 11:52:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5e4fc3a-031c-54c8-a55c-ad86b83df945 with identifier: WW38185 to the API
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:19:05Z',
 'fuel_type': 'diesel',
 'id': 'c5e4fc3a-031c-54c8-a55c-ad86b83df945',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW38185',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 303451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2010}
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW38185%27 HTTP/1.1" 200 None
2026-03-30 11:52:11 [auto1.de] INFO: Saving data for WW38185: {'auction_closing_time': 1774883945.0, 'created_time': 1774694308.498407, 'last_price_update_time': 1774871531.731855}
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW38185') HTTP/1.1" 204 0
2026-03-30 11:52:11 [auto1.de] INFO: Found listing with ID: UW13690
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13690%27 HTTP/1.1" 200 None
2026-03-30 11:52:11 [auto1.de] INFO: Scrape type for UW13690: 2
2026-03-30 11:52:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dce7078-2a57-5825-87c4-a8037aac5212 with identifier: UW13690
2026-03-30 11:52:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dce7078-2a57-5825-87c4-a8037aac5212 with scrape type 2
2026-03-30 11:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dce7078-2a57-5825-87c4-a8037aac5212 with scrape type 2
2026-03-30 11:52:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0dce7078-2a57-5825-87c4-a8037aac5212, identifier: UW13690
2026-03-30 11:52:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0dce7078-2a57-5825-87c4-a8037aac5212 with identifier: UW13690
2026-03-30 11:52:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0dce7078-2a57-5825-87c4-a8037aac5212 with identifier: UW13690
2026-03-30 11:52:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0dce7078-2a57-5825-87c4-a8037aac5212 with identifier: UW13690 to the API
2026-03-30 11:52:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:05:39Z',
 'fuel_type': 'diesel',
 'id': '0dce7078-2a57-5825-87c4-a8037aac5212',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW13690',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 76083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-06',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13690%27 HTTP/1.1" 200 None
2026-03-30 11:52:12 [auto1.de] INFO: Saving data for UW13690: {'auction_closing_time': 1774883139.0, 'created_time': 1774552702.150152, 'last_price_update_time': 1774871532.118853}
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW13690') HTTP/1.1" 204 0
2026-03-30 11:52:12 [auto1.de] INFO: Found listing with ID: CW14038
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW14038%27 HTTP/1.1" 200 None
2026-03-30 11:52:12 [auto1.de] INFO: Scrape type for CW14038: 2
2026-03-30 11:52:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cae082d-9655-5aa7-9ab3-984921733949 with identifier: CW14038
2026-03-30 11:52:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cae082d-9655-5aa7-9ab3-984921733949 with scrape type 2
2026-03-30 11:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cae082d-9655-5aa7-9ab3-984921733949 with scrape type 2
2026-03-30 11:52:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cae082d-9655-5aa7-9ab3-984921733949, identifier: CW14038
2026-03-30 11:52:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cae082d-9655-5aa7-9ab3-984921733949 with identifier: CW14038
2026-03-30 11:52:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cae082d-9655-5aa7-9ab3-984921733949 with identifier: CW14038
2026-03-30 11:52:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cae082d-9655-5aa7-9ab3-984921733949 with identifier: CW14038 to the API
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:48:35Z',
 'fuel_type': 'diesel',
 'id': '0cae082d-9655-5aa7-9ab3-984921733949',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW14038',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 135660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-03',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2022}
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW14038%27 HTTP/1.1" 200 None
2026-03-30 11:52:12 [auto1.de] INFO: Saving data for CW14038: {'auction_closing_time': 1774885715.0, 'created_time': 1774694385.891554, 'last_price_update_time': 1774871532.504551}
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW14038') HTTP/1.1" 204 0
2026-03-30 11:52:12 [auto1.de] INFO: Found listing with ID: HS42053
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS42053%27 HTTP/1.1" 200 None
2026-03-30 11:52:12 [auto1.de] INFO: Scrape type for HS42053: 2
2026-03-30 11:52:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44147b12-2026-515b-8f70-10bce9503174 with identifier: HS42053
2026-03-30 11:52:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44147b12-2026-515b-8f70-10bce9503174 with scrape type 2
2026-03-30 11:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44147b12-2026-515b-8f70-10bce9503174 with scrape type 2
2026-03-30 11:52:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44147b12-2026-515b-8f70-10bce9503174, identifier: HS42053
2026-03-30 11:52:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44147b12-2026-515b-8f70-10bce9503174 with identifier: HS42053
2026-03-30 11:52:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44147b12-2026-515b-8f70-10bce9503174 with identifier: HS42053
2026-03-30 11:52:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44147b12-2026-515b-8f70-10bce9503174 with identifier: HS42053 to the API
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:36:51Z',
 'fuel_type': 'electro',
 'id': '44147b12-2026-515b-8f70-10bce9503174',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS42053',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 54253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-19',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 150 kW Pro Performance',
 'transmission': 'automatic',
 'trim': 'Pro Performance',
 'year': 2021}
2026-03-30 11:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS42053%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.de] INFO: Saving data for HS42053: {'auction_closing_time': 1774885011.0, 'created_time': 1774553211.478106, 'last_price_update_time': 1774871533.007442}
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS42053') HTTP/1.1" 204 0
2026-03-30 11:52:13 [auto1.de] INFO: Found listing with ID: JX55294
2026-03-30 11:52:13 [auto1.de] INFO: Found listing with ID: PY14416
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY14416%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.de] INFO: Scrape type for PY14416: 2
2026-03-30 11:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with identifier: PY14416
2026-03-30 11:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with scrape type 2
2026-03-30 11:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with scrape type 2
2026-03-30 11:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970, identifier: PY14416
2026-03-30 11:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with identifier: PY14416
2026-03-30 11:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with identifier: PY14416
2026-03-30 11:52:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with identifier: PY14416 to the API
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:23:24Z',
 'fuel_type': 'petrol',
 'id': '0f3ab19c-7ba2-5bf8-9f71-95a03e60f970',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY14416',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 162831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-05',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2013}
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY14416%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.de] INFO: Saving data for PY14416: {'auction_closing_time': 1774884204.0, 'created_time': 1774694349.809742, 'last_price_update_time': 1774871533.410582}
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY14416') HTTP/1.1" 204 0
2026-03-30 11:52:13 [auto1.de] INFO: Found listing with ID: BK93979
2026-03-30 11:52:13 [auto1.de] INFO: Found listing with ID: LC65511
2026-03-30 11:52:13 [auto1.de] INFO: Found listing with ID: DM10226
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM10226%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.de] INFO: Scrape type for DM10226: 2
2026-03-30 11:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with identifier: DM10226
2026-03-30 11:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with scrape type 2
2026-03-30 11:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with scrape type 2
2026-03-30 11:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704, identifier: DM10226
2026-03-30 11:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with identifier: DM10226
2026-03-30 11:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with identifier: DM10226
2026-03-30 11:52:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with identifier: DM10226 to the API
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:45:50Z',
 'fuel_type': 'petrol',
 'id': '1f4d39f2-46b2-5982-b2d2-c8a14d4e5704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM10226',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 4507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-29',
 'seller_name': None,
 'title': 'Opel Mokka 1.2 Turbo GS',
 'transmission': 'automatic',
 'trim': 'GS',
 'year': 2024}
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM10226%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.de] INFO: Saving data for DM10226: {'auction_closing_time': 1774885550.0, 'created_time': 1774694333.867462, 'last_price_update_time': 1774871533.810573}
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM10226') HTTP/1.1" 204 0
2026-03-30 11:52:13 [auto1.de] INFO: Found listing with ID: NH74164
2026-03-30 11:52:13 [auto1.de] INFO: Found listing with ID: EE69038
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE69038%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.de] INFO: Scrape type for EE69038: 2
2026-03-30 11:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with identifier: EE69038
2026-03-30 11:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with scrape type 2
2026-03-30 11:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with scrape type 2
2026-03-30 11:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48, identifier: EE69038
2026-03-30 11:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with identifier: EE69038
2026-03-30 11:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with identifier: EE69038
2026-03-30 11:52:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with identifier: EE69038 to the API
2026-03-30 11:52:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:02:18Z',
 'fuel_type': 'petrol',
 'id': 'f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE69038',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 154555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-24',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.2 MyLife',
 'transmission': 'manual',
 'trim': 'MyLife',
 'year': 2011}
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE69038%27 HTTP/1.1" 200 None
2026-03-30 11:52:15 [auto1.de] INFO: Saving data for EE69038: {'auction_closing_time': 1774882938.0, 'created_time': 1774694341.497831, 'last_price_update_time': 1774871535.061214}
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE69038') HTTP/1.1" 204 0
2026-03-30 11:52:15 [auto1.de] INFO: Found listing with ID: PA12194
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA12194%27 HTTP/1.1" 200 None
2026-03-30 11:52:15 [auto1.de] INFO: Scrape type for PA12194: 2
2026-03-30 11:52:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with identifier: PA12194
2026-03-30 11:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with scrape type 2
2026-03-30 11:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with scrape type 2
2026-03-30 11:52:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545, identifier: PA12194
2026-03-30 11:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with identifier: PA12194
2026-03-30 11:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with identifier: PA12194
2026-03-30 11:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with identifier: PA12194 to the API
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:41:24Z',
 'fuel_type': 'petrol',
 'id': '14b4fa88-bc89-5d07-aaf1-cba3ce7bc545',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA12194',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 88046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-22',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA12194%27 HTTP/1.1" 200 None
2026-03-30 11:52:15 [auto1.de] INFO: Saving data for PA12194: {'auction_closing_time': 1774885284.0, 'created_time': 1774694342.309507, 'last_price_update_time': 1774871535.430669}
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA12194') HTTP/1.1" 204 0
2026-03-30 11:52:15 [auto1.de] INFO: Found listing with ID: HZ13405
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13405%27 HTTP/1.1" 200 None
2026-03-30 11:52:15 [auto1.de] INFO: Scrape type for HZ13405: 2
2026-03-30 11:52:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eee8243-4694-54fd-abdc-e9a7f0b65314 with identifier: HZ13405
2026-03-30 11:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eee8243-4694-54fd-abdc-e9a7f0b65314 with scrape type 2
2026-03-30 11:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3eee8243-4694-54fd-abdc-e9a7f0b65314 with scrape type 2
2026-03-30 11:52:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3eee8243-4694-54fd-abdc-e9a7f0b65314, identifier: HZ13405
2026-03-30 11:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3eee8243-4694-54fd-abdc-e9a7f0b65314 with identifier: HZ13405
2026-03-30 11:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3eee8243-4694-54fd-abdc-e9a7f0b65314 with identifier: HZ13405
2026-03-30 11:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3eee8243-4694-54fd-abdc-e9a7f0b65314 with identifier: HZ13405 to the API
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:29:56Z',
 'fuel_type': 'diesel',
 'id': '3eee8243-4694-54fd-abdc-e9a7f0b65314',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ13405',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 168380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-04',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Cool&Connect',
 'transmission': 'automatic',
 'trim': 'Cool&Connect',
 'year': 2018}
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13405%27 HTTP/1.1" 200 None
2026-03-30 11:52:15 [auto1.de] INFO: Saving data for HZ13405: {'auction_closing_time': 1774884596.0, 'created_time': 1774694339.786667, 'last_price_update_time': 1774871535.805876}
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ13405') HTTP/1.1" 204 0
2026-03-30 11:52:15 [auto1.de] INFO: Found listing with ID: CG50140
2026-03-30 11:52:15 [auto1.de] INFO: Found listing with ID: YL16347
2026-03-30 11:52:15 [auto1.de] INFO: Found listing with ID: MN41763
2026-03-30 11:52:15 [auto1.de] INFO: Found listing with ID: LU05124
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05124%27 HTTP/1.1" 200 None
2026-03-30 11:52:15 [auto1.de] INFO: Scrape type for LU05124: 2
2026-03-30 11:52:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3afa6242-ac63-57f4-8d95-e67435e84324 with identifier: LU05124
2026-03-30 11:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3afa6242-ac63-57f4-8d95-e67435e84324 with scrape type 2
2026-03-30 11:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3afa6242-ac63-57f4-8d95-e67435e84324 with scrape type 2
2026-03-30 11:52:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3afa6242-ac63-57f4-8d95-e67435e84324, identifier: LU05124
2026-03-30 11:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3afa6242-ac63-57f4-8d95-e67435e84324 with identifier: LU05124
2026-03-30 11:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3afa6242-ac63-57f4-8d95-e67435e84324 with identifier: LU05124
2026-03-30 11:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3afa6242-ac63-57f4-8d95-e67435e84324 with identifier: LU05124 to the API
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:54:02Z',
 'fuel_type': 'diesel',
 'id': '3afa6242-ac63-57f4-8d95-e67435e84324',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU05124',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 187871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-28',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05124%27 HTTP/1.1" 200 None
2026-03-30 11:52:16 [auto1.de] INFO: Saving data for LU05124: {'auction_closing_time': 1774886042.0, 'created_time': 1774350682.46448, 'last_price_update_time': 1774871536.206855}
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU05124') HTTP/1.1" 204 0
2026-03-30 11:52:16 [auto1.de] INFO: Found listing with ID: SY55071
2026-03-30 11:52:16 [auto1.de] INFO: Found listing with ID: TJ50371
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ50371%27 HTTP/1.1" 200 None
2026-03-30 11:52:16 [auto1.de] INFO: Scrape type for TJ50371: 2
2026-03-30 11:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71b4971d-294a-5961-a0bf-9ede159beb09 with identifier: TJ50371
2026-03-30 11:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71b4971d-294a-5961-a0bf-9ede159beb09 with scrape type 2
2026-03-30 11:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71b4971d-294a-5961-a0bf-9ede159beb09 with scrape type 2
2026-03-30 11:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71b4971d-294a-5961-a0bf-9ede159beb09, identifier: TJ50371
2026-03-30 11:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71b4971d-294a-5961-a0bf-9ede159beb09 with identifier: TJ50371
2026-03-30 11:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71b4971d-294a-5961-a0bf-9ede159beb09 with identifier: TJ50371
2026-03-30 11:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71b4971d-294a-5961-a0bf-9ede159beb09 with identifier: TJ50371 to the API
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 97,
 'expiration_date': '2026-03-30T15:50:45Z',
 'fuel_type': 'petrol',
 'id': '71b4971d-294a-5961-a0bf-9ede159beb09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ50371',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 131303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-30',
 'seller_name': None,
 'title': 'Toyota Corolla 1.4 Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2004}
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ50371%27 HTTP/1.1" 200 None
2026-03-30 11:52:16 [auto1.de] INFO: Saving data for TJ50371: {'auction_closing_time': 1774885845.0, 'created_time': 1774694332.777912, 'last_price_update_time': 1774871536.688739}
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ50371') HTTP/1.1" 204 0
2026-03-30 11:52:16 [auto1.de] INFO: Found listing with ID: WT57840
2026-03-30 11:52:16 [auto1.de] INFO: Found listing with ID: BZ34179
2026-03-30 11:52:16 [auto1.de] INFO: Found listing with ID: PA26532
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA26532%27 HTTP/1.1" 200 None
2026-03-30 11:52:16 [auto1.de] INFO: Scrape type for PA26532: 2
2026-03-30 11:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with identifier: PA26532
2026-03-30 11:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with scrape type 2
2026-03-30 11:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with scrape type 2
2026-03-30 11:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71, identifier: PA26532
2026-03-30 11:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with identifier: PA26532
2026-03-30 11:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with identifier: PA26532
2026-03-30 11:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with identifier: PA26532 to the API
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 188,
 'expiration_date': '2026-03-30T15:49:21Z',
 'fuel_type': 'hybrid',
 'id': '962d0dc1-404c-52b5-9ff2-4cbdfd71cd71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA26532',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 48503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-11',
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 2.4 Plug-in Hybrid Plus Select Black 4WD',
 'transmission': 'automatic',
 'trim': 'Plus Select Black 4WD',
 'year': 2022}
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA26532%27 HTTP/1.1" 200 None
2026-03-30 11:52:18 [auto1.de] INFO: Saving data for PA26532: {'auction_closing_time': 1774885761.0, 'created_time': 1774350591.579727, 'last_price_update_time': 1774871538.122768}
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA26532') HTTP/1.1" 204 0
2026-03-30 11:52:18 [auto1.de] INFO: Found listing with ID: CY89611
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY89611%27 HTTP/1.1" 200 None
2026-03-30 11:52:18 [auto1.de] INFO: Scrape type for CY89611: 2
2026-03-30 11:52:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05e63a9c-5207-5003-84cf-f73000dbb885 with identifier: CY89611
2026-03-30 11:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05e63a9c-5207-5003-84cf-f73000dbb885 with scrape type 2
2026-03-30 11:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05e63a9c-5207-5003-84cf-f73000dbb885 with scrape type 2
2026-03-30 11:52:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05e63a9c-5207-5003-84cf-f73000dbb885, identifier: CY89611
2026-03-30 11:52:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05e63a9c-5207-5003-84cf-f73000dbb885 with identifier: CY89611
2026-03-30 11:52:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05e63a9c-5207-5003-84cf-f73000dbb885 with identifier: CY89611
2026-03-30 11:52:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05e63a9c-5207-5003-84cf-f73000dbb885 with identifier: CY89611 to the API
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:44:49Z',
 'fuel_type': 'petrol',
 'id': '05e63a9c-5207-5003-84cf-f73000dbb885',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY89611',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 140067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-04',
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY89611%27 HTTP/1.1" 200 None
2026-03-30 11:52:18 [auto1.de] INFO: Saving data for CY89611: {'auction_closing_time': 1774885489.0, 'created_time': 1774694334.578788, 'last_price_update_time': 1774871538.525011}
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY89611') HTTP/1.1" 204 0
2026-03-30 11:52:18 [auto1.de] INFO: Found listing with ID: GZ42240
2026-03-30 11:52:18 [auto1.de] INFO: Found listing with ID: DV90621
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV90621%27 HTTP/1.1" 200 None
2026-03-30 11:52:18 [auto1.de] INFO: Scrape type for DV90621: 2
2026-03-30 11:52:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cfc6c51-3297-5da6-937a-7825f7130efd with identifier: DV90621
2026-03-30 11:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cfc6c51-3297-5da6-937a-7825f7130efd with scrape type 2
2026-03-30 11:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cfc6c51-3297-5da6-937a-7825f7130efd with scrape type 2
2026-03-30 11:52:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cfc6c51-3297-5da6-937a-7825f7130efd, identifier: DV90621
2026-03-30 11:52:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cfc6c51-3297-5da6-937a-7825f7130efd with identifier: DV90621
2026-03-30 11:52:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cfc6c51-3297-5da6-937a-7825f7130efd with identifier: DV90621
2026-03-30 11:52:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cfc6c51-3297-5da6-937a-7825f7130efd with identifier: DV90621 to the API
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:50:16Z',
 'fuel_type': 'diesel',
 'id': '0cfc6c51-3297-5da6-937a-7825f7130efd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV90621',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 330869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-22',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 HDi Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2010}
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV90621%27 HTTP/1.1" 200 None
2026-03-30 11:52:18 [auto1.de] INFO: Saving data for DV90621: {'auction_closing_time': 1774885816.0, 'created_time': 1773428457.471864, 'last_price_update_time': 1774871538.96686}
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV90621') HTTP/1.1" 204 0
2026-03-30 11:52:18 [auto1.de] INFO: Found listing with ID: DZ63249
2026-03-30 11:52:18 [auto1.de] INFO: Found listing with ID: MN76950
2026-03-30 11:52:18 [auto1.de] INFO: Found listing with ID: AG97842
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG97842%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Scrape type for AG97842: 2
2026-03-30 11:52:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with identifier: AG97842
2026-03-30 11:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with scrape type 2
2026-03-30 11:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with scrape type 2
2026-03-30 11:52:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46, identifier: AG97842
2026-03-30 11:52:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with identifier: AG97842
2026-03-30 11:52:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with identifier: AG97842
2026-03-30 11:52:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with identifier: AG97842 to the API
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:27:24Z',
 'fuel_type': 'petrol',
 'id': '9c00e65f-51fe-5c96-b9f6-8f699b1ebe46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG97842',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 88272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-25',
 'seller_name': None,
 'title': 'Dacia Dokker 1.2 TCe Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2017}
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG97842%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Saving data for AG97842: {'auction_closing_time': 1774884444.0, 'created_time': 1774694324.715576, 'last_price_update_time': 1774871539.374235}
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG97842') HTTP/1.1" 204 0
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: KV46000
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: LA95104
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA95104%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Scrape type for LA95104: 2
2026-03-30 11:52:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with identifier: LA95104
2026-03-30 11:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with scrape type 2
2026-03-30 11:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with scrape type 2
2026-03-30 11:52:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08, identifier: LA95104
2026-03-30 11:52:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with identifier: LA95104
2026-03-30 11:52:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with identifier: LA95104
2026-03-30 11:52:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with identifier: LA95104 to the API
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:28:34Z',
 'fuel_type': 'petrol',
 'id': '9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA95104',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 37546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-23',
 'seller_name': None,
 'title': 'Renault Twingo 0.9 TCe Le Coq Sportif',
 'transmission': 'automatic',
 'trim': 'Le Coq Sportif',
 'year': 2019}
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA95104%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Saving data for LA95104: {'auction_closing_time': 1774884514.0, 'created_time': 1774694328.313199, 'last_price_update_time': 1774871539.894964}
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA95104') HTTP/1.1" 204 0
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: TA12646
2026-03-30 11:52:19 [auto1.de] INFO: Found listing with ID: LX44847
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX44847%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.de] INFO: Scrape type for LX44847: 2
2026-03-30 11:52:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5b185f9-2494-5a2f-b23c-65840b646c05 with identifier: LX44847
2026-03-30 11:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5b185f9-2494-5a2f-b23c-65840b646c05 with scrape type 2
2026-03-30 11:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5b185f9-2494-5a2f-b23c-65840b646c05 with scrape type 2
2026-03-30 11:52:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5b185f9-2494-5a2f-b23c-65840b646c05, identifier: LX44847
2026-03-30 11:52:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5b185f9-2494-5a2f-b23c-65840b646c05 with identifier: LX44847
2026-03-30 11:52:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5b185f9-2494-5a2f-b23c-65840b646c05 with identifier: LX44847
2026-03-30 11:52:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5b185f9-2494-5a2f-b23c-65840b646c05 with identifier: LX44847 to the API
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:50Z',
 'fuel_type': 'diesel',
 'id': 'a5b185f9-2494-5a2f-b23c-65840b646c05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX44847',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 194225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-17',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX44847%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.de] INFO: Saving data for LX44847: {'auction_closing_time': 1774882850.0, 'created_time': 1774694343.77001, 'last_price_update_time': 1774871540.357207}
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX44847') HTTP/1.1" 204 0
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: LB45550
2026-03-30 11:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:20 [auto1.de] INFO: Channel: 24h | Page: 244 | totalHits: 9931 | hits on page: 40
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: LB45550
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: VG58612
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: YC71395
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: GG20866
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG20866%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.de] INFO: Scrape type for GG20866: 2
2026-03-30 11:52:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 390eeb7e-0948-53dc-b8eb-5e019d019e36 with identifier: GG20866
2026-03-30 11:52:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 390eeb7e-0948-53dc-b8eb-5e019d019e36 with scrape type 2
2026-03-30 11:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 390eeb7e-0948-53dc-b8eb-5e019d019e36 with scrape type 2
2026-03-30 11:52:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 390eeb7e-0948-53dc-b8eb-5e019d019e36, identifier: GG20866
2026-03-30 11:52:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 390eeb7e-0948-53dc-b8eb-5e019d019e36 with identifier: GG20866
2026-03-30 11:52:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 390eeb7e-0948-53dc-b8eb-5e019d019e36 with identifier: GG20866
2026-03-30 11:52:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 390eeb7e-0948-53dc-b8eb-5e019d019e36 with identifier: GG20866 to the API
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:59:27Z',
 'fuel_type': 'petrol',
 'id': '390eeb7e-0948-53dc-b8eb-5e019d019e36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG20866',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 160581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-18',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG20866%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.de] INFO: Saving data for GG20866: {'auction_closing_time': 1774886367.0, 'created_time': 1773429035.282637, 'last_price_update_time': 1774871540.941606}
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG20866') HTTP/1.1" 204 0
2026-03-30 11:52:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: SW39146
2026-03-30 11:52:20 [auto1.de] INFO: Found listing with ID: WY65265
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY65265%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.de] INFO: Scrape type for WY65265: 2
2026-03-30 11:52:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13725041-f5f9-5e70-b087-3e2c0b642cc2 with identifier: WY65265
2026-03-30 11:52:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13725041-f5f9-5e70-b087-3e2c0b642cc2 with scrape type 2
2026-03-30 11:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13725041-f5f9-5e70-b087-3e2c0b642cc2 with scrape type 2
2026-03-30 11:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13725041-f5f9-5e70-b087-3e2c0b642cc2, identifier: WY65265
2026-03-30 11:52:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13725041-f5f9-5e70-b087-3e2c0b642cc2 with identifier: WY65265
2026-03-30 11:52:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13725041-f5f9-5e70-b087-3e2c0b642cc2 with identifier: WY65265
2026-03-30 11:52:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13725041-f5f9-5e70-b087-3e2c0b642cc2 with identifier: WY65265 to the API
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:24:03Z',
 'fuel_type': 'diesel',
 'id': '13725041-f5f9-5e70-b087-3e2c0b642cc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY65265',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 227748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY65265%27 HTTP/1.1" 200 None
2026-03-30 11:52:21 [auto1.de] INFO: Saving data for WY65265: {'auction_closing_time': 1774884243.0, 'created_time': 1773427397.877473, 'last_price_update_time': 1774871541.341043}
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY65265') HTTP/1.1" 204 0
2026-03-30 11:52:21 [auto1.de] INFO: Found listing with ID: SS56268
2026-03-30 11:52:21 [auto1.de] INFO: Found listing with ID: HM38388
2026-03-30 11:52:21 [auto1.de] INFO: Found listing with ID: SA98041
2026-03-30 11:52:21 [auto1.de] INFO: Found listing with ID: RV78416
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV78416%27 HTTP/1.1" 200 None
2026-03-30 11:52:21 [auto1.de] INFO: Scrape type for RV78416: 2
2026-03-30 11:52:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebc1933d-86f1-53b4-94d6-a65785ebb8db with identifier: RV78416
2026-03-30 11:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebc1933d-86f1-53b4-94d6-a65785ebb8db with scrape type 2
2026-03-30 11:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebc1933d-86f1-53b4-94d6-a65785ebb8db with scrape type 2
2026-03-30 11:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebc1933d-86f1-53b4-94d6-a65785ebb8db, identifier: RV78416
2026-03-30 11:52:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebc1933d-86f1-53b4-94d6-a65785ebb8db with identifier: RV78416
2026-03-30 11:52:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebc1933d-86f1-53b4-94d6-a65785ebb8db with identifier: RV78416
2026-03-30 11:52:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebc1933d-86f1-53b4-94d6-a65785ebb8db with identifier: RV78416 to the API
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:30:05Z',
 'fuel_type': 'petrol',
 'id': 'ebc1933d-86f1-53b4-94d6-a65785ebb8db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV78416',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 138027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-03',
 'seller_name': None,
 'title': "Kia cee'd 1.6 GDI Dream-Team",
 'transmission': 'manual',
 'trim': 'Dream-Team',
 'year': 2018}
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV78416%27 HTTP/1.1" 200 None
2026-03-30 11:52:21 [auto1.de] INFO: Saving data for RV78416: {'auction_closing_time': 1774884605.0, 'created_time': 1773382621.812883, 'last_price_update_time': 1774871541.846321}
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV78416') HTTP/1.1" 204 0
2026-03-30 11:52:21 [auto1.de] INFO: Found listing with ID: GB67844
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB67844%27 HTTP/1.1" 200 None
2026-03-30 11:52:21 [auto1.de] INFO: Scrape type for GB67844: 2
2026-03-30 11:52:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with identifier: GB67844
2026-03-30 11:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with scrape type 2
2026-03-30 11:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with scrape type 2
2026-03-30 11:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4, identifier: GB67844
2026-03-30 11:52:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with identifier: GB67844
2026-03-30 11:52:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with identifier: GB67844
2026-03-30 11:52:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with identifier: GB67844 to the API
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:05:22Z',
 'fuel_type': 'petrol',
 'id': 'eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB67844',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 97563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-28',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2020}
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB67844%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Saving data for GB67844: {'auction_closing_time': 1774883122.0, 'created_time': 1774002058.622467, 'last_price_update_time': 1774871542.266229}
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB67844') HTTP/1.1" 204 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: GJ08958
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ08958%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for GJ08958: 2
2026-03-30 11:52:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f6bdfff-f77d-502c-908b-e8357da2500d with identifier: GJ08958
2026-03-30 11:52:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f6bdfff-f77d-502c-908b-e8357da2500d with scrape type 2
2026-03-30 11:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f6bdfff-f77d-502c-908b-e8357da2500d with scrape type 2
2026-03-30 11:52:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f6bdfff-f77d-502c-908b-e8357da2500d, identifier: GJ08958
2026-03-30 11:52:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f6bdfff-f77d-502c-908b-e8357da2500d with identifier: GJ08958
2026-03-30 11:52:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f6bdfff-f77d-502c-908b-e8357da2500d with identifier: GJ08958
2026-03-30 11:52:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f6bdfff-f77d-502c-908b-e8357da2500d with identifier: GJ08958 to the API
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:57:21Z',
 'fuel_type': 'diesel',
 'id': '2f6bdfff-f77d-502c-908b-e8357da2500d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ08958',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 284990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-07-28',
 'seller_name': None,
 'title': 'BMW X5 3.0d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ08958%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Saving data for GJ08958: {'auction_closing_time': 1774886241.0, 'created_time': 1774694400.904261, 'last_price_update_time': 1774871542.700383}
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ08958') HTTP/1.1" 204 0
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: HS55924
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: RM27503
2026-03-30 11:52:22 [auto1.de] INFO: Found listing with ID: ZD45339
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD45339%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.de] INFO: Scrape type for ZD45339: 2
2026-03-30 11:52:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03910b3f-6d25-54b0-8e59-b551a22382ca with identifier: ZD45339
2026-03-30 11:52:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03910b3f-6d25-54b0-8e59-b551a22382ca with scrape type 2
2026-03-30 11:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03910b3f-6d25-54b0-8e59-b551a22382ca with scrape type 2
2026-03-30 11:52:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03910b3f-6d25-54b0-8e59-b551a22382ca, identifier: ZD45339
2026-03-30 11:52:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03910b3f-6d25-54b0-8e59-b551a22382ca with identifier: ZD45339
2026-03-30 11:52:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03910b3f-6d25-54b0-8e59-b551a22382ca with identifier: ZD45339
2026-03-30 11:52:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03910b3f-6d25-54b0-8e59-b551a22382ca with identifier: ZD45339 to the API
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:44:03Z',
 'fuel_type': 'diesel',
 'id': '03910b3f-6d25-54b0-8e59-b551a22382ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD45339',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 54260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2020}
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD45339%27 HTTP/1.1" 200 None
2026-03-30 11:52:23 [auto1.de] INFO: Saving data for ZD45339: {'auction_closing_time': 1774885443.0, 'created_time': 1773429665.54088, 'last_price_update_time': 1774871543.127346}
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD45339') HTTP/1.1" 204 0
2026-03-30 11:52:23 [auto1.de] INFO: Found listing with ID: BU26829
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU26829%27 HTTP/1.1" 200 None
2026-03-30 11:52:23 [auto1.de] INFO: Scrape type for BU26829: 2
2026-03-30 11:52:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with identifier: BU26829
2026-03-30 11:52:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with scrape type 2
2026-03-30 11:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with scrape type 2
2026-03-30 11:52:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 211e999d-a1e4-5dca-86fe-7f2790d3eaf9, identifier: BU26829
2026-03-30 11:52:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with identifier: BU26829
2026-03-30 11:52:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with identifier: BU26829
2026-03-30 11:52:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with identifier: BU26829 to the API
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:27:53Z',
 'fuel_type': 'diesel',
 'id': '211e999d-a1e4-5dca-86fe-7f2790d3eaf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU26829',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 114186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Match 4Motion',
 'transmission': 'manual',
 'trim': 'Match 4Motion',
 'year': 2012}
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU26829%27 HTTP/1.1" 200 None
2026-03-30 11:52:23 [auto1.de] INFO: Saving data for BU26829: {'auction_closing_time': 1774884473.0, 'created_time': 1774034010.275338, 'last_price_update_time': 1774871543.557264}
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU26829') HTTP/1.1" 204 0
2026-03-30 11:52:23 [auto1.de] INFO: Found listing with ID: UL74029
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL74029%27 HTTP/1.1" 200 None
2026-03-30 11:52:23 [auto1.de] INFO: Scrape type for UL74029: 2
2026-03-30 11:52:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da197803-6d7a-5b47-a9f6-7fad77b4a4cb with identifier: UL74029
2026-03-30 11:52:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da197803-6d7a-5b47-a9f6-7fad77b4a4cb with scrape type 2
2026-03-30 11:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da197803-6d7a-5b47-a9f6-7fad77b4a4cb with scrape type 2
2026-03-30 11:52:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da197803-6d7a-5b47-a9f6-7fad77b4a4cb, identifier: UL74029
2026-03-30 11:52:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da197803-6d7a-5b47-a9f6-7fad77b4a4cb with identifier: UL74029
2026-03-30 11:52:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da197803-6d7a-5b47-a9f6-7fad77b4a4cb with identifier: UL74029
2026-03-30 11:52:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da197803-6d7a-5b47-a9f6-7fad77b4a4cb with identifier: UL74029 to the API
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:34:57Z',
 'fuel_type': 'diesel',
 'id': 'da197803-6d7a-5b47-a9f6-7fad77b4a4cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL74029',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 142197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-04',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL74029%27 HTTP/1.1" 200 None
2026-03-30 11:52:23 [auto1.de] INFO: Saving data for UL74029: {'auction_closing_time': 1774884897.0, 'created_time': 1774032381.296751, 'last_price_update_time': 1774871543.951832}
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL74029') HTTP/1.1" 204 0
2026-03-30 11:52:24 [auto1.de] INFO: Found listing with ID: GB23451
2026-03-30 11:52:24 [auto1.de] INFO: Found listing with ID: GD85387
2026-03-30 11:52:24 [auto1.de] INFO: Found listing with ID: MF41650
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41650%27 HTTP/1.1" 200 None
2026-03-30 11:52:24 [auto1.de] INFO: Scrape type for MF41650: 2
2026-03-30 11:52:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with identifier: MF41650
2026-03-30 11:52:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with scrape type 2
2026-03-30 11:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with scrape type 2
2026-03-30 11:52:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 572fd3f9-1eaf-5c0f-a2ad-faf61d021577, identifier: MF41650
2026-03-30 11:52:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with identifier: MF41650
2026-03-30 11:52:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with identifier: MF41650
2026-03-30 11:52:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with identifier: MF41650 to the API
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:30:01Z',
 'fuel_type': 'petrol',
 'id': '572fd3f9-1eaf-5c0f-a2ad-faf61d021577',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF41650',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 134524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-21',
 'seller_name': None,
 'title': 'Volvo V60 2.0 T5 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2016}
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41650%27 HTTP/1.1" 200 None
2026-03-30 11:52:24 [auto1.de] INFO: Saving data for MF41650: {'auction_closing_time': 1774884601.0, 'created_time': 1774694397.28224, 'last_price_update_time': 1774871544.432165}
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF41650') HTTP/1.1" 204 0
2026-03-30 11:52:24 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-30 11:52:24 [auto1.de] INFO: Found listing with ID: NV71817
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV71817%27 HTTP/1.1" 200 None
2026-03-30 11:52:24 [auto1.de] INFO: Scrape type for NV71817: 2
2026-03-30 11:52:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf8e8c73-2548-5053-a372-7709a20b14be with identifier: NV71817
2026-03-30 11:52:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8e8c73-2548-5053-a372-7709a20b14be with scrape type 2
2026-03-30 11:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf8e8c73-2548-5053-a372-7709a20b14be with scrape type 2
2026-03-30 11:52:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf8e8c73-2548-5053-a372-7709a20b14be, identifier: NV71817
2026-03-30 11:52:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf8e8c73-2548-5053-a372-7709a20b14be with identifier: NV71817
2026-03-30 11:52:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf8e8c73-2548-5053-a372-7709a20b14be with identifier: NV71817
2026-03-30 11:52:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf8e8c73-2548-5053-a372-7709a20b14be with identifier: NV71817 to the API
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:36:37Z',
 'fuel_type': 'diesel',
 'id': 'bf8e8c73-2548-5053-a372-7709a20b14be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV71817',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 90699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-21',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV71817%27 HTTP/1.1" 200 None
2026-03-30 11:52:24 [auto1.de] INFO: Saving data for NV71817: {'auction_closing_time': 1774884997.0, 'created_time': 1774694372.771765, 'last_price_update_time': 1774871544.861811}
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV71817') HTTP/1.1" 204 0
2026-03-30 11:52:24 [auto1.de] INFO: Found listing with ID: TG89658
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG89658%27 HTTP/1.1" 200 None
2026-03-30 11:52:24 [auto1.de] INFO: Scrape type for TG89658: 2
2026-03-30 11:52:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with identifier: TG89658
2026-03-30 11:52:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with scrape type 2
2026-03-30 11:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with scrape type 2
2026-03-30 11:52:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c7dcc5f-6c84-569a-8caa-2acd112040b4, identifier: TG89658
2026-03-30 11:52:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with identifier: TG89658
2026-03-30 11:52:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with identifier: TG89658
2026-03-30 11:52:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with identifier: TG89658 to the API
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:14:28Z',
 'fuel_type': 'petrol',
 'id': '8c7dcc5f-6c84-569a-8caa-2acd112040b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG89658',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 134532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-12',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG89658%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.de] INFO: Saving data for TG89658: {'auction_closing_time': 1774883668.0, 'created_time': 1773383033.276909, 'last_price_update_time': 1774871545.239497}
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG89658') HTTP/1.1" 204 0
2026-03-30 11:52:25 [auto1.de] INFO: Found listing with ID: GA70819
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA70819%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.de] INFO: Scrape type for GA70819: 2
2026-03-30 11:52:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0b4b5c2-ce85-54ee-aa47-e670959110bd with identifier: GA70819
2026-03-30 11:52:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0b4b5c2-ce85-54ee-aa47-e670959110bd with scrape type 2
2026-03-30 11:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0b4b5c2-ce85-54ee-aa47-e670959110bd with scrape type 2
2026-03-30 11:52:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0b4b5c2-ce85-54ee-aa47-e670959110bd, identifier: GA70819
2026-03-30 11:52:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0b4b5c2-ce85-54ee-aa47-e670959110bd with identifier: GA70819
2026-03-30 11:52:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0b4b5c2-ce85-54ee-aa47-e670959110bd with identifier: GA70819
2026-03-30 11:52:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0b4b5c2-ce85-54ee-aa47-e670959110bd with identifier: GA70819 to the API
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:22:35Z',
 'fuel_type': 'petrol',
 'id': 'f0b4b5c2-ce85-54ee-aa47-e670959110bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA70819',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 142807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-19',
 'seller_name': None,
 'title': 'Honda CR-V 2.0 i-VTEC Lifestyle 4WD',
 'transmission': 'automatic',
 'trim': 'Lifestyle 4WD',
 'year': 2018}
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA70819%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.de] INFO: Saving data for GA70819: {'auction_closing_time': 1774884155.0, 'created_time': 1774694383.603959, 'last_price_update_time': 1774871545.647324}
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA70819') HTTP/1.1" 204 0
2026-03-30 11:52:25 [auto1.de] INFO: Found listing with ID: TY06085
2026-03-30 11:52:25 [auto1.de] INFO: Found listing with ID: NU23342
2026-03-30 11:52:25 [auto1.de] INFO: Found listing with ID: BW55074
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW55074%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.de] INFO: Scrape type for BW55074: 2
2026-03-30 11:52:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c24b8bbd-ae61-53d1-968a-013f8bc1496b with identifier: BW55074
2026-03-30 11:52:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c24b8bbd-ae61-53d1-968a-013f8bc1496b with scrape type 2
2026-03-30 11:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c24b8bbd-ae61-53d1-968a-013f8bc1496b with scrape type 2
2026-03-30 11:52:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c24b8bbd-ae61-53d1-968a-013f8bc1496b, identifier: BW55074
2026-03-30 11:52:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c24b8bbd-ae61-53d1-968a-013f8bc1496b with identifier: BW55074
2026-03-30 11:52:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c24b8bbd-ae61-53d1-968a-013f8bc1496b with identifier: BW55074
2026-03-30 11:52:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c24b8bbd-ae61-53d1-968a-013f8bc1496b with identifier: BW55074 to the API
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:21:08Z',
 'fuel_type': 'petrol',
 'id': 'c24b8bbd-ae61-53d1-968a-013f8bc1496b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW55074',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 195435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-30',
 'seller_name': None,
 'title': 'Citroen DS3 1.6 VTi SoChic',
 'transmission': 'manual',
 'trim': 'SoChic',
 'year': 2011}
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW55074%27 HTTP/1.1" 200 None
2026-03-30 11:52:26 [auto1.de] INFO: Saving data for BW55074: {'auction_closing_time': 1774884068.0, 'created_time': 1774694457.789882, 'last_price_update_time': 1774871546.043879}
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW55074') HTTP/1.1" 204 0
2026-03-30 11:52:26 [auto1.de] INFO: Found listing with ID: XE90423
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE90423%27 HTTP/1.1" 200 None
2026-03-30 11:52:26 [auto1.de] INFO: Scrape type for XE90423: 2
2026-03-30 11:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with identifier: XE90423
2026-03-30 11:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with scrape type 2
2026-03-30 11:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with scrape type 2
2026-03-30 11:52:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db, identifier: XE90423
2026-03-30 11:52:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with identifier: XE90423
2026-03-30 11:52:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with identifier: XE90423
2026-03-30 11:52:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with identifier: XE90423 to the API
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:27:50Z',
 'fuel_type': 'petrol',
 'id': 'd2a2ebd6-dd39-5bb7-9a8e-a513bfa537db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE90423',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 119409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-18',
 'seller_name': None,
 'title': 'Hyundai i30 2.0 TGDI N Performance',
 'transmission': 'manual',
 'trim': 'N Performance',
 'year': 2019}
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE90423%27 HTTP/1.1" 200 None
2026-03-30 11:52:26 [auto1.de] INFO: Saving data for XE90423: {'auction_closing_time': 1774884470.0, 'created_time': 1774694461.648944, 'last_price_update_time': 1774871546.44134}
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE90423') HTTP/1.1" 204 0
2026-03-30 11:52:26 [auto1.de] INFO: Found listing with ID: SK80695
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK80695%27 HTTP/1.1" 200 None
2026-03-30 11:52:26 [auto1.de] INFO: Scrape type for SK80695: 2
2026-03-30 11:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with identifier: SK80695
2026-03-30 11:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with scrape type 2
2026-03-30 11:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with scrape type 2
2026-03-30 11:52:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad, identifier: SK80695
2026-03-30 11:52:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with identifier: SK80695
2026-03-30 11:52:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with identifier: SK80695
2026-03-30 11:52:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with identifier: SK80695 to the API
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:07:19Z',
 'fuel_type': 'petrol',
 'id': '7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK80695',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 183607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-25',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 150 Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2006}
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK80695%27 HTTP/1.1" 200 None
2026-03-30 11:52:26 [auto1.de] INFO: Saving data for SK80695: {'auction_closing_time': 1774883239.0, 'created_time': 1774694453.673618, 'last_price_update_time': 1774871546.919631}
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK80695') HTTP/1.1" 204 0
2026-03-30 11:52:26 [auto1.de] INFO: Found listing with ID: FL62048
2026-03-30 11:52:26 [auto1.de] INFO: Found listing with ID: DU93693
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU93693%27 HTTP/1.1" 200 None
2026-03-30 11:52:26 [auto1.de] INFO: Scrape type for DU93693: 2
2026-03-30 11:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with identifier: DU93693
2026-03-30 11:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with scrape type 2
2026-03-30 11:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with scrape type 2
2026-03-30 11:52:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1, identifier: DU93693
2026-03-30 11:52:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with identifier: DU93693
2026-03-30 11:52:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with identifier: DU93693
2026-03-30 11:52:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with identifier: DU93693 to the API
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:10:42Z',
 'fuel_type': 'diesel',
 'id': '455d24a2-5900-55ff-bbb8-9baf1e7d7aa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU93693',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 151069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-21',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI lang Ambiente',
 'transmission': 'automatic',
 'trim': 'lang Ambiente',
 'year': 2009}
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU93693%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.de] INFO: Saving data for DU93693: {'auction_closing_time': 1774883442.0, 'created_time': 1774694455.900231, 'last_price_update_time': 1774871547.365155}
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU93693') HTTP/1.1" 204 0
2026-03-30 11:52:27 [auto1.de] INFO: Found listing with ID: XV72554
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV72554%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.de] INFO: Scrape type for XV72554: 2
2026-03-30 11:52:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7fa4612-196d-5fd0-8279-b54a17631155 with identifier: XV72554
2026-03-30 11:52:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7fa4612-196d-5fd0-8279-b54a17631155 with scrape type 2
2026-03-30 11:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7fa4612-196d-5fd0-8279-b54a17631155 with scrape type 2
2026-03-30 11:52:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7fa4612-196d-5fd0-8279-b54a17631155, identifier: XV72554
2026-03-30 11:52:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7fa4612-196d-5fd0-8279-b54a17631155 with identifier: XV72554
2026-03-30 11:52:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7fa4612-196d-5fd0-8279-b54a17631155 with identifier: XV72554
2026-03-30 11:52:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7fa4612-196d-5fd0-8279-b54a17631155 with identifier: XV72554 to the API
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:56:15Z',
 'fuel_type': 'petrol',
 'id': 'a7fa4612-196d-5fd0-8279-b54a17631155',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV72554',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid',
 'odometer': 206641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-06',
 'seller_name': None,
 'title': 'Skoda Rapid 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV72554%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.de] INFO: Saving data for XV72554: {'auction_closing_time': 1774886175.0, 'created_time': 1774694375.905778, 'last_price_update_time': 1774871547.765247}
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV72554') HTTP/1.1" 204 0
2026-03-30 11:52:27 [auto1.de] INFO: Found listing with ID: RG68419
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG68419%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.de] INFO: Scrape type for RG68419: 2
2026-03-30 11:52:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4f1776e-456f-5ca3-9373-159f5ed2fbfe with identifier: RG68419
2026-03-30 11:52:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe with scrape type 2
2026-03-30 11:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe with scrape type 2
2026-03-30 11:52:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4f1776e-456f-5ca3-9373-159f5ed2fbfe, identifier: RG68419
2026-03-30 11:52:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4f1776e-456f-5ca3-9373-159f5ed2fbfe with identifier: RG68419
2026-03-30 11:52:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4f1776e-456f-5ca3-9373-159f5ed2fbfe with identifier: RG68419
2026-03-30 11:52:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4f1776e-456f-5ca3-9373-159f5ed2fbfe with identifier: RG68419 to the API
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:00:44Z',
 'fuel_type': 'petrol',
 'id': 'a4f1776e-456f-5ca3-9373-159f5ed2fbfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG68419',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Ateca',
 'odometer': 58214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-26',
 'seller_name': None,
 'title': 'Cupra Ateca 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2018}
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG68419%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.de] INFO: Saving data for RG68419: {'auction_closing_time': 1774882844.0, 'created_time': 1774694400.512675, 'last_price_update_time': 1774871548.162142}
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG68419') HTTP/1.1" 204 0
2026-03-30 11:52:28 [auto1.de] INFO: Found listing with ID: NE45887
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE45887%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.de] INFO: Scrape type for NE45887: 2
2026-03-30 11:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 811247cf-65bd-5002-8eeb-49c701a816ee with identifier: NE45887
2026-03-30 11:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 811247cf-65bd-5002-8eeb-49c701a816ee with scrape type 2
2026-03-30 11:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 811247cf-65bd-5002-8eeb-49c701a816ee with scrape type 2
2026-03-30 11:52:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 811247cf-65bd-5002-8eeb-49c701a816ee, identifier: NE45887
2026-03-30 11:52:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 811247cf-65bd-5002-8eeb-49c701a816ee with identifier: NE45887
2026-03-30 11:52:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 811247cf-65bd-5002-8eeb-49c701a816ee with identifier: NE45887
2026-03-30 11:52:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 811247cf-65bd-5002-8eeb-49c701a816ee with identifier: NE45887 to the API
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:14:07Z',
 'fuel_type': 'petrol',
 'id': '811247cf-65bd-5002-8eeb-49c701a816ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE45887',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 21797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-12',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.5 eTSI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2024}
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE45887%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.de] INFO: Saving data for NE45887: {'auction_closing_time': 1774883647.0, 'created_time': 1774694431.942245, 'last_price_update_time': 1774871548.55933}
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE45887') HTTP/1.1" 204 0
2026-03-30 11:52:28 [auto1.de] INFO: Found listing with ID: VZ98908
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ98908%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.de] INFO: Scrape type for VZ98908: 2
2026-03-30 11:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af3c8a47-bd80-5dc3-936a-a72e276603f1 with identifier: VZ98908
2026-03-30 11:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af3c8a47-bd80-5dc3-936a-a72e276603f1 with scrape type 2
2026-03-30 11:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af3c8a47-bd80-5dc3-936a-a72e276603f1 with scrape type 2
2026-03-30 11:52:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af3c8a47-bd80-5dc3-936a-a72e276603f1, identifier: VZ98908
2026-03-30 11:52:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af3c8a47-bd80-5dc3-936a-a72e276603f1 with identifier: VZ98908
2026-03-30 11:52:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af3c8a47-bd80-5dc3-936a-a72e276603f1 with identifier: VZ98908
2026-03-30 11:52:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af3c8a47-bd80-5dc3-936a-a72e276603f1 with identifier: VZ98908 to the API
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:30:01Z',
 'fuel_type': 'petrol',
 'id': 'af3c8a47-bd80-5dc3-936a-a72e276603f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ98908',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 175842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-08',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2009}
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ98908%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.de] INFO: Saving data for VZ98908: {'auction_closing_time': 1774884601.0, 'created_time': 1774694450.682133, 'last_price_update_time': 1774871548.99443}
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ98908') HTTP/1.1" 204 0
2026-03-30 11:52:29 [auto1.de] INFO: Found listing with ID: MG84960
2026-03-30 11:52:29 [auto1.de] INFO: Found listing with ID: KU56806
2026-03-30 11:52:29 [auto1.de] INFO: Found listing with ID: BH58500
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH58500%27 HTTP/1.1" 200 None
2026-03-30 11:52:29 [auto1.de] INFO: Scrape type for BH58500: 2
2026-03-30 11:52:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef4b9696-1893-5928-a415-06ae470f0d36 with identifier: BH58500
2026-03-30 11:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef4b9696-1893-5928-a415-06ae470f0d36 with scrape type 2
2026-03-30 11:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef4b9696-1893-5928-a415-06ae470f0d36 with scrape type 2
2026-03-30 11:52:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef4b9696-1893-5928-a415-06ae470f0d36, identifier: BH58500
2026-03-30 11:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef4b9696-1893-5928-a415-06ae470f0d36 with identifier: BH58500
2026-03-30 11:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef4b9696-1893-5928-a415-06ae470f0d36 with identifier: BH58500
2026-03-30 11:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef4b9696-1893-5928-a415-06ae470f0d36 with identifier: BH58500 to the API
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:06:56Z',
 'fuel_type': 'diesel',
 'id': 'ef4b9696-1893-5928-a415-06ae470f0d36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH58500',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 158619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-04',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH58500%27 HTTP/1.1" 200 None
2026-03-30 11:52:29 [auto1.de] INFO: Saving data for BH58500: {'auction_closing_time': 1774883216.0, 'created_time': 1774694435.327649, 'last_price_update_time': 1774871549.356036}
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH58500') HTTP/1.1" 204 0
2026-03-30 11:52:29 [auto1.de] INFO: Found listing with ID: FN47599
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN47599%27 HTTP/1.1" 200 None
2026-03-30 11:52:29 [auto1.de] INFO: Scrape type for FN47599: 2
2026-03-30 11:52:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with identifier: FN47599
2026-03-30 11:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with scrape type 2
2026-03-30 11:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with scrape type 2
2026-03-30 11:52:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99, identifier: FN47599
2026-03-30 11:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with identifier: FN47599
2026-03-30 11:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with identifier: FN47599
2026-03-30 11:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with identifier: FN47599 to the API
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:11Z',
 'fuel_type': 'diesel',
 'id': '92c1cde4-d2ca-50cd-beb9-b19a20d7bc99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN47599',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 152055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-13',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN47599%27 HTTP/1.1" 200 None
2026-03-30 11:52:29 [auto1.de] INFO: Saving data for FN47599: {'auction_closing_time': 1774885571.0, 'created_time': 1774694396.139286, 'last_price_update_time': 1774871549.754082}
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN47599') HTTP/1.1" 204 0
2026-03-30 11:52:29 [auto1.de] INFO: Found listing with ID: YB04799
2026-03-30 11:53:03 [scrapy.extensions.logstats] INFO: Crawled 948 pages (at 2 pages/min), scraped 1295 items (at 52 items/min)
2026-03-30 11:53:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:54:03 [scrapy.extensions.logstats] INFO: Crawled 948 pages (at 0 pages/min), scraped 1295 items (at 0 items/min)
2026-03-30 11:54:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:54:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.354(s), this was the 1st time calling it.
2026-03-30 11:54:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.120823602192999 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:54:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:54:48 [auto1.de] INFO: Channel: 24h | Page: 245 | totalHits: 9964 | hits on page: 40
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: HM38388
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: SA98041
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: RV78416
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV78416%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for RV78416: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: GB67844
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB67844%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for GB67844: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: GJ08958
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ08958%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for GJ08958: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: HS55924
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: RM27503
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: ZD45339
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD45339%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for ZD45339: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: BU26829
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU26829%27 HTTP/1.1" 200 None
2026-03-30 11:54:48 [auto1.de] INFO: Scrape type for BU26829: 0
2026-03-30 11:54:48 [auto1.de] INFO: Found listing with ID: UL74029
2026-03-30 11:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL74029%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for UL74029: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: GB23451
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: GD85387
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: MF41650
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41650%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for MF41650: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: NV71817
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV71817%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for NV71817: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: TG89658
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG89658%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for TG89658: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: GA70819
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA70819%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for GA70819: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: TY06085
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: NU23342
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: BW55074
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW55074%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for BW55074: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: XE90423
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE90423%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for XE90423: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: SK80695
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK80695%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for SK80695: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: FL62048
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: DU93693
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU93693%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for DU93693: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: XV72554
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV72554%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for XV72554: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: RG68419
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG68419%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for RG68419: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: NE45887
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE45887%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for NE45887: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: VZ98908
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ98908%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for VZ98908: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: MG84960
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: KU56806
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: BH58500
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH58500%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for BH58500: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: FN47599
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN47599%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for FN47599: 0
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: YB04799
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: JS16399
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS16399%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for JS16399: 2
2026-03-30 11:54:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with identifier: JS16399
2026-03-30 11:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with scrape type 2
2026-03-30 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with scrape type 2
2026-03-30 11:54:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 552f88f6-5c52-5f67-92aa-4ea5c77aad73, identifier: JS16399
2026-03-30 11:54:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with identifier: JS16399
2026-03-30 11:54:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with identifier: JS16399
2026-03-30 11:54:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with identifier: JS16399 to the API
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:40:19Z',
 'fuel_type': 'petrol',
 'id': '552f88f6-5c52-5f67-92aa-4ea5c77aad73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS16399',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 175106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-13',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 High up! BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'High  BlueMotion Tech',
 'year': 2012}
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS16399%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Saving data for JS16399: {'auction_closing_time': 1774885219.0, 'created_time': 1774034365.785527, 'last_price_update_time': 1774871689.658857}
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS16399') HTTP/1.1" 204 0
2026-03-30 11:54:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: ME28341
2026-03-30 11:54:49 [auto1.de] INFO: Found listing with ID: JP40190
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP40190%27 HTTP/1.1" 200 None
2026-03-30 11:54:49 [auto1.de] INFO: Scrape type for JP40190: 2
2026-03-30 11:54:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c51401d-33e2-5333-9397-86fdd33486ce with identifier: JP40190
2026-03-30 11:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c51401d-33e2-5333-9397-86fdd33486ce with scrape type 2
2026-03-30 11:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c51401d-33e2-5333-9397-86fdd33486ce with scrape type 2
2026-03-30 11:54:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c51401d-33e2-5333-9397-86fdd33486ce, identifier: JP40190
2026-03-30 11:54:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c51401d-33e2-5333-9397-86fdd33486ce with identifier: JP40190
2026-03-30 11:54:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c51401d-33e2-5333-9397-86fdd33486ce with identifier: JP40190
2026-03-30 11:54:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c51401d-33e2-5333-9397-86fdd33486ce with identifier: JP40190 to the API
2026-03-30 11:54:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:54:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:14:32Z',
 'fuel_type': 'diesel',
 'id': '8c51401d-33e2-5333-9397-86fdd33486ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP40190',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 75294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-09',
 'seller_name': None,
 'title': 'Volkswagen Amarok 3.0 V6 TDI Comfortline DoubleCab 4Motion',
 'transmission': 'automatic',
 'trim': 'Comfortline DoubleCab 4Motion',
 'year': 2019}
2026-03-30 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP40190%27 HTTP/1.1" 200 None
2026-03-30 11:54:51 [auto1.de] INFO: Saving data for JP40190: {'auction_closing_time': 1774883672.0, 'created_time': 1774002148.536693, 'last_price_update_time': 1774871691.064178}
2026-03-30 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP40190') HTTP/1.1" 204 0
2026-03-30 11:54:51 [auto1.de] INFO: Found listing with ID: AU10222
2026-03-30 11:54:51 [auto1.de] INFO: Found listing with ID: JN77870
2026-03-30 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN77870%27 HTTP/1.1" 200 None
2026-03-30 11:54:51 [auto1.de] INFO: Scrape type for JN77870: 2
2026-03-30 11:54:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with identifier: JN77870
2026-03-30 11:54:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with scrape type 2
2026-03-30 11:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with scrape type 2
2026-03-30 11:54:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72b17b06-64e3-5e26-8752-0dc02cf8bca5, identifier: JN77870
2026-03-30 11:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with identifier: JN77870
2026-03-30 11:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with identifier: JN77870
2026-03-30 11:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with identifier: JN77870 to the API
2026-03-30 11:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:54:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:54:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-30T15:28:06Z',
 'fuel_type': 'diesel',
 'id': '72b17b06-64e3-5e26-8752-0dc02cf8bca5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN77870',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 75850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-04',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 400 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-30 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN77870%27 HTTP/1.1" 200 None
2026-03-30 11:54:53 [auto1.de] INFO: Saving data for JN77870: {'auction_closing_time': 1774884486.0, 'created_time': 1774694399.070006, 'last_price_update_time': 1774871693.389302}
2026-03-30 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN77870') HTTP/1.1" 204 0
2026-03-30 11:54:53 [auto1.de] INFO: Found listing with ID: MN75028
2026-03-30 11:54:53 [auto1.de] INFO: Found listing with ID: LR31578
2026-03-30 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR31578%27 HTTP/1.1" 200 None
2026-03-30 11:54:53 [auto1.de] INFO: Scrape type for LR31578: 2
2026-03-30 11:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with identifier: LR31578
2026-03-30 11:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with scrape type 2
2026-03-30 11:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with scrape type 2
2026-03-30 11:54:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c323a7b-2b9c-5b6a-94ee-70c153456f37, identifier: LR31578
2026-03-30 11:54:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with identifier: LR31578
2026-03-30 11:54:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with identifier: LR31578
2026-03-30 11:54:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with identifier: LR31578 to the API
2026-03-30 11:54:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:54:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:54:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:55:39Z',
 'fuel_type': 'petrol',
 'id': '2c323a7b-2b9c-5b6a-94ee-70c153456f37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR31578',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'MX-5',
 'odometer': 72914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Mazda MX-5 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2017}
2026-03-30 11:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR31578%27 HTTP/1.1" 200 None
2026-03-30 11:54:55 [auto1.de] INFO: Saving data for LR31578: {'auction_closing_time': 1774886139.0, 'created_time': 1774694428.223475, 'last_price_update_time': 1774871695.856504}
2026-03-30 11:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR31578') HTTP/1.1" 204 0
2026-03-30 11:55:03 [scrapy.extensions.logstats] INFO: Crawled 949 pages (at 1 pages/min), scraped 1299 items (at 4 items/min)
2026-03-30 11:55:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-30 11:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:06 [auto1.de] INFO: Channel: 24h | Page: 246 | totalHits: 9966 | hits on page: 40
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: MN75028
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: LR31578
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR31578%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for LR31578: 0
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: SB90605
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: HL93382
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: HU71027
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: HW93754
2026-03-30 11:55:06 [auto1.de] INFO: Found listing with ID: KV33816
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33816%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.de] INFO: Scrape type for KV33816: 2
2026-03-30 11:55:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with identifier: KV33816
2026-03-30 11:55:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with scrape type 2
2026-03-30 11:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with scrape type 2
2026-03-30 11:55:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8dcc66d6-54f0-5149-a0d0-b9e82766ae85, identifier: KV33816
2026-03-30 11:55:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with identifier: KV33816
2026-03-30 11:55:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with identifier: KV33816
2026-03-30 11:55:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with identifier: KV33816 to the API
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:59:57Z',
 'fuel_type': 'diesel',
 'id': '8dcc66d6-54f0-5149-a0d0-b9e82766ae85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV33816',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 184044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-07',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2016}
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33816%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.de] INFO: Saving data for KV33816: {'auction_closing_time': 1774886397.0, 'created_time': 1774694373.512448, 'last_price_update_time': 1774871707.247494}
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV33816') HTTP/1.1" 204 0
2026-03-30 11:55:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: NB68023
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: BG93361
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: ZV32018
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: MV90577
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV90577%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.de] INFO: Scrape type for MV90577: 2
2026-03-30 11:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54332895-5083-5c7a-bd18-7855ded463dc with identifier: MV90577
2026-03-30 11:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54332895-5083-5c7a-bd18-7855ded463dc with scrape type 2
2026-03-30 11:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54332895-5083-5c7a-bd18-7855ded463dc with scrape type 2
2026-03-30 11:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54332895-5083-5c7a-bd18-7855ded463dc, identifier: MV90577
2026-03-30 11:55:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54332895-5083-5c7a-bd18-7855ded463dc with identifier: MV90577
2026-03-30 11:55:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54332895-5083-5c7a-bd18-7855ded463dc with identifier: MV90577
2026-03-30 11:55:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54332895-5083-5c7a-bd18-7855ded463dc with identifier: MV90577 to the API
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:15:03Z',
 'fuel_type': 'diesel',
 'id': '54332895-5083-5c7a-bd18-7855ded463dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV90577',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 75676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-27',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV90577%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.de] INFO: Saving data for MV90577: {'auction_closing_time': 1774883703.0, 'created_time': 1774002213.526079, 'last_price_update_time': 1774871707.790286}
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV90577') HTTP/1.1" 204 0
2026-03-30 11:55:07 [auto1.de] INFO: Found listing with ID: DF55649
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF55649%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.de] INFO: Scrape type for DF55649: 2
2026-03-30 11:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1436325f-8282-5f93-be02-60a6e76a0da7 with identifier: DF55649
2026-03-30 11:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1436325f-8282-5f93-be02-60a6e76a0da7 with scrape type 2
2026-03-30 11:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1436325f-8282-5f93-be02-60a6e76a0da7 with scrape type 2
2026-03-30 11:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1436325f-8282-5f93-be02-60a6e76a0da7, identifier: DF55649
2026-03-30 11:55:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1436325f-8282-5f93-be02-60a6e76a0da7 with identifier: DF55649
2026-03-30 11:55:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1436325f-8282-5f93-be02-60a6e76a0da7 with identifier: DF55649
2026-03-30 11:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1436325f-8282-5f93-be02-60a6e76a0da7 with identifier: DF55649 to the API
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:47:28Z',
 'fuel_type': 'petrol',
 'id': '1436325f-8282-5f93-be02-60a6e76a0da7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF55649',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 67060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-10',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF55649%27 HTTP/1.1" 200 None
2026-03-30 11:55:08 [auto1.de] INFO: Saving data for DF55649: {'auction_closing_time': 1774885648.0, 'created_time': 1774694403.378595, 'last_price_update_time': 1774871708.195458}
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF55649') HTTP/1.1" 204 0
2026-03-30 11:55:08 [auto1.de] INFO: Found listing with ID: FT64289
2026-03-30 11:55:08 [auto1.de] INFO: Found listing with ID: ED71538
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED71538%27 HTTP/1.1" 200 None
2026-03-30 11:55:08 [auto1.de] INFO: Scrape type for ED71538: 2
2026-03-30 11:55:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c030561c-8927-581d-8b37-b1cfada4d831 with identifier: ED71538
2026-03-30 11:55:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c030561c-8927-581d-8b37-b1cfada4d831 with scrape type 2
2026-03-30 11:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c030561c-8927-581d-8b37-b1cfada4d831 with scrape type 2
2026-03-30 11:55:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c030561c-8927-581d-8b37-b1cfada4d831, identifier: ED71538
2026-03-30 11:55:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c030561c-8927-581d-8b37-b1cfada4d831 with identifier: ED71538
2026-03-30 11:55:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c030561c-8927-581d-8b37-b1cfada4d831 with identifier: ED71538
2026-03-30 11:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c030561c-8927-581d-8b37-b1cfada4d831 with identifier: ED71538 to the API
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:41:52Z',
 'fuel_type': 'diesel',
 'id': 'c030561c-8927-581d-8b37-b1cfada4d831',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED71538',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Signum',
 'odometer': 189328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-27',
 'seller_name': None,
 'title': 'Opel Signum 3.0 V6 CDTI Cosmo Plus',
 'transmission': 'automatic',
 'trim': 'Cosmo Plus',
 'year': 2007}
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED71538%27 HTTP/1.1" 200 None
2026-03-30 11:55:08 [auto1.de] INFO: Saving data for ED71538: {'auction_closing_time': 1774885312.0, 'created_time': 1774694427.498074, 'last_price_update_time': 1774871708.583275}
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED71538') HTTP/1.1" 204 0
2026-03-30 11:55:08 [auto1.de] INFO: Found listing with ID: PJ47645
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ47645%27 HTTP/1.1" 200 None
2026-03-30 11:55:08 [auto1.de] INFO: Scrape type for PJ47645: 2
2026-03-30 11:55:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68e16d97-69df-547f-aced-383070789b22 with identifier: PJ47645
2026-03-30 11:55:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e16d97-69df-547f-aced-383070789b22 with scrape type 2
2026-03-30 11:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68e16d97-69df-547f-aced-383070789b22 with scrape type 2
2026-03-30 11:55:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68e16d97-69df-547f-aced-383070789b22, identifier: PJ47645
2026-03-30 11:55:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68e16d97-69df-547f-aced-383070789b22 with identifier: PJ47645
2026-03-30 11:55:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68e16d97-69df-547f-aced-383070789b22 with identifier: PJ47645
2026-03-30 11:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68e16d97-69df-547f-aced-383070789b22 with identifier: PJ47645 to the API
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:18:47Z',
 'fuel_type': 'petrol',
 'id': '68e16d97-69df-547f-aced-383070789b22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ47645',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 162954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-18',
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ47645%27 HTTP/1.1" 200 None
2026-03-30 11:55:09 [auto1.de] INFO: Saving data for PJ47645: {'auction_closing_time': 1774883927.0, 'created_time': 1774694433.273251, 'last_price_update_time': 1774871709.000814}
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ47645') HTTP/1.1" 204 0
2026-03-30 11:55:09 [auto1.de] INFO: Found listing with ID: UT04321
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT04321%27 HTTP/1.1" 200 None
2026-03-30 11:55:09 [auto1.de] INFO: Scrape type for UT04321: 2
2026-03-30 11:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8545ab6-db4b-5888-89bb-23f1749d14c9 with identifier: UT04321
2026-03-30 11:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8545ab6-db4b-5888-89bb-23f1749d14c9 with scrape type 2
2026-03-30 11:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8545ab6-db4b-5888-89bb-23f1749d14c9 with scrape type 2
2026-03-30 11:55:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8545ab6-db4b-5888-89bb-23f1749d14c9, identifier: UT04321
2026-03-30 11:55:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8545ab6-db4b-5888-89bb-23f1749d14c9 with identifier: UT04321
2026-03-30 11:55:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8545ab6-db4b-5888-89bb-23f1749d14c9 with identifier: UT04321
2026-03-30 11:55:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8545ab6-db4b-5888-89bb-23f1749d14c9 with identifier: UT04321 to the API
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:03:04Z',
 'fuel_type': 'petrol',
 'id': 'f8545ab6-db4b-5888-89bb-23f1749d14c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT04321',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 126641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-22',
 'seller_name': None,
 'title': 'Hyundai ix35 1.6 FIFA World Cup Edition 2WD',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition 2WD',
 'year': 2015}
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT04321%27 HTTP/1.1" 200 None
2026-03-30 11:55:09 [auto1.de] INFO: Saving data for UT04321: {'auction_closing_time': 1774882984.0, 'created_time': 1774694389.337467, 'last_price_update_time': 1774871709.392221}
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT04321') HTTP/1.1" 204 0
2026-03-30 11:55:09 [auto1.de] INFO: Found listing with ID: KE10146
2026-03-30 11:55:09 [auto1.de] INFO: Found listing with ID: PN64243
2026-03-30 11:55:09 [auto1.de] INFO: Found listing with ID: DF72133
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF72133%27 HTTP/1.1" 200 None
2026-03-30 11:55:09 [auto1.de] INFO: Scrape type for DF72133: 2
2026-03-30 11:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with identifier: DF72133
2026-03-30 11:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with scrape type 2
2026-03-30 11:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with scrape type 2
2026-03-30 11:55:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cabc91e-0795-5c0e-ad1c-02fa29af5462, identifier: DF72133
2026-03-30 11:55:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with identifier: DF72133
2026-03-30 11:55:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with identifier: DF72133
2026-03-30 11:55:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with identifier: DF72133 to the API
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:03:43Z',
 'fuel_type': 'petrol',
 'id': '8cabc91e-0795-5c0e-ad1c-02fa29af5462',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF72133',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 191741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-26',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2013}
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF72133%27 HTTP/1.1" 200 None
2026-03-30 11:55:09 [auto1.de] INFO: Saving data for DF72133: {'auction_closing_time': 1774883023.0, 'created_time': 1774694429.0128, 'last_price_update_time': 1774871709.839093}
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF72133') HTTP/1.1" 204 0
2026-03-30 11:55:09 [auto1.de] INFO: Found listing with ID: RL77282
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL77282%27 HTTP/1.1" 200 None
2026-03-30 11:55:09 [auto1.de] INFO: Scrape type for RL77282: 2
2026-03-30 11:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87990e2c-76dd-531a-9012-89b4b86f2f0c with identifier: RL77282
2026-03-30 11:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87990e2c-76dd-531a-9012-89b4b86f2f0c with scrape type 2
2026-03-30 11:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87990e2c-76dd-531a-9012-89b4b86f2f0c with scrape type 2
2026-03-30 11:55:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87990e2c-76dd-531a-9012-89b4b86f2f0c, identifier: RL77282
2026-03-30 11:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87990e2c-76dd-531a-9012-89b4b86f2f0c with identifier: RL77282
2026-03-30 11:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87990e2c-76dd-531a-9012-89b4b86f2f0c with identifier: RL77282
2026-03-30 11:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87990e2c-76dd-531a-9012-89b4b86f2f0c with identifier: RL77282 to the API
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:57:02Z',
 'fuel_type': 'petrol',
 'id': '87990e2c-76dd-531a-9012-89b4b86f2f0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL77282',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 55312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-15',
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL77282%27 HTTP/1.1" 200 None
2026-03-30 11:55:10 [auto1.de] INFO: Saving data for RL77282: {'auction_closing_time': 1774886222.0, 'created_time': 1774694388.097597, 'last_price_update_time': 1774871710.363456}
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL77282') HTTP/1.1" 204 0
2026-03-30 11:55:10 [auto1.de] INFO: Found listing with ID: NC99241
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC99241%27 HTTP/1.1" 200 None
2026-03-30 11:55:10 [auto1.de] INFO: Scrape type for NC99241: 2
2026-03-30 11:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5c133de-69fe-5e04-89d3-87045991704a with identifier: NC99241
2026-03-30 11:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5c133de-69fe-5e04-89d3-87045991704a with scrape type 2
2026-03-30 11:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5c133de-69fe-5e04-89d3-87045991704a with scrape type 2
2026-03-30 11:55:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5c133de-69fe-5e04-89d3-87045991704a, identifier: NC99241
2026-03-30 11:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5c133de-69fe-5e04-89d3-87045991704a with identifier: NC99241
2026-03-30 11:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5c133de-69fe-5e04-89d3-87045991704a with identifier: NC99241
2026-03-30 11:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5c133de-69fe-5e04-89d3-87045991704a with identifier: NC99241 to the API
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:36:23Z',
 'fuel_type': 'petrol',
 'id': 'c5c133de-69fe-5e04-89d3-87045991704a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC99241',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 218884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-06',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Sports-Line AWD',
 'transmission': 'manual',
 'trim': 'Sports-Line AWD',
 'year': 2012}
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC99241%27 HTTP/1.1" 200 None
2026-03-30 11:55:10 [auto1.de] INFO: Saving data for NC99241: {'auction_closing_time': 1774884983.0, 'created_time': 1774694384.193912, 'last_price_update_time': 1774871710.767991}
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC99241') HTTP/1.1" 204 0
2026-03-30 11:55:10 [auto1.de] INFO: Found listing with ID: YW14341
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW14341%27 HTTP/1.1" 200 None
2026-03-30 11:55:10 [auto1.de] INFO: Scrape type for YW14341: 2
2026-03-30 11:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e05177-bcae-5a46-a30e-320e1cef2df7 with identifier: YW14341
2026-03-30 11:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e05177-bcae-5a46-a30e-320e1cef2df7 with scrape type 2
2026-03-30 11:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61e05177-bcae-5a46-a30e-320e1cef2df7 with scrape type 2
2026-03-30 11:55:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61e05177-bcae-5a46-a30e-320e1cef2df7, identifier: YW14341
2026-03-30 11:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61e05177-bcae-5a46-a30e-320e1cef2df7 with identifier: YW14341
2026-03-30 11:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61e05177-bcae-5a46-a30e-320e1cef2df7 with identifier: YW14341
2026-03-30 11:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61e05177-bcae-5a46-a30e-320e1cef2df7 with identifier: YW14341 to the API
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:30Z',
 'fuel_type': 'diesel',
 'id': '61e05177-bcae-5a46-a30e-320e1cef2df7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW14341',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 153938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-28',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW14341%27 HTTP/1.1" 200 None
2026-03-30 11:55:11 [auto1.de] INFO: Saving data for YW14341: {'auction_closing_time': 1774884210.0, 'created_time': 1774089512.377336, 'last_price_update_time': 1774871711.18925}
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW14341') HTTP/1.1" 204 0
2026-03-30 11:55:11 [auto1.de] INFO: Found listing with ID: WH57282
2026-03-30 11:55:11 [auto1.de] INFO: Found listing with ID: SE82228
2026-03-30 11:55:11 [auto1.de] INFO: Found listing with ID: WB94546
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94546%27 HTTP/1.1" 200 None
2026-03-30 11:55:11 [auto1.de] INFO: Scrape type for WB94546: 2
2026-03-30 11:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60158439-dfbb-5db0-9278-aab9484e26aa with identifier: WB94546
2026-03-30 11:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60158439-dfbb-5db0-9278-aab9484e26aa with scrape type 2
2026-03-30 11:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60158439-dfbb-5db0-9278-aab9484e26aa with scrape type 2
2026-03-30 11:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60158439-dfbb-5db0-9278-aab9484e26aa, identifier: WB94546
2026-03-30 11:55:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60158439-dfbb-5db0-9278-aab9484e26aa with identifier: WB94546
2026-03-30 11:55:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60158439-dfbb-5db0-9278-aab9484e26aa with identifier: WB94546
2026-03-30 11:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60158439-dfbb-5db0-9278-aab9484e26aa with identifier: WB94546 to the API
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:49:13Z',
 'fuel_type': 'petrol',
 'id': '60158439-dfbb-5db0-9278-aab9484e26aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB94546',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 142257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-20',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94546%27 HTTP/1.1" 200 None
2026-03-30 11:55:11 [auto1.de] INFO: Saving data for WB94546: {'auction_closing_time': 1774885753.0, 'created_time': 1774694422.65219, 'last_price_update_time': 1774871711.596181}
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB94546') HTTP/1.1" 204 0
2026-03-30 11:55:11 [auto1.de] INFO: Found listing with ID: LV05660
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV05660%27 HTTP/1.1" 200 None
2026-03-30 11:55:11 [auto1.de] INFO: Scrape type for LV05660: 2
2026-03-30 11:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 889dd955-08a4-5d8a-83ea-3ce96c103f89 with identifier: LV05660
2026-03-30 11:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 889dd955-08a4-5d8a-83ea-3ce96c103f89 with scrape type 2
2026-03-30 11:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 889dd955-08a4-5d8a-83ea-3ce96c103f89 with scrape type 2
2026-03-30 11:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 889dd955-08a4-5d8a-83ea-3ce96c103f89, identifier: LV05660
2026-03-30 11:55:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 889dd955-08a4-5d8a-83ea-3ce96c103f89 with identifier: LV05660
2026-03-30 11:55:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 889dd955-08a4-5d8a-83ea-3ce96c103f89 with identifier: LV05660
2026-03-30 11:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 889dd955-08a4-5d8a-83ea-3ce96c103f89 with identifier: LV05660 to the API
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:00:40Z',
 'fuel_type': 'diesel',
 'id': '889dd955-08a4-5d8a-83ea-3ce96c103f89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV05660',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce',
 'odometer': 55168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-13',
 'seller_name': None,
 'title': 'Toyota ProAce 2.0 D-4D L2 Kasten Meister',
 'transmission': 'manual',
 'trim': 'L2 Kasten Meister',
 'year': 2020}
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV05660%27 HTTP/1.1" 200 None
2026-03-30 11:55:12 [auto1.de] INFO: Saving data for LV05660: {'auction_closing_time': 1774882840.0, 'created_time': 1774694392.088947, 'last_price_update_time': 1774871712.003143}
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV05660') HTTP/1.1" 204 0
2026-03-30 11:55:12 [auto1.de] INFO: Found listing with ID: ZY49257
2026-03-30 11:55:12 [auto1.de] INFO: Found listing with ID: PG18082
2026-03-30 11:55:12 [auto1.de] INFO: Found listing with ID: VX47645
2026-03-30 11:55:12 [auto1.de] INFO: Found listing with ID: UJ37250
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ37250%27 HTTP/1.1" 200 None
2026-03-30 11:55:12 [auto1.de] INFO: Scrape type for UJ37250: 2
2026-03-30 11:55:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e56a8417-1e7d-5bca-9a99-354592d7c3b9 with identifier: UJ37250
2026-03-30 11:55:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e56a8417-1e7d-5bca-9a99-354592d7c3b9 with scrape type 2
2026-03-30 11:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e56a8417-1e7d-5bca-9a99-354592d7c3b9 with scrape type 2
2026-03-30 11:55:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e56a8417-1e7d-5bca-9a99-354592d7c3b9, identifier: UJ37250
2026-03-30 11:55:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e56a8417-1e7d-5bca-9a99-354592d7c3b9 with identifier: UJ37250
2026-03-30 11:55:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e56a8417-1e7d-5bca-9a99-354592d7c3b9 with identifier: UJ37250
2026-03-30 11:55:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e56a8417-1e7d-5bca-9a99-354592d7c3b9 with identifier: UJ37250 to the API
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:47:06Z',
 'fuel_type': 'diesel',
 'id': 'e56a8417-1e7d-5bca-9a99-354592d7c3b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ37250',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 190864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-29',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi GT Line",
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2015}
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ37250%27 HTTP/1.1" 200 None
2026-03-30 11:55:12 [auto1.de] INFO: Saving data for UJ37250: {'auction_closing_time': 1774885626.0, 'created_time': 1774694419.277646, 'last_price_update_time': 1774871712.423632}
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ37250') HTTP/1.1" 204 0
2026-03-30 11:55:12 [auto1.de] INFO: Found listing with ID: BF02767
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF02767%27 HTTP/1.1" 200 None
2026-03-30 11:55:12 [auto1.de] INFO: Scrape type for BF02767: 2
2026-03-30 11:55:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with identifier: BF02767
2026-03-30 11:55:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with scrape type 2
2026-03-30 11:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with scrape type 2
2026-03-30 11:55:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2e60ed2-ad9a-5831-8ecb-e1819ca4806f, identifier: BF02767
2026-03-30 11:55:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with identifier: BF02767
2026-03-30 11:55:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with identifier: BF02767
2026-03-30 11:55:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with identifier: BF02767 to the API
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:36:59Z',
 'fuel_type': 'diesel',
 'id': 'e2e60ed2-ad9a-5831-8ecb-e1819ca4806f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF02767',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 262237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-06',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Ghia',
 'transmission': 'manual',
 'trim': 'Ghia',
 'year': 2009}
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF02767%27 HTTP/1.1" 200 None
2026-03-30 11:55:12 [auto1.de] INFO: Saving data for BF02767: {'auction_closing_time': 1774885019.0, 'created_time': 1774694381.292843, 'last_price_update_time': 1774871712.987477}
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF02767') HTTP/1.1" 204 0
2026-03-30 11:55:13 [auto1.de] INFO: Found listing with ID: HX00661
2026-03-30 11:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00661%27 HTTP/1.1" 200 None
2026-03-30 11:55:13 [auto1.de] INFO: Scrape type for HX00661: 2
2026-03-30 11:55:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8498033-940f-556b-8bb2-5d54e188ff29 with identifier: HX00661
2026-03-30 11:55:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8498033-940f-556b-8bb2-5d54e188ff29 with scrape type 2
2026-03-30 11:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8498033-940f-556b-8bb2-5d54e188ff29 with scrape type 2
2026-03-30 11:55:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8498033-940f-556b-8bb2-5d54e188ff29, identifier: HX00661
2026-03-30 11:55:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8498033-940f-556b-8bb2-5d54e188ff29 with identifier: HX00661
2026-03-30 11:55:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8498033-940f-556b-8bb2-5d54e188ff29 with identifier: HX00661
2026-03-30 11:55:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8498033-940f-556b-8bb2-5d54e188ff29 with identifier: HX00661 to the API
2026-03-30 11:55:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:43:06Z',
 'fuel_type': 'petrol',
 'id': 'a8498033-940f-556b-8bb2-5d54e188ff29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX00661',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 67053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-08',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2018}
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00661%27 HTTP/1.1" 200 None
2026-03-30 11:55:14 [auto1.de] INFO: Saving data for HX00661: {'auction_closing_time': 1774885386.0, 'created_time': 1774694382.226068, 'last_price_update_time': 1774871714.172741}
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX00661') HTTP/1.1" 204 0
2026-03-30 11:55:14 [auto1.de] INFO: Found listing with ID: BV18863
2026-03-30 11:55:14 [auto1.de] INFO: Found listing with ID: RC95289
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC95289%27 HTTP/1.1" 200 None
2026-03-30 11:55:14 [auto1.de] INFO: Scrape type for RC95289: 2
2026-03-30 11:55:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23321a31-5475-5504-9de8-4b2a22945016 with identifier: RC95289
2026-03-30 11:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23321a31-5475-5504-9de8-4b2a22945016 with scrape type 2
2026-03-30 11:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23321a31-5475-5504-9de8-4b2a22945016 with scrape type 2
2026-03-30 11:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23321a31-5475-5504-9de8-4b2a22945016, identifier: RC95289
2026-03-30 11:55:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23321a31-5475-5504-9de8-4b2a22945016 with identifier: RC95289
2026-03-30 11:55:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23321a31-5475-5504-9de8-4b2a22945016 with identifier: RC95289
2026-03-30 11:55:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23321a31-5475-5504-9de8-4b2a22945016 with identifier: RC95289 to the API
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:21:07Z',
 'fuel_type': 'diesel',
 'id': '23321a31-5475-5504-9de8-4b2a22945016',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC95289',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 217198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-01',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC95289%27 HTTP/1.1" 200 None
2026-03-30 11:55:14 [auto1.de] INFO: Saving data for RC95289: {'auction_closing_time': 1774884067.0, 'created_time': 1773382855.197107, 'last_price_update_time': 1774871714.666148}
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC95289') HTTP/1.1" 204 0
2026-03-30 11:55:14 [auto1.de] INFO: Found listing with ID: HE38410
2026-03-30 11:55:14 [auto1.de] INFO: Found listing with ID: GE96927
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96927%27 HTTP/1.1" 200 None
2026-03-30 11:55:14 [auto1.de] INFO: Scrape type for GE96927: 2
2026-03-30 11:55:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bf15954-0fd3-575b-be4b-66e59f000b7e with identifier: GE96927
2026-03-30 11:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bf15954-0fd3-575b-be4b-66e59f000b7e with scrape type 2
2026-03-30 11:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bf15954-0fd3-575b-be4b-66e59f000b7e with scrape type 2
2026-03-30 11:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bf15954-0fd3-575b-be4b-66e59f000b7e, identifier: GE96927
2026-03-30 11:55:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bf15954-0fd3-575b-be4b-66e59f000b7e with identifier: GE96927
2026-03-30 11:55:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bf15954-0fd3-575b-be4b-66e59f000b7e with identifier: GE96927
2026-03-30 11:55:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bf15954-0fd3-575b-be4b-66e59f000b7e with identifier: GE96927 to the API
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:50:26Z',
 'fuel_type': 'petrol',
 'id': '8bf15954-0fd3-575b-be4b-66e59f000b7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE96927',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 161103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96927%27 HTTP/1.1" 200 None
2026-03-30 11:55:15 [auto1.de] INFO: Saving data for GE96927: {'auction_closing_time': 1774885826.0, 'created_time': 1774694391.159504, 'last_price_update_time': 1774871715.079768}
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE96927') HTTP/1.1" 204 0
2026-03-30 11:55:15 [auto1.de] INFO: Found listing with ID: XL36309
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL36309%27 HTTP/1.1" 200 None
2026-03-30 11:55:15 [auto1.de] INFO: Scrape type for XL36309: 2
2026-03-30 11:55:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7d84747-dab8-5f4c-a11f-319f68f7ed1e with identifier: XL36309
2026-03-30 11:55:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7d84747-dab8-5f4c-a11f-319f68f7ed1e with scrape type 2
2026-03-30 11:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7d84747-dab8-5f4c-a11f-319f68f7ed1e with scrape type 2
2026-03-30 11:55:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7d84747-dab8-5f4c-a11f-319f68f7ed1e, identifier: XL36309
2026-03-30 11:55:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7d84747-dab8-5f4c-a11f-319f68f7ed1e with identifier: XL36309
2026-03-30 11:55:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7d84747-dab8-5f4c-a11f-319f68f7ed1e with identifier: XL36309
2026-03-30 11:55:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7d84747-dab8-5f4c-a11f-319f68f7ed1e with identifier: XL36309 to the API
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:13:16Z',
 'fuel_type': 'petrol',
 'id': 'e7d84747-dab8-5f4c-a11f-319f68f7ed1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL36309',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 99065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-02',
 'seller_name': None,
 'title': 'Kia Picanto 1.1 Attract',
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2011}
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL36309%27 HTTP/1.1" 200 None
2026-03-30 11:55:15 [auto1.de] INFO: Saving data for XL36309: {'auction_closing_time': 1774883596.0, 'created_time': 1774035533.588183, 'last_price_update_time': 1774871715.489476}
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL36309') HTTP/1.1" 204 0
2026-03-30 11:55:15 [auto1.de] INFO: Found listing with ID: FM75567
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM75567%27 HTTP/1.1" 200 None
2026-03-30 11:55:15 [auto1.de] INFO: Scrape type for FM75567: 2
2026-03-30 11:55:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0646a2db-3728-530c-a382-4c6cd92c5746 with identifier: FM75567
2026-03-30 11:55:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0646a2db-3728-530c-a382-4c6cd92c5746 with scrape type 2
2026-03-30 11:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0646a2db-3728-530c-a382-4c6cd92c5746 with scrape type 2
2026-03-30 11:55:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0646a2db-3728-530c-a382-4c6cd92c5746, identifier: FM75567
2026-03-30 11:55:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0646a2db-3728-530c-a382-4c6cd92c5746 with identifier: FM75567
2026-03-30 11:55:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0646a2db-3728-530c-a382-4c6cd92c5746 with identifier: FM75567
2026-03-30 11:55:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0646a2db-3728-530c-a382-4c6cd92c5746 with identifier: FM75567 to the API
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:52Z',
 'fuel_type': 'diesel',
 'id': '0646a2db-3728-530c-a382-4c6cd92c5746',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM75567',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 153696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-22',
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI S line Sportpaket',
 'transmission': 'manual',
 'trim': 'S line Sportpaket',
 'year': 2013}
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM75567%27 HTTP/1.1" 200 None
2026-03-30 11:55:15 [auto1.de] INFO: Saving data for FM75567: {'auction_closing_time': 1774883032.0, 'created_time': 1774033948.411529, 'last_price_update_time': 1774871715.889824}
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM75567') HTTP/1.1" 204 0
2026-03-30 11:55:15 [auto1.de] INFO: Found listing with ID: TU93300
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU93300%27 HTTP/1.1" 200 None
2026-03-30 11:55:15 [auto1.de] INFO: Scrape type for TU93300: 2
2026-03-30 11:55:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with identifier: TU93300
2026-03-30 11:55:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with scrape type 2
2026-03-30 11:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with scrape type 2
2026-03-30 11:55:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c, identifier: TU93300
2026-03-30 11:55:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with identifier: TU93300
2026-03-30 11:55:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with identifier: TU93300
2026-03-30 11:55:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with identifier: TU93300 to the API
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:56:24Z',
 'fuel_type': 'diesel',
 'id': '6a5a9de1-918e-5c41-bdd8-bd2d96ca775c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU93300',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 211818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-15',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2011}
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU93300%27 HTTP/1.1" 200 None
2026-03-30 11:55:16 [auto1.de] INFO: Saving data for TU93300: {'auction_closing_time': 1774886184.0, 'created_time': 1774694443.482385, 'last_price_update_time': 1774871716.283373}
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU93300') HTTP/1.1" 204 0
2026-03-30 11:55:16 [auto1.de] INFO: Found listing with ID: SH00876
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH00876%27 HTTP/1.1" 200 None
2026-03-30 11:55:16 [auto1.de] INFO: Scrape type for SH00876: 2
2026-03-30 11:55:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a227b5aa-145c-54e8-b216-336963c4b36c with identifier: SH00876
2026-03-30 11:55:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a227b5aa-145c-54e8-b216-336963c4b36c with scrape type 2
2026-03-30 11:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a227b5aa-145c-54e8-b216-336963c4b36c with scrape type 2
2026-03-30 11:55:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a227b5aa-145c-54e8-b216-336963c4b36c, identifier: SH00876
2026-03-30 11:55:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a227b5aa-145c-54e8-b216-336963c4b36c with identifier: SH00876
2026-03-30 11:55:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a227b5aa-145c-54e8-b216-336963c4b36c with identifier: SH00876
2026-03-30 11:55:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a227b5aa-145c-54e8-b216-336963c4b36c with identifier: SH00876 to the API
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:22:42Z',
 'fuel_type': 'diesel',
 'id': 'a227b5aa-145c-54e8-b216-336963c4b36c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH00876',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 129795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d extralang Avantgarde',
 'transmission': 'automatic',
 'trim': 'extralang Avantgarde',
 'year': 2019}
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH00876%27 HTTP/1.1" 200 None
2026-03-30 11:55:16 [auto1.de] INFO: Saving data for SH00876: {'auction_closing_time': 1774884162.0, 'created_time': 1774694460.726262, 'last_price_update_time': 1774871716.697014}
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH00876') HTTP/1.1" 204 0
2026-03-30 11:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:17 [auto1.de] INFO: Channel: 24h | Page: 247 | totalHits: 9967 | hits on page: 40
2026-03-30 11:55:17 [auto1.de] INFO: Found listing with ID: SH00876
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH00876%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.de] INFO: Scrape type for SH00876: 0
2026-03-30 11:55:17 [auto1.de] INFO: Found listing with ID: YC00182
2026-03-30 11:55:17 [auto1.de] INFO: Found listing with ID: AG44580
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44580%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.de] INFO: Scrape type for AG44580: 2
2026-03-30 11:55:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d96409da-afd3-5edc-8ff4-9cc587bc71f0 with identifier: AG44580
2026-03-30 11:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d96409da-afd3-5edc-8ff4-9cc587bc71f0 with scrape type 2
2026-03-30 11:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d96409da-afd3-5edc-8ff4-9cc587bc71f0 with scrape type 2
2026-03-30 11:55:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d96409da-afd3-5edc-8ff4-9cc587bc71f0, identifier: AG44580
2026-03-30 11:55:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d96409da-afd3-5edc-8ff4-9cc587bc71f0 with identifier: AG44580
2026-03-30 11:55:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d96409da-afd3-5edc-8ff4-9cc587bc71f0 with identifier: AG44580
2026-03-30 11:55:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d96409da-afd3-5edc-8ff4-9cc587bc71f0 with identifier: AG44580 to the API
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:36:28Z',
 'fuel_type': 'diesel',
 'id': 'd96409da-afd3-5edc-8ff4-9cc587bc71f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG44580',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 177025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-11',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44580%27 HTTP/1.1" 200 None
2026-03-30 11:55:18 [auto1.de] INFO: Saving data for AG44580: {'auction_closing_time': 1774884988.0, 'created_time': 1774034982.916842, 'last_price_update_time': 1774871718.16999}
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG44580') HTTP/1.1" 204 0
2026-03-30 11:55:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:18 [auto1.de] INFO: Found listing with ID: KZ11771
2026-03-30 11:55:18 [auto1.de] INFO: Found listing with ID: RP91666
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP91666%27 HTTP/1.1" 200 None
2026-03-30 11:55:18 [auto1.de] INFO: Scrape type for RP91666: 2
2026-03-30 11:55:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with identifier: RP91666
2026-03-30 11:55:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with scrape type 2
2026-03-30 11:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with scrape type 2
2026-03-30 11:55:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88, identifier: RP91666
2026-03-30 11:55:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with identifier: RP91666
2026-03-30 11:55:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with identifier: RP91666
2026-03-30 11:55:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with identifier: RP91666 to the API
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:31:59Z',
 'fuel_type': 'petrol',
 'id': '6f7475fb-78f6-5fde-bfdb-5f6d62d44a88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP91666',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 83960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-02',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP91666%27 HTTP/1.1" 200 None
2026-03-30 11:55:18 [auto1.de] INFO: Saving data for RP91666: {'auction_closing_time': 1774884719.0, 'created_time': 1773427794.434334, 'last_price_update_time': 1774871718.651199}
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP91666') HTTP/1.1" 204 0
2026-03-30 11:55:18 [auto1.de] INFO: Found listing with ID: YS46144
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS46144%27 HTTP/1.1" 200 None
2026-03-30 11:55:18 [auto1.de] INFO: Scrape type for YS46144: 2
2026-03-30 11:55:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6c44470-b59c-53a5-89da-d0a9941966d1 with identifier: YS46144
2026-03-30 11:55:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6c44470-b59c-53a5-89da-d0a9941966d1 with scrape type 2
2026-03-30 11:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6c44470-b59c-53a5-89da-d0a9941966d1 with scrape type 2
2026-03-30 11:55:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6c44470-b59c-53a5-89da-d0a9941966d1, identifier: YS46144
2026-03-30 11:55:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6c44470-b59c-53a5-89da-d0a9941966d1 with identifier: YS46144
2026-03-30 11:55:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6c44470-b59c-53a5-89da-d0a9941966d1 with identifier: YS46144
2026-03-30 11:55:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6c44470-b59c-53a5-89da-d0a9941966d1 with identifier: YS46144 to the API
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 387,
 'expiration_date': '2026-03-30T15:59:34Z',
 'fuel_type': 'petrol',
 'id': 'f6c44470-b59c-53a5-89da-d0a9941966d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS46144',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 212721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-15',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 500 T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2008}
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS46144%27 HTTP/1.1" 200 None
2026-03-30 11:55:19 [auto1.de] INFO: Saving data for YS46144: {'auction_closing_time': 1774886374.0, 'created_time': 1773429048.268717, 'last_price_update_time': 1774871719.054349}
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS46144') HTTP/1.1" 204 0
2026-03-30 11:55:19 [auto1.de] INFO: Found listing with ID: BE92832
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE92832%27 HTTP/1.1" 200 None
2026-03-30 11:55:19 [auto1.de] INFO: Scrape type for BE92832: 2
2026-03-30 11:55:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c919492-41be-565a-bc14-3c79d4bd00bc with identifier: BE92832
2026-03-30 11:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c919492-41be-565a-bc14-3c79d4bd00bc with scrape type 2
2026-03-30 11:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c919492-41be-565a-bc14-3c79d4bd00bc with scrape type 2
2026-03-30 11:55:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c919492-41be-565a-bc14-3c79d4bd00bc, identifier: BE92832
2026-03-30 11:55:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c919492-41be-565a-bc14-3c79d4bd00bc with identifier: BE92832
2026-03-30 11:55:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c919492-41be-565a-bc14-3c79d4bd00bc with identifier: BE92832
2026-03-30 11:55:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c919492-41be-565a-bc14-3c79d4bd00bc with identifier: BE92832 to the API
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:27:15Z',
 'fuel_type': 'petrol',
 'id': '5c919492-41be-565a-bc14-3c79d4bd00bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE92832',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid',
 'odometer': 137612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-26',
 'seller_name': None,
 'title': 'Skoda Rapid 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE92832%27 HTTP/1.1" 200 None
2026-03-30 11:55:19 [auto1.de] INFO: Saving data for BE92832: {'auction_closing_time': 1774884435.0, 'created_time': 1774350454.977619, 'last_price_update_time': 1774871719.440004}
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE92832') HTTP/1.1" 204 0
2026-03-30 11:55:19 [auto1.de] INFO: Found listing with ID: HJ16589
2026-03-30 11:55:19 [auto1.de] INFO: Found listing with ID: TN63274
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN63274%27 HTTP/1.1" 200 None
2026-03-30 11:55:19 [auto1.de] INFO: Scrape type for TN63274: 2
2026-03-30 11:55:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with identifier: TN63274
2026-03-30 11:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with scrape type 2
2026-03-30 11:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with scrape type 2
2026-03-30 11:55:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5, identifier: TN63274
2026-03-30 11:55:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with identifier: TN63274
2026-03-30 11:55:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with identifier: TN63274
2026-03-30 11:55:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with identifier: TN63274 to the API
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-30T15:00:39Z',
 'fuel_type': 'petrol',
 'id': '7c2e3bfb-24e1-5e24-af36-0dc40b215ad5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN63274',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 84969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-17',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Skyactiv-G Exclusive-Line',
 'transmission': 'automatic',
 'trim': 'Exclusive-Line',
 'year': 2019}
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN63274%27 HTTP/1.1" 200 None
2026-03-30 11:55:19 [auto1.de] INFO: Saving data for TN63274: {'auction_closing_time': 1774882839.0, 'created_time': 1774694433.660176, 'last_price_update_time': 1774871719.856236}
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN63274') HTTP/1.1" 204 0
2026-03-30 11:55:19 [auto1.de] INFO: Found listing with ID: BJ75751
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ75751%27 HTTP/1.1" 200 None
2026-03-30 11:55:19 [auto1.de] INFO: Scrape type for BJ75751: 2
2026-03-30 11:55:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with identifier: BJ75751
2026-03-30 11:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with scrape type 2
2026-03-30 11:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with scrape type 2
2026-03-30 11:55:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b41d75b5-76bc-56bc-bfaa-10b986b21fe6, identifier: BJ75751
2026-03-30 11:55:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with identifier: BJ75751
2026-03-30 11:55:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with identifier: BJ75751
2026-03-30 11:55:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with identifier: BJ75751 to the API
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:00:24Z',
 'fuel_type': 'petrol',
 'id': 'b41d75b5-76bc-56bc-bfaa-10b986b21fe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ75751',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 94885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-28',
 'seller_name': None,
 'title': 'MINI Countryman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ75751%27 HTTP/1.1" 200 None
2026-03-30 11:55:20 [auto1.de] INFO: Saving data for BJ75751: {'auction_closing_time': 1774882824.0, 'created_time': 1774035456.590379, 'last_price_update_time': 1774871720.262292}
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ75751') HTTP/1.1" 204 0
2026-03-30 11:55:20 [auto1.de] INFO: Found listing with ID: ZT80456
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT80456%27 HTTP/1.1" 200 None
2026-03-30 11:55:20 [auto1.de] INFO: Scrape type for ZT80456: 2
2026-03-30 11:55:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 650d417b-7a87-5852-b228-2837088e2ae0 with identifier: ZT80456
2026-03-30 11:55:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 650d417b-7a87-5852-b228-2837088e2ae0 with scrape type 2
2026-03-30 11:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 650d417b-7a87-5852-b228-2837088e2ae0 with scrape type 2
2026-03-30 11:55:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 650d417b-7a87-5852-b228-2837088e2ae0, identifier: ZT80456
2026-03-30 11:55:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 650d417b-7a87-5852-b228-2837088e2ae0 with identifier: ZT80456
2026-03-30 11:55:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 650d417b-7a87-5852-b228-2837088e2ae0 with identifier: ZT80456
2026-03-30 11:55:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 650d417b-7a87-5852-b228-2837088e2ae0 with identifier: ZT80456 to the API
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:40:37Z',
 'fuel_type': 'petrol',
 'id': '650d417b-7a87-5852-b228-2837088e2ae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT80456',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 186453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-28',
 'seller_name': None,
 'title': 'Skoda Roomster 1.4 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT80456%27 HTTP/1.1" 200 None
2026-03-30 11:55:20 [auto1.de] INFO: Saving data for ZT80456: {'auction_closing_time': 1774885237.0, 'created_time': 1773382387.080665, 'last_price_update_time': 1774871720.698841}
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT80456') HTTP/1.1" 204 0
2026-03-30 11:55:20 [auto1.de] INFO: Found listing with ID: VY67413
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67413%27 HTTP/1.1" 200 None
2026-03-30 11:55:20 [auto1.de] INFO: Scrape type for VY67413: 2
2026-03-30 11:55:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f320efa-a541-547e-86fd-10375c1cc8c1 with identifier: VY67413
2026-03-30 11:55:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f320efa-a541-547e-86fd-10375c1cc8c1 with scrape type 2
2026-03-30 11:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f320efa-a541-547e-86fd-10375c1cc8c1 with scrape type 2
2026-03-30 11:55:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f320efa-a541-547e-86fd-10375c1cc8c1, identifier: VY67413
2026-03-30 11:55:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f320efa-a541-547e-86fd-10375c1cc8c1 with identifier: VY67413
2026-03-30 11:55:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f320efa-a541-547e-86fd-10375c1cc8c1 with identifier: VY67413
2026-03-30 11:55:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f320efa-a541-547e-86fd-10375c1cc8c1 with identifier: VY67413 to the API
2026-03-30 11:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:31:31Z',
 'fuel_type': 'petrol',
 'id': '7f320efa-a541-547e-86fd-10375c1cc8c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY67413',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 98170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-01',
 'seller_name': None,
 'title': 'Smart forfour 1.0 Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2015}
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67413%27 HTTP/1.1" 200 None
2026-03-30 11:55:21 [auto1.de] INFO: Saving data for VY67413: {'auction_closing_time': 1774884691.0, 'created_time': 1774694447.967768, 'last_price_update_time': 1774871721.112211}
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY67413') HTTP/1.1" 204 0
2026-03-30 11:55:21 [auto1.de] INFO: Found listing with ID: HB69209
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69209%27 HTTP/1.1" 200 None
2026-03-30 11:55:21 [auto1.de] INFO: Scrape type for HB69209: 2
2026-03-30 11:55:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce78ea01-6141-555d-bbf1-a826460b8be7 with identifier: HB69209
2026-03-30 11:55:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce78ea01-6141-555d-bbf1-a826460b8be7 with scrape type 2
2026-03-30 11:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce78ea01-6141-555d-bbf1-a826460b8be7 with scrape type 2
2026-03-30 11:55:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce78ea01-6141-555d-bbf1-a826460b8be7, identifier: HB69209
2026-03-30 11:55:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce78ea01-6141-555d-bbf1-a826460b8be7 with identifier: HB69209
2026-03-30 11:55:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce78ea01-6141-555d-bbf1-a826460b8be7 with identifier: HB69209
2026-03-30 11:55:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce78ea01-6141-555d-bbf1-a826460b8be7 with identifier: HB69209 to the API
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:48:46Z',
 'fuel_type': 'petrol',
 'id': 'ce78ea01-6141-555d-bbf1-a826460b8be7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB69209',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 127641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-18',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI beats',
 'transmission': 'manual',
 'trim': 'beats',
 'year': 2018}
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69209%27 HTTP/1.1" 200 None
2026-03-30 11:55:21 [auto1.de] INFO: Saving data for HB69209: {'auction_closing_time': 1774885726.0, 'created_time': 1774033894.228237, 'last_price_update_time': 1774871721.500563}
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB69209') HTTP/1.1" 204 0
2026-03-30 11:55:21 [auto1.de] INFO: Found listing with ID: KM53361
2026-03-30 11:55:21 [auto1.de] INFO: Found listing with ID: GF17035
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF17035%27 HTTP/1.1" 200 None
2026-03-30 11:55:21 [auto1.de] INFO: Scrape type for GF17035: 2
2026-03-30 11:55:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with identifier: GF17035
2026-03-30 11:55:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with scrape type 2
2026-03-30 11:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with scrape type 2
2026-03-30 11:55:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0, identifier: GF17035
2026-03-30 11:55:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with identifier: GF17035
2026-03-30 11:55:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with identifier: GF17035
2026-03-30 11:55:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with identifier: GF17035 to the API
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:51:48Z',
 'fuel_type': 'petrol',
 'id': '23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF17035',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 123319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-24',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2010}
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF17035%27 HTTP/1.1" 200 None
2026-03-30 11:55:21 [auto1.de] INFO: Saving data for GF17035: {'auction_closing_time': 1774885908.0, 'created_time': 1774003270.953743, 'last_price_update_time': 1774871721.874233}
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF17035') HTTP/1.1" 204 0
2026-03-30 11:55:21 [auto1.de] INFO: Found listing with ID: ZV63958
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV63958%27 HTTP/1.1" 200 None
2026-03-30 11:55:22 [auto1.de] INFO: Scrape type for ZV63958: 2
2026-03-30 11:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dab3ec60-1e85-5c08-be19-0ac6f7c02853 with identifier: ZV63958
2026-03-30 11:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dab3ec60-1e85-5c08-be19-0ac6f7c02853 with scrape type 2
2026-03-30 11:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dab3ec60-1e85-5c08-be19-0ac6f7c02853 with scrape type 2
2026-03-30 11:55:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dab3ec60-1e85-5c08-be19-0ac6f7c02853, identifier: ZV63958
2026-03-30 11:55:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dab3ec60-1e85-5c08-be19-0ac6f7c02853 with identifier: ZV63958
2026-03-30 11:55:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dab3ec60-1e85-5c08-be19-0ac6f7c02853 with identifier: ZV63958
2026-03-30 11:55:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dab3ec60-1e85-5c08-be19-0ac6f7c02853 with identifier: ZV63958 to the API
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:28Z',
 'fuel_type': 'petrol',
 'id': 'dab3ec60-1e85-5c08-be19-0ac6f7c02853',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV63958',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 232902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-10',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Ultimate Start/Stop',
 'transmission': 'automatic',
 'trim': 'Ultimate Start/Stop',
 'year': 2019}
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV63958%27 HTTP/1.1" 200 None
2026-03-30 11:55:22 [auto1.de] INFO: Saving data for ZV63958: {'auction_closing_time': 1774885048.0, 'created_time': 1774694445.189796, 'last_price_update_time': 1774871722.35493}
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV63958') HTTP/1.1" 204 0
2026-03-30 11:55:22 [auto1.de] INFO: Found listing with ID: VG24913
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG24913%27 HTTP/1.1" 200 None
2026-03-30 11:55:22 [auto1.de] INFO: Scrape type for VG24913: 2
2026-03-30 11:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5428b46a-2f48-52d9-a2ad-7345de79f9fa with identifier: VG24913
2026-03-30 11:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5428b46a-2f48-52d9-a2ad-7345de79f9fa with scrape type 2
2026-03-30 11:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5428b46a-2f48-52d9-a2ad-7345de79f9fa with scrape type 2
2026-03-30 11:55:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5428b46a-2f48-52d9-a2ad-7345de79f9fa, identifier: VG24913
2026-03-30 11:55:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5428b46a-2f48-52d9-a2ad-7345de79f9fa with identifier: VG24913
2026-03-30 11:55:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5428b46a-2f48-52d9-a2ad-7345de79f9fa with identifier: VG24913
2026-03-30 11:55:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5428b46a-2f48-52d9-a2ad-7345de79f9fa with identifier: VG24913 to the API
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:51:58Z',
 'fuel_type': 'petrol',
 'id': '5428b46a-2f48-52d9-a2ad-7345de79f9fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG24913',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 156286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-28',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG24913%27 HTTP/1.1" 200 None
2026-03-30 11:55:22 [auto1.de] INFO: Saving data for VG24913: {'auction_closing_time': 1774885918.0, 'created_time': 1774349945.030406, 'last_price_update_time': 1774871722.732226}
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG24913') HTTP/1.1" 204 0
2026-03-30 11:55:22 [auto1.de] INFO: Found listing with ID: XE04045
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE04045%27 HTTP/1.1" 200 None
2026-03-30 11:55:22 [auto1.de] INFO: Scrape type for XE04045: 2
2026-03-30 11:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1de937e9-94f5-5079-903c-375c532e29a7 with identifier: XE04045
2026-03-30 11:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1de937e9-94f5-5079-903c-375c532e29a7 with scrape type 2
2026-03-30 11:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1de937e9-94f5-5079-903c-375c532e29a7 with scrape type 2
2026-03-30 11:55:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1de937e9-94f5-5079-903c-375c532e29a7, identifier: XE04045
2026-03-30 11:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1de937e9-94f5-5079-903c-375c532e29a7 with identifier: XE04045
2026-03-30 11:55:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1de937e9-94f5-5079-903c-375c532e29a7 with identifier: XE04045
2026-03-30 11:55:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1de937e9-94f5-5079-903c-375c532e29a7 with identifier: XE04045 to the API
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:09:46Z',
 'fuel_type': 'diesel',
 'id': '1de937e9-94f5-5079-903c-375c532e29a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE04045',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 52865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-22',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE04045%27 HTTP/1.1" 200 None
2026-03-30 11:55:23 [auto1.de] INFO: Saving data for XE04045: {'auction_closing_time': 1774883386.0, 'created_time': 1774035194.037889, 'last_price_update_time': 1774871723.126442}
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE04045') HTTP/1.1" 204 0
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: PU74458
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: UV81203
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV81203%27 HTTP/1.1" 200 None
2026-03-30 11:55:23 [auto1.de] INFO: Scrape type for UV81203: 2
2026-03-30 11:55:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d05342b4-f6e1-540a-8edb-c35bd6f65172 with identifier: UV81203
2026-03-30 11:55:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d05342b4-f6e1-540a-8edb-c35bd6f65172 with scrape type 2
2026-03-30 11:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d05342b4-f6e1-540a-8edb-c35bd6f65172 with scrape type 2
2026-03-30 11:55:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d05342b4-f6e1-540a-8edb-c35bd6f65172, identifier: UV81203
2026-03-30 11:55:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d05342b4-f6e1-540a-8edb-c35bd6f65172 with identifier: UV81203
2026-03-30 11:55:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d05342b4-f6e1-540a-8edb-c35bd6f65172 with identifier: UV81203
2026-03-30 11:55:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d05342b4-f6e1-540a-8edb-c35bd6f65172 with identifier: UV81203 to the API
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:30:05Z',
 'fuel_type': 'petrol',
 'id': 'd05342b4-f6e1-540a-8edb-c35bd6f65172',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV81203',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 45685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Google',
 'transmission': 'manual',
 'trim': 'Google',
 'year': 2021}
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV81203%27 HTTP/1.1" 200 None
2026-03-30 11:55:23 [auto1.de] INFO: Saving data for UV81203: {'auction_closing_time': 1774884605.0, 'created_time': 1774035358.337396, 'last_price_update_time': 1774871723.539787}
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV81203') HTTP/1.1" 204 0
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: NK23311
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: HP69948
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: FK48222
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK48222%27 HTTP/1.1" 200 None
2026-03-30 11:55:23 [auto1.de] INFO: Scrape type for FK48222: 2
2026-03-30 11:55:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffabbdad-2c54-5a23-a7e4-b6497662fc7a with identifier: FK48222
2026-03-30 11:55:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffabbdad-2c54-5a23-a7e4-b6497662fc7a with scrape type 2
2026-03-30 11:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffabbdad-2c54-5a23-a7e4-b6497662fc7a with scrape type 2
2026-03-30 11:55:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffabbdad-2c54-5a23-a7e4-b6497662fc7a, identifier: FK48222
2026-03-30 11:55:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffabbdad-2c54-5a23-a7e4-b6497662fc7a with identifier: FK48222
2026-03-30 11:55:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffabbdad-2c54-5a23-a7e4-b6497662fc7a with identifier: FK48222
2026-03-30 11:55:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffabbdad-2c54-5a23-a7e4-b6497662fc7a with identifier: FK48222 to the API
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:31:52Z',
 'fuel_type': 'petrol',
 'id': 'ffabbdad-2c54-5a23-a7e4-b6497662fc7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK48222',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 10891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-16',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2024}
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK48222%27 HTTP/1.1" 200 None
2026-03-30 11:55:23 [auto1.de] INFO: Saving data for FK48222: {'auction_closing_time': 1774884712.0, 'created_time': 1773399974.619575, 'last_price_update_time': 1774871723.940655}
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK48222') HTTP/1.1" 204 0
2026-03-30 11:55:23 [auto1.de] INFO: Channel: 24h | Page: 248 | totalHits: 9967 | hits on page: 40
2026-03-30 11:55:23 [auto1.de] INFO: Found listing with ID: KE90826
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90826%27 HTTP/1.1" 200 None
2026-03-30 11:55:23 [auto1.de] INFO: Scrape type for KE90826: 2
2026-03-30 11:55:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with identifier: KE90826
2026-03-30 11:55:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with scrape type 2
2026-03-30 11:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with scrape type 2
2026-03-30 11:55:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09edb6e8-1b98-5bbd-9f63-4555ecf2639a, identifier: KE90826
2026-03-30 11:55:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with identifier: KE90826
2026-03-30 11:55:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with identifier: KE90826
2026-03-30 11:55:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with identifier: KE90826 to the API
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:34:57Z',
 'fuel_type': 'petrol',
 'id': '09edb6e8-1b98-5bbd-9f63-4555ecf2639a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE90826',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 115776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-15',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90826%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.de] INFO: Saving data for KE90826: {'auction_closing_time': 1774884897.0, 'created_time': 1773427918.145951, 'last_price_update_time': 1774871724.343042}
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE90826') HTTP/1.1" 204 0
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: NG84191
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: UX99567
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: XD36777
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD36777%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.de] INFO: Scrape type for XD36777: 2
2026-03-30 11:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b101f291-1c0a-5e60-be91-380369a5330b with identifier: XD36777
2026-03-30 11:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b101f291-1c0a-5e60-be91-380369a5330b with scrape type 2
2026-03-30 11:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b101f291-1c0a-5e60-be91-380369a5330b with scrape type 2
2026-03-30 11:55:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b101f291-1c0a-5e60-be91-380369a5330b, identifier: XD36777
2026-03-30 11:55:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:24 [auto1.de] INFO: Found listing with ID: MN93715
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN93715%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.de] INFO: Scrape type for MN93715: 2
2026-03-30 11:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58e72cac-eb60-5a58-bffe-dd9676629371 with identifier: MN93715
2026-03-30 11:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58e72cac-eb60-5a58-bffe-dd9676629371 with scrape type 2
2026-03-30 11:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58e72cac-eb60-5a58-bffe-dd9676629371 with scrape type 2
2026-03-30 11:55:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58e72cac-eb60-5a58-bffe-dd9676629371, identifier: MN93715
2026-03-30 11:55:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b101f291-1c0a-5e60-be91-380369a5330b with identifier: XD36777
2026-03-30 11:55:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b101f291-1c0a-5e60-be91-380369a5330b with identifier: XD36777
2026-03-30 11:55:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b101f291-1c0a-5e60-be91-380369a5330b with identifier: XD36777 to the API
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:33:41Z',
 'fuel_type': 'diesel',
 'id': 'b101f291-1c0a-5e60-be91-380369a5330b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD36777',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 169131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-07',
 'seller_name': None,
 'title': 'Opel Mokka 1.6 CDTI DPF Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2015}
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD36777%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.de] INFO: Saving data for XD36777: {'auction_closing_time': 1774884821.0, 'created_time': 1774033316.388897, 'last_price_update_time': 1774871724.869886}
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD36777') HTTP/1.1" 204 0
2026-03-30 11:55:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58e72cac-eb60-5a58-bffe-dd9676629371 with identifier: MN93715
2026-03-30 11:55:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58e72cac-eb60-5a58-bffe-dd9676629371 with identifier: MN93715
2026-03-30 11:55:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58e72cac-eb60-5a58-bffe-dd9676629371 with identifier: MN93715 to the API
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:47:34Z',
 'fuel_type': 'diesel',
 'id': '58e72cac-eb60-5a58-bffe-dd9676629371',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN93715',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 185055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-22',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2004}
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN93715%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Saving data for MN93715: {'auction_closing_time': 1774885654.0, 'created_time': 1774002029.850646, 'last_price_update_time': 1774871725.349039}
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN93715') HTTP/1.1" 204 0
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: PC48603
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC48603%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for PC48603: 2
2026-03-30 11:55:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac61c536-0bdb-5c8f-887c-22e80ff00e6d with identifier: PC48603
2026-03-30 11:55:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac61c536-0bdb-5c8f-887c-22e80ff00e6d with scrape type 2
2026-03-30 11:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac61c536-0bdb-5c8f-887c-22e80ff00e6d with scrape type 2
2026-03-30 11:55:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac61c536-0bdb-5c8f-887c-22e80ff00e6d, identifier: PC48603
2026-03-30 11:55:25 [auto1.de] INFO: Found listing with ID: BS68769
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68769%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Scrape type for BS68769: 2
2026-03-30 11:55:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6330493b-dc11-593e-a743-a21e30b057eb with identifier: BS68769
2026-03-30 11:55:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6330493b-dc11-593e-a743-a21e30b057eb with scrape type 2
2026-03-30 11:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6330493b-dc11-593e-a743-a21e30b057eb with scrape type 2
2026-03-30 11:55:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6330493b-dc11-593e-a743-a21e30b057eb, identifier: BS68769
2026-03-30 11:55:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac61c536-0bdb-5c8f-887c-22e80ff00e6d with identifier: PC48603
2026-03-30 11:55:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac61c536-0bdb-5c8f-887c-22e80ff00e6d with identifier: PC48603
2026-03-30 11:55:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac61c536-0bdb-5c8f-887c-22e80ff00e6d with identifier: PC48603 to the API
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:08:54Z',
 'fuel_type': 'diesel',
 'id': 'ac61c536-0bdb-5c8f-887c-22e80ff00e6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC48603',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 149435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-11',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang 4Matic BlueTEC',
 'transmission': 'automatic',
 'trim': 'lang 4Matic BlueTEC',
 'year': 2018}
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC48603%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.de] INFO: Saving data for PC48603: {'auction_closing_time': 1774883334.0, 'created_time': 1773400760.502129, 'last_price_update_time': 1774871725.828537}
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC48603') HTTP/1.1" 204 0
2026-03-30 11:55:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6330493b-dc11-593e-a743-a21e30b057eb with identifier: BS68769
2026-03-30 11:55:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6330493b-dc11-593e-a743-a21e30b057eb with identifier: BS68769
2026-03-30 11:55:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6330493b-dc11-593e-a743-a21e30b057eb with identifier: BS68769 to the API
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:21:22Z',
 'fuel_type': 'petrol',
 'id': '6330493b-dc11-593e-a743-a21e30b057eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS68769',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 132074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-26',
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Ambition Plus Edition',
 'transmission': 'automatic',
 'trim': 'Ambition Plus Edition',
 'year': 2012}
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68769%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Saving data for BS68769: {'auction_closing_time': 1774884082.0, 'created_time': 1774032332.002269, 'last_price_update_time': 1774871726.148386}
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS68769') HTTP/1.1" 204 0
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: SR86923
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: GJ17699
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17699%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Scrape type for GJ17699: 2
2026-03-30 11:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e129244-9817-5315-9826-0565b2e0ceec with identifier: GJ17699
2026-03-30 11:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e129244-9817-5315-9826-0565b2e0ceec with scrape type 2
2026-03-30 11:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e129244-9817-5315-9826-0565b2e0ceec with scrape type 2
2026-03-30 11:55:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e129244-9817-5315-9826-0565b2e0ceec, identifier: GJ17699
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: LJ34502
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ34502%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Scrape type for LJ34502: 0
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: NE48651
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: TJ68834
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ68834%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Scrape type for TJ68834: 2
2026-03-30 11:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with identifier: TJ68834
2026-03-30 11:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with scrape type 2
2026-03-30 11:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with scrape type 2
2026-03-30 11:55:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c, identifier: TJ68834
2026-03-30 11:55:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e129244-9817-5315-9826-0565b2e0ceec with identifier: GJ17699
2026-03-30 11:55:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e129244-9817-5315-9826-0565b2e0ceec with identifier: GJ17699
2026-03-30 11:55:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e129244-9817-5315-9826-0565b2e0ceec with identifier: GJ17699 to the API
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:29:22Z',
 'fuel_type': 'petrol',
 'id': '0e129244-9817-5315-9826-0565b2e0ceec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ17699',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 160379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-06',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2011}
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17699%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Saving data for GJ17699: {'auction_closing_time': 1774884562.0, 'created_time': 1774001906.450448, 'last_price_update_time': 1774871726.678398}
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ17699') HTTP/1.1" 204 0
2026-03-30 11:55:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with identifier: TJ68834
2026-03-30 11:55:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with identifier: TJ68834
2026-03-30 11:55:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with identifier: TJ68834 to the API
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:44:01Z',
 'fuel_type': 'petrol',
 'id': '6a01dfb3-7862-56ba-9ef0-29eafcd2b52c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ68834',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 116201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-22',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ68834%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.de] INFO: Saving data for TJ68834: {'auction_closing_time': 1774885441.0, 'created_time': 1773380119.157368, 'last_price_update_time': 1774871726.981535}
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ68834') HTTP/1.1" 204 0
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: ZX68256
2026-03-30 11:55:26 [auto1.de] INFO: Found listing with ID: HF47476
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47476%27 HTTP/1.1" 200 None
2026-03-30 11:55:27 [auto1.de] INFO: Scrape type for HF47476: 2
2026-03-30 11:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with identifier: HF47476
2026-03-30 11:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with scrape type 2
2026-03-30 11:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with scrape type 2
2026-03-30 11:55:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26f18a9a-9790-5f6a-bd69-3ef53bf8661e, identifier: HF47476
2026-03-30 11:55:27 [auto1.de] INFO: Found listing with ID: BA78869
2026-03-30 11:55:27 [auto1.de] INFO: Found listing with ID: NG50641
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG50641%27 HTTP/1.1" 200 None
2026-03-30 11:55:27 [auto1.de] INFO: Scrape type for NG50641: 2
2026-03-30 11:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with identifier: NG50641
2026-03-30 11:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with scrape type 2
2026-03-30 11:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with scrape type 2
2026-03-30 11:55:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7, identifier: NG50641
2026-03-30 11:55:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with identifier: HF47476
2026-03-30 11:55:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with identifier: HF47476
2026-03-30 11:55:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with identifier: HF47476 to the API
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:34:45Z',
 'fuel_type': 'petrol',
 'id': '26f18a9a-9790-5f6a-bd69-3ef53bf8661e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF47476',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 44511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-20',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47476%27 HTTP/1.1" 200 None
2026-03-30 11:55:27 [auto1.de] INFO: Saving data for HF47476: {'auction_closing_time': 1774884885.0, 'created_time': 1774031756.380528, 'last_price_update_time': 1774871727.475221}
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF47476') HTTP/1.1" 204 0
2026-03-30 11:55:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with identifier: NG50641
2026-03-30 11:55:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with identifier: NG50641
2026-03-30 11:55:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with identifier: NG50641 to the API
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:57:08Z',
 'fuel_type': 'diesel',
 'id': 'c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG50641',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 238404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-17',
 'seller_name': None,
 'title': 'Audi A5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2008}
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG50641%27 HTTP/1.1" 200 None
2026-03-30 11:55:27 [auto1.de] INFO: Saving data for NG50641: {'auction_closing_time': 1774886228.0, 'created_time': 1774694454.469318, 'last_price_update_time': 1774871727.856732}
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG50641') HTTP/1.1" 204 0
2026-03-30 11:55:27 [auto1.de] INFO: Found listing with ID: CZ39134
2026-03-30 11:55:27 [auto1.de] INFO: Found listing with ID: EU15499
2026-03-30 11:55:27 [auto1.de] INFO: Found listing with ID: DC48276
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC48276%27 HTTP/1.1" 200 None
2026-03-30 11:55:27 [auto1.de] INFO: Scrape type for DC48276: 2
2026-03-30 11:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81662b1e-9d4b-5d62-8598-92415cfbd56d with identifier: DC48276
2026-03-30 11:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81662b1e-9d4b-5d62-8598-92415cfbd56d with scrape type 2
2026-03-30 11:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81662b1e-9d4b-5d62-8598-92415cfbd56d with scrape type 2
2026-03-30 11:55:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81662b1e-9d4b-5d62-8598-92415cfbd56d, identifier: DC48276
2026-03-30 11:55:27 [auto1.de] INFO: Found listing with ID: DJ78015
2026-03-30 11:55:27 [auto1.de] INFO: Found listing with ID: SM71650
2026-03-30 11:55:27 [auto1.de] INFO: Found listing with ID: BA31995
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31995%27 HTTP/1.1" 200 None
2026-03-30 11:55:28 [auto1.de] INFO: Scrape type for BA31995: 2
2026-03-30 11:55:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with identifier: BA31995
2026-03-30 11:55:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with scrape type 2
2026-03-30 11:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with scrape type 2
2026-03-30 11:55:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10b04593-3a41-523b-9bb5-29a46f0ed0c7, identifier: BA31995
2026-03-30 11:55:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81662b1e-9d4b-5d62-8598-92415cfbd56d with identifier: DC48276
2026-03-30 11:55:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81662b1e-9d4b-5d62-8598-92415cfbd56d with identifier: DC48276
2026-03-30 11:55:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81662b1e-9d4b-5d62-8598-92415cfbd56d with identifier: DC48276 to the API
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-30T15:04:25Z',
 'fuel_type': 'petrol',
 'id': '81662b1e-9d4b-5d62-8598-92415cfbd56d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC48276',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 145832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-21',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2014}
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC48276%27 HTTP/1.1" 200 None
2026-03-30 11:55:28 [auto1.de] INFO: Saving data for DC48276: {'auction_closing_time': 1774883065.0, 'created_time': 1774034501.398481, 'last_price_update_time': 1774871728.454546}
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC48276') HTTP/1.1" 204 0
2026-03-30 11:55:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with identifier: BA31995
2026-03-30 11:55:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with identifier: BA31995
2026-03-30 11:55:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with identifier: BA31995 to the API
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:48:51Z',
 'fuel_type': 'diesel',
 'id': '10b04593-3a41-523b-9bb5-29a46f0ed0c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA31995',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 119867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-07',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31995%27 HTTP/1.1" 200 None
2026-03-30 11:55:28 [auto1.de] INFO: Saving data for BA31995: {'auction_closing_time': 1774885731.0, 'created_time': 1774033863.169293, 'last_price_update_time': 1774871728.727492}
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA31995') HTTP/1.1" 204 0
2026-03-30 11:55:28 [auto1.de] INFO: Found listing with ID: HG48100
2026-03-30 11:55:28 [auto1.de] INFO: Found listing with ID: DS20438
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS20438%27 HTTP/1.1" 200 None
2026-03-30 11:55:28 [auto1.de] INFO: Scrape type for DS20438: 2
2026-03-30 11:55:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with identifier: DS20438
2026-03-30 11:55:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with scrape type 2
2026-03-30 11:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with scrape type 2
2026-03-30 11:55:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fb7c6e4-e8ba-5bef-9bce-e52199708f93, identifier: DS20438
2026-03-30 11:55:28 [auto1.de] INFO: Found listing with ID: ZU52934
2026-03-30 11:55:28 [auto1.de] INFO: Found listing with ID: PW89679
2026-03-30 11:55:28 [auto1.de] INFO: Found listing with ID: GD61279
2026-03-30 11:55:28 [auto1.de] INFO: Found listing with ID: PF87793
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF87793%27 HTTP/1.1" 200 None
2026-03-30 11:55:28 [auto1.de] INFO: Scrape type for PF87793: 2
2026-03-30 11:55:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e22417b4-4de5-5e59-bd1d-314801102de4 with identifier: PF87793
2026-03-30 11:55:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e22417b4-4de5-5e59-bd1d-314801102de4 with scrape type 2
2026-03-30 11:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e22417b4-4de5-5e59-bd1d-314801102de4 with scrape type 2
2026-03-30 11:55:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e22417b4-4de5-5e59-bd1d-314801102de4, identifier: PF87793
2026-03-30 11:55:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with identifier: DS20438
2026-03-30 11:55:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with identifier: DS20438
2026-03-30 11:55:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with identifier: DS20438 to the API
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:38:21Z',
 'fuel_type': 'diesel',
 'id': '0fb7c6e4-e8ba-5bef-9bce-e52199708f93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS20438',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 109205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-05',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS20438%27 HTTP/1.1" 200 None
2026-03-30 11:55:29 [auto1.de] INFO: Saving data for DS20438: {'auction_closing_time': 1774885101.0, 'created_time': 1774694446.294124, 'last_price_update_time': 1774871729.220542}
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS20438') HTTP/1.1" 204 0
2026-03-30 11:55:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e22417b4-4de5-5e59-bd1d-314801102de4 with identifier: PF87793
2026-03-30 11:55:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e22417b4-4de5-5e59-bd1d-314801102de4 with identifier: PF87793
2026-03-30 11:55:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e22417b4-4de5-5e59-bd1d-314801102de4 with identifier: PF87793 to the API
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:16:46Z',
 'fuel_type': 'petrol',
 'id': 'e22417b4-4de5-5e59-bd1d-314801102de4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF87793',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 56599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF87793%27 HTTP/1.1" 200 None
2026-03-30 11:55:29 [auto1.de] INFO: Saving data for PF87793: {'auction_closing_time': 1774883806.0, 'created_time': 1773382809.711778, 'last_price_update_time': 1774871729.592659}
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF87793') HTTP/1.1" 204 0
2026-03-30 11:55:29 [auto1.de] INFO: Found listing with ID: CC34542
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC34542%27 HTTP/1.1" 200 None
2026-03-30 11:55:29 [auto1.de] INFO: Scrape type for CC34542: 2
2026-03-30 11:55:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9871451f-a45a-59fa-bfe7-33f472c897af with identifier: CC34542
2026-03-30 11:55:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9871451f-a45a-59fa-bfe7-33f472c897af with scrape type 2
2026-03-30 11:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9871451f-a45a-59fa-bfe7-33f472c897af with scrape type 2
2026-03-30 11:55:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9871451f-a45a-59fa-bfe7-33f472c897af, identifier: CC34542
2026-03-30 11:55:29 [auto1.de] INFO: Found listing with ID: KU32415
2026-03-30 11:55:29 [auto1.de] INFO: Found listing with ID: RR24690
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR24690%27 HTTP/1.1" 200 None
2026-03-30 11:55:29 [auto1.de] INFO: Scrape type for RR24690: 2
2026-03-30 11:55:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03fc03a0-6612-5e95-9f7b-af39c676baea with identifier: RR24690
2026-03-30 11:55:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03fc03a0-6612-5e95-9f7b-af39c676baea with scrape type 2
2026-03-30 11:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03fc03a0-6612-5e95-9f7b-af39c676baea with scrape type 2
2026-03-30 11:55:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03fc03a0-6612-5e95-9f7b-af39c676baea, identifier: RR24690
2026-03-30 11:55:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9871451f-a45a-59fa-bfe7-33f472c897af with identifier: CC34542
2026-03-30 11:55:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9871451f-a45a-59fa-bfe7-33f472c897af with identifier: CC34542
2026-03-30 11:55:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9871451f-a45a-59fa-bfe7-33f472c897af with identifier: CC34542 to the API
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:00:20Z',
 'fuel_type': 'petrol',
 'id': '9871451f-a45a-59fa-bfe7-33f472c897af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC34542',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 218384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-30',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2009}
2026-03-30 11:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC34542%27 HTTP/1.1" 200 None
2026-03-30 11:55:30 [auto1.de] INFO: Saving data for CC34542: {'auction_closing_time': 1774882820.0, 'created_time': 1774350510.409861, 'last_price_update_time': 1774871730.096842}
2026-03-30 11:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC34542') HTTP/1.1" 204 0
2026-03-30 11:55:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03fc03a0-6612-5e95-9f7b-af39c676baea with identifier: RR24690
2026-03-30 11:55:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03fc03a0-6612-5e95-9f7b-af39c676baea with identifier: RR24690
2026-03-30 11:55:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03fc03a0-6612-5e95-9f7b-af39c676baea with identifier: RR24690 to the API
2026-03-30 11:55:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:00:52Z',
 'fuel_type': 'petrol',
 'id': '03fc03a0-6612-5e95-9f7b-af39c676baea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR24690',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 56992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-05',
 'seller_name': None,
 'title': 'Opel Meriva 1.8 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2004}
2026-03-30 11:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR24690%27 HTTP/1.1" 200 None
2026-03-30 11:55:30 [auto1.de] INFO: Saving data for RR24690: {'auction_closing_time': 1774882852.0, 'created_time': 1774034185.748281, 'last_price_update_time': 1774871730.387993}
2026-03-30 11:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR24690') HTTP/1.1" 204 0
2026-03-30 11:55:30 [auto1.de] INFO: Found listing with ID: WA68058
2026-03-30 11:55:30 [auto1.de] INFO: Found listing with ID: WC61131
2026-03-30 11:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC61131%27 HTTP/1.1" 200 None
2026-03-30 11:55:30 [auto1.de] INFO: Scrape type for WC61131: 2
2026-03-30 11:55:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with identifier: WC61131
2026-03-30 11:55:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with scrape type 2
2026-03-30 11:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with scrape type 2
2026-03-30 11:55:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 667bb6bd-3af4-560e-a58e-5af0ed8f57f9, identifier: WC61131
2026-03-30 11:55:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with identifier: WC61131
2026-03-30 11:55:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with identifier: WC61131
2026-03-30 11:55:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with identifier: WC61131 to the API
2026-03-30 11:55:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:26:28Z',
 'fuel_type': 'diesel',
 'id': '667bb6bd-3af4-560e-a58e-5af0ed8f57f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC61131',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 347285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-27',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2011}
2026-03-30 11:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC61131%27 HTTP/1.1" 200 None
2026-03-30 11:55:31 [auto1.de] INFO: Saving data for WC61131: {'auction_closing_time': 1774884388.0, 'created_time': 1773946513.615865, 'last_price_update_time': 1774871731.561638}
2026-03-30 11:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC61131') HTTP/1.1" 204 0
2026-03-30 11:55:31 [auto1.de] INFO: Found listing with ID: RZ05971
2026-03-30 11:55:31 [auto1.de] INFO: Found listing with ID: RU40839
2026-03-30 11:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU40839%27 HTTP/1.1" 200 None
2026-03-30 11:55:31 [auto1.de] INFO: Scrape type for RU40839: 2
2026-03-30 11:55:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with identifier: RU40839
2026-03-30 11:55:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with scrape type 2
2026-03-30 11:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with scrape type 2
2026-03-30 11:55:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ab06a83-ca1b-5684-abdd-5a53f38de1ea, identifier: RU40839
2026-03-30 11:55:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with identifier: RU40839
2026-03-30 11:55:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with identifier: RU40839
2026-03-30 11:55:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with identifier: RU40839 to the API
2026-03-30 11:55:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 349,
 'expiration_date': '2026-03-30T15:16:19Z',
 'fuel_type': 'diesel',
 'id': '4ab06a83-ca1b-5684-abdd-5a53f38de1ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU40839',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 127133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-08',
 'seller_name': None,
 'title': 'Audi A6 Allroad 55 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-30 11:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU40839%27 HTTP/1.1" 200 None
2026-03-30 11:55:31 [auto1.de] INFO: Saving data for RU40839: {'auction_closing_time': 1774883779.0, 'created_time': 1774694442.747279, 'last_price_update_time': 1774871731.956047}
2026-03-30 11:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU40839') HTTP/1.1" 204 0
2026-03-30 11:55:31 [auto1.de] INFO: Found listing with ID: VL73605
2026-03-30 11:55:31 [auto1.de] INFO: Found listing with ID: TZ58013
2026-03-30 11:55:31 [auto1.de] INFO: Found listing with ID: BC10414
2026-03-30 11:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC10414%27 HTTP/1.1" 200 None
2026-03-30 11:55:31 [auto1.de] INFO: Scrape type for BC10414: 2
2026-03-30 11:55:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2207154b-a38d-53d6-b607-c1eeff60122b with identifier: BC10414
2026-03-30 11:55:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2207154b-a38d-53d6-b607-c1eeff60122b with scrape type 2
2026-03-30 11:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2207154b-a38d-53d6-b607-c1eeff60122b with scrape type 2
2026-03-30 11:55:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2207154b-a38d-53d6-b607-c1eeff60122b, identifier: BC10414
2026-03-30 11:55:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2207154b-a38d-53d6-b607-c1eeff60122b with identifier: BC10414
2026-03-30 11:55:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2207154b-a38d-53d6-b607-c1eeff60122b with identifier: BC10414
2026-03-30 11:55:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2207154b-a38d-53d6-b607-c1eeff60122b with identifier: BC10414 to the API
2026-03-30 11:55:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:32:36Z',
 'fuel_type': 'petrol',
 'id': '2207154b-a38d-53d6-b607-c1eeff60122b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC10414',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 150082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-07',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.2 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2010}
2026-03-30 11:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC10414%27 HTTP/1.1" 200 None
2026-03-30 11:55:32 [auto1.de] INFO: Saving data for BC10414: {'auction_closing_time': 1774884756.0, 'created_time': 1774118564.704608, 'last_price_update_time': 1774871732.36511}
2026-03-30 11:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC10414') HTTP/1.1" 204 0
2026-03-30 11:55:32 [auto1.de] INFO: Found listing with ID: LG96250
2026-03-30 11:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG96250%27 HTTP/1.1" 200 None
2026-03-30 11:55:32 [auto1.de] INFO: Scrape type for LG96250: 2
2026-03-30 11:55:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with identifier: LG96250
2026-03-30 11:55:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with scrape type 2
2026-03-30 11:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with scrape type 2
2026-03-30 11:55:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0, identifier: LG96250
2026-03-30 11:55:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with identifier: LG96250
2026-03-30 11:55:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with identifier: LG96250
2026-03-30 11:55:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with identifier: LG96250 to the API
2026-03-30 11:55:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:54:03Z',
 'fuel_type': 'diesel',
 'id': '33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG96250',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 41206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-06',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 320 L1 Trend',
 'transmission': 'manual',
 'trim': '320 L1 Trend',
 'year': 2020}
2026-03-30 11:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG96250%27 HTTP/1.1" 200 None
2026-03-30 11:55:32 [auto1.de] INFO: Saving data for LG96250: {'auction_closing_time': 1774886043.0, 'created_time': 1774694452.400891, 'last_price_update_time': 1774871732.769386}
2026-03-30 11:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG96250') HTTP/1.1" 204 0
2026-03-30 11:55:32 [auto1.de] INFO: Found listing with ID: MG73872
2026-03-30 11:55:32 [auto1.de] INFO: Found listing with ID: SB27489
2026-03-30 11:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB27489%27 HTTP/1.1" 200 None
2026-03-30 11:55:32 [auto1.de] INFO: Scrape type for SB27489: 2
2026-03-30 11:55:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87524815-4ab9-5a57-802c-eb2415c14cb2 with identifier: SB27489
2026-03-30 11:55:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87524815-4ab9-5a57-802c-eb2415c14cb2 with scrape type 2
2026-03-30 11:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87524815-4ab9-5a57-802c-eb2415c14cb2 with scrape type 2
2026-03-30 11:55:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87524815-4ab9-5a57-802c-eb2415c14cb2, identifier: SB27489
2026-03-30 11:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87524815-4ab9-5a57-802c-eb2415c14cb2 with identifier: SB27489
2026-03-30 11:55:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87524815-4ab9-5a57-802c-eb2415c14cb2 with identifier: SB27489
2026-03-30 11:55:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87524815-4ab9-5a57-802c-eb2415c14cb2 with identifier: SB27489 to the API
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:50Z',
 'fuel_type': 'petrol',
 'id': '87524815-4ab9-5a57-802c-eb2415c14cb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB27489',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 57395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-13',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2019}
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB27489%27 HTTP/1.1" 200 None
2026-03-30 11:55:33 [auto1.de] INFO: Saving data for SB27489: {'auction_closing_time': 1774886090.0, 'created_time': 1774031770.609876, 'last_price_update_time': 1774871733.297276}
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB27489') HTTP/1.1" 204 0
2026-03-30 11:55:33 [auto1.de] INFO: Found listing with ID: RM35826
2026-03-30 11:55:33 [auto1.de] INFO: Found listing with ID: EH57829
2026-03-30 11:55:33 [auto1.de] INFO: Found listing with ID: GR42785
2026-03-30 11:55:33 [auto1.de] INFO: Found listing with ID: FG97894
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG97894%27 HTTP/1.1" 200 None
2026-03-30 11:55:33 [auto1.de] INFO: Scrape type for FG97894: 2
2026-03-30 11:55:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8008ee99-275f-5bbc-8401-d8f522dd13c1 with identifier: FG97894
2026-03-30 11:55:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8008ee99-275f-5bbc-8401-d8f522dd13c1 with scrape type 2
2026-03-30 11:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8008ee99-275f-5bbc-8401-d8f522dd13c1 with scrape type 2
2026-03-30 11:55:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8008ee99-275f-5bbc-8401-d8f522dd13c1, identifier: FG97894
2026-03-30 11:55:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8008ee99-275f-5bbc-8401-d8f522dd13c1 with identifier: FG97894
2026-03-30 11:55:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8008ee99-275f-5bbc-8401-d8f522dd13c1 with identifier: FG97894
2026-03-30 11:55:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8008ee99-275f-5bbc-8401-d8f522dd13c1 with identifier: FG97894 to the API
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:55:04Z',
 'fuel_type': 'petrol',
 'id': '8008ee99-275f-5bbc-8401-d8f522dd13c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG97894',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 60713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-07',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 DualJet Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2018}
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG97894%27 HTTP/1.1" 200 None
2026-03-30 11:55:33 [auto1.de] INFO: Saving data for FG97894: {'auction_closing_time': 1774886104.0, 'created_time': 1773341077.602483, 'last_price_update_time': 1774871733.687738}
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG97894') HTTP/1.1" 204 0
2026-03-30 11:55:33 [auto1.de] INFO: Found listing with ID: MM73538
2026-03-30 11:55:33 [auto1.de] INFO: Found listing with ID: PX49171
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX49171%27 HTTP/1.1" 200 None
2026-03-30 11:55:33 [auto1.de] INFO: Scrape type for PX49171: 2
2026-03-30 11:55:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b51fc7b6-e869-525e-a098-dfc99aa20e17 with identifier: PX49171
2026-03-30 11:55:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b51fc7b6-e869-525e-a098-dfc99aa20e17 with scrape type 2
2026-03-30 11:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b51fc7b6-e869-525e-a098-dfc99aa20e17 with scrape type 2
2026-03-30 11:55:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b51fc7b6-e869-525e-a098-dfc99aa20e17, identifier: PX49171
2026-03-30 11:55:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b51fc7b6-e869-525e-a098-dfc99aa20e17 with identifier: PX49171
2026-03-30 11:55:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b51fc7b6-e869-525e-a098-dfc99aa20e17 with identifier: PX49171
2026-03-30 11:55:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b51fc7b6-e869-525e-a098-dfc99aa20e17 with identifier: PX49171 to the API
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:45:51Z',
 'fuel_type': 'diesel',
 'id': 'b51fc7b6-e869-525e-a098-dfc99aa20e17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX49171',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 244825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-01',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX49171%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Saving data for PX49171: {'auction_closing_time': 1774885551.0, 'created_time': 1774694448.945573, 'last_price_update_time': 1774871734.096589}
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX49171') HTTP/1.1" 204 0
2026-03-30 11:55:34 [auto1.de] INFO: Channel: 24h | Page: 249 | totalHits: 9970 | hits on page: 40
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: AH24505
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: SU92609
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU92609%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for SU92609: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: RF00811
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: CA70430
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: CG16297
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG16297%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for CG16297: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: AZ56926
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: GY33643
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: PF97491
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97491%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for PF97491: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: EK48004
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: PF97491
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97491%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for PF97491: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: EK48004
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: GY05092
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY05092%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for GY05092: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: NH74932
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74932%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for NH74932: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: WA60872
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: PC86018
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86018%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for PC86018: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: EE70645
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70645%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for EE70645: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: WC98530
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: ET93890
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: DV01854
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: UE23148
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: GV87257
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV87257%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for GV87257: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: MR80797
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR80797%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for MR80797: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: DW63947
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW63947%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for DW63947: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: JG09776
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG09776%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for JG09776: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: KN89851
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN89851%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for KN89851: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: ZS91776
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN59057%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for SN59057: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN30713%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for HN30713: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX26034%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for HX26034: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM84539%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for JM84539: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: ED17592
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA72016%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for SA72016: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: WG54603
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: VV82390
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: KG73349
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: NR46432
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR46432%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for NR46432: 0
2026-03-30 11:55:34 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD21382%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Scrape type for GD21382: 2
2026-03-30 11:55:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53a9a771-8248-5b29-b7ae-fb13f9177d58 with identifier: GD21382
2026-03-30 11:55:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53a9a771-8248-5b29-b7ae-fb13f9177d58 with scrape type 2
2026-03-30 11:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53a9a771-8248-5b29-b7ae-fb13f9177d58 with scrape type 2
2026-03-30 11:55:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53a9a771-8248-5b29-b7ae-fb13f9177d58, identifier: GD21382
2026-03-30 11:55:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53a9a771-8248-5b29-b7ae-fb13f9177d58 with identifier: GD21382
2026-03-30 11:55:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53a9a771-8248-5b29-b7ae-fb13f9177d58 with identifier: GD21382
2026-03-30 11:55:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53a9a771-8248-5b29-b7ae-fb13f9177d58 with identifier: GD21382 to the API
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:31:54Z',
 'fuel_type': 'diesel',
 'id': '53a9a771-8248-5b29-b7ae-fb13f9177d58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD21382',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 454600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-12',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2011}
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD21382%27 HTTP/1.1" 200 None
2026-03-30 11:55:34 [auto1.de] INFO: Saving data for GD21382: {'auction_closing_time': 1774884714.0, 'created_time': 1774263760.259523, 'last_price_update_time': 1774871734.920261}
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD21382') HTTP/1.1" 204 0
2026-03-30 11:55:35 [auto1.de] INFO: Found listing with ID: GX76510
2026-03-30 11:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX76510%27 HTTP/1.1" 200 None
2026-03-30 11:55:35 [auto1.de] INFO: Scrape type for GX76510: 0
2026-03-30 11:55:35 [auto1.de] INFO: Found listing with ID: DT67052
2026-03-30 11:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT67052%27 HTTP/1.1" 200 None
2026-03-30 11:55:35 [auto1.de] INFO: Scrape type for DT67052: 0
2026-03-30 11:55:35 [auto1.de] INFO: Found listing with ID: ZZ82496
2026-03-30 11:55:35 [auto1.de] INFO: Found listing with ID: MA81744
2026-03-30 11:55:35 [auto1.de] INFO: Found listing with ID: KG50767
2026-03-30 11:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:39 [auto1.de] INFO: Channel: 24h | Page: 250 | totalHits: 9970 | hits on page: 10
2026-03-30 11:55:39 [auto1.de] INFO: Found listing with ID: AR70360
2026-03-30 11:55:39 [auto1.de] INFO: Found listing with ID: YX36608
2026-03-30 11:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX36608%27 HTTP/1.1" 200 None
2026-03-30 11:55:39 [auto1.de] INFO: Scrape type for YX36608: 0
2026-03-30 11:55:39 [auto1.de] INFO: Found listing with ID: XL74124
2026-03-30 11:55:39 [auto1.de] INFO: Found listing with ID: WX78972
2026-03-30 11:55:39 [auto1.de] INFO: Found listing with ID: TW02363
2026-03-30 11:55:39 [auto1.de] INFO: Found listing with ID: HR58634
2026-03-30 11:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR58634%27 HTTP/1.1" 200 None
2026-03-30 11:55:39 [auto1.de] INFO: Scrape type for HR58634: 0
2026-03-30 11:55:39 [auto1.de] INFO: Found listing with ID: LM22131
2026-03-30 11:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM22131%27 HTTP/1.1" 200 None
2026-03-30 11:55:39 [auto1.de] INFO: Scrape type for LM22131: 0
2026-03-30 11:55:39 [auto1.de] INFO: Found listing with ID: YV43994
2026-03-30 11:55:39 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-30 11:55:39 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-30 11:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE63664%27 HTTP/1.1" 200 None
2026-03-30 11:55:39 [auto1.de] INFO: Scrape type for UE63664: 0
2026-03-30 11:55:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:55 [auto1.de] INFO: Channel: 24h | Page: 251 | totalHits: 9972 | hits on page: 0
2026-03-30 11:55:55 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 11:55:55 [auto1.de] INFO: auto1.de Batch config: batch 2/2
2026-03-30 11:55:55 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 6, <ScrapeType.BATCH_SKIPPED: 5>: 9}
2026-03-30 11:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP66204%27 HTTP/1.1" 200 None
2026-03-30 11:55:56 [auto1.de] INFO: Saving data for BP66204: {'created_time': 1774871756.081254}
2026-03-30 11:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP66204') HTTP/1.1" 204 0
2026-03-30 11:55:56 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (1358 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_18_2026-03-30T10_35_00.jl
2026-03-30 11:55:56 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 5157671,
 'downloader/request_count': 2876,
 'downloader/request_method_count/GET': 2622,
 'downloader/request_method_count/POST': 254,
 'downloader/response_bytes': 969218806,
 'downloader/response_count': 2876,
 'downloader/response_status_count/200': 2875,
 'downloader/response_status_count/401': 1,
 'dupefilter/filtered': 26,
 'elapsed_time_seconds': 4852.115557,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 11, 55, 56, 98203, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 1358,
 'log_count/DEBUG': 37900,
 'log_count/INFO': 41414,
 'log_count/WARNING': 1,
 'memusage/max': 194260992,
 'memusage/startup': 148054016,
 'photo_download_count': 1921,
 'request_depth_max': 256,
 'response_received_count': 955,
 'scheduler/dequeued': 2876,
 'scheduler/dequeued/memory': 2876,
 'scheduler/enqueued': 2876,
 'scheduler/enqueued/memory': 2876,
 'scrape_type/batch_skipped': 4969,
 'scrape_type/new': 348,
 'scrape_type/new_duplicate_id': 1,
 'scrape_type/price_update': 1010,
 'scrape_type/skipped': 3656,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 980,
 'scrapy-zyte-api/error_ratio': 0.025510204081632654,
 'scrapy-zyte-api/errors': 25,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 25,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 8.687062068068029,
 'scrapy-zyte-api/mean_response_seconds': 8.729340455962907,
 'scrapy-zyte-api/processed': 955,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 955,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 954,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 955,
 'scrapy-zyte-api/request_args/httpRequestBody': 254,
 'scrapy-zyte-api/request_args/httpRequestMethod': 254,
 'scrapy-zyte-api/request_args/httpResponseBody': 955,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 955,
 'scrapy-zyte-api/request_args/sessionContext': 955,
 'scrapy-zyte-api/request_args/url': 955,
 'scrapy-zyte-api/status_codes/0': 25,
 'scrapy-zyte-api/status_codes/200': 955,
 'scrapy-zyte-api/success': 955,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 10010,
 'source/total_available': 9972,
 'start_time': datetime.datetime(2026, 3, 30, 10, 35, 3, 982646, tzinfo=datetime.timezone.utc)}
2026-03-30 11:55:56 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 11:55:56 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9ef79fb010>
2026-03-30 11:55:56 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9ef7886790>

PROJECT (sourcing_v2)
SPIDER (auto1.de)